[x86/entry] 2bbc68f837: ltp.ptrace08.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 2bbc68f8373c0631ebf137f376fbea00e8086be7 ("x86/entry: Convert Debug exception to IDTENTRY_DB")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: ltp
with following parameters:
disk: 1HDD
fs: xfs
test: syscalls_part4
test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features.
test-url: http://linux-test-project.github.io/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
<<<test_start>>>
tag=ptrace08 stime=1592201579
cmdline="ptrace08"
contacts=""
analysis=exit
<<<test_output>>>
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
ptrace08.c:62: BROK: Cannot find address of kernel symbol "do_debug"
Summary:
passed 0
failed 0
skipped 0
warnings 0
<<<execution_status>>>
initiation_status="ok"
duration=0 termination_type=exited termination_id=2 corefile=no
cutime=13 cstime=11
<<<test_end>>>
To reproduce:
# build kernel
cd linux
cp config-5.7.0-14099-g2bbc68f8373c0 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 1 month
- 8
- 12
[blk] 6e6fcbc27e: ltp.fs_fill.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 6e6fcbc27e7788af54139c53537395d95560f2ef ("blk-mq: support batching dispatch in case of io")
https://git.kernel.org/cgit/linux/kernel/git/axboe/linux-block.git for-5.9/drivers
in testcase: ltp
with following parameters:
disk: 1HDD
fs: ext4
test: fs-03
test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features.
test-url: http://linux-test-project.github.io/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
<<<test_start>>>
tag=fs_fill stime=1595659069
cmdline="fs_fill"
contacts=""
analysis=exit
<<<test_output>>>
tst_device.c:89: INFO: Found free device 0 '/dev/loop0'
tst_supported_fs_types.c:60: INFO: Kernel supports ext2
tst_supported_fs_types.c:44: INFO: mkfs.ext2 does exist
tst_supported_fs_types.c:60: INFO: Kernel supports ext3
tst_supported_fs_types.c:44: INFO: mkfs.ext3 does exist
tst_supported_fs_types.c:60: INFO: Kernel supports ext4
tst_supported_fs_types.c:44: INFO: mkfs.ext4 does exist
tst_supported_fs_types.c:60: INFO: Kernel supports xfs
tst_supported_fs_types.c:44: INFO: mkfs.xfs does exist
tst_supported_fs_types.c:60: INFO: Kernel supports btrfs
tst_supported_fs_types.c:44: INFO: mkfs.btrfs does exist
tst_supported_fs_types.c:60: INFO: Kernel supports vfat
tst_supported_fs_types.c:44: INFO: mkfs.vfat does exist
tst_supported_fs_types.c:83: INFO: Filesystem exfat is not supported
tst_supported_fs_types.c:92: INFO: FUSE does support ntfs
tst_supported_fs_types.c:44: INFO: mkfs.ntfs does exist
tst_test.c:1308: INFO: Testing on ext2
tst_mkfs.c:90: INFO: Formatting /dev/loop0 with ext2 opts='' extra opts=''
mke2fs 1.44.5 (15-Dec-2018)
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
fs_fill.c:103: INFO: Running 10 writer threads
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file0
fs_fill.c:87: PASS: Got 10 ENOSPC runtime 1194ms
tst_test.c:1308: INFO: Testing on ext3
tst_mkfs.c:90: INFO: Formatting /dev/loop0 with ext3 opts='' extra opts=''
mke2fs 1.44.5 (15-Dec-2018)
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
fs_fill.c:103: INFO: Running 10 writer threads
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file14
fs_fill.c:87: PASS: Got 17 ENOSPC runtime 1000ms
tst_test.c:1308: INFO: Testing on ext4
tst_mkfs.c:90: INFO: Formatting /dev/loop0 with ext4 opts='' extra opts=''
mke2fs 1.44.5 (15-Dec-2018)
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
fs_fill.c:103: INFO: Running 10 writer threads
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file1
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file1
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file3
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file6
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file6
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file1
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file6
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file1
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file6
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file4
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file3
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file3
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file3
fs_fill.c:87: PASS: Got 73 ENOSPC runtime 1000ms
tst_test.c:1308: INFO: Testing on xfs
tst_mkfs.c:90: INFO: Formatting /dev/loop0 with xfs opts='' extra opts=''
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
fs_fill.c:103: INFO: Running 10 writer threads
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file2
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file1
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file1
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file1
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file2
fs_fill.c:87: PASS: Got 111 ENOSPC runtime 566ms
tst_test.c:1308: INFO: Testing on btrfs
tst_mkfs.c:90: INFO: Formatting /dev/loop0 with btrfs opts='' extra opts=''
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
fs_fill.c:103: INFO: Running 10 writer threads
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread1/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread5/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread2/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread4/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread7/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread10/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread3/file0
fs_fill.c:53: INFO: Unlinking mntpoint/thread9/file0
tst_fill_fs.c:39: INFO: open(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread6/file0
tst_fill_fs.c:59: INFO: write(): ENOSPC (28)
fs_fill.c:53: INFO: Unlinking mntpoint/thread8/file0
fs_fill.c:87: PASS: Got 10 ENOSPC runtime 9454ms
tst_test.c:1308: INFO: Testing on vfat
tst_mkfs.c:90: INFO: Formatting /dev/loop0 with vfat opts='' extra opts=''
tst_test.c:1247: INFO: Timeout per run is 0h 05m 00s
fs_fill.c:103: INFO: Running 10 writer threads
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Test timeouted, sending SIGKILL!
Cannot kill test processes!
Congratulation, likely test hit a kernel bug.
Exitting uncleanly...
<<<execution_status>>>
initiation_status="ok"
duration=385 termination_type=exited termination_id=1 corefile=no
cutime=53 cstime=1400
<<<test_end>>>
To reproduce:
# build kernel
cd linux
cp config-5.8.0-rc2-00057-g6e6fcbc27e7788 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 1 month
- 4
- 5
[md] e1a86dbbbd: mdadm-selftests.enchmarks/mdadm-selftests/tests/07layouts.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: e1a86dbbbd6a77f73c3d099030495fa31f181e2f ("md: fix deadlock causing by sysfs_notify")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: mdadm-selftests
with following parameters:
disk: 1HDD
test_prefix: 07layout
ucode: 0x21
on test machine: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 4G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
2020-07-29 01:06:34 mkdir -p /var/tmp
2020-07-29 01:06:34 mke2fs -t ext3 -b 4096 -J size=4 -q /dev/sda3
2020-07-29 01:07:36 mount -t ext3 /dev/sda3 /var/tmp
sed -e 's/{DEFAULT_METADATA}/1.2/g' \
-e 's,{MAP_PATH},/run/mdadm/map,g' mdadm.8.in > mdadm.8
/usr/bin/install -D -m 644 mdadm.8 /usr/share/man/man8/mdadm.8
/usr/bin/install -D -m 644 mdmon.8 /usr/share/man/man8/mdmon.8
/usr/bin/install -D -m 644 md.4 /usr/share/man/man4/md.4
/usr/bin/install -D -m 644 mdadm.conf.5 /usr/share/man/man5/mdadm.conf.5
/usr/bin/install -D -m 644 udev-md-raid-creating.rules /lib/udev/rules.d/01-md-raid-creating.rules
/usr/bin/install -D -m 644 udev-md-raid-arrays.rules /lib/udev/rules.d/63-md-raid-arrays.rules
/usr/bin/install -D -m 644 udev-md-raid-assembly.rules /lib/udev/rules.d/64-md-raid-assembly.rules
/usr/bin/install -D -m 644 udev-md-clustered-confirm-device.rules /lib/udev/rules.d/69-md-clustered-confirm-device.rules
/usr/bin/install -D -m 755 mdadm /sbin/mdadm
/usr/bin/install -D -m 755 mdmon /sbin/mdmon
Testing on linux-5.8.0-rc4-00129-ge1a86dbbbd6a7 kernel
/lkp/benchmarks/mdadm-selftests/tests/07layouts... FAILED - see /var/tmp/07layouts.log and /var/tmp/fail07layouts.log for details
07layouts TIMEOUT
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Rong Chen
1 year, 1 month
- 3
- 3
[cpufreq] 48fc4efcdd: WARNING:possible_circular_locking_dependency_detected
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 48fc4efcdd584e8f04da8b195262ec38221bd6db ("[PATCH v2 2/2] cpufreq: intel_pstate: Implement passive mode with HWP enabled")
url: https://github.com/0day-ci/linux/commits/Rafael-J-Wysocki/cpufreq-intel_p...
base: https://git.kernel.org/cgit/linux/kernel/git/rafael/linux-pm.git linux-next
in testcase: kernel-selftests
with following parameters:
group: kselftests-cpufreq
ucode: 0x5002f01
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 74.745395] WARNING: possible circular locking dependency detected
[ 74.752071] 5.8.0-rc5-00064-g48fc4efcdd584 #1 Not tainted
[ 74.757949] ------------------------------------------------------
[ 74.764604] main.sh/3019 is trying to acquire lock:
[ 74.769954] ffffffff82ec7f08 (intel_pstate_driver_lock){+.+.}-{3:3}, at: store_energy_performance_preference+0xec/0x250
[ 74.781228]
[ 74.781228] but task is already holding lock:
[ 74.788017] ffff88b07b5f8380 (&policy->rwsem){++++}-{3:3}, at: store+0x69/0xa0
[ 74.795711]
[ 74.795711] which lock already depends on the new lock.
[ 74.795711]
[ 74.805222]
[ 74.805222] the existing dependency chain (in reverse order) is:
[ 74.813529]
[ 74.813529] -> #2 (&policy->rwsem){++++}-{3:3}:
[ 74.820371] __lock_acquire+0x538/0xa90
[ 74.825144] lock_acquire+0xab/0x390
[ 74.829660] down_write+0x38/0x70
[ 74.833910] store+0x69/0xa0
[ 74.837724] kernfs_fop_write+0xdc/0x1c0
[ 74.842576] vfs_write+0xee/0x220
[ 74.846814] ksys_write+0x68/0xe0
[ 74.851039] do_syscall_64+0x52/0xb0
[ 74.855512] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 74.861463]
[ 74.861463] -> #1 (cpu_hotplug_lock){++++}-{0:0}:
[ 74.868395] __lock_acquire+0x538/0xa90
[ 74.873127] lock_acquire+0xab/0x390
[ 74.877597] cpus_read_lock+0x39/0xd0
[ 74.882146] cpufreq_register_driver+0xb6/0x2a0
[ 74.887556] intel_pstate_register_driver+0x32/0x70
[ 74.893312] intel_pstate_init+0x45d/0x4ca
[ 74.898281] do_one_initcall+0x5d/0x330
[ 74.902984] kernel_init_freeable+0x248/0x2c9
[ 74.908185] kernel_init+0xa/0x112
[ 74.912430] ret_from_fork+0x1f/0x30
[ 74.916850]
[ 74.916850] -> #0 (intel_pstate_driver_lock){+.+.}-{3:3}:
[ 74.924376] check_prev_add+0x8e/0x9f0
[ 74.928988] validate_chain+0x79b/0x1080
[ 74.933773] __lock_acquire+0x538/0xa90
[ 74.938469] lock_acquire+0xab/0x390
[ 74.942896] __mutex_lock+0xac/0x9c0
[ 74.947318] store_energy_performance_preference+0xec/0x250
[ 74.953735] store+0x7c/0xa0
[ 74.957458] kernfs_fop_write+0xdc/0x1c0
[ 74.962231] vfs_write+0xee/0x220
[ 74.966395] ksys_write+0x68/0xe0
[ 74.970549] do_syscall_64+0x52/0xb0
[ 74.974975] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 74.980859]
[ 74.980859] other info that might help us debug this:
[ 74.980859]
[ 74.989744] Chain exists of:
[ 74.989744] intel_pstate_driver_lock --> cpu_hotplug_lock --> &policy->rwsem
[ 74.989744]
[ 75.002149] Possible unsafe locking scenario:
[ 75.002149]
[ 75.008643] CPU0 CPU1
[ 75.013461] ---- ----
[ 75.018275] lock(&policy->rwsem);
[ 75.022037] lock(cpu_hotplug_lock);
[ 75.028495] lock(&policy->rwsem);
[ 75.034773] lock(intel_pstate_driver_lock);
[ 75.039427]
[ 75.039427] *** DEADLOCK ***
[ 75.039427]
[ 75.046168] 5 locks held by main.sh/3019:
[ 75.050456] #0: ffff888b9d973438 (sb_writers#4){.+.+}-{0:0}, at: vfs_write+0x1ba/0x220
[ 75.058750] #1: ffff888beaaec488 (&of->mutex){+.+.}-{3:3}, at: kernfs_fop_write+0xa5/0x1c0
[ 75.067413] #2: ffff8898284de890 (kn->active#163){.+.+}-{0:0}, at: kernfs_fop_write+0xad/0x1c0
[ 75.076422] #3: ffffffff82c73a70 (cpu_hotplug_lock){++++}-{0:0}, at: store+0x26/0xa0
[ 75.084566] #4: ffff88b07b5f8380 (&policy->rwsem){++++}-{3:3}, at: store+0x69/0xa0
[ 75.092528]
[ 75.092528] stack backtrace:
[ 75.097500] CPU: 0 PID: 3019 Comm: main.sh Not tainted 5.8.0-rc5-00064-g48fc4efcdd584 #1
[ 75.105902] Hardware name: Intel Corporation ............/S9200WKBRD2, BIOS SE5C620.86B.0D.01.0552.060220191912 06/02/2019
[ 75.117274] Call Trace:
[ 75.120081] dump_stack+0x96/0xd0
[ 75.123754] check_noncircular+0x162/0x180
[ 75.128220] check_prev_add+0x8e/0x9f0
[ 75.132325] validate_chain+0x79b/0x1080
[ 75.136589] __lock_acquire+0x538/0xa90
[ 75.140767] lock_acquire+0xab/0x390
[ 75.144684] ? store_energy_performance_preference+0xec/0x250
[ 75.150775] __mutex_lock+0xac/0x9c0
[ 75.154697] ? store_energy_performance_preference+0xec/0x250
[ 75.160786] ? __lock_acquire+0x538/0xa90
[ 75.165147] ? store_energy_performance_preference+0xec/0x250
[ 75.171282] ? sscanf+0x4e/0x70
[ 75.174781] ? store_energy_performance_preference+0xec/0x250
[ 75.180886] store_energy_performance_preference+0xec/0x250
[ 75.186816] store+0x7c/0xa0
[ 75.190056] kernfs_fop_write+0xdc/0x1c0
[ 75.194338] vfs_write+0xee/0x220
[ 75.198011] ksys_write+0x68/0xe0
[ 75.201685] do_syscall_64+0x52/0xb0
[ 75.205617] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 75.211051] RIP: 0033:0x7f2c1dfa9504
[ 75.214999] Code: Bad RIP value.
[ 75.218582] RSP: 002b:00007fffe26da068 EFLAGS: 00000246 ORIG_RAX: 0000000000000001
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Rong Chen
1 year, 1 month
- 3
- 2
[perf/x86] 097e4311cd: will-it-scale.per_process_ops 7.3% improvement
by kernel test robot
Greeting,
FYI, we noticed a 7.3% improvement of will-it-scale.per_process_ops due to commit:
commit: 097e4311cda952dfb047f2a49d35aa5de500d474 ("perf/x86: Add constraint to create guest LBR event without hw counter")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: will-it-scale
on test machine: 104 threads Skylake with 192G memory
with following parameters:
nr_task: 100%
mode: process
test: signal1
cpufreq_governor: performance
ucode: 0x2006906
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/100%/debian-10.4-x86_64-20200603.cgz/lkp-skl-fpga01/signal1/will-it-scale/0x2006906
commit:
b2d6504761 ("perf/x86/lbr: Add interface to get LBR information")
097e4311cd ("perf/x86: Add constraint to create guest LBR event without hw counter")
b2d6504761a50b94 097e4311cda952dfb047f2a49d3
---------------- ---------------------------
%stddev %change %stddev
\ | \
86644 +7.3% 92967 will-it-scale.per_process_ops
9011113 +7.3% 9668655 will-it-scale.workload
449.40 ± 36% +68.3% 756.40 ± 42% interrupts.CPU58.CAL:Function_call_interrupts
469.28 ± 5% -14.3% 402.14 ± 12% sched_debug.cpu.curr->pid.stddev
1102 ± 9% -22.1% 859.00 ± 13% slabinfo.file_lock_cache.active_objs
1102 ± 9% -22.1% 859.00 ± 13% slabinfo.file_lock_cache.num_objs
73.00 -2.2% 71.40 vmstat.cpu.sy
25.00 +5.6% 26.40 vmstat.cpu.us
18725 ± 2% +12.6% 21082 ± 5% softirqs.CPU10.RCU
18903 ± 3% +9.3% 20662 ± 3% softirqs.CPU103.RCU
20904 ± 2% +9.5% 22893 ± 3% softirqs.CPU24.RCU
20333 ± 8% +12.1% 22802 ± 2% softirqs.CPU25.RCU
20544 ± 13% +15.9% 23820 ± 3% softirqs.CPU55.RCU
17201 ± 9% +18.4% 20373 ± 5% softirqs.CPU77.RCU
18801 ± 4% +13.8% 21400 ± 8% softirqs.CPU8.RCU
21434 ± 2% +15.0% 24640 ± 7% softirqs.CPU81.RCU
18689 ± 3% +11.3% 20794 ± 4% softirqs.CPU9.RCU
18841 ± 2% +10.8% 20882 ± 3% softirqs.CPU92.RCU
18786 ± 2% +10.7% 20792 ± 3% softirqs.CPU97.RCU
18295 ± 11% +15.0% 21030 ± 4% softirqs.CPU98.RCU
18809 ± 2% +10.0% 20695 ± 2% softirqs.CPU99.RCU
will-it-scale.per_process_ops
98000 +-------------------------------------------------------------------+
| O O O |
96000 |-+ |
| O O |
94000 |-+ O O O O O |
| O O O O O O O O O O O O |
92000 |-+ |
| |
90000 |-+ .+ |
| +. : |
88000 |-+ : : |
| : : .+..+.. |
86000 |.. .+..+..+..+. .+.. : +.+. +..+ |
| .+..+.+..+. +. + |
84000 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 1 month
- 1
- 0
[ACPICA] 6c3339269a: UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/utstring.c
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 6c3339269a8af0ee4d3661ec28b0fb06b79191ec ("ACPICA: Fixes for acpiExec namespace init file")
https://git.kernel.org/cgit/linux/kernel/git/stable/linux-stable-rc.git linux-5.4.y
in testcase: boot
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+------------------------------------------------------------------+------------+------------+
| | 9f8b1216da | 6c3339269a |
+------------------------------------------------------------------+------------+------------+
| boot_successes | 0 | 0 |
| boot_failures | 4 | 2 |
| UBSAN:Undefined_behaviour_in_arch/x86/kernel.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/tbprint.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/tbutils.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/tbdata.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/tbxface.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_mm/page_alloc.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/workqueue.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/module.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/nsaccess.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_lib/string.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_arch/x86/kernel/alternative.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_arch/x86/realmode/init.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_arch/x86/kernel/smpboot.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/sched/fair.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_crypto/algapi.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/exit.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/locking/lockdep.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/sched/cputime.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/tbxfload.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/dsmthdat.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/psargs.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/dsinit.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/evgpeinit.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/nsinit.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/evregion.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/utpredef.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/sysfs.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/rsxface.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/rsutils.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/rsaddr.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/rscalc.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/rsmisc.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/core/dev.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/netlink/genetlink.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_lib/zlib_inflate/inffast.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/base/devres.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_drivers/base/power/trace.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/ipv4/devinet.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/ipv4/ipconfig.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/ipv4/af_inet.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_include/net/ip.h | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/ipv4/ip_input.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/ipv4/udp.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_net/ipv6/ip6_offload.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/ip6_input.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_include/net/ipv6.h | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/route.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/icmp.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_include/net/ip6_checksum.h | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/ndisc.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/addrconf_core.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/addrconf.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv6/ip6_fib.c | 4 | 1 |
| UBSAN:Undefined_behaviour_in_kernel/signal.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_include/linux/skbuff.h | 4 | 2 |
| UBSAN:Undefined_behaviour_in_kernel/cgroup/cgroup.c | 4 | 2 |
| UBSAN:Undefined_behaviour_in_fs/readdir.c | 2 | 1 |
| WARNING:possible_circular_locking_dependency_detected | 1 | 1 |
| UBSAN:Undefined_behaviour_in_fs/fuse/control.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_lib/rhashtable.c | 2 | |
| UBSAN:Undefined_behaviour_in_include/linux/rhashtable.h | 2 | |
| UBSAN:Undefined_behaviour_in_arch/x86/kernel/module.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/unix/garbage.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/core/rtnetlink.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_include/linux/etherdevice.h | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv4/tcp_offload.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv4/tcp_ipv4.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_include/linux/tcp.h | 2 | 1 |
| UBSAN:Undefined_behaviour_in_include/net/dsfield.h | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv4/tcp_input.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/ipv4/tcp_minisocks.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_net/sunrpc/xprtsock.c | 2 | 1 |
| UBSAN:Undefined_behaviour_in_include/linux/unaligned/access_ok.h | 2 | 1 |
| UBSAN:Undefined_behaviour_in_drivers/acpi/acpica/utstring.c | 0 | 2 |
+------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 1.936206] ================================================================================
[ 1.937324] UBSAN: Undefined behaviour in drivers/acpi/acpica/utstring.c:144:6
[ 1.938507] load of misaligned address (ptrval) for type 'u32'
[ 1.939282] which requires 4 byte alignment
[ 1.939862] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.34-00084-g6c3339269a8af #1
[ 1.940869] Call Trace:
[ 1.941199] ? dump_stack+0x6f/0xae
[ 1.941665] ? ubsan_epilogue+0x8/0x21
[ 1.942161] ? ubsan_type_mismatch_common.cold+0x3c/0xb5
[ 1.942876] ? __ubsan_handle_type_mismatch_v1+0x2d/0x40
[ 1.943593] ? kmsg_dump_rewind_nolock+0x30/0x8e
[ 1.944203] ? acpi_ut_repair_name+0x30/0xd8
[ 1.944788] ? acpi_ns_search_and_enter+0x8c/0x525
[ 1.945433] ? acpi_ns_lookup+0x638/0x8d7
[ 1.945966] ? acpi_ns_get_node_unlocked+0x10a/0x17a
[ 1.946651] ? acpi_ns_get_node+0x61/0x91
[ 1.947202] ? acpi_ns_root_initialize+0x3c2/0x3e8
[ 1.947874] ? acpi_initialize_subsystem+0xc8/0x14e
[ 1.948529] ? acpi_early_init+0x53/0xc6
[ 1.949072] ? start_kernel+0x402/0x483
[ 1.949604] ? i386_start_kernel+0x43/0x45
[ 1.950155] ? startup_32_smp+0x164/0x168
[ 1.950714] ================================================================================
[ 1.951980] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[ 1.953316] APIC: Switch to symmetric I/O mode setup
[ 1.954019] Enabling APIC mode: Flat. Using 1 I/O APICs
[ 1.954848] masked ExtINT on CPU#0
[ 1.956263] ENABLING IO-APIC IRQs
[ 1.956727] init IO_APIC IRQs
[ 1.957122] apic 0 pin 0 not connected
[ 1.957664] IOAPIC[0]: Set routing entry (0-1 -> 0xef -> IRQ 1 Mode:0 Active:0 Dest:1)
[ 1.958722] IOAPIC[0]: Set routing entry (0-2 -> 0x30 -> IRQ 0 Mode:0 Active:0 Dest:1)
[ 1.959778] IOAPIC[0]: Set routing entry (0-3 -> 0xef -> IRQ 3 Mode:0 Active:0 Dest:1)
[ 1.960821] IOAPIC[0]: Set routing entry (0-4 -> 0xef -> IRQ 4 Mode:0 Active:0 Dest:1)
[ 1.961860] IOAPIC[0]: Set routing entry (0-5 -> 0xef -> IRQ 5 Mode:1 Active:0 Dest:1)
[ 1.962906] IOAPIC[0]: Set routing entry (0-6 -> 0xef -> IRQ 6 Mode:0 Active:0 Dest:1)
[ 1.972079] IOAPIC[0]: Set routing entry (0-7 -> 0xef -> IRQ 7 Mode:0 Active:0 Dest:1)
[ 1.973393] IOAPIC[0]: Set routing entry (0-8 -> 0xef -> IRQ 8 Mode:0 Active:0 Dest:1)
[ 1.974512] IOAPIC[0]: Set routing entry (0-9 -> 0xef -> IRQ 9 Mode:1 Active:0 Dest:1)
[ 1.975541] IOAPIC[0]: Set routing entry (0-10 -> 0xef -> IRQ 10 Mode:1 Active:0 Dest:1)
[ 1.976559] IOAPIC[0]: Set routing entry (0-11 -> 0xef -> IRQ 11 Mode:1 Active:0 Dest:1)
[ 1.977569] IOAPIC[0]: Set routing entry (0-12 -> 0xef -> IRQ 12 Mode:0 Active:0 Dest:1)
[ 1.978595] IOAPIC[0]: Set routing entry (0-13 -> 0xef -> IRQ 13 Mode:0 Active:0 Dest:1)
[ 1.979643] IOAPIC[0]: Set routing entry (0-14 -> 0xef -> IRQ 14 Mode:0 Active:0 Dest:1)
[ 1.980681] IOAPIC[0]: Set routing entry (0-15 -> 0xef -> IRQ 15 Mode:0 Active:0 Dest:1)
[ 1.981736] apic 0 pin 16 not connected
[ 1.982368] apic 0 pin 17 not connected
[ 1.982947] apic 0 pin 18 not connected
[ 1.987553] apic 0 pin 19 not connected
[ 1.988070] apic 0 pin 20 not connected
[ 1.988581] apic 0 pin 21 not connected
[ 1.989091] apic 0 pin 22 not connected
[ 1.989605] apic 0 pin 23 not connected
[ 1.990302] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 1.991105] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x29b386e1255, max_idle_ns: 440795237519 ns
[ 1.992481] Calibrating delay loop (skipped) preset value.. 5786.05 BogoMIPS (lpj=28930260)
[ 2.002482] pid_max: default: 32768 minimum: 301
[ 2.003202] Mount-cache hash table entries: 8192 (order: 3, 32768 bytes, linear)
[ 2.004146] Mountpoint-cache hash table entries: 8192 (order: 3, 32768 bytes, linear)
To reproduce:
# build kernel
cd linux
cp config-5.4.34-00084-g6c3339269a8af .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 1 month
- 1
- 0
[xfs] 74388072e2: xfstests.xfs.299.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 74388072e2e7c9a90a62fb856c13ad1bb1215920 ("xfs: actually bump warning counts when we send warnings")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: xfstests
with following parameters:
disk: 4HDD
fs: xfs
test: xfs-group13
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 16G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
xfs/299 - output mismatch (see /lkp/benchmarks/xfstests/results//xfs/299.out.bad)
--- tests/xfs/299.out 2020-06-19 03:26:43.000000000 +0000
+++ /lkp/benchmarks/xfstests/results//xfs/299.out.bad 2020-07-30 14:38:24.667000000 +0000
@@ -16,19 +16,19 @@
*** push past the soft inode limit
[ROOT] 0 0 0 00 [--------] 3 0 0 00 [--------] 0 0 0 00 [--------]
-[NAME] 0 100 500 00 [--------] 5 4 10 00 [7 days] 0 0 0 00 [--------]
+[NAME] 0 100 500 00 [--------] 5 4 10 02 [7 days] 0 0 0 00 [--------]
*** push past the soft block limit
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/299.out /lkp/benchmarks/xfstests/results//xfs/299.out.bad' to see the entire diff)
To reproduce:
# build kernel
cd linux
cp config-5.8.0-rc4-00076-g74388072e2e7c9 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 1 month
- 1
- 0
[block] 54529aac98: blktests.block.005.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 54529aac984de8d3928810c85b575efac0f9d616 ("[PATCH 07/14] block: make QUEUE_SYSFS_BIT_FNS a little more useful")
url: https://github.com/0day-ci/linux/commits/Christoph-Hellwig/fs-remove-the-...
base: https://git.kernel.org/cgit/linux/kernel/git/axboe/linux-block.git for-next
in testcase: blktests
with following parameters:
disk: 1SSD
test: block-group1
ucode: 0x21
on test machine: 4 threads Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz with 8G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
block/005 => sdb1 (switch schedulers while doing IO)
block/005 => sdb1 (switch schedulers while doing IO) [failed]
read iops ... 31828
runtime ... 33.620s
--- tests/block/005.out 2020-07-13 05:13:39.000000000 +0000
+++ /lkp/benchmarks/blktests/results/sdb1/block/005.out.bad 2020-07-29 09:54:17.895325186 +0000
@@ -1,2 +1,3 @@
Running block/005
+cat: '/sys/devices/pci0000:00/0000:00:1f.2/ata5/host4/target4:0:0/4:0:0:0/block/sdb/queue/rotational': No such file or directory
Test complete
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Rong Chen
1 year, 1 month
- 1
- 0
Re: [mm/lru] ea4ebd4126: fio.read_iops -10.0% regression
by Rong Chen
Hi Alex,
head commit has a worse result of fio.read_iops:
3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d 1095176b8feb6fd1f293161423 testcase/testparams/testbox
---------------- -------------------------- -------------------------- ---------------------------
%stddev change %stddev change %stddev
\ | \ | \
4175190 -10% 3757735 -11% 3713262 fio-basic/4k-performance-2pmem-btrfs-sync-50%-200s-read-100G-tb-ucode=0x5002f01/lkp-csl-2sp6
4175190 -10% 3757735 -11% 3713262 GEO-MEAN fio.read_iops
Best Regards,
Rong Chen
On Wed, Jul 29, 2020 at 05:54:02PM +0800, Alex Shi wrote:
> Hi Rong,
>
> Thanks for response!
>
> I should ask how much regression has on the whole patchset? :)
> And don't know if the new head 1f3bea0814fd could relief a little of this regression.
>
> Thanks
> Alex
>
> 在 2020/7/29 下午4:54, Rong Chen 写道:
> > Hi Alex,
> >
> > The regression still exists in head ("1095176b8feb6 mm/mlock: remove __munlock_isolate_lru_page") of the branch.
> >
> > Best Regards,
> > Rong Chen
> >
> >
> > On 7/29/20 11:06 AM, Alex Shi wrote:
> >> Hi Rong,
> >>
> >> Thanks a lots for the result!
> >>
> >> What's the result on the final whole patchset?
> >>
> >> Thanks
> >> Alex
> >>
> >> 在 2020/7/28 下午5:16, kernel test robot 写道:
> >>> Greeting,
> >>>
> >>> FYI, we noticed a -10.0% regression of fio.read_iops due to commit:
> >>>
> >>>
> >>> commit: ea4ebd4126d0c2d82f1210f18d0b698e7cf5fcc5 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>> https://github.com/alexshi/linux.git lruv17
> >>>
> >>>
> >>> in testcase: fio-basic
> >>> on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
> >>> with following parameters:
> >>>
> >>> disk: 2pmem
> >>> fs: btrfs
> >>> runtime: 200s
> >>> nr_task: 50%
> >>> time_based: tb
> >>> rw: read
> >>> bs: 4k
> >>> ioengine: sync
> >>> test_size: 100G
> >>> cpufreq_governor: performance
> >>> ucode: 0x5002f01
> >>>
> >>> test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
> >>> test-url: https://github.com/axboe/fio
> >>>
> >>> In addition to that, the commit also has significant impact on the following tests:
> >>>
> >>> +------------------+---------------------------------------------------------------------------+
> >>> | testcase: change | vm-scalability: vm-scalability.throughput -25.2% regression |
> >>> | test machine | 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory |
> >>> | test parameters | cpufreq_governor=performance |
> >>> | | runtime=300s |
> >>> | | test=lru-file-mmap-read |
> >>> | | ucode=0x5002f01 |
> >>> +------------------+---------------------------------------------------------------------------+
> >>> | testcase: change | fio-basic: fio.read_iops -11.4% regression |
> >>> | test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory |
> >>> | test parameters | bs=4k |
> >>> | | cpufreq_governor=performance |
> >>> | | disk=2pmem |
> >>> | | fs=ext4 |
> >>> | | ioengine=sync |
> >>> | | nr_task=50% |
> >>> | | runtime=200s |
> >>> | | rw=randread |
> >>> | | test_size=200G |
> >>> | | time_based=tb |
> >>> | | ucode=0x5002f01 |
> >>> +------------------+---------------------------------------------------------------------------+
> >>> | testcase: change | vm-scalability: vm-scalability.throughput -21.3% regression |
> >>> | test machine | 104 threads Skylake with 192G memory |
> >>> | test parameters | cpufreq_governor=performance |
> >>> | | runtime=300s |
> >>> | | test=lru-file-mmap-read |
> >>> | | ucode=0x2006906 |
> >>> +------------------+---------------------------------------------------------------------------+
> >>> | testcase: change | vm-scalability: vm-scalability.throughput -19.2% regression |
> >>> | test machine | 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory |
> >>> | test parameters | cpufreq_governor=performance |
> >>> | | runtime=300s |
> >>> | | test=lru-file-readtwice |
> >>> | | ucode=0x16 |
> >>> +------------------+---------------------------------------------------------------------------+
> >>> | testcase: change | fio-basic: fio.read_iops -8.6% regression |
> >>> | test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory |
> >>> | test parameters | bs=2M |
> >>> | | cpufreq_governor=performance |
> >>> | | disk=2pmem |
> >>> | | fs=btrfs |
> >>> | | ioengine=sync |
> >>> | | nr_task=50% |
> >>> | | runtime=200s |
> >>> | | rw=randread |
> >>> | | test_size=100G |
> >>> | | time_based=tb |
> >>> | | ucode=0x5002f01 |
> >>> +------------------+---------------------------------------------------------------------------+
> >>>
> >>>
> >>> If you fix the issue, kindly add following tag
> >>> Reported-by: kernel test robot <rong.a.chen(a)intel.com>
> >>>
> >>>
> >>> Details are as below:
> >>> -------------------------------------------------------------------------------------------------->
> >>>
> >>>
> >>> To reproduce:
> >>>
> >>> git clone https://github.com/intel/lkp-tests.git
> >>> cd lkp-tests
> >>> bin/lkp install job.yaml # job file is attached in this email
> >>> bin/lkp run job.yaml
> >>>
> >>> =========================================================================================
> >>> bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
> >>> 4k/gcc-9/performance/2pmem/btrfs/sync/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/200s/read/lkp-csl-2sp6/100G/fio-basic/tb/0x5002f01
> >>>
> >>> commit:
> >>> 3fbdbb91fe ("mm/swap: serialize memcg changes in pagevec_lru_move_fn")
> >>> ea4ebd4126 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>>
> >>> 3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d0
> >>> ---------------- ---------------------------
> >>> %stddev %change %stddev
> >>> \ | \
> >>> 0.02 ± 2% -0.0 0.01 ± 5% fio.latency_10ms%
> >>> 1.83 ± 8% -0.3 1.49 ± 3% fio.latency_10us%
> >>> 0.02 ± 2% +0.0 0.02 ± 3% fio.latency_20ms%
> >>> 0.16 ± 4% -0.0 0.13 ± 6% fio.latency_20us%
> >>> 48.43 -2.3 46.14 fio.latency_2us%
> >>> 19.08 -1.6 17.44 ± 2% fio.latency_4us%
> >>> 0.01 +0.0 0.01 fio.latency_50ms%
> >>> 16309 -10.0% 14678 fio.read_bw_MBps
> >>> 2648 -3.9% 2544 fio.read_clat_90%_us
> >>> 3224 -4.5% 3080 fio.read_clat_95%_us
> >>> 4768 ± 2% -4.4% 4560 fio.read_clat_99%_us
> >>> 9917 +8.2% 10732 fio.read_clat_mean_us
> >>> 486425 +5.9% 514983 fio.read_clat_stddev
> >>> 4175190 -10.0% 3757735 fio.read_iops
> >>> 6.688e+09 -10.0% 6.018e+09 fio.time.file_system_inputs
> >>> 259585 -9.9% 233865 ± 3% fio.time.involuntary_context_switches
> >>> 325.26 ± 3% -11.0% 289.62 fio.time.user_time
> >>> 8.358e+08 -10.0% 7.522e+08 fio.workload
> >>> 4104 ± 27% -31.3% 2819 ± 19% slabinfo.blkdev_ioc.active_objs
> >>> 4308 ± 26% -30.0% 3014 ± 20% slabinfo.blkdev_ioc.num_objs
> >>> 38.41 +10.4% 42.38 ± 4% iostat.cpu.idle
> >>> 59.88 -6.3% 56.13 ± 3% iostat.cpu.system
> >>> 1.69 ± 3% -14.5% 1.44 ± 2% iostat.cpu.user
> >>> 37.81 +4.0 41.85 ± 4% mpstat.cpu.all.idle%
> >>> 0.08 -0.0 0.07 ± 7% mpstat.cpu.all.soft%
> >>> 1.70 ± 3% -0.2 1.45 ± 2% mpstat.cpu.all.usr%
> >>> 140.25 ± 5% -24.8% 105.50 ± 10% numa-vmstat.node0.nr_isolated_file
> >>> 18550 ± 4% -12.6% 16221 ± 3% numa-vmstat.node0.workingset_nodes
> >>> 158.75 ± 3% -26.3% 117.00 ± 13% numa-vmstat.node1.nr_isolated_file
> >>> 38.00 +9.9% 41.75 ± 4% vmstat.cpu.id
> >>> 59.50 -6.7% 55.50 ± 3% vmstat.cpu.sy
> >>> 16392239 -13.5% 14176171 ± 3% vmstat.io.bi
> >>> 33173 -15.0% 28185 ± 3% vmstat.system.cs
> >>> 23624 ± 14% -26.0% 17490 sched_debug.cfs_rq:/.exec_clock.min
> >>> 24047 ± 18% -21.5% 18881 sched_debug.cpu.nr_switches.avg
> >>> 10475 ± 12% -35.7% 6732 ± 10% sched_debug.cpu.nr_switches.min
> >>> 44.38 ± 9% +18.7% 52.67 ± 10% sched_debug.cpu.nr_uninterruptible.max
> >>> 10.90 ± 11% +20.9% 13.17 ± 5% sched_debug.cpu.nr_uninterruptible.stddev
> >>> 22088 ± 19% -23.4% 16929 sched_debug.cpu.sched_count.avg
> >>> 9138 ± 10% -39.9% 5495 ± 9% sched_debug.cpu.sched_count.min
> >>> 10046 ± 19% -23.6% 7672 sched_debug.cpu.sched_goidle.avg
> >>> 3180 ± 9% -51.9% 1529 ± 23% sched_debug.cpu.sched_goidle.min
> >>> 10986 ± 19% -23.6% 8399 sched_debug.cpu.ttwu_count.avg
> >>> 17999 ± 15% -15.7% 15171 ± 12% sched_debug.cpu.ttwu_count.max
> >>> 4502 ± 22% -24.0% 3424 ± 4% sched_debug.cpu.ttwu_count.min
> >>> 3080 ± 14% -17.3% 2547 ± 7% sched_debug.cpu.ttwu_count.stddev
> >>> 587.90 ± 26% -34.6% 384.25 ± 11% sched_debug.cpu.ttwu_local.min
> >>> 100104 -15.1% 84957 ± 5% proc-vmstat.allocstall_movable
> >>> 7878799 ± 40% +75.7% 13841337 ± 25% proc-vmstat.compact_daemon_free_scanned
> >>> 7901537 ± 40% +75.2% 13841337 ± 25% proc-vmstat.compact_free_scanned
> >>> 2882 +16.0% 3343 ± 6% proc-vmstat.kswapd_low_wmark_hit_quickly
> >>> 86037 +3.1% 88706 proc-vmstat.nr_active_anon
> >>> 300.50 ± 2% -26.2% 221.75 ± 4% proc-vmstat.nr_isolated_file
> >>> 51990 -1.2% 51360 proc-vmstat.nr_slab_reclaimable
> >>> 86093 +3.1% 88760 proc-vmstat.nr_zone_active_anon
> >>> 1.133e+08 ± 4% -11.7% 1e+08 ± 5% proc-vmstat.numa_foreign
> >>> 7.218e+08 -9.6% 6.527e+08 ± 2% proc-vmstat.numa_hit
> >>> 7.218e+08 -9.6% 6.526e+08 ± 2% proc-vmstat.numa_local
> >>> 1.133e+08 ± 4% -11.7% 1e+08 ± 5% proc-vmstat.numa_miss
> >>> 1.133e+08 ± 4% -11.7% 1.001e+08 ± 5% proc-vmstat.numa_other
> >>> 2950 +18.7% 3503 ± 5% proc-vmstat.pageoutrun
> >>> 21236 ± 2% +9.5% 23252 proc-vmstat.pgactivate
> >>> 29981250 ± 2% -10.7% 26786986 proc-vmstat.pgalloc_dma32
> >>> 8.078e+08 -10.0% 7.273e+08 proc-vmstat.pgalloc_normal
> >>> 8.28e+08 -10.1% 7.447e+08 proc-vmstat.pgfree
> >>> 3.342e+09 -10.0% 3.008e+09 proc-vmstat.pgpgin
> >>> 2.688e+08 -15.2% 2.28e+08 ± 4% proc-vmstat.pgscan_direct
> >>> 3.564e+08 -13.4% 3.085e+08 ± 2% proc-vmstat.pgscan_file
> >>> 87571561 ± 2% -8.1% 80474516 ± 4% proc-vmstat.pgscan_kswapd
> >>> 2.688e+08 -15.2% 2.28e+08 ± 4% proc-vmstat.pgsteal_direct
> >>> 3.563e+08 -13.4% 3.084e+08 ± 2% proc-vmstat.pgsteal_file
> >>> 87564825 ± 2% -8.1% 80463177 ± 4% proc-vmstat.pgsteal_kswapd
> >>> 30163 -10.2% 27079 proc-vmstat.workingset_nodes
> >>> 9391 ± 4% +15.3% 10831 ± 9% softirqs.CPU11.RCU
> >>> 77831 ± 2% +14.1% 88771 ± 11% softirqs.CPU11.TIMER
> >>> 77281 +9.7% 84780 ± 4% softirqs.CPU12.TIMER
> >>> 13405 ± 9% +24.5% 16683 ± 10% softirqs.CPU16.SCHED
> >>> 76757 +9.6% 84124 ± 2% softirqs.CPU17.TIMER
> >>> 76910 +8.8% 83647 ± 3% softirqs.CPU18.TIMER
> >>> 76754 +8.8% 83530 ± 2% softirqs.CPU19.TIMER
> >>> 9446 ± 6% +14.8% 10847 ± 11% softirqs.CPU20.RCU
> >>> 8268 ± 3% +25.4% 10371 ± 8% softirqs.CPU21.RCU
> >>> 16818 ± 4% -20.5% 13370 ± 12% softirqs.CPU21.SCHED
> >>> 76915 +7.9% 82964 ± 3% softirqs.CPU22.TIMER
> >>> 82513 ± 5% +29.4% 106739 ± 27% softirqs.CPU24.TIMER
> >>> 77651 +11.0% 86182 ± 6% softirqs.CPU32.TIMER
> >>> 77571 +7.3% 83240 ± 2% softirqs.CPU33.TIMER
> >>> 10198 ± 5% -14.2% 8752 ± 10% softirqs.CPU38.RCU
> >>> 12262 ± 13% +34.7% 16514 ± 9% softirqs.CPU38.SCHED
> >>> 10483 ± 3% -15.2% 8890 ± 9% softirqs.CPU39.RCU
> >>> 12607 ± 10% +33.3% 16801 ± 5% softirqs.CPU39.SCHED
> >>> 8763 ± 11% +19.4% 10459 ± 5% softirqs.CPU4.RCU
> >>> 77249 +12.3% 86716 ± 8% softirqs.CPU44.TIMER
> >>> 7687 ± 12% +23.4% 9488 ± 9% softirqs.CPU53.RCU
> >>> 75498 +8.0% 81567 ± 3% softirqs.CPU57.TIMER
> >>> 6584 ± 9% +32.0% 8693 ± 17% softirqs.CPU64.RCU
> >>> 76347 ± 2% +6.7% 81476 ± 3% softirqs.CPU65.TIMER
> >>> 77315 +52.1% 117627 ± 36% softirqs.CPU72.TIMER
> >>> 76466 +8.0% 82603 ± 2% softirqs.CPU8.TIMER
> >>> 7372 ± 6% +28.2% 9448 ± 11% softirqs.CPU86.RCU
> >>> 7568 ± 12% +23.4% 9338 ± 10% softirqs.CPU87.RCU
> >>> 76578 +9.3% 83688 ± 3% softirqs.CPU88.TIMER
> >>> 32.75 ±162% -98.5% 0.50 ±173% interrupts.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
> >>> 176214 ± 8% -13.9% 151699 ± 5% interrupts.CAL:Function_call_interrupts
> >>> 4011 ± 37% +59.1% 6381 ± 18% interrupts.CPU0.NMI:Non-maskable_interrupts
> >>> 4011 ± 37% +59.1% 6381 ± 18% interrupts.CPU0.PMI:Performance_monitoring_interrupts
> >>> 1945 ± 28% -32.4% 1315 ± 13% interrupts.CPU15.CAL:Function_call_interrupts
> >>> 6577 ± 7% -20.8% 5207 ± 15% interrupts.CPU20.NMI:Non-maskable_interrupts
> >>> 6577 ± 7% -20.8% 5207 ± 15% interrupts.CPU20.PMI:Performance_monitoring_interrupts
> >>> 32.25 ±166% -99.2% 0.25 ±173% interrupts.CPU22.58:PCI-MSI.31981591-edge.i40e-eth0-TxRx-22
> >>> 1954 ± 27% -38.5% 1201 ± 22% interrupts.CPU23.CAL:Function_call_interrupts
> >>> 1550 ± 12% -17.5% 1279 ± 11% interrupts.CPU24.CAL:Function_call_interrupts
> >>> 1686 ± 7% -18.1% 1380 ± 14% interrupts.CPU31.CAL:Function_call_interrupts
> >>> 4651 ± 27% +44.9% 6740 ± 12% interrupts.CPU37.NMI:Non-maskable_interrupts
> >>> 4651 ± 27% +44.9% 6740 ± 12% interrupts.CPU37.PMI:Performance_monitoring_interrupts
> >>> 1404 ± 10% +17.9% 1656 ± 9% interrupts.CPU38.CAL:Function_call_interrupts
> >>> 1523 ± 5% +10.6% 1684 ± 5% interrupts.CPU39.CAL:Function_call_interrupts
> >>> 691.25 ± 4% -15.6% 583.75 ± 11% interrupts.CPU43.RES:Rescheduling_interrupts
> >>> 2176 ± 9% -37.5% 1360 ± 3% interrupts.CPU50.CAL:Function_call_interrupts
> >>> 5955 ± 10% +17.9% 7022 ± 7% interrupts.CPU51.NMI:Non-maskable_interrupts
> >>> 5955 ± 10% +17.9% 7022 ± 7% interrupts.CPU51.PMI:Performance_monitoring_interrupts
> >>> 2182 ± 35% -39.8% 1314 ± 11% interrupts.CPU54.CAL:Function_call_interrupts
> >>> 1722 ± 12% -22.4% 1335 ± 6% interrupts.CPU56.CAL:Function_call_interrupts
> >>> 2190 ± 13% -29.8% 1538 ± 7% interrupts.CPU59.CAL:Function_call_interrupts
> >>> 3623 ± 27% +69.9% 6156 ± 12% interrupts.CPU6.NMI:Non-maskable_interrupts
> >>> 3623 ± 27% +69.9% 6156 ± 12% interrupts.CPU6.PMI:Performance_monitoring_interrupts
> >>> 2208 ± 16% -37.3% 1384 ± 11% interrupts.CPU64.CAL:Function_call_interrupts
> >>> 6672 ± 9% -14.5% 5706 ± 12% interrupts.CPU66.NMI:Non-maskable_interrupts
> >>> 6672 ± 9% -14.5% 5706 ± 12% interrupts.CPU66.PMI:Performance_monitoring_interrupts
> >>> 2234 ± 5% -33.8% 1478 ± 12% interrupts.CPU71.CAL:Function_call_interrupts
> >>> 2034 ± 5% -26.0% 1505 ± 12% interrupts.CPU77.CAL:Function_call_interrupts
> >>> 1951 ± 6% -8.5% 1785 ± 7% interrupts.CPU81.CAL:Function_call_interrupts
> >>> 697.00 ± 4% -13.5% 602.75 ± 18% interrupts.CPU81.RES:Rescheduling_interrupts
> >>> 7657 ± 2% -41.2% 4502 ± 25% interrupts.CPU82.NMI:Non-maskable_interrupts
> >>> 7657 ± 2% -41.2% 4502 ± 25% interrupts.CPU82.PMI:Performance_monitoring_interrupts
> >>> 1909 ± 8% -22.2% 1485 ± 9% interrupts.CPU85.CAL:Function_call_interrupts
> >>> 691.50 ± 3% -15.9% 581.25 ± 12% interrupts.CPU85.RES:Rescheduling_interrupts
> >>> 1949 ± 8% -28.2% 1400 ± 15% interrupts.CPU86.CAL:Function_call_interrupts
> >>> 1968 ± 7% -12.9% 1714 ± 3% interrupts.CPU89.CAL:Function_call_interrupts
> >>> 6224 ± 7% +18.8% 7395 ± 5% interrupts.CPU89.NMI:Non-maskable_interrupts
> >>> 6224 ± 7% +18.8% 7395 ± 5% interrupts.CPU89.PMI:Performance_monitoring_interrupts
> >>> 1936 ± 10% -18.8% 1572 ± 10% interrupts.CPU91.CAL:Function_call_interrupts
> >>> 715.00 ± 5% -20.7% 567.25 ± 14% interrupts.CPU93.RES:Rescheduling_interrupts
> >>> 1679 ± 3% -17.3% 1388 ± 5% interrupts.CPU94.CAL:Function_call_interrupts
> >>> 1.201e+10 -11.0% 1.069e+10 ± 3% perf-stat.i.branch-instructions
> >>> 35629117 -16.3% 29815198 ± 2% perf-stat.i.branch-misses
> >>> 1.171e+09 -14.3% 1.004e+09 ± 2% perf-stat.i.cache-misses
> >>> 1.443e+09 -15.0% 1.226e+09 ± 2% perf-stat.i.cache-references
> >>> 33572 -15.1% 28501 ± 3% perf-stat.i.context-switches
> >>> 2.66 +10.1% 2.93 ± 4% perf-stat.i.cpi
> >>> 1.663e+11 -6.3% 1.557e+11 ± 3% perf-stat.i.cpu-cycles
> >>> 185.09 -6.0% 174.02 ± 3% perf-stat.i.cpu-migrations
> >>> 149.40 +45.7% 217.72 ± 23% perf-stat.i.cycles-between-cache-misses
> >>> 0.03 ± 15% +0.0 0.06 ± 47% perf-stat.i.dTLB-load-miss-rate%
> >>> 1.712e+10 -11.9% 1.509e+10 ± 3% perf-stat.i.dTLB-loads
> >>> 1607318 ± 5% -16.0% 1350376 ± 3% perf-stat.i.dTLB-store-misses
> >>> 8.579e+09 -13.7% 7.407e+09 ± 2% perf-stat.i.dTLB-stores
> >>> 10276073 ± 13% -19.7% 8247544 ± 2% perf-stat.i.iTLB-load-misses
> >>> 2854415 ± 3% -11.8% 2518474 ± 3% perf-stat.i.iTLB-loads
> >>> 6.268e+10 -11.7% 5.537e+10 ± 3% perf-stat.i.instructions
> >>> 0.38 -7.2% 0.35 perf-stat.i.ipc
> >>> 1.73 -6.3% 1.62 ± 3% perf-stat.i.metric.GHz
> >>> 411.97 -12.1% 362.07 ± 3% perf-stat.i.metric.M/sec
> >>> 63588198 -16.1% 53345962 ± 3% perf-stat.i.node-load-misses
> >>> 2.007e+08 ± 2% -14.3% 1.72e+08 ± 3% perf-stat.i.node-loads
> >>> 46946259 ± 3% -16.0% 39421864 ± 7% perf-stat.i.node-store-misses
> >>> 82124837 ± 2% -13.2% 71290999 ± 4% perf-stat.i.node-stores
> >>> 23.03 -3.8% 22.15 perf-stat.overall.MPKI
> >>> 0.30 -0.0 0.28 ± 2% perf-stat.overall.branch-miss-rate%
> >>> 2.65 +6.0% 2.81 perf-stat.overall.cpi
> >>> 142.03 +9.2% 155.11 perf-stat.overall.cycles-between-cache-misses
> >>> 78.08 ± 2% -1.5 76.63 perf-stat.overall.iTLB-load-miss-rate%
> >>> 6193 ± 11% +8.4% 6711 perf-stat.overall.instructions-per-iTLB-miss
> >>> 0.38 -5.6% 0.36 perf-stat.overall.ipc
> >>> 15052 +2.4% 15421 perf-stat.overall.path-length
> >>> 1.195e+10 -10.9% 1.064e+10 ± 3% perf-stat.ps.branch-instructions
> >>> 35431993 -16.2% 29676698 ± 2% perf-stat.ps.branch-misses
> >>> 1.165e+09 -14.2% 9.997e+08 ± 2% perf-stat.ps.cache-misses
> >>> 1.435e+09 -14.9% 1.221e+09 ± 2% perf-stat.ps.cache-references
> >>> 33349 -15.0% 28349 ± 3% perf-stat.ps.context-switches
> >>> 1.655e+11 -6.3% 1.551e+11 ± 3% perf-stat.ps.cpu-cycles
> >>> 184.24 -6.0% 173.23 ± 3% perf-stat.ps.cpu-migrations
> >>> 1.703e+10 -11.8% 1.503e+10 ± 3% perf-stat.ps.dTLB-loads
> >>> 1596295 ± 5% -15.9% 1342979 ± 3% perf-stat.ps.dTLB-store-misses
> >>> 8.533e+09 -13.6% 7.375e+09 ± 2% perf-stat.ps.dTLB-stores
> >>> 10224586 ± 13% -19.7% 8212555 ± 2% perf-stat.ps.iTLB-load-misses
> >>> 2837664 ± 3% -11.7% 2505655 ± 3% perf-stat.ps.iTLB-loads
> >>> 6.234e+10 -11.6% 5.513e+10 ± 2% perf-stat.ps.instructions
> >>> 63235032 -16.1% 53084316 ± 2% perf-stat.ps.node-load-misses
> >>> 1.997e+08 ± 2% -14.2% 1.714e+08 ± 3% perf-stat.ps.node-loads
> >>> 46695356 ± 3% -16.0% 39224658 ± 7% perf-stat.ps.node-store-misses
> >>> 81746105 ± 2% -13.1% 71041314 ± 3% perf-stat.ps.node-stores
> >>> 1.258e+13 -7.8% 1.16e+13 perf-stat.total.instructions
> >>> 7.69 ± 9% -7.7 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 7.64 ± 9% -7.6 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 20.41 ± 6% -5.3 15.10 ± 10% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 11.02 ± 8% -4.1 6.94 ± 14% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 17.27 ± 6% -4.0 13.30 ± 11% perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 16.63 ± 6% -3.6 13.02 ± 11% perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
> >>> 16.63 ± 6% -3.6 13.02 ± 11% perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.page_cache_readahead_unbounded
> >>> 16.63 ± 6% -3.6 13.03 ± 11% perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 16.51 ± 6% -3.6 12.94 ± 11% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages
> >>> 16.52 ± 6% -3.6 12.96 ± 11% perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
> >>> 6.79 ± 11% -2.2 4.60 ± 16% perf-profile.calltrace.cycles-pp.btrfs_releasepage.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 6.69 ± 11% -2.1 4.54 ± 16% perf-profile.calltrace.cycles-pp.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list.shrink_lruvec
> >>> 3.88 ± 9% -2.1 1.82 ± 10% perf-profile.calltrace.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 13.60 ± 5% -1.5 12.09 ± 7% perf-profile.calltrace.cycles-pp.extent_readahead.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 13.60 ± 5% -1.5 12.09 ± 7% perf-profile.calltrace.cycles-pp.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 2.70 ± 6% -1.5 1.19 ± 10% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
> >>> 2.54 ± 6% -1.5 1.08 ± 10% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list
> >>> 3.01 ± 5% -1.3 1.69 ± 9% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 2.70 ± 6% -1.2 1.49 ± 9% perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 11.54 ± 5% -1.2 10.33 ± 7% perf-profile.calltrace.cycles-pp.__do_readpage.extent_readahead.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 2.49 ± 6% -1.2 1.29 ± 10% perf-profile.calltrace.cycles-pp.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded
> >>> 3.00 ± 6% -1.2 1.80 ± 7% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 2.96 ± 6% -1.2 1.78 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 2.95 ± 6% -1.2 1.77 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
> >>> 1.89 ± 7% -1.2 0.72 ± 13% perf-profile.calltrace.cycles-pp._raw_spin_lock.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages_nodemask
> >>> 1.88 ± 7% -1.2 0.72 ± 12% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.rmqueue_bulk.rmqueue.get_page_from_freelist
> >>> 10.80 ± 5% -1.1 9.74 ± 7% perf-profile.calltrace.cycles-pp.submit_extent_page.__do_readpage.extent_readahead.read_pages.page_cache_readahead_unbounded
> >>> 10.58 ± 5% -1.1 9.53 ± 7% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio
> >>> 10.56 ± 5% -1.0 9.52 ± 7% perf-profile.calltrace.cycles-pp.pmem_make_request.generic_make_request.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook
> >>> 10.38 ± 5% -1.0 9.36 ± 7% perf-profile.calltrace.cycles-pp.pmem_do_read.pmem_make_request.generic_make_request.submit_bio.btrfs_map_bio
> >>> 10.27 ± 5% -1.0 9.26 ± 7% perf-profile.calltrace.cycles-pp.__memcpy_mcsafe.pmem_do_read.pmem_make_request.generic_make_request.submit_bio
> >>> 9.78 ± 5% -0.9 8.84 ± 7% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.__do_readpage.extent_readahead.read_pages
> >>> 9.77 ± 5% -0.9 8.84 ± 7% perf-profile.calltrace.cycles-pp.btrfs_submit_bio_hook.submit_one_bio.submit_extent_page.__do_readpage.extent_readahead
> >>> 3.24 ± 9% -0.9 2.31 ± 16% perf-profile.calltrace.cycles-pp.__clear_extent_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list
> >>> 9.61 ± 5% -0.9 8.70 ± 7% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.submit_extent_page.__do_readpage
> >>> 9.59 ± 5% -0.9 8.68 ± 7% perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.submit_extent_page
> >>> 2.87 ± 10% -0.8 2.02 ± 16% perf-profile.calltrace.cycles-pp.test_range_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list
> >>> 2.75 ± 10% -0.8 1.96 ± 16% perf-profile.calltrace.cycles-pp._raw_spin_lock.__clear_extent_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list
> >>> 2.66 ± 10% -0.8 1.88 ± 16% perf-profile.calltrace.cycles-pp._raw_spin_lock.test_range_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list
> >>> 2.65 ± 10% -0.8 1.89 ± 17% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__clear_extent_bit.try_release_extent_mapping.btrfs_releasepage
> >>> 2.57 ± 10% -0.8 1.82 ± 16% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.test_range_bit.try_release_extent_mapping.btrfs_releasepage
> >>> 2.15 ± 6% -0.7 1.47 ± 8% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 3.86 ± 9% -0.7 3.21 ± 5% perf-profile.calltrace.cycles-pp.ret_from_fork
> >>> 3.86 ± 9% -0.7 3.21 ± 5% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
> >>> 4.95 ± 6% -0.6 4.31 ± 7% perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_buffered_read.new_sync_read.vfs_read.ksys_read
> >>> 4.83 ± 6% -0.6 4.20 ± 7% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 4.79 ± 6% -0.6 4.17 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.generic_file_buffered_read.new_sync_read
> >>> 1.45 ± 5% -0.4 1.07 ± 8% perf-profile.calltrace.cycles-pp.free_unref_page_list.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise
> >>> 1.35 ± 5% -0.4 0.99 ± 8% perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page_list.release_pages.__pagevec_release.invalidate_mapping_pages
> >>> 1.28 ± 11% -0.4 0.93 ± 5% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
> >>> 0.77 ± 8% -0.3 0.42 ± 58% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 1.83 ± 5% -0.3 1.49 ± 6% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
> >>> 1.73 ± 5% -0.3 1.42 ± 5% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
> >>> 1.66 ± 5% -0.3 1.38 ± 6% perf-profile.calltrace.cycles-pp.end_workqueue_fn.btrfs_work_helper.process_one_work.worker_thread.kthread
> >>> 1.66 ± 5% -0.3 1.38 ± 6% perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
> >>> 1.63 ± 5% -0.3 1.36 ± 6% perf-profile.calltrace.cycles-pp.end_bio_extent_readpage.end_workqueue_fn.btrfs_work_helper.process_one_work.worker_thread
> >>> 1.73 ± 5% -0.2 1.50 ± 4% perf-profile.calltrace.cycles-pp.crc_128
> >>> 1.22 ± 6% -0.2 1.07 ± 6% perf-profile.calltrace.cycles-pp.pagecache_get_page.generic_file_buffered_read.new_sync_read.vfs_read.ksys_read
> >>> 1.21 ± 6% -0.2 1.05 ± 6% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 1.02 ± 4% -0.1 0.87 ± 8% perf-profile.calltrace.cycles-pp.submit_one_bio.extent_readahead.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 1.02 ± 4% -0.1 0.87 ± 8% perf-profile.calltrace.cycles-pp.btrfs_submit_bio_hook.submit_one_bio.extent_readahead.read_pages.page_cache_readahead_unbounded
> >>> 1.00 ± 4% -0.1 0.85 ± 8% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_readahead.read_pages
> >>> 1.00 ± 4% -0.1 0.85 ± 8% perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_readahead
> >>> 0.67 ± 7% -0.1 0.56 ± 11% perf-profile.calltrace.cycles-pp.remove_mapping.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64
> >>> 0.67 ± 7% -0.1 0.56 ± 10% perf-profile.calltrace.cycles-pp.__remove_mapping.remove_mapping.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64
> >>> 0.63 ± 5% -0.1 0.55 ± 7% perf-profile.calltrace.cycles-pp.crc_42
> >>> 2.10 ± 7% +1.7 3.82 ± 7% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 2.11 ± 7% +1.7 3.83 ± 7% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.posix_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.posix_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.posix_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe.posix_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe.posix_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64.entry_SYSCALL_64_after_hwframe
> >>> 6.67 ± 8% +2.2 8.86 ± 6% perf-profile.calltrace.cycles-pp.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64.do_syscall_64
> >>> 4.87 ± 9% +2.4 7.27 ± 6% perf-profile.calltrace.cycles-pp.__pagevec_release.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64
> >>> 4.86 ± 9% +2.4 7.27 ± 6% perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64
> >>> 0.00 +5.5 5.50 ± 8% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release
> >>> 0.00 +5.5 5.54 ± 8% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages
> >>> 0.00 +5.5 5.54 ± 8% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise
> >>> 10.94 ± 8% +6.7 17.65 ± 3% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 8.75 ± 8% +7.4 16.15 ± 3% perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 8.67 ± 8% +7.4 16.08 ± 3% perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 0.00 +14.8 14.82 ± 3% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
> >>> 0.00 +14.9 14.89 ± 3% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.00 +14.9 14.89 ± 3% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 21.04 ± 6% -5.5 15.56 ± 10% perf-profile.children.cycles-pp.__alloc_pages_nodemask
> >>> 12.68 ± 7% -4.6 8.09 ± 13% perf-profile.children.cycles-pp.shrink_page_list
> >>> 17.84 ± 6% -4.1 13.72 ± 11% perf-profile.children.cycles-pp.__alloc_pages_slowpath
> >>> 19.16 ± 6% -4.0 15.12 ± 10% perf-profile.children.cycles-pp.shrink_node
> >>> 19.05 ± 6% -4.0 15.05 ± 10% perf-profile.children.cycles-pp.shrink_lruvec
> >>> 19.03 ± 6% -4.0 15.03 ± 10% perf-profile.children.cycles-pp.shrink_inactive_list
> >>> 17.19 ± 6% -3.8 13.44 ± 11% perf-profile.children.cycles-pp.do_try_to_free_pages
> >>> 17.19 ± 6% -3.8 13.44 ± 11% perf-profile.children.cycles-pp.try_to_free_pages
> >>> 9.56 ± 6% -3.7 5.88 ± 14% perf-profile.children.cycles-pp._raw_spin_lock
> >>> 4.97 ± 5% -2.2 2.74 ± 9% perf-profile.children.cycles-pp.__remove_mapping
> >>> 7.67 ± 8% -2.2 5.51 ± 14% perf-profile.children.cycles-pp.btrfs_releasepage
> >>> 7.50 ± 8% -2.1 5.37 ± 15% perf-profile.children.cycles-pp.try_release_extent_mapping
> >>> 3.63 ± 5% -1.7 1.98 ± 9% perf-profile.children.cycles-pp.get_page_from_freelist
> >>> 3.29 ± 5% -1.5 1.75 ± 9% perf-profile.children.cycles-pp.rmqueue
> >>> 13.60 ± 5% -1.5 12.09 ± 7% perf-profile.children.cycles-pp.extent_readahead
> >>> 13.60 ± 5% -1.5 12.09 ± 7% perf-profile.children.cycles-pp.read_pages
> >>> 2.96 ± 6% -1.5 1.49 ± 10% perf-profile.children.cycles-pp.rmqueue_bulk
> >>> 3.43 ± 7% -1.4 2.06 ± 7% perf-profile.children.cycles-pp.lru_note_cost
> >>> 11.54 ± 5% -1.2 10.34 ± 7% perf-profile.children.cycles-pp.__do_readpage
> >>> 10.79 ± 5% -1.1 9.71 ± 7% perf-profile.children.cycles-pp.btrfs_submit_bio_hook
> >>> 3.97 ± 8% -1.1 2.89 ± 15% perf-profile.children.cycles-pp.__clear_extent_bit
> >>> 10.79 ± 5% -1.1 9.71 ± 7% perf-profile.children.cycles-pp.submit_one_bio
> >>> 10.81 ± 5% -1.1 9.74 ± 7% perf-profile.children.cycles-pp.submit_extent_page
> >>> 10.61 ± 5% -1.1 9.55 ± 7% perf-profile.children.cycles-pp.btrfs_map_bio
> >>> 10.58 ± 5% -1.1 9.53 ± 7% perf-profile.children.cycles-pp.submit_bio
> >>> 10.58 ± 5% -1.1 9.53 ± 7% perf-profile.children.cycles-pp.generic_make_request
> >>> 10.56 ± 5% -1.0 9.52 ± 7% perf-profile.children.cycles-pp.pmem_make_request
> >>> 10.38 ± 5% -1.0 9.36 ± 7% perf-profile.children.cycles-pp.pmem_do_read
> >>> 3.52 ± 8% -1.0 2.49 ± 14% perf-profile.children.cycles-pp.test_range_bit
> >>> 10.29 ± 5% -1.0 9.27 ± 7% perf-profile.children.cycles-pp.__memcpy_mcsafe
> >>> 2.16 ± 6% -0.7 1.48 ± 8% perf-profile.children.cycles-pp.__add_to_page_cache_locked
> >>> 3.86 ± 9% -0.7 3.21 ± 5% perf-profile.children.cycles-pp.ret_from_fork
> >>> 3.86 ± 9% -0.7 3.21 ± 5% perf-profile.children.cycles-pp.kthread
> >>> 4.96 ± 6% -0.6 4.31 ± 7% perf-profile.children.cycles-pp.copy_page_to_iter
> >>> 4.83 ± 6% -0.6 4.20 ± 7% perf-profile.children.cycles-pp.copyout
> >>> 4.83 ± 6% -0.6 4.20 ± 7% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
> >>> 1.93 ± 5% -0.6 1.35 ± 8% perf-profile.children.cycles-pp.free_pcppages_bulk
> >>> 2.04 ± 6% -0.6 1.47 ± 7% perf-profile.children.cycles-pp.free_unref_page_list
> >>> 1.17 ± 9% -0.3 0.82 ± 8% perf-profile.children.cycles-pp.__mod_lruvec_state
> >>> 1.83 ± 5% -0.3 1.49 ± 6% perf-profile.children.cycles-pp.worker_thread
> >>> 1.28 ± 7% -0.3 0.95 ± 8% perf-profile.children.cycles-pp.__delete_from_page_cache
> >>> 1.73 ± 5% -0.3 1.42 ± 5% perf-profile.children.cycles-pp.process_one_work
> >>> 1.66 ± 5% -0.3 1.38 ± 6% perf-profile.children.cycles-pp.end_workqueue_fn
> >>> 1.66 ± 5% -0.3 1.38 ± 6% perf-profile.children.cycles-pp.btrfs_work_helper
> >>> 1.64 ± 5% -0.3 1.36 ± 6% perf-profile.children.cycles-pp.end_bio_extent_readpage
> >>> 1.47 ± 6% -0.2 1.23 ± 8% perf-profile.children.cycles-pp.__list_del_entry_valid
> >>> 1.83 ± 5% -0.2 1.60 ± 5% perf-profile.children.cycles-pp.crc_128
> >>> 0.77 ± 9% -0.2 0.56 ± 9% perf-profile.children.cycles-pp.mem_cgroup_charge
> >>> 0.58 ± 8% -0.2 0.38 ± 6% perf-profile.children.cycles-pp.unaccount_page_cache_page
> >>> 0.37 ± 5% -0.2 0.21 ± 7% perf-profile.children.cycles-pp.workingset_eviction
> >>> 1.23 ± 6% -0.2 1.07 ± 6% perf-profile.children.cycles-pp.pagecache_get_page
> >>> 1.21 ± 7% -0.2 1.05 ± 6% perf-profile.children.cycles-pp.find_get_entry
> >>> 1.00 ± 6% -0.1 0.87 ± 6% perf-profile.children.cycles-pp.crc_42
> >>> 0.69 ± 7% -0.1 0.56 ± 9% perf-profile.children.cycles-pp.xas_store
> >>> 0.47 ± 7% -0.1 0.36 ± 9% perf-profile.children.cycles-pp.__etree_search
> >>> 0.47 ± 10% -0.1 0.35 ± 11% perf-profile.children.cycles-pp.__mod_memcg_state
> >>> 0.67 ± 7% -0.1 0.56 ± 10% perf-profile.children.cycles-pp.remove_mapping
> >>> 0.48 ± 4% -0.1 0.38 ± 10% perf-profile.children.cycles-pp.crc_96
> >>> 0.48 ± 6% -0.1 0.39 ± 8% perf-profile.children.cycles-pp.crc_72
> >>> 0.28 ± 8% -0.1 0.20 ± 5% perf-profile.children.cycles-pp.unlock_page
> >>> 0.43 ± 5% -0.1 0.35 ± 7% perf-profile.children.cycles-pp.crc_32
> >>> 0.32 ± 6% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.xas_create
> >>> 0.33 ± 10% -0.1 0.25 ± 8% perf-profile.children.cycles-pp.try_charge
> >>> 0.39 ± 7% -0.1 0.32 ± 9% perf-profile.children.cycles-pp.clear_state_bit
> >>> 0.39 ± 8% -0.1 0.32 ± 9% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
> >>> 0.63 ± 8% -0.1 0.56 ± 6% perf-profile.children.cycles-pp.xas_load
> >>> 0.38 ± 6% -0.1 0.31 ± 6% perf-profile.children.cycles-pp.crc_88
> >>> 0.23 ± 13% -0.1 0.16 ± 14% perf-profile.children.cycles-pp.__count_memcg_events
> >>> 0.34 ± 9% -0.1 0.27 ± 10% perf-profile.children.cycles-pp.uncharge_batch
> >>> 0.18 ± 13% -0.1 0.12 ± 17% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
> >>> 0.17 ± 8% -0.1 0.12 ± 7% perf-profile.children.cycles-pp._raw_write_lock
> >>> 0.32 ± 5% -0.1 0.26 ± 7% perf-profile.children.cycles-pp.crc_16
> >>> 0.31 ± 6% -0.1 0.25 ± 6% perf-profile.children.cycles-pp.crc_56
> >>> 0.26 ± 8% -0.0 0.21 ± 10% perf-profile.children.cycles-pp.page_counter_uncharge
> >>> 0.24 ± 14% -0.0 0.19 ± 12% perf-profile.children.cycles-pp.get_io_u
> >>> 0.18 ± 8% -0.0 0.13 ± 9% perf-profile.children.cycles-pp.page_counter_try_charge
> >>> 0.14 ± 5% -0.0 0.09 ± 8% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
> >>> 0.33 ± 6% -0.0 0.28 ± 5% perf-profile.children.cycles-pp.crc_80
> >>> 0.32 ± 6% -0.0 0.27 ± 6% perf-profile.children.cycles-pp.crc_24
> >>> 0.25 ± 8% -0.0 0.20 ± 9% perf-profile.children.cycles-pp.page_counter_cancel
> >>> 0.15 ± 7% -0.0 0.11 ± 9% perf-profile.children.cycles-pp.split_state
> >>> 0.14 ± 3% -0.0 0.09 ± 11% perf-profile.children.cycles-pp.workingset_age_nonresident
> >>> 0.20 ± 7% -0.0 0.15 ± 8% perf-profile.children.cycles-pp.__mod_node_page_state
> >>> 0.24 ± 9% -0.0 0.20 ± 12% perf-profile.children.cycles-pp.xas_init_marks
> >>> 0.42 ± 5% -0.0 0.38 ± 6% perf-profile.children.cycles-pp.crc_64
> >>> 0.07 ± 7% -0.0 0.03 ±100% perf-profile.children.cycles-pp.xas_alloc
> >>> 0.39 ± 7% -0.0 0.35 ± 8% perf-profile.children.cycles-pp.pagevec_lookup_entries
> >>> 0.39 ± 7% -0.0 0.35 ± 8% perf-profile.children.cycles-pp.find_get_entries
> >>> 0.31 ± 5% -0.0 0.27 ± 6% perf-profile.children.cycles-pp.crc_40
> >>> 0.26 ± 6% -0.0 0.22 ± 8% perf-profile.children.cycles-pp.crc_48
> >>> 0.18 ± 8% -0.0 0.15 ± 3% perf-profile.children.cycles-pp.count_range_bits
> >>> 0.20 ± 7% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.clean_io_failure
> >>> 0.19 ± 6% -0.0 0.16 ± 4% perf-profile.children.cycles-pp.btrfs_readpage_end_io_hook
> >>> 0.18 ± 7% -0.0 0.15 ± 9% perf-profile.children.cycles-pp.btrfs_lookup_bio_sums
> >>> 0.07 ± 6% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.shrink_slab
> >>> 0.21 ± 9% -0.0 0.18 ± 8% perf-profile.children.cycles-pp.__crc32c_pcl_intel_finup
> >>> 0.14 ± 9% -0.0 0.12 ± 7% perf-profile.children.cycles-pp.check_data_csum
> >>> 0.15 ± 10% -0.0 0.12 ± 10% perf-profile.children.cycles-pp.kmem_cache_free
> >>> 0.18 ± 8% -0.0 0.16 ± 8% perf-profile.children.cycles-pp.kernel_fpu_begin
> >>> 0.10 ± 8% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.free_extent_state
> >>> 0.20 ± 7% -0.0 0.18 ± 7% perf-profile.children.cycles-pp.xa_load
> >>> 0.18 ± 6% -0.0 0.16 ± 6% perf-profile.children.cycles-pp.crc_12
> >>> 0.11 ± 7% -0.0 0.09 ± 13% perf-profile.children.cycles-pp.__sched_text_start
> >>> 0.15 ± 5% -0.0 0.13 ± 6% perf-profile.children.cycles-pp.syscall_return_via_sysret
> >>> 0.07 ± 5% -0.0 0.05 ± 8% perf-profile.children.cycles-pp._cond_resched
> >>> 0.17 ± 5% -0.0 0.15 ± 8% perf-profile.children.cycles-pp.entry_SYSCALL_64
> >>> 0.09 ± 5% -0.0 0.07 ± 12% perf-profile.children.cycles-pp.schedule
> >>> 0.11 ± 6% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.__mod_zone_page_state
> >>> 0.13 ± 7% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.free_extent_map
> >>> 0.08 ± 6% -0.0 0.06 ± 11% perf-profile.children.cycles-pp.crc_28
> >>> 0.07 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.__fdget_pos
> >>> 0.15 ± 10% +0.0 0.18 ± 4% perf-profile.children.cycles-pp.__lock_text_start
> >>> 0.09 ± 9% +0.0 0.13 ± 9% perf-profile.children.cycles-pp.__list_add_valid
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.children.cycles-pp.posix_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.children.cycles-pp.__x64_sys_fadvise64
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.children.cycles-pp.ksys_fadvise64_64
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.children.cycles-pp.generic_fadvise
> >>> 6.68 ± 8% +2.2 8.86 ± 6% perf-profile.children.cycles-pp.invalidate_mapping_pages
> >>> 4.97 ± 9% +2.4 7.35 ± 6% perf-profile.children.cycles-pp.release_pages
> >>> 4.87 ± 9% +2.4 7.27 ± 6% perf-profile.children.cycles-pp.__pagevec_release
> >>> 28.04 ± 6% +5.4 33.43 ± 3% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
> >>> 10.94 ± 8% +6.7 17.66 ± 3% perf-profile.children.cycles-pp.add_to_page_cache_lru
> >>> 8.76 ± 8% +7.4 16.17 ± 3% perf-profile.children.cycles-pp.lru_cache_add
> >>> 8.71 ± 8% +7.4 16.13 ± 3% perf-profile.children.cycles-pp.__pagevec_lru_add
> >>> 13.48 ± 8% +8.4 21.87 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
> >>> 0.00 +20.5 20.49 ± 4% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
> >>> 10.21 ± 5% -1.0 9.21 ± 7% perf-profile.self.cycles-pp.__memcpy_mcsafe
> >>> 4.79 ± 6% -0.6 4.17 ± 7% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
> >>> 1.46 ± 6% -0.2 1.23 ± 8% perf-profile.self.cycles-pp.__list_del_entry_valid
> >>> 1.83 ± 5% -0.2 1.60 ± 4% perf-profile.self.cycles-pp.crc_128
> >>> 0.51 ± 11% -0.2 0.32 ± 6% perf-profile.self.cycles-pp.__mod_lruvec_state
> >>> 1.03 ± 5% -0.2 0.87 ± 6% perf-profile.self.cycles-pp.end_bio_extent_readpage
> >>> 0.98 ± 6% -0.1 0.86 ± 7% perf-profile.self.cycles-pp.find_get_entry
> >>> 0.36 ± 6% -0.1 0.23 ± 3% perf-profile.self.cycles-pp.__add_to_page_cache_locked
> >>> 0.99 ± 6% -0.1 0.87 ± 6% perf-profile.self.cycles-pp.crc_42
> >>> 0.23 ± 7% -0.1 0.11 ± 4% perf-profile.self.cycles-pp.workingset_eviction
> >>> 0.59 ± 8% -0.1 0.47 ± 6% perf-profile.self.cycles-pp._raw_spin_lock
> >>> 0.47 ± 10% -0.1 0.35 ± 11% perf-profile.self.cycles-pp.__mod_memcg_state
> >>> 0.45 ± 6% -0.1 0.35 ± 9% perf-profile.self.cycles-pp.__etree_search
> >>> 0.30 ± 8% -0.1 0.19 ± 8% perf-profile.self.cycles-pp.get_page_from_freelist
> >>> 0.47 ± 4% -0.1 0.37 ± 10% perf-profile.self.cycles-pp.crc_96
> >>> 0.66 ± 7% -0.1 0.57 ± 6% perf-profile.self.cycles-pp.free_pcppages_bulk
> >>> 0.47 ± 6% -0.1 0.39 ± 8% perf-profile.self.cycles-pp.crc_72
> >>> 0.28 ± 7% -0.1 0.19 ± 6% perf-profile.self.cycles-pp.unlock_page
> >>> 0.22 ± 8% -0.1 0.14 ± 8% perf-profile.self.cycles-pp.unaccount_page_cache_page
> >>> 0.42 ± 5% -0.1 0.34 ± 6% perf-profile.self.cycles-pp.crc_32
> >>> 0.23 ± 5% -0.1 0.16 ± 9% perf-profile.self.cycles-pp.__remove_mapping
> >>> 0.37 ± 5% -0.1 0.30 ± 5% perf-profile.self.cycles-pp.crc_88
> >>> 0.23 ± 13% -0.1 0.16 ± 14% perf-profile.self.cycles-pp.__count_memcg_events
> >>> 0.53 ± 4% -0.1 0.46 ± 6% perf-profile.self.cycles-pp.extent_readahead
> >>> 0.54 ± 8% -0.1 0.48 ± 7% perf-profile.self.cycles-pp.xas_load
> >>> 0.17 ± 8% -0.1 0.11 ± 9% perf-profile.self.cycles-pp._raw_write_lock
> >>> 0.37 ± 7% -0.1 0.32 ± 10% perf-profile.self.cycles-pp.__do_readpage
> >>> 0.26 ± 8% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.xas_create
> >>> 0.30 ± 7% -0.1 0.25 ± 6% perf-profile.self.cycles-pp.crc_56
> >>> 0.31 ± 5% -0.0 0.26 ± 7% perf-profile.self.cycles-pp.crc_16
> >>> 0.14 ± 5% -0.0 0.09 ± 8% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
> >>> 0.23 ± 14% -0.0 0.19 ± 13% perf-profile.self.cycles-pp.get_io_u
> >>> 0.16 ± 9% -0.0 0.11 ± 11% perf-profile.self.cycles-pp.page_counter_try_charge
> >>> 0.14 ± 3% -0.0 0.09 ± 11% perf-profile.self.cycles-pp.workingset_age_nonresident
> >>> 0.22 ± 7% -0.0 0.18 ± 10% perf-profile.self.cycles-pp.page_counter_cancel
> >>> 0.34 ± 5% -0.0 0.29 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
> >>> 0.33 ± 6% -0.0 0.28 ± 5% perf-profile.self.cycles-pp.crc_80
> >>> 0.19 ± 9% -0.0 0.15 ± 8% perf-profile.self.cycles-pp.__mod_node_page_state
> >>> 0.31 ± 6% -0.0 0.27 ± 7% perf-profile.self.cycles-pp.crc_24
> >>> 0.41 ± 4% -0.0 0.37 ± 6% perf-profile.self.cycles-pp.crc_64
> >>> 0.15 ± 7% -0.0 0.11 ± 7% perf-profile.self.cycles-pp.try_release_extent_mapping
> >>> 0.26 ± 6% -0.0 0.22 ± 8% perf-profile.self.cycles-pp.crc_48
> >>> 0.18 ± 11% -0.0 0.14 ± 7% perf-profile.self.cycles-pp.btrfs_releasepage
> >>> 0.12 ± 8% -0.0 0.09 ± 13% perf-profile.self.cycles-pp.split_state
> >>> 0.30 ± 5% -0.0 0.26 ± 8% perf-profile.self.cycles-pp.crc_40
> >>> 0.11 ± 7% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.mem_cgroup_charge
> >>> 0.19 ± 8% -0.0 0.16 ± 7% perf-profile.self.cycles-pp.release_pages
> >>> 0.15 ± 11% -0.0 0.12 ± 7% perf-profile.self.cycles-pp.try_charge
> >>> 0.10 ± 9% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.xas_init_marks
> >>> 0.10 ± 5% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.__delete_from_page_cache
> >>> 0.11 ± 10% -0.0 0.08 ± 13% perf-profile.self.cycles-pp.crc_22
> >>> 0.18 ± 8% -0.0 0.16 ± 8% perf-profile.self.cycles-pp.kernel_fpu_begin
> >>> 0.13 ± 6% -0.0 0.11 ± 8% perf-profile.self.cycles-pp.free_extent_map
> >>> 0.15 ± 5% -0.0 0.13 ± 6% perf-profile.self.cycles-pp.syscall_return_via_sysret
> >>> 0.10 ± 8% -0.0 0.08 ± 14% perf-profile.self.cycles-pp.free_extent_state
> >>> 0.18 ± 4% -0.0 0.16 ± 6% perf-profile.self.cycles-pp.crc_12
> >>> 0.10 ± 9% -0.0 0.08 ± 11% perf-profile.self.cycles-pp.crc_36
> >>> 0.11 ± 6% -0.0 0.09 ± 7% perf-profile.self.cycles-pp.__mod_zone_page_state
> >>> 0.21 ± 6% -0.0 0.20 ± 4% perf-profile.self.cycles-pp.crc_120
> >>> 0.13 ± 3% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.rmqueue
> >>> 0.09 ± 5% -0.0 0.07 ± 5% perf-profile.self.cycles-pp.__alloc_pages_nodemask
> >>> 0.08 ± 5% +0.0 0.12 ± 8% perf-profile.self.cycles-pp.__list_add_valid
> >>> 0.14 ± 8% +0.1 0.23 ± 8% perf-profile.self.cycles-pp.isolate_lru_pages
> >>> 0.39 ± 8% +0.3 0.64 ± 3% perf-profile.self.cycles-pp.__pagevec_lru_add
> >>> 28.01 ± 6% +5.4 33.41 ± 3% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
> >>>
> >>>
> >>> fio.read_bw_MBps
> >>> 17000 +-------------------------------------------------------------------+
> >>> | |
> >>> 16500 |.+.+. .+. .+. .+ .+.+. .+. .+..+. .+.+. .+. |
> >>> | +. + + + .+..+.+ + + + +.+.+. .+ +.+.|
> >>> 16000 |-+ +.+ +. |
> >>> | |
> >>> 15500 |-+ |
> >>> | |
> >>> 15000 |-+ O O O O |
> >>> | O O O O O O O |
> >>> 14500 |-O O O O O O O |
> >>> | O |
> >>> 14000 |-+ |
> >>> | |
> >>> 13500 +-------------------------------------------------------------------+
> >>> fio.read_iops
> >>> 4.3e+06 +-----------------------------------------------------------------+
> >>> |.+.+. .+. .+. .+ .+.+. .+. .+.+. .+.+.. .+. |
> >>> 4.2e+06 |-+ + + +. + .+.+ + + + +.+.+. .+ +. .|
> >>> 4.1e+06 |-+ +.+.+ + + |
> >>> | |
> >>> 4e+06 |-+ |
> >>> 3.9e+06 |-+ |
> >>> | O O |
> >>> 3.8e+06 |-+ O O O O O O O |
> >>> 3.7e+06 |-O O O O O O O O O |
> >>> | O |
> >>> 3.6e+06 |-+ |
> >>> 3.5e+06 |-+ |
> >>> | O |
> >>> 3.4e+06 +-----------------------------------------------------------------+
> >>> fio.read_clat_mean_us
> >>> 11600 +-------------------------------------------------------------------+
> >>> 11400 |-+ O |
> >>> | |
> >>> 11200 |-+ |
> >>> 11000 |-+ |
> >>> | O O O |
> >>> 10800 |-+ O O O O O O O O O |
> >>> 10600 |-+ O O O O O O O |
> >>> 10400 |-+ |
> >>> | |
> >>> 10200 |-+ |
> >>> 10000 |-+ +.+.+.. .+.. .+.|
> >>> |. .+.. .+. .+. + +.+. .+. .+. .+. .+.+.+ +. .+ |
> >>> 9800 |-+.+ + + + +.+ + +..+ +.+ + |
> >>> 9600 +-------------------------------------------------------------------+
> >>> fio.latency_10ms_
> >>> 0.021 +-------------------------------------------------------------------+
> >>> 0.02 |-+ +.+. .+.+. .|
> >>> | .+. .+. .+. : +. +.+ |
> >>> 0.019 |.+ +..+.+.+. .+ .+ +.+. .+. +.+.+. : |
> >>> 0.018 |-+ + + .+.+..+.+ + + |
> >>> 0.017 |-+ + |
> >>> 0.016 |-+ |
> >>> | |
> >>> 0.015 |-+ O O O |
> >>> 0.014 |-+ O O O O |
> >>> 0.013 |-O O O O O |
> >>> 0.012 |-+ O O O O O O |
> >>> | O |
> >>> 0.011 |-+ O |
> >>> 0.01 +-------------------------------------------------------------------+
> >>> fio.workload
> >>> 8.6e+08 +-----------------------------------------------------------------+
> >>> |.+.+. .+. .+. .+ .+.+. .+. .+.+. .+.+.. .+. |
> >>> 8.4e+08 |-+ + + +. + .+.+ + + + +.+.+. .+ +. .|
> >>> 8.2e+08 |-+ +.+.+ + + |
> >>> | |
> >>> 8e+08 |-+ |
> >>> 7.8e+08 |-+ |
> >>> | O O O |
> >>> 7.6e+08 |-+ O O O O O O O |
> >>> 7.4e+08 |-O O O O O O O O |
> >>> | O |
> >>> 7.2e+08 |-+ |
> >>> 7e+08 |-+ |
> >>> | O |
> >>> 6.8e+08 +-----------------------------------------------------------------+
> >>> fio.time.file_system_inputs
> >>> 6.8e+09 +-----------------------------------------------------------------+
> >>> | +.+.+.+.+. + .+.+ +.+.+ +.+.+..+.+.+. .+ +. .|
> >>> 6.6e+09 |-+ +.+.+ + + |
> >>> | |
> >>> 6.4e+09 |-+ |
> >>> | |
> >>> 6.2e+09 |-+ |
> >>> | O O O O O |
> >>> 6e+09 |-+ O O O O O O O O O |
> >>> | O O O O O |
> >>> 5.8e+09 |-+ |
> >>> | |
> >>> 5.6e+09 |-+ O |
> >>> | |
> >>> 5.4e+09 +-----------------------------------------------------------------+
> >>> [*] bisect-good sample
> >>> [O] bisect-bad sample
> >>>
> >>> ***************************************************************************************************
> >>> lkp-csl-2ap4: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
> >>> =========================================================================================
> >>> compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase/ucode:
> >>> gcc-9/performance/x86_64-rhel-8.3/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap4/lru-file-mmap-read/vm-scalability/0x5002f01
> >>>
> >>> commit:
> >>> 3fbdbb91fe ("mm/swap: serialize memcg changes in pagevec_lru_move_fn")
> >>> ea4ebd4126 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>>
> >>> 3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d0
> >>> ---------------- ---------------------------
> >>> %stddev %change %stddev
> >>> \ | \
> >>> 0.09 +53.1% 0.14 ± 12% vm-scalability.free_time
> >>> 97425 -25.1% 72961 vm-scalability.median
> >>> 244.71 ± 14% +479.3 724.04 ± 17% vm-scalability.stddev%
> >>> 18776401 -25.2% 14040268 vm-scalability.throughput
> >>> 308.46 +12.4% 346.60 vm-scalability.time.elapsed_time
> >>> 308.46 +12.4% 346.60 vm-scalability.time.elapsed_time.max
> >>> 750734 +8.8% 816822 ± 2% vm-scalability.time.involuntary_context_switches
> >>> 6659 ± 7% -39.2% 4048 ± 9% vm-scalability.time.major_page_faults
> >>> 2516115 ± 6% -14.1% 2160109 ± 3% vm-scalability.time.maximum_resident_set_size
> >>> 98586162 -14.1% 84646008 ± 2% vm-scalability.time.minor_page_faults
> >>> 15427 +4.0% 16047 vm-scalability.time.percent_of_cpu_this_job_got
> >>> 44435 +19.3% 53024 vm-scalability.time.system_time
> >>> 3154 -17.7% 2597 vm-scalability.time.user_time
> >>> 4.832e+09 -12.7% 4.22e+09 vm-scalability.workload
> >>> 39455 ± 8% -18.4% 32202 ± 8% meminfo.CmaFree
> >>> 21156129 -11.1% 18810670 meminfo.MemFree
> >>> 3578554 -10.9% 3187885 meminfo.PageTables
> >>> 16.91 -3.1 13.79 mpstat.cpu.all.idle%
> >>> 0.07 ± 5% -0.0 0.06 ± 2% mpstat.cpu.all.soft%
> >>> 5.41 -1.4 4.05 mpstat.cpu.all.usr%
> >>> 16.75 ± 2% -20.9% 13.25 ± 3% vmstat.cpu.id
> >>> 76.75 +6.8% 82.00 vmstat.cpu.sy
> >>> 539.25 ± 3% -24.7% 406.00 ± 5% vmstat.memory.buff
> >>> 19846925 -13.9% 17082076 vmstat.memory.free
> >>> 6242 -6.8% 5818 ± 2% vmstat.system.cs
> >>> 595982 ± 3% -23.8% 454298 ± 6% vmstat.system.in
> >>> 3560 ± 88% +146.8% 8787 ± 33% numa-meminfo.node0.Inactive(anon)
> >>> 925287 -13.6% 799271 ± 2% numa-meminfo.node0.PageTables
> >>> 19372 ± 5% +43.3% 27758 ± 17% numa-meminfo.node0.Shmem
> >>> 901503 -11.6% 797060 ± 2% numa-meminfo.node1.PageTables
> >>> 5239303 ± 4% -10.1% 4711819 ± 3% numa-meminfo.node2.MemFree
> >>> 891493 -10.7% 796152 numa-meminfo.node2.PageTables
> >>> 5809693 ± 6% -12.3% 5093799 ± 2% numa-meminfo.node3.MemFree
> >>> 822917 -9.3% 746345 ± 2% numa-meminfo.node3.PageTables
> >>> 84743 ± 5% +9.5% 92828 ± 3% numa-meminfo.node3.SUnreclaim
> >>> 2.33e+08 -16.3% 1.95e+08 ± 3% numa-numastat.node0.local_node
> >>> 2.331e+08 -16.3% 1.95e+08 ± 3% numa-numastat.node0.numa_hit
> >>> 2.334e+08 -16.9% 1.939e+08 ± 4% numa-numastat.node1.local_node
> >>> 2.334e+08 -16.9% 1.939e+08 ± 4% numa-numastat.node1.numa_hit
> >>> 2.339e+08 -14.6% 1.997e+08 ± 4% numa-numastat.node2.local_node
> >>> 2.339e+08 -14.6% 1.998e+08 ± 4% numa-numastat.node2.numa_hit
> >>> 2.317e+08 -15.3% 1.963e+08 ± 2% numa-numastat.node3.local_node
> >>> 2.317e+08 -15.3% 1.963e+08 ± 2% numa-numastat.node3.numa_hit
> >>> 38532863 ± 3% -9.4% 34897027 ± 2% numa-numastat.node3.numa_miss
> >>> 38564082 ± 3% -9.4% 34920564 ± 2% numa-numastat.node3.other_node
> >>> 20719189 ± 6% -12.4% 18156378 sched_debug.cfs_rq:/.min_vruntime.min
> >>> 769938 ± 7% +24.5% 958769 ± 3% sched_debug.cfs_rq:/.min_vruntime.stddev
> >>> 48.92 ± 11% +129.0% 112.04 ± 8% sched_debug.cfs_rq:/.nr_spread_over.avg
> >>> 165.62 ± 19% +201.7% 499.65 ± 18% sched_debug.cfs_rq:/.nr_spread_over.max
> >>> 21.37 ± 17% +175.0% 58.75 ± 12% sched_debug.cfs_rq:/.nr_spread_over.min
> >>> 20.62 ± 10% +155.7% 52.71 ± 9% sched_debug.cfs_rq:/.nr_spread_over.stddev
> >>> -2235566 +82.5% -4080941 sched_debug.cfs_rq:/.spread0.min
> >>> 768740 ± 7% +24.2% 955083 ± 3% sched_debug.cfs_rq:/.spread0.stddev
> >>> 1369 ± 4% +9.1% 1494 ± 4% sched_debug.cfs_rq:/.util_avg.max
> >>> 13103 ± 6% +42.0% 18606 ± 8% sched_debug.cpu.sched_count.max
> >>> 1506 ± 4% +25.5% 1891 ± 8% sched_debug.cpu.sched_count.stddev
> >>> 215.25 ± 19% +43.0% 307.83 ± 10% sched_debug.cpu.sched_goidle.avg
> >>> 3788 ± 13% +213.4% 11870 ± 13% sched_debug.cpu.sched_goidle.max
> >>> 449.75 ± 16% +158.3% 1161 ± 8% sched_debug.cpu.sched_goidle.stddev
> >>> 2161 ± 8% -17.9% 1774 ± 3% sched_debug.cpu.ttwu_count.avg
> >>> 1317 ± 9% -16.6% 1098 sched_debug.cpu.ttwu_count.min
> >>> 1613 ± 8% -13.7% 1393 ± 3% sched_debug.cpu.ttwu_local.avg
> >>> 878.00 ± 90% +147.3% 2171 ± 34% numa-vmstat.node0.nr_inactive_anon
> >>> 229349 -13.5% 198493 ± 2% numa-vmstat.node0.nr_page_table_pages
> >>> 4879 ± 5% +43.1% 6983 ± 16% numa-vmstat.node0.nr_shmem
> >>> 879.25 ± 89% +147.0% 2171 ± 34% numa-vmstat.node0.nr_zone_inactive_anon
> >>> 1.44e+08 -17.1% 1.194e+08 ± 4% numa-vmstat.node0.numa_hit
> >>> 1.44e+08 -17.1% 1.194e+08 ± 4% numa-vmstat.node0.numa_local
> >>> 1491453 ± 11% -39.8% 897444 ± 12% numa-vmstat.node0.workingset_nodereclaim
> >>> 222.25 ± 3% +20.6% 268.00 ± 6% numa-vmstat.node1.nr_isolated_file
> >>> 223314 -11.3% 197992 ± 2% numa-vmstat.node1.nr_page_table_pages
> >>> 1.459e+08 -18.4% 1.191e+08 ± 3% numa-vmstat.node1.numa_hit
> >>> 1.458e+08 -18.4% 1.19e+08 ± 3% numa-vmstat.node1.numa_local
> >>> 1352757 ± 13% -37.2% 849841 ± 4% numa-vmstat.node1.workingset_nodereclaim
> >>> 20.25 ±173% +6819.8% 1401 ± 81% numa-vmstat.node1.workingset_refault
> >>> 1375726 ± 5% -9.6% 1243389 ± 3% numa-vmstat.node2.nr_free_pages
> >>> 215.00 ± 2% +36.4% 293.25 ± 8% numa-vmstat.node2.nr_isolated_file
> >>> 220838 -10.4% 197800 numa-vmstat.node2.nr_page_table_pages
> >>> 1.466e+08 -16.8% 1.219e+08 ± 3% numa-vmstat.node2.numa_hit
> >>> 1.465e+08 -16.8% 1.218e+08 ± 3% numa-vmstat.node2.numa_local
> >>> 10092 ± 7% -17.5% 8324 ± 8% numa-vmstat.node3.nr_free_cma
> >>> 1522342 ± 5% -12.0% 1340393 ± 2% numa-vmstat.node3.nr_free_pages
> >>> 215.25 ± 3% +34.8% 290.25 ± 4% numa-vmstat.node3.nr_isolated_file
> >>> 203855 -9.1% 185290 ± 2% numa-vmstat.node3.nr_page_table_pages
> >>> 21191 ± 5% +9.5% 23205 ± 3% numa-vmstat.node3.nr_slab_unreclaimable
> >>> 1.452e+08 -17.0% 1.205e+08 ± 2% numa-vmstat.node3.numa_hit
> >>> 1.451e+08 -17.0% 1.204e+08 ± 2% numa-vmstat.node3.numa_local
> >>> 871343 ± 8% -24.1% 661286 ± 7% numa-vmstat.node3.workingset_nodereclaim
> >>> 144319 -16.7% 120249 ± 2% proc-vmstat.allocstall_movable
> >>> 8340 ± 6% -30.0% 5839 ± 17% proc-vmstat.allocstall_normal
> >>> 1972983 ± 6% -10.4% 1767182 ± 5% proc-vmstat.compact_daemon_migrate_scanned
> >>> 2031110 ± 7% -11.4% 1799109 ± 6% proc-vmstat.compact_migrate_scanned
> >>> 121.25 ± 8% -15.3% 102.75 ± 7% proc-vmstat.kswapd_high_wmark_hit_quickly
> >>> 118294 +4.5% 123626 proc-vmstat.nr_active_anon
> >>> 41815768 +1.5% 42446505 proc-vmstat.nr_file_pages
> >>> 9764 ± 8% -17.4% 8067 ± 8% proc-vmstat.nr_free_cma
> >>> 5351342 -9.4% 4847789 proc-vmstat.nr_free_pages
> >>> 41500342 +1.5% 42125386 proc-vmstat.nr_inactive_file
> >>> 917.25 ± 4% +29.6% 1188 ± 4% proc-vmstat.nr_isolated_file
> >>> 37026785 +3.3% 38235898 proc-vmstat.nr_mapped
> >>> 895840 -11.0% 797506 proc-vmstat.nr_page_table_pages
> >>> 71633 +8.1% 77427 proc-vmstat.nr_shmem
> >>> 755143 -2.4% 737170 proc-vmstat.nr_slab_reclaimable
> >>> 102.25 +1.7% 104.00 proc-vmstat.nr_written
> >>> 118336 +4.5% 123662 proc-vmstat.nr_zone_active_anon
> >>> 41493234 +1.5% 42119457 proc-vmstat.nr_zone_inactive_file
> >>> 9.321e+08 -15.8% 7.851e+08 ± 2% proc-vmstat.numa_hit
> >>> 9.32e+08 -15.8% 7.85e+08 ± 2% proc-vmstat.numa_local
> >>> 6225 ± 49% -66.6% 2079 ± 38% proc-vmstat.numa_pages_migrated
> >>> 7903132 -12.1% 6950560 proc-vmstat.pgalloc_dma32
> >>> 1.071e+09 -14.2% 9.183e+08 proc-vmstat.pgalloc_normal
> >>> 1.332e+08 -14.0% 1.145e+08 ± 2% proc-vmstat.pgfault
> >>> 1.08e+09 -14.2% 9.264e+08 proc-vmstat.pgfree
> >>> 6659 ± 7% -39.2% 4048 ± 9% proc-vmstat.pgmajfault
> >>> 14013 ± 56% -80.1% 2786 ± 7% proc-vmstat.pgmigrate_fail
> >>> 2392 -3.0% 2321 proc-vmstat.pgpgout
> >>> 1.876e+09 -18.5% 1.529e+09 ± 2% proc-vmstat.pgscan_direct
> >>> 641.50 ± 38% -83.8% 104.00 ± 40% proc-vmstat.pgscan_direct_throttle
> >>> 2.054e+09 -13.8% 1.769e+09 proc-vmstat.pgscan_file
> >>> 1.775e+08 ± 3% +35.3% 2.402e+08 ± 2% proc-vmstat.pgscan_kswapd
> >>> 9.922e+08 -14.8% 8.456e+08 ± 2% proc-vmstat.pgsteal_direct
> >>> 1.027e+09 -14.9% 8.738e+08 proc-vmstat.pgsteal_file
> >>> 34436983 ± 5% -18.1% 28195284 ± 3% proc-vmstat.pgsteal_kswapd
> >>> 15891609 -20.1% 12703413 ± 2% proc-vmstat.slabs_scanned
> >>> 4721382 -29.3% 3337436 ± 2% proc-vmstat.workingset_nodereclaim
> >>> 4215183 -2.9% 4092037 proc-vmstat.workingset_nodes
> >>> 2.897e+10 -13.5% 2.506e+10 perf-stat.i.branch-instructions
> >>> 34665883 ± 4% -20.4% 27602188 ± 7% perf-stat.i.branch-misses
> >>> 1.575e+08 -18.1% 1.289e+08 perf-stat.i.cache-misses
> >>> 5.194e+08 -20.1% 4.148e+08 perf-stat.i.cache-references
> >>> 6050 -5.5% 5714 ± 2% perf-stat.i.context-switches
> >>> 4.29 +26.4% 5.43 perf-stat.i.cpi
> >>> 4.757e+11 +4.9% 4.99e+11 perf-stat.i.cpu-cycles
> >>> 262.96 +1.4% 266.58 perf-stat.i.cpu-migrations
> >>> 3283 +31.5% 4319 ± 2% perf-stat.i.cycles-between-cache-misses
> >>> 9068746 ± 7% -25.6% 6751562 ± 8% perf-stat.i.dTLB-load-misses
> >>> 2.917e+10 -13.5% 2.524e+10 perf-stat.i.dTLB-loads
> >>> 648353 ± 5% -25.1% 485811 ± 7% perf-stat.i.dTLB-store-misses
> >>> 5.991e+09 -22.3% 4.652e+09 perf-stat.i.dTLB-stores
> >>> 88.32 +2.2 90.53 perf-stat.i.iTLB-load-miss-rate%
> >>> 6719082 ± 6% -20.8% 5321777 ± 6% perf-stat.i.iTLB-load-misses
> >>> 1.062e+11 -12.5% 9.292e+10 perf-stat.i.instructions
> >>> 15378 ± 5% +11.9% 17205 ± 5% perf-stat.i.instructions-per-iTLB-miss
> >>> 0.29 -14.6% 0.25 ± 2% perf-stat.i.ipc
> >>> 19.17 ± 7% -44.6% 10.61 ± 12% perf-stat.i.major-faults
> >>> 2.47 +4.9% 2.59 perf-stat.i.metric.GHz
> >>> 0.50 ± 3% +38.0% 0.69 ± 2% perf-stat.i.metric.K/sec
> >>> 336.14 -14.4% 287.86 perf-stat.i.metric.M/sec
> >>> 318951 -23.1% 245264 ± 2% perf-stat.i.minor-faults
> >>> 18925096 -3.6% 18242044 perf-stat.i.node-load-misses
> >>> 4098303 -11.2% 3639476 perf-stat.i.node-loads
> >>> 63.83 +2.7 66.51 perf-stat.i.node-store-miss-rate%
> >>> 13628814 -19.3% 10993468 perf-stat.i.node-store-misses
> >>> 10485415 -24.3% 7942074 ± 2% perf-stat.i.node-stores
> >>> 318970 -23.1% 245274 ± 2% perf-stat.i.page-faults
> >>> 4.84 -8.6% 4.42 perf-stat.overall.MPKI
> >>> 30.40 +0.9 31.25 perf-stat.overall.cache-miss-rate%
> >>> 4.54 +19.6% 5.43 perf-stat.overall.cpi
> >>> 3084 +27.3% 3926 perf-stat.overall.cycles-between-cache-misses
> >>> 0.03 ± 7% -0.0 0.03 ± 7% perf-stat.overall.dTLB-load-miss-rate%
> >>> 0.22 -16.4% 0.18 perf-stat.overall.ipc
> >>> 82.40 +1.1 83.50 perf-stat.overall.node-load-miss-rate%
> >>> 57.09 +1.4 58.45 perf-stat.overall.node-store-miss-rate%
> >>> 6934 +12.0% 7764 perf-stat.overall.path-length
> >>> 2.952e+10 -13.9% 2.541e+10 perf-stat.ps.branch-instructions
> >>> 34744977 ± 3% -21.2% 27368016 ± 6% perf-stat.ps.branch-misses
> >>> 1.594e+08 -18.2% 1.304e+08 perf-stat.ps.cache-misses
> >>> 5.246e+08 -20.5% 4.173e+08 perf-stat.ps.cache-references
> >>> 6197 -6.7% 5784 ± 2% perf-stat.ps.context-switches
> >>> 4.918e+11 +4.1% 5.118e+11 perf-stat.ps.cpu-cycles
> >>> 261.67 +1.4% 265.34 perf-stat.ps.cpu-migrations
> >>> 9268219 ± 7% -26.4% 6819465 ± 8% perf-stat.ps.dTLB-load-misses
> >>> 2.975e+10 -13.9% 2.561e+10 perf-stat.ps.dTLB-loads
> >>> 650707 ± 5% -25.8% 482513 ± 6% perf-stat.ps.dTLB-store-misses
> >>> 6.08e+09 -22.9% 4.69e+09 perf-stat.ps.dTLB-stores
> >>> 6705817 ± 5% -20.9% 5301976 ± 5% perf-stat.ps.iTLB-load-misses
> >>> 1.084e+11 -13.0% 9.432e+10 perf-stat.ps.instructions
> >>> 21.55 ± 8% -45.9% 11.65 ± 9% perf-stat.ps.major-faults
> >>> 322272 -23.4% 246810 ± 2% perf-stat.ps.minor-faults
> >>> 19313059 -3.7% 18594650 perf-stat.ps.node-load-misses
> >>> 4125420 -10.9% 3674701 perf-stat.ps.node-loads
> >>> 14062251 -20.2% 11223532 perf-stat.ps.node-store-misses
> >>> 10567431 -24.5% 7979180 ± 2% perf-stat.ps.node-stores
> >>> 322293 -23.4% 246822 ± 2% perf-stat.ps.page-faults
> >>> 3.351e+13 -2.2% 3.276e+13 perf-stat.total.instructions
> >>> 20.57 ± 3% -20.6 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 20.54 ± 3% -20.5 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 25.78 ± 3% -11.5 14.25 ± 21% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 25.74 ± 3% -11.5 14.21 ± 21% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
> >>> 25.70 ± 2% -11.4 14.32 ± 20% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 1.86 ± 37% -1.6 0.29 ±100% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault
> >>> 2.63 ± 18% -1.6 1.08 ± 69% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault
> >>> 1.81 ± 28% -1.4 0.37 ±100% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.filemap_fault
> >>> 1.63 ± 41% -1.4 0.26 ±100% perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.filemap_fault
> >>> 3.88 ± 4% -1.2 2.65 ± 24% perf-profile.calltrace.cycles-pp.read_pages.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault.__do_fault
> >>> 3.88 ± 4% -1.2 2.64 ± 24% perf-profile.calltrace.cycles-pp.iomap_readahead.read_pages.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault
> >>> 3.88 ± 4% -1.2 2.64 ± 24% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_readahead.read_pages.page_cache_readahead_unbounded.filemap_fault
> >>> 3.85 ± 4% -1.2 2.62 ± 24% perf-profile.calltrace.cycles-pp.iomap_readahead_actor.iomap_apply.iomap_readahead.read_pages.page_cache_readahead_unbounded
> >>> 3.72 ± 4% -1.2 2.53 ± 24% perf-profile.calltrace.cycles-pp.iomap_readpage_actor.iomap_readahead_actor.iomap_apply.iomap_readahead.read_pages
> >>> 1.92 ± 11% -0.9 1.03 ± 60% perf-profile.calltrace.cycles-pp.memset_erms.iomap_readpage_actor.iomap_readahead_actor.iomap_apply.iomap_readahead
> >>> 1.46 ± 11% -0.7 0.73 ± 67% perf-profile.calltrace.cycles-pp.iomap_set_range_uptodate.iomap_readpage_actor.iomap_readahead_actor.iomap_apply.iomap_readahead
> >>> 2.18 ± 5% -0.4 1.73 ± 11% perf-profile.calltrace.cycles-pp.ret_from_fork
> >>> 2.18 ± 5% -0.4 1.73 ± 11% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
> >>> 0.65 ± 11% -0.4 0.29 ±100% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
> >>> 4.60 ± 4% +3.0 7.57 ± 14% perf-profile.calltrace.cycles-pp.smp_call_function_many_cond.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list
> >>> 4.85 ± 3% +3.1 7.92 ± 13% perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list
> >>> 4.85 ± 3% +3.1 7.92 ± 13% perf-profile.calltrace.cycles-pp.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 4.85 ± 3% +3.1 7.92 ± 13% perf-profile.calltrace.cycles-pp.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec
> >>> 20.70 +10.6 31.33 ± 21% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 20.55 +11.1 31.60 ± 22% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 0.00 +25.8 25.84 ± 20% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
> >>> 0.00 +25.9 25.86 ± 20% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.00 +25.9 25.86 ± 20% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 26.92 -11.5 15.43 ± 21% perf-profile.children.cycles-pp.lru_note_cost
> >>> 2.46 ± 22% -1.6 0.86 ± 9% perf-profile.children.cycles-pp._raw_spin_lock
> >>> 2.25 ± 24% -1.5 0.76 ± 25% perf-profile.children.cycles-pp.get_page_from_freelist
> >>> 2.13 ± 26% -1.4 0.69 ± 27% perf-profile.children.cycles-pp.rmqueue
> >>> 1.96 ± 27% -1.4 0.59 ± 27% perf-profile.children.cycles-pp.rmqueue_bulk
> >>> 2.64 ± 18% -1.3 1.39 ± 30% perf-profile.children.cycles-pp.__add_to_page_cache_locked
> >>> 3.88 ± 4% -1.2 2.65 ± 24% perf-profile.children.cycles-pp.read_pages
> >>> 3.88 ± 4% -1.2 2.65 ± 24% perf-profile.children.cycles-pp.iomap_readahead
> >>> 3.88 ± 4% -1.2 2.64 ± 24% perf-profile.children.cycles-pp.iomap_apply
> >>> 3.85 ± 4% -1.2 2.63 ± 24% perf-profile.children.cycles-pp.iomap_readahead_actor
> >>> 3.74 ± 4% -1.2 2.53 ± 24% perf-profile.children.cycles-pp.iomap_readpage_actor
> >>> 1.82 ± 28% -1.0 0.82 ± 41% perf-profile.children.cycles-pp.mem_cgroup_charge
> >>> 2.07 ± 4% -0.7 1.37 ± 25% perf-profile.children.cycles-pp.memset_erms
> >>> 0.75 ± 31% -0.5 0.28 ± 46% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
> >>> 1.55 ± 4% -0.5 1.09 ± 24% perf-profile.children.cycles-pp.iomap_set_range_uptodate
> >>> 2.21 ± 5% -0.5 1.75 ± 12% perf-profile.children.cycles-pp.ret_from_fork
> >>> 2.18 ± 5% -0.4 1.73 ± 11% perf-profile.children.cycles-pp.kthread
> >>> 1.65 -0.4 1.21 ± 11% perf-profile.children.cycles-pp.rmap_walk_file
> >>> 0.96 -0.3 0.62 ± 5% perf-profile.children.cycles-pp.page_referenced
> >>> 1.00 ± 6% -0.3 0.70 ± 24% perf-profile.children.cycles-pp.__mod_lruvec_state
> >>> 0.95 ± 8% -0.3 0.67 ± 14% perf-profile.children.cycles-pp.free_pcppages_bulk
> >>> 0.63 ± 10% -0.2 0.41 ± 34% perf-profile.children.cycles-pp.workingset_eviction
> >>> 0.55 ± 2% -0.2 0.35 ± 6% perf-profile.children.cycles-pp.page_referenced_one
> >>> 0.74 -0.2 0.55 perf-profile.children.cycles-pp.__list_del_entry_valid
> >>> 0.52 ± 12% -0.2 0.35 ± 34% perf-profile.children.cycles-pp.__mod_memcg_state
> >>> 0.67 ± 6% -0.2 0.51 ± 25% perf-profile.children.cycles-pp.free_unref_page_list
> >>> 0.45 -0.1 0.31 ± 7% perf-profile.children.cycles-pp.page_vma_mapped_walk
> >>> 0.54 ± 4% -0.1 0.40 ± 27% perf-profile.children.cycles-pp.filemap_map_pages
> >>> 0.54 ± 5% -0.1 0.42 ± 23% perf-profile.children.cycles-pp.__delete_from_page_cache
> >>> 0.34 ± 5% -0.1 0.23 ± 26% perf-profile.children.cycles-pp.alloc_set_pte
> >>> 0.30 ± 5% -0.1 0.19 ± 26% perf-profile.children.cycles-pp.page_add_file_rmap
> >>> 0.45 ± 2% -0.1 0.34 ± 9% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
> >>> 0.31 ± 15% -0.1 0.21 ± 31% perf-profile.children.cycles-pp.__count_memcg_events
> >>> 0.27 ± 15% -0.1 0.19 ± 34% perf-profile.children.cycles-pp.try_charge
> >>> 0.24 -0.1 0.16 ± 5% perf-profile.children.cycles-pp.down_read
> >>> 0.33 ± 2% -0.1 0.26 ± 25% perf-profile.children.cycles-pp.xas_store
> >>> 0.22 ± 18% -0.1 0.15 ± 34% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
> >>> 0.41 ± 2% -0.1 0.34 ± 10% perf-profile.children.cycles-pp.asm_call_on_stack
> >>> 0.34 ± 2% -0.1 0.29 ± 9% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
> >>> 0.22 ± 3% -0.1 0.17 ± 21% perf-profile.children.cycles-pp.xas_create
> >>> 0.15 ± 3% -0.1 0.10 ± 21% perf-profile.children.cycles-pp.__mod_node_page_state
> >>> 0.29 ± 2% -0.0 0.24 ± 7% perf-profile.children.cycles-pp.hrtimer_interrupt
> >>> 0.29 ± 2% -0.0 0.25 ± 7% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
> >>> 0.16 ± 5% -0.0 0.12 ± 24% perf-profile.children.cycles-pp.asm_sysvec_call_function
> >>> 0.14 ± 3% -0.0 0.10 ± 18% perf-profile.children.cycles-pp.unlock_page
> >>> 0.22 -0.0 0.18 ± 7% perf-profile.children.cycles-pp.__hrtimer_run_queues
> >>> 0.11 ± 4% -0.0 0.08 ± 14% perf-profile.children.cycles-pp.up_read
> >>> 0.11 -0.0 0.08 ± 10% perf-profile.children.cycles-pp.page_mapping
> >>> 0.11 ± 4% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.___might_sleep
> >>> 0.16 ± 2% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.tick_sched_timer
> >>> 0.15 ± 2% -0.0 0.12 ± 6% perf-profile.children.cycles-pp.update_process_times
> >>> 0.15 ± 2% -0.0 0.12 ± 4% perf-profile.children.cycles-pp.tick_sched_handle
> >>> 0.11 ± 3% -0.0 0.10 ± 5% perf-profile.children.cycles-pp.scheduler_tick
> >>> 0.08 -0.0 0.07 ± 7% perf-profile.children.cycles-pp.task_tick_fair
> >>> 0.03 ±100% +0.1 0.09 ± 12% perf-profile.children.cycles-pp.ksys_write
> >>> 0.03 ±100% +0.1 0.09 ± 12% perf-profile.children.cycles-pp.vfs_write
> >>> 0.03 ±100% +0.1 0.09 ± 12% perf-profile.children.cycles-pp.new_sync_write
> >>> 0.03 ±100% +0.1 0.14 ± 56% perf-profile.children.cycles-pp.execve
> >>> 0.03 ±100% +0.1 0.15 ± 51% perf-profile.children.cycles-pp.__x64_sys_execve
> >>> 0.03 ±100% +0.1 0.15 ± 51% perf-profile.children.cycles-pp.__do_execve_file
> >>> 0.25 ± 11% +0.2 0.46 ± 37% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
> >>> 0.25 ± 11% +0.2 0.46 ± 37% perf-profile.children.cycles-pp.do_syscall_64
> >>> 5.15 ± 4% +3.0 8.12 ± 14% perf-profile.children.cycles-pp.smp_call_function_many_cond
> >>> 5.43 ± 4% +3.1 8.52 ± 12% perf-profile.children.cycles-pp.try_to_unmap_flush
> >>> 5.43 ± 4% +3.1 8.52 ± 12% perf-profile.children.cycles-pp.arch_tlbbatch_flush
> >>> 5.51 ± 4% +3.1 8.61 ± 12% perf-profile.children.cycles-pp.on_each_cpu_cond_mask
> >>> 0.00 +26.0 26.02 ± 20% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
> >>> 2.05 ± 4% -0.7 1.35 ± 25% perf-profile.self.cycles-pp.memset_erms
> >>> 0.74 ± 32% -0.5 0.28 ± 46% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
> >>> 1.53 ± 4% -0.5 1.07 ± 24% perf-profile.self.cycles-pp.iomap_set_range_uptodate
> >>> 0.57 ± 33% -0.4 0.20 ± 48% perf-profile.self.cycles-pp.mem_cgroup_charge
> >>> 0.74 -0.2 0.55 ± 2% perf-profile.self.cycles-pp.__list_del_entry_valid
> >>> 0.45 ± 12% -0.2 0.27 ± 36% perf-profile.self.cycles-pp.workingset_eviction
> >>> 0.51 ± 12% -0.2 0.35 ± 33% perf-profile.self.cycles-pp.__mod_memcg_state
> >>> 0.31 ± 14% -0.1 0.21 ± 31% perf-profile.self.cycles-pp.__count_memcg_events
> >>> 0.27 -0.1 0.19 ± 7% perf-profile.self.cycles-pp.page_vma_mapped_walk
> >>> 0.25 -0.1 0.18 ± 4% perf-profile.self.cycles-pp.shrink_page_list
> >>> 0.18 ± 2% -0.1 0.11 ± 24% perf-profile.self.cycles-pp.__add_to_page_cache_locked
> >>> 0.19 ± 2% -0.1 0.12 ± 4% perf-profile.self.cycles-pp.down_read
> >>> 0.08 ± 5% -0.1 0.03 ±100% perf-profile.self.cycles-pp.page_add_file_rmap
> >>> 0.15 ± 2% -0.0 0.10 ± 4% perf-profile.self.cycles-pp.page_referenced_one
> >>> 0.14 ± 5% -0.0 0.09 ± 22% perf-profile.self.cycles-pp.__mod_node_page_state
> >>> 0.11 ± 4% -0.0 0.06 ± 61% perf-profile.self.cycles-pp.iomap_readpage_actor
> >>> 0.08 ± 6% -0.0 0.03 ±100% perf-profile.self.cycles-pp.unaccount_page_cache_page
> >>> 0.10 ± 15% -0.0 0.06 ± 60% perf-profile.self.cycles-pp.try_charge
> >>> 0.13 -0.0 0.09 ± 7% perf-profile.self.cycles-pp._raw_spin_lock
> >>> 0.10 -0.0 0.06 ± 13% perf-profile.self.cycles-pp.get_page_from_freelist
> >>> 0.14 ± 3% -0.0 0.10 ± 18% perf-profile.self.cycles-pp.unlock_page
> >>> 0.11 ± 4% -0.0 0.08 ± 14% perf-profile.self.cycles-pp.up_read
> >>> 0.10 ± 4% -0.0 0.07 ± 11% perf-profile.self.cycles-pp.___might_sleep
> >>> 0.11 ± 4% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.page_mapping
> >>> 0.07 ± 7% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.rmap_walk_file
> >>> 0.11 -0.0 0.09 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irq
> >>> 0.23 +0.1 0.31 ± 7% perf-profile.self.cycles-pp.isolate_lru_pages
> >>> 0.10 ± 4% +0.1 0.19 ± 44% perf-profile.self.cycles-pp.move_pages_to_lru
> >>> 5.05 ± 4% +3.0 8.02 ± 14% perf-profile.self.cycles-pp.smp_call_function_many_cond
> >>> 136204 ± 2% +13.0% 153883 ± 3% softirqs.CPU0.TIMER
> >>> 125606 ± 2% +15.5% 145056 ± 2% softirqs.CPU100.TIMER
> >>> 125480 ± 2% +15.8% 145326 ± 2% softirqs.CPU101.TIMER
> >>> 125988 ± 3% +14.8% 144635 ± 2% softirqs.CPU102.TIMER
> >>> 125152 ± 2% +15.9% 145112 ± 2% softirqs.CPU103.TIMER
> >>> 125205 ± 2% +15.8% 145007 ± 2% softirqs.CPU104.TIMER
> >>> 125436 ± 2% +15.2% 144536 ± 3% softirqs.CPU105.TIMER
> >>> 125083 ± 2% +15.5% 144435 ± 3% softirqs.CPU106.TIMER
> >>> 125185 ± 2% +15.7% 144881 ± 3% softirqs.CPU107.TIMER
> >>> 126131 ± 3% +15.1% 145131 ± 2% softirqs.CPU108.TIMER
> >>> 124951 ± 2% +15.9% 144818 ± 2% softirqs.CPU109.TIMER
> >>> 125632 ± 3% +15.0% 144533 ± 2% softirqs.CPU110.TIMER
> >>> 125485 ± 2% +14.9% 144142 ± 3% softirqs.CPU111.TIMER
> >>> 125201 ± 2% +16.0% 145197 ± 2% softirqs.CPU112.TIMER
> >>> 125265 ± 2% +15.9% 145125 ± 2% softirqs.CPU113.TIMER
> >>> 125518 ± 2% +15.3% 144780 ± 2% softirqs.CPU114.TIMER
> >>> 127012 +13.9% 144651 ± 2% softirqs.CPU115.TIMER
> >>> 125396 ± 2% +15.7% 145142 ± 2% softirqs.CPU116.TIMER
> >>> 125472 ± 2% +15.3% 144708 ± 2% softirqs.CPU117.TIMER
> >>> 9794 ± 8% -10.0% 8820 ± 3% softirqs.CPU118.RCU
> >>> 125175 ± 2% +15.2% 144223 ± 3% softirqs.CPU118.TIMER
> >>> 125232 ± 2% +15.6% 144709 ± 2% softirqs.CPU119.TIMER
> >>> 123862 +19.6% 148184 softirqs.CPU120.TIMER
> >>> 10494 ± 3% -10.5% 9391 softirqs.CPU121.RCU
> >>> 123493 ± 2% +19.9% 148009 softirqs.CPU121.TIMER
> >>> 122499 ± 3% +20.0% 147026 softirqs.CPU122.TIMER
> >>> 124304 +19.4% 148380 softirqs.CPU123.TIMER
> >>> 9898 ± 4% -8.4% 9068 ± 2% softirqs.CPU124.RCU
> >>> 124361 +19.1% 148057 softirqs.CPU124.TIMER
> >>> 10283 ± 4% -15.4% 8700 ± 4% softirqs.CPU125.RCU
> >>> 124216 +19.0% 147803 softirqs.CPU125.TIMER
> >>> 9957 ± 4% -11.4% 8826 ± 2% softirqs.CPU126.RCU
> >>> 123418 +19.9% 147984 softirqs.CPU126.TIMER
> >>> 123364 ± 2% +20.0% 147980 softirqs.CPU127.TIMER
> >>> 12723 ± 35% -25.8% 9439 ± 4% softirqs.CPU128.RCU
> >>> 123801 ± 2% +19.5% 147958 softirqs.CPU128.TIMER
> >>> 10413 ± 7% -12.2% 9140 softirqs.CPU129.RCU
> >>> 126738 ± 3% +14.6% 145227 ± 3% softirqs.CPU13.TIMER
> >>> 123684 +19.9% 148237 softirqs.CPU130.TIMER
> >>> 123888 +19.6% 148199 softirqs.CPU131.TIMER
> >>> 124248 ± 2% +19.1% 148040 softirqs.CPU132.TIMER
> >>> 123213 ± 2% +20.3% 148184 softirqs.CPU133.TIMER
> >>> 124318 +19.7% 148752 ± 2% softirqs.CPU134.TIMER
> >>> 124036 +19.1% 147714 softirqs.CPU135.TIMER
> >>> 123575 ± 2% +19.4% 147591 softirqs.CPU136.TIMER
> >>> 10091 ± 5% -9.4% 9138 ± 3% softirqs.CPU137.RCU
> >>> 124020 +19.2% 147851 softirqs.CPU137.TIMER
> >>> 124022 +19.3% 147958 softirqs.CPU138.TIMER
> >>> 11191 ± 12% -17.3% 9250 ± 4% softirqs.CPU139.RCU
> >>> 123685 ± 2% +19.6% 147932 softirqs.CPU139.TIMER
> >>> 10392 ± 4% -11.1% 9242 ± 3% softirqs.CPU140.RCU
> >>> 124631 +18.5% 147638 softirqs.CPU140.TIMER
> >>> 124090 +19.4% 148131 softirqs.CPU141.TIMER
> >>> 10358 ± 6% -10.4% 9278 ± 3% softirqs.CPU142.RCU
> >>> 124200 +19.2% 148042 softirqs.CPU142.TIMER
> >>> 123541 +19.7% 147886 softirqs.CPU143.TIMER
> >>> 126321 ± 2% +16.9% 147674 ± 2% softirqs.CPU144.TIMER
> >>> 126275 ± 2% +16.6% 147221 ± 2% softirqs.CPU145.TIMER
> >>> 126175 ± 2% +16.5% 146949 ± 2% softirqs.CPU146.TIMER
> >>> 126145 ± 2% +17.4% 148123 softirqs.CPU147.TIMER
> >>> 126227 ± 2% +16.9% 147606 ± 2% softirqs.CPU148.TIMER
> >>> 126245 ± 2% +16.9% 147557 ± 2% softirqs.CPU149.TIMER
> >>> 126541 ± 3% +22.5% 154967 ± 10% softirqs.CPU15.TIMER
> >>> 10462 ± 7% -12.8% 9124 ± 3% softirqs.CPU150.RCU
> >>> 126317 ± 2% +16.7% 147447 ± 2% softirqs.CPU150.TIMER
> >>> 126097 ± 2% +17.0% 147533 ± 2% softirqs.CPU151.TIMER
> >>> 126278 ± 2% +17.2% 148004 softirqs.CPU152.TIMER
> >>> 126006 ± 2% +17.0% 147420 ± 2% softirqs.CPU153.TIMER
> >>> 10459 ± 3% -12.7% 9129 ± 4% softirqs.CPU154.RCU
> >>> 125989 ± 2% +17.0% 147405 ± 2% softirqs.CPU154.TIMER
> >>> 10421 ± 4% -11.8% 9194 ± 2% softirqs.CPU155.RCU
> >>> 126102 ± 2% +17.2% 147842 softirqs.CPU155.TIMER
> >>> 10764 ± 7% -14.6% 9190 ± 3% softirqs.CPU156.RCU
> >>> 125906 ± 2% +16.6% 146823 ± 2% softirqs.CPU156.TIMER
> >>> 10381 ± 3% -10.3% 9310 ± 4% softirqs.CPU157.RCU
> >>> 125964 ± 2% +16.8% 147174 ± 2% softirqs.CPU157.TIMER
> >>> 10412 ± 6% -10.7% 9298 ± 2% softirqs.CPU158.RCU
> >>> 126174 ± 2% +17.1% 147712 softirqs.CPU158.TIMER
> >>> 125839 ± 2% +16.8% 146944 ± 2% softirqs.CPU159.TIMER
> >>> 126011 ± 3% +17.1% 147561 ± 2% softirqs.CPU160.TIMER
> >>> 125947 ± 2% +18.0% 148628 softirqs.CPU161.TIMER
> >>> 125723 ± 2% +24.5% 156479 ± 8% softirqs.CPU162.TIMER
> >>> 125954 ± 3% +16.8% 147100 ± 2% softirqs.CPU163.TIMER
> >>> 10327 ± 2% -11.6% 9130 ± 3% softirqs.CPU164.RCU
> >>> 126137 ± 2% +17.7% 148463 ± 2% softirqs.CPU164.TIMER
> >>> 11056 ± 9% -16.8% 9196 ± 4% softirqs.CPU165.RCU
> >>> 125888 ± 3% +16.7% 146935 ± 2% softirqs.CPU165.TIMER
> >>> 126718 ± 3% +16.6% 147749 ± 2% softirqs.CPU166.TIMER
> >>> 126176 ± 2% +17.0% 147570 ± 2% softirqs.CPU167.TIMER
> >>> 125303 +17.7% 147527 softirqs.CPU168.TIMER
> >>> 126002 +16.8% 147145 softirqs.CPU169.TIMER
> >>> 125158 +17.9% 147550 softirqs.CPU170.TIMER
> >>> 125371 +17.6% 147426 softirqs.CPU171.TIMER
> >>> 125308 +17.6% 147345 softirqs.CPU172.TIMER
> >>> 125174 +17.7% 147294 softirqs.CPU173.TIMER
> >>> 125201 +17.9% 147663 softirqs.CPU174.TIMER
> >>> 125087 +17.7% 147219 softirqs.CPU175.TIMER
> >>> 125401 +17.4% 147243 softirqs.CPU176.TIMER
> >>> 126045 +16.8% 147265 softirqs.CPU177.TIMER
> >>> 125376 +17.4% 147236 softirqs.CPU178.TIMER
> >>> 125357 +17.5% 147273 softirqs.CPU179.TIMER
> >>> 126529 ± 3% +22.0% 154334 ± 10% softirqs.CPU18.TIMER
> >>> 125146 +17.6% 147204 softirqs.CPU180.TIMER
> >>> 125679 +17.0% 147100 softirqs.CPU181.TIMER
> >>> 125283 +17.6% 147304 softirqs.CPU182.TIMER
> >>> 125040 +17.8% 147310 softirqs.CPU183.TIMER
> >>> 125272 +17.7% 147424 softirqs.CPU184.TIMER
> >>> 125179 +17.9% 147539 softirqs.CPU185.TIMER
> >>> 125031 +18.2% 147763 ± 2% softirqs.CPU186.TIMER
> >>> 125387 +17.4% 147254 softirqs.CPU187.TIMER
> >>> 125265 +17.8% 147553 softirqs.CPU188.TIMER
> >>> 125371 +17.4% 147177 softirqs.CPU189.TIMER
> >>> 125143 +17.6% 147184 softirqs.CPU190.TIMER
> >>> 122424 +18.0% 144512 softirqs.CPU191.TIMER
> >>> 11822 ± 13% -17.0% 9808 softirqs.CPU24.RCU
> >>> 126318 ± 2% +17.6% 148503 softirqs.CPU24.TIMER
> >>> 126871 ± 2% +17.4% 148916 softirqs.CPU25.TIMER
> >>> 122998 ± 4% +18.2% 145427 ± 3% softirqs.CPU26.TIMER
> >>> 125387 +18.3% 148348 softirqs.CPU27.TIMER
> >>> 126560 ± 2% +17.5% 148702 softirqs.CPU28.TIMER
> >>> 11422 ± 10% -19.1% 9240 ± 2% softirqs.CPU29.RCU
> >>> 125622 ± 2% +18.1% 148410 softirqs.CPU29.TIMER
> >>> 10489 ± 6% -10.8% 9361 ± 2% softirqs.CPU30.RCU
> >>> 125278 ± 2% +18.4% 148340 softirqs.CPU30.TIMER
> >>> 10729 ± 4% -14.0% 9224 ± 5% softirqs.CPU31.RCU
> >>> 125514 ± 3% +18.1% 148256 softirqs.CPU31.TIMER
> >>> 11591 ± 11% -15.1% 9843 ± 4% softirqs.CPU32.RCU
> >>> 125732 ± 3% +17.8% 148147 softirqs.CPU32.TIMER
> >>> 10831 ± 9% -11.5% 9585 softirqs.CPU33.RCU
> >>> 125542 ± 2% +18.2% 148348 softirqs.CPU33.TIMER
> >>> 125311 ± 2% +18.5% 148505 softirqs.CPU34.TIMER
> >>> 125716 ± 2% +18.6% 149149 ± 2% softirqs.CPU35.TIMER
> >>> 11879 ± 7% -17.5% 9800 ± 2% softirqs.CPU36.RCU
> >>> 126196 ± 2% +17.6% 148442 softirqs.CPU36.TIMER
> >>> 125370 ± 3% +18.9% 149030 ± 2% softirqs.CPU37.TIMER
> >>> 10732 ± 5% -8.6% 9812 ± 3% softirqs.CPU38.RCU
> >>> 125302 ± 3% +18.3% 148198 softirqs.CPU38.TIMER
> >>> 125681 ± 2% +18.0% 148250 softirqs.CPU39.TIMER
> >>> 125154 ± 3% +18.7% 148557 softirqs.CPU40.TIMER
> >>> 10777 ± 5% -9.1% 9792 softirqs.CPU41.RCU
> >>> 125468 ± 3% +18.2% 148307 softirqs.CPU41.TIMER
> >>> 10890 ± 6% -11.4% 9646 ± 3% softirqs.CPU42.RCU
> >>> 125597 ± 2% +18.2% 148463 softirqs.CPU42.TIMER
> >>> 12073 ± 10% -17.6% 9950 ± 5% softirqs.CPU43.RCU
> >>> 125483 ± 3% +18.3% 148419 softirqs.CPU43.TIMER
> >>> 11421 ± 9% -15.1% 9692 softirqs.CPU44.RCU
> >>> 126380 ± 2% +17.4% 148421 softirqs.CPU44.TIMER
> >>> 11026 ± 2% -10.9% 9820 ± 2% softirqs.CPU45.RCU
> >>> 125520 ± 2% +18.4% 148623 softirqs.CPU45.TIMER
> >>> 126075 ± 2% +18.1% 148900 ± 2% softirqs.CPU46.TIMER
> >>> 11283 ± 6% -15.6% 9520 ± 2% softirqs.CPU47.RCU
> >>> 126247 ± 3% +17.3% 148139 softirqs.CPU47.TIMER
> >>> 126393 ± 2% +17.8% 148872 ± 2% softirqs.CPU48.TIMER
> >>> 126502 ± 3% +17.3% 148438 ± 2% softirqs.CPU49.TIMER
> >>> 126731 ± 3% +17.0% 148288 ± 2% softirqs.CPU50.TIMER
> >>> 126392 ± 3% +18.1% 149261 softirqs.CPU51.TIMER
> >>> 11551 ± 8% -12.0% 10164 ± 4% softirqs.CPU52.RCU
> >>> 126154 ± 2% +18.0% 148914 softirqs.CPU52.TIMER
> >>> 126360 ± 3% +17.8% 148886 softirqs.CPU53.TIMER
> >>> 126429 ± 2% +18.0% 149167 ± 2% softirqs.CPU54.TIMER
> >>> 126389 ± 3% +17.6% 148616 ± 2% softirqs.CPU55.TIMER
> >>> 126581 ± 2% +17.5% 148791 softirqs.CPU56.TIMER
> >>> 126468 ± 2% +17.5% 148639 ± 2% softirqs.CPU57.TIMER
> >>> 11579 ± 10% -13.6% 10005 ± 5% softirqs.CPU58.RCU
> >>> 126274 ± 3% +17.8% 148699 ± 2% softirqs.CPU58.TIMER
> >>> 127027 ± 3% +17.2% 148883 softirqs.CPU59.TIMER
> >>> 126169 ± 2% +17.6% 148374 ± 2% softirqs.CPU60.TIMER
> >>> 126268 ± 3% +17.4% 148286 ± 2% softirqs.CPU61.TIMER
> >>> 127067 ± 2% +17.2% 148906 softirqs.CPU62.TIMER
> >>> 126246 ± 3% +17.5% 148313 ± 2% softirqs.CPU63.TIMER
> >>> 126246 ± 3% +17.8% 148669 softirqs.CPU64.TIMER
> >>> 126183 ± 3% +17.9% 148765 softirqs.CPU65.TIMER
> >>> 127316 ± 3% +15.9% 147552 ± 3% softirqs.CPU66.TIMER
> >>> 10670 ± 3% -10.7% 9527 ± 5% softirqs.CPU68.RCU
> >>> 126399 ± 2% +17.9% 149033 softirqs.CPU68.TIMER
> >>> 126107 ± 3% +17.5% 148215 ± 2% softirqs.CPU69.TIMER
> >>> 9954 ± 2% -16.8% 8281 ± 18% softirqs.CPU7.SCHED
> >>> 126173 ± 3% +18.0% 148882 softirqs.CPU70.TIMER
> >>> 126036 ± 3% +18.0% 148668 ± 2% softirqs.CPU71.TIMER
> >>> 126352 +17.8% 148846 softirqs.CPU72.TIMER
> >>> 126750 +17.2% 148580 softirqs.CPU73.TIMER
> >>> 126785 +16.6% 147776 softirqs.CPU74.TIMER
> >>> 126495 +17.1% 148078 softirqs.CPU75.TIMER
> >>> 126693 +16.7% 147877 softirqs.CPU76.TIMER
> >>> 126324 +17.6% 148568 softirqs.CPU77.TIMER
> >>> 126257 +17.0% 147728 softirqs.CPU78.TIMER
> >>> 126270 +17.0% 147770 softirqs.CPU79.TIMER
> >>> 126430 +17.0% 147892 softirqs.CPU80.TIMER
> >>> 126706 +16.6% 147789 softirqs.CPU81.TIMER
> >>> 126587 +16.7% 147736 softirqs.CPU82.TIMER
> >>> 126506 +16.8% 147798 softirqs.CPU83.TIMER
> >>> 126416 +17.0% 147883 softirqs.CPU84.TIMER
> >>> 126804 +16.6% 147835 softirqs.CPU85.TIMER
> >>> 126486 +16.7% 147616 softirqs.CPU86.TIMER
> >>> 126124 +17.0% 147609 softirqs.CPU87.TIMER
> >>> 126277 +17.0% 147748 softirqs.CPU88.TIMER
> >>> 126200 +17.0% 147705 softirqs.CPU89.TIMER
> >>> 126129 +17.0% 147625 softirqs.CPU90.TIMER
> >>> 126483 +17.5% 148664 softirqs.CPU91.TIMER
> >>> 126259 +17.0% 147750 softirqs.CPU92.TIMER
> >>> 126441 +16.7% 147576 softirqs.CPU93.TIMER
> >>> 126443 +16.9% 147792 softirqs.CPU94.TIMER
> >>> 126313 +17.2% 148053 softirqs.CPU95.TIMER
> >>> 9817 ± 3% -7.5% 9082 ± 4% softirqs.CPU96.SCHED
> >>> 125997 ± 2% +14.8% 144591 ± 3% softirqs.CPU96.TIMER
> >>> 125068 ± 2% +16.3% 145409 ± 2% softirqs.CPU97.TIMER
> >>> 124998 ± 2% +16.0% 144976 ± 2% softirqs.CPU98.TIMER
> >>> 125398 ± 2% +15.6% 144957 ± 2% softirqs.CPU99.TIMER
> >>> 24192932 +17.0% 28301200 softirqs.TIMER
> >>> 417.50 ± 21% +1314.2% 5904 ±130% interrupts.39:PCI-MSI.524290-edge.eth0-TxRx-1
> >>> 619.50 +12.3% 696.00 interrupts.9:IO-APIC.9-fasteoi.acpi
> >>> 71113144 -21.9% 55559510 ± 2% interrupts.CAL:Function_call_interrupts
> >>> 369377 ± 4% -22.9% 284872 ± 5% interrupts.CPU0.CAL:Function_call_interrupts
> >>> 986.50 ± 2% +13.0% 1114 ± 3% interrupts.CPU0.RES:Rescheduling_interrupts
> >>> 508479 ± 3% -17.3% 420668 ± 7% interrupts.CPU0.TLB:TLB_shootdowns
> >>> 619.50 +12.3% 696.00 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
> >>> 370591 ± 3% -22.4% 287413 ± 3% interrupts.CPU1.CAL:Function_call_interrupts
> >>> 508307 ± 3% -16.3% 425392 ± 3% interrupts.CPU1.TLB:TLB_shootdowns
> >>> 369586 ± 2% -19.7% 296647 interrupts.CPU10.CAL:Function_call_interrupts
> >>> 511649 ± 2% -13.7% 441343 interrupts.CPU10.TLB:TLB_shootdowns
> >>> 364792 ± 2% -17.9% 299397 interrupts.CPU100.CAL:Function_call_interrupts
> >>> 275.00 ± 6% -15.7% 231.75 ± 9% interrupts.CPU100.RES:Rescheduling_interrupts
> >>> 502343 ± 2% -11.1% 446631 interrupts.CPU100.TLB:TLB_shootdowns
> >>> 375995 ± 2% -25.4% 280306 ± 5% interrupts.CPU101.CAL:Function_call_interrupts
> >>> 519023 ± 2% -19.2% 419534 ± 5% interrupts.CPU101.TLB:TLB_shootdowns
> >>> 366635 -20.2% 292570 ± 3% interrupts.CPU102.CAL:Function_call_interrupts
> >>> 505758 ± 2% -13.8% 436064 ± 3% interrupts.CPU102.TLB:TLB_shootdowns
> >>> 366109 ± 2% -20.4% 291575 interrupts.CPU103.CAL:Function_call_interrupts
> >>> 291.75 ± 8% -16.2% 244.50 ± 9% interrupts.CPU103.RES:Rescheduling_interrupts
> >>> 505095 -14.5% 431782 ± 2% interrupts.CPU103.TLB:TLB_shootdowns
> >>> 378387 -20.1% 302406 ± 3% interrupts.CPU104.CAL:Function_call_interrupts
> >>> 523369 ± 2% -13.3% 453831 ± 3% interrupts.CPU104.TLB:TLB_shootdowns
> >>> 377206 -23.5% 288662 ± 4% interrupts.CPU105.CAL:Function_call_interrupts
> >>> 520940 -18.1% 426423 ± 5% interrupts.CPU105.TLB:TLB_shootdowns
> >>> 367169 ± 2% -19.6% 295214 ± 3% interrupts.CPU106.CAL:Function_call_interrupts
> >>> 506686 ± 2% -14.2% 434917 ± 5% interrupts.CPU106.TLB:TLB_shootdowns
> >>> 376287 -22.0% 293509 ± 2% interrupts.CPU107.CAL:Function_call_interrupts
> >>> 524641 -16.7% 437050 ± 4% interrupts.CPU107.TLB:TLB_shootdowns
> >>> 370420 ± 5% -21.5% 290883 ± 3% interrupts.CPU108.CAL:Function_call_interrupts
> >>> 508999 ± 5% -14.8% 433526 ± 3% interrupts.CPU108.TLB:TLB_shootdowns
> >>> 371372 -21.3% 292363 ± 2% interrupts.CPU109.CAL:Function_call_interrupts
> >>> 512488 -16.2% 429226 ± 3% interrupts.CPU109.TLB:TLB_shootdowns
> >>> 417.50 ± 21% +1314.2% 5904 ±130% interrupts.CPU11.39:PCI-MSI.524290-edge.eth0-TxRx-1
> >>> 380231 -25.5% 283335 ± 8% interrupts.CPU11.CAL:Function_call_interrupts
> >>> 524351 -19.2% 423812 ± 9% interrupts.CPU11.TLB:TLB_shootdowns
> >>> 374701 -22.5% 290484 ± 2% interrupts.CPU110.CAL:Function_call_interrupts
> >>> 520894 -16.4% 435619 ± 2% interrupts.CPU110.TLB:TLB_shootdowns
> >>> 363008 -20.1% 289875 ± 2% interrupts.CPU111.CAL:Function_call_interrupts
> >>> 500069 -14.1% 429618 ± 3% interrupts.CPU111.TLB:TLB_shootdowns
> >>> 376991 -23.4% 288754 interrupts.CPU112.CAL:Function_call_interrupts
> >>> 250.25 ± 6% -14.5% 214.00 ± 9% interrupts.CPU112.RES:Rescheduling_interrupts
> >>> 521717 -18.6% 424462 ± 2% interrupts.CPU112.TLB:TLB_shootdowns
> >>> 368451 ± 2% -18.8% 299167 ± 2% interrupts.CPU113.CAL:Function_call_interrupts
> >>> 258.50 ± 10% -16.8% 215.00 ± 11% interrupts.CPU113.RES:Rescheduling_interrupts
> >>> 506084 ± 2% -12.1% 444853 ± 2% interrupts.CPU113.TLB:TLB_shootdowns
> >>> 362405 ± 4% -18.2% 296450 ± 2% interrupts.CPU114.CAL:Function_call_interrupts
> >>> 499481 ± 4% -11.8% 440751 ± 2% interrupts.CPU114.TLB:TLB_shootdowns
> >>> 355262 ± 6% -17.3% 293764 ± 4% interrupts.CPU115.CAL:Function_call_interrupts
> >>> 490366 ± 6% -11.2% 435482 ± 3% interrupts.CPU115.TLB:TLB_shootdowns
> >>> 369120 ± 2% -19.7% 296271 ± 3% interrupts.CPU116.CAL:Function_call_interrupts
> >>> 510298 ± 2% -13.6% 441018 ± 3% interrupts.CPU116.TLB:TLB_shootdowns
> >>> 369518 -20.8% 292554 interrupts.CPU117.CAL:Function_call_interrupts
> >>> 256.75 ± 9% -16.7% 214.00 ± 6% interrupts.CPU117.RES:Rescheduling_interrupts
> >>> 510370 ± 2% -15.0% 433767 ± 2% interrupts.CPU117.TLB:TLB_shootdowns
> >>> 378076 -21.6% 296311 ± 2% interrupts.CPU118.CAL:Function_call_interrupts
> >>> 522745 ± 2% -15.5% 441877 ± 3% interrupts.CPU118.TLB:TLB_shootdowns
> >>> 366989 ± 3% -20.0% 293467 ± 3% interrupts.CPU119.CAL:Function_call_interrupts
> >>> 505645 ± 4% -13.6% 436902 ± 3% interrupts.CPU119.TLB:TLB_shootdowns
> >>> 368217 ± 2% -20.3% 293404 ± 4% interrupts.CPU12.CAL:Function_call_interrupts
> >>> 506086 ± 2% -14.3% 433806 ± 3% interrupts.CPU12.TLB:TLB_shootdowns
> >>> 367742 -24.7% 276964 ± 3% interrupts.CPU120.CAL:Function_call_interrupts
> >>> 504287 ± 2% -18.1% 413055 ± 4% interrupts.CPU120.TLB:TLB_shootdowns
> >>> 371354 -26.3% 273645 ± 6% interrupts.CPU121.CAL:Function_call_interrupts
> >>> 512850 -20.5% 407564 ± 8% interrupts.CPU121.TLB:TLB_shootdowns
> >>> 367208 ± 3% -23.3% 281613 ± 4% interrupts.CPU122.CAL:Function_call_interrupts
> >>> 511545 ± 3% -17.6% 421393 ± 5% interrupts.CPU122.TLB:TLB_shootdowns
> >>> 374605 ± 2% -24.2% 284095 ± 2% interrupts.CPU123.CAL:Function_call_interrupts
> >>> 520564 ± 2% -18.6% 423854 ± 2% interrupts.CPU123.TLB:TLB_shootdowns
> >>> 373097 ± 3% -24.2% 282855 ± 2% interrupts.CPU124.CAL:Function_call_interrupts
> >>> 517520 ± 3% -19.4% 416877 ± 3% interrupts.CPU124.TLB:TLB_shootdowns
> >>> 367409 ± 4% -22.9% 283197 ± 3% interrupts.CPU125.CAL:Function_call_interrupts
> >>> 506531 ± 4% -17.1% 420000 ± 4% interrupts.CPU125.TLB:TLB_shootdowns
> >>> 373157 -24.2% 282824 ± 3% interrupts.CPU126.CAL:Function_call_interrupts
> >>> 515695 -18.3% 421532 ± 6% interrupts.CPU126.TLB:TLB_shootdowns
> >>> 368591 ± 3% -22.7% 284742 ± 4% interrupts.CPU127.CAL:Function_call_interrupts
> >>> 510338 ± 3% -17.1% 423107 ± 5% interrupts.CPU127.TLB:TLB_shootdowns
> >>> 369272 ± 2% -24.2% 279922 ± 4% interrupts.CPU128.CAL:Function_call_interrupts
> >>> 507088 ± 2% -18.4% 414033 ± 5% interrupts.CPU128.TLB:TLB_shootdowns
> >>> 369036 -21.9% 288234 ± 3% interrupts.CPU129.CAL:Function_call_interrupts
> >>> 255.00 ± 4% -22.0% 199.00 ± 9% interrupts.CPU129.RES:Rescheduling_interrupts
> >>> 512701 ± 2% -16.4% 428536 ± 3% interrupts.CPU129.TLB:TLB_shootdowns
> >>> 368039 -17.8% 302649 ± 2% interrupts.CPU13.CAL:Function_call_interrupts
> >>> 505679 -10.6% 452237 ± 4% interrupts.CPU13.TLB:TLB_shootdowns
> >>> 373033 ± 3% -24.7% 281047 ± 6% interrupts.CPU130.CAL:Function_call_interrupts
> >>> 516508 ± 3% -18.6% 420401 ± 8% interrupts.CPU130.TLB:TLB_shootdowns
> >>> 377210 -29.5% 266095 ± 7% interrupts.CPU131.CAL:Function_call_interrupts
> >>> 522013 ± 2% -24.1% 396269 ± 7% interrupts.CPU131.TLB:TLB_shootdowns
> >>> 375350 ± 2% -24.8% 282429 ± 2% interrupts.CPU132.CAL:Function_call_interrupts
> >>> 5403 ± 34% +61.7% 8734 interrupts.CPU132.NMI:Non-maskable_interrupts
> >>> 5403 ± 34% +61.7% 8734 interrupts.CPU132.PMI:Performance_monitoring_interrupts
> >>> 521282 ± 2% -18.8% 423145 ± 2% interrupts.CPU132.TLB:TLB_shootdowns
> >>> 375566 ± 2% -24.0% 285465 ± 2% interrupts.CPU133.CAL:Function_call_interrupts
> >>> 521521 -18.9% 423088 ± 3% interrupts.CPU133.TLB:TLB_shootdowns
> >>> 359237 ± 3% -21.7% 281305 ± 2% interrupts.CPU134.CAL:Function_call_interrupts
> >>> 496821 ± 4% -15.4% 420130 ± 4% interrupts.CPU134.TLB:TLB_shootdowns
> >>> 372142 ± 3% -22.8% 287450 ± 6% interrupts.CPU135.CAL:Function_call_interrupts
> >>> 513252 ± 2% -15.9% 431729 ± 8% interrupts.CPU135.TLB:TLB_shootdowns
> >>> 375170 ± 4% -24.9% 281763 ± 4% interrupts.CPU136.CAL:Function_call_interrupts
> >>> 517644 ± 4% -18.8% 420503 ± 4% interrupts.CPU136.TLB:TLB_shootdowns
> >>> 371717 ± 3% -23.8% 283107 ± 4% interrupts.CPU137.CAL:Function_call_interrupts
> >>> 235.00 ± 8% -16.0% 197.50 ± 10% interrupts.CPU137.RES:Rescheduling_interrupts
> >>> 513943 ± 2% -17.9% 421855 ± 5% interrupts.CPU137.TLB:TLB_shootdowns
> >>> 365629 -23.3% 280406 ± 2% interrupts.CPU138.CAL:Function_call_interrupts
> >>> 245.50 ± 5% -18.0% 201.25 ± 7% interrupts.CPU138.RES:Rescheduling_interrupts
> >>> 508640 -18.4% 414877 ± 3% interrupts.CPU138.TLB:TLB_shootdowns
> >>> 370195 ± 3% -23.7% 282376 ± 5% interrupts.CPU139.CAL:Function_call_interrupts
> >>> 512685 ± 3% -18.1% 419670 ± 6% interrupts.CPU139.TLB:TLB_shootdowns
> >>> 374688 ± 2% -21.6% 293713 ± 2% interrupts.CPU14.CAL:Function_call_interrupts
> >>> 518450 ± 2% -15.3% 439307 ± 4% interrupts.CPU14.TLB:TLB_shootdowns
> >>> 382988 ± 2% -25.2% 286480 ± 2% interrupts.CPU140.CAL:Function_call_interrupts
> >>> 531420 ± 2% -20.2% 423967 ± 3% interrupts.CPU140.TLB:TLB_shootdowns
> >>> 375310 ± 3% -26.0% 277611 interrupts.CPU141.CAL:Function_call_interrupts
> >>> 518271 ± 4% -20.4% 412622 ± 2% interrupts.CPU141.TLB:TLB_shootdowns
> >>> 360773 ± 5% -22.0% 281337 ± 4% interrupts.CPU142.CAL:Function_call_interrupts
> >>> 223.75 ± 6% -17.0% 185.75 ± 9% interrupts.CPU142.RES:Rescheduling_interrupts
> >>> 498689 ± 6% -15.9% 419304 ± 5% interrupts.CPU142.TLB:TLB_shootdowns
> >>> 375038 ± 3% -25.7% 278620 ± 4% interrupts.CPU143.CAL:Function_call_interrupts
> >>> 519515 ± 3% -20.5% 412967 ± 7% interrupts.CPU143.TLB:TLB_shootdowns
> >>> 358944 ± 2% -23.6% 274151 ± 4% interrupts.CPU144.CAL:Function_call_interrupts
> >>> 495826 ± 2% -17.7% 407818 ± 4% interrupts.CPU144.TLB:TLB_shootdowns
> >>> 370318 ± 4% -19.1% 299670 ± 3% interrupts.CPU145.CAL:Function_call_interrupts
> >>> 515815 ± 3% -12.9% 449088 ± 5% interrupts.CPU145.TLB:TLB_shootdowns
> >>> 354835 ± 3% -14.8% 302385 ± 3% interrupts.CPU146.CAL:Function_call_interrupts
> >>> 254.25 ± 15% -19.5% 204.75 ± 16% interrupts.CPU146.RES:Rescheduling_interrupts
> >>> 364397 -18.9% 295654 ± 2% interrupts.CPU147.CAL:Function_call_interrupts
> >>> 503513 ± 2% -12.5% 440552 ± 3% interrupts.CPU147.TLB:TLB_shootdowns
> >>> 374313 ± 2% -22.6% 289796 ± 2% interrupts.CPU148.CAL:Function_call_interrupts
> >>> 521774 -16.7% 434507 ± 3% interrupts.CPU148.TLB:TLB_shootdowns
> >>> 369112 ± 2% -19.7% 296457 interrupts.CPU149.CAL:Function_call_interrupts
> >>> 514232 ± 3% -13.8% 443222 interrupts.CPU149.TLB:TLB_shootdowns
> >>> 380902 -26.3% 280545 ± 5% interrupts.CPU15.CAL:Function_call_interrupts
> >>> 527143 -21.7% 412722 ± 6% interrupts.CPU15.TLB:TLB_shootdowns
> >>> 363449 -17.9% 298256 ± 3% interrupts.CPU150.CAL:Function_call_interrupts
> >>> 507138 -13.0% 441094 ± 3% interrupts.CPU150.TLB:TLB_shootdowns
> >>> 365922 ± 2% -20.9% 289342 ± 3% interrupts.CPU151.CAL:Function_call_interrupts
> >>> 509900 -14.9% 433869 ± 5% interrupts.CPU151.TLB:TLB_shootdowns
> >>> 352838 ± 2% -17.1% 292581 ± 2% interrupts.CPU152.CAL:Function_call_interrupts
> >>> 490671 ± 4% -11.5% 434059 ± 2% interrupts.CPU152.TLB:TLB_shootdowns
> >>> 362115 ± 4% -16.8% 301323 ± 5% interrupts.CPU153.CAL:Function_call_interrupts
> >>> 502187 ± 3% -10.9% 447427 ± 6% interrupts.CPU153.TLB:TLB_shootdowns
> >>> 367682 -20.2% 293543 interrupts.CPU154.CAL:Function_call_interrupts
> >>> 511791 -14.5% 437589 interrupts.CPU154.TLB:TLB_shootdowns
> >>> 361264 -19.2% 291966 ± 4% interrupts.CPU155.CAL:Function_call_interrupts
> >>> 504978 -13.6% 436311 ± 5% interrupts.CPU155.TLB:TLB_shootdowns
> >>> 370992 ± 2% -21.2% 292378 ± 2% interrupts.CPU156.CAL:Function_call_interrupts
> >>> 516001 -15.9% 434122 ± 3% interrupts.CPU156.TLB:TLB_shootdowns
> >>> 367721 ± 3% -20.9% 290763 ± 2% interrupts.CPU157.CAL:Function_call_interrupts
> >>> 510444 ± 2% -15.3% 432216 ± 2% interrupts.CPU157.TLB:TLB_shootdowns
> >>> 368030 -21.1% 290517 ± 2% interrupts.CPU158.CAL:Function_call_interrupts
> >>> 513843 ± 2% -15.6% 433674 ± 2% interrupts.CPU158.TLB:TLB_shootdowns
> >>> 356635 ± 5% -17.1% 295791 ± 5% interrupts.CPU159.CAL:Function_call_interrupts
> >>> 368199 ± 2% -20.0% 294421 interrupts.CPU16.CAL:Function_call_interrupts
> >>> 504670 ± 3% -13.6% 436186 interrupts.CPU16.TLB:TLB_shootdowns
> >>> 360600 ± 2% -16.2% 302201 ± 5% interrupts.CPU160.CAL:Function_call_interrupts
> >>> 370517 -21.6% 290617 ± 7% interrupts.CPU161.CAL:Function_call_interrupts
> >>> 514137 -15.7% 433491 ± 7% interrupts.CPU161.TLB:TLB_shootdowns
> >>> 358723 -16.5% 299400 ± 4% interrupts.CPU162.CAL:Function_call_interrupts
> >>> 357626 -18.5% 291454 ± 3% interrupts.CPU163.CAL:Function_call_interrupts
> >>> 498258 ± 2% -12.9% 433822 ± 3% interrupts.CPU163.TLB:TLB_shootdowns
> >>> 361620 -19.7% 290484 ± 5% interrupts.CPU164.CAL:Function_call_interrupts
> >>> 504707 -13.8% 434872 ± 5% interrupts.CPU164.TLB:TLB_shootdowns
> >>> 365801 ± 3% -19.7% 293690 ± 2% interrupts.CPU165.CAL:Function_call_interrupts
> >>> 507862 ± 3% -14.0% 436997 ± 2% interrupts.CPU165.TLB:TLB_shootdowns
> >>> 356842 ± 3% -17.6% 293947 ± 2% interrupts.CPU166.CAL:Function_call_interrupts
> >>> 368990 -19.3% 297901 ± 3% interrupts.CPU167.CAL:Function_call_interrupts
> >>> 513493 -14.3% 440292 ± 3% interrupts.CPU167.TLB:TLB_shootdowns
> >>> 355231 ± 3% -23.4% 272174 interrupts.CPU168.CAL:Function_call_interrupts
> >>> 486211 ± 3% -17.3% 401985 interrupts.CPU168.TLB:TLB_shootdowns
> >>> 373731 -22.4% 290148 ± 4% interrupts.CPU169.CAL:Function_call_interrupts
> >>> 515003 -16.1% 432294 ± 5% interrupts.CPU169.TLB:TLB_shootdowns
> >>> 365385 ± 3% -19.7% 293321 ± 4% interrupts.CPU17.CAL:Function_call_interrupts
> >>> 501901 ± 2% -13.2% 435881 ± 5% interrupts.CPU17.TLB:TLB_shootdowns
> >>> 366029 -24.0% 278021 ± 8% interrupts.CPU170.CAL:Function_call_interrupts
> >>> 504071 -18.1% 412947 ± 8% interrupts.CPU170.TLB:TLB_shootdowns
> >>> 375332 -24.5% 283300 ± 5% interrupts.CPU171.CAL:Function_call_interrupts
> >>> 520391 -19.5% 419002 ± 6% interrupts.CPU171.TLB:TLB_shootdowns
> >>> 370471 ± 2% -20.3% 295419 ± 4% interrupts.CPU172.CAL:Function_call_interrupts
> >>> 507254 ± 2% -12.5% 444075 ± 5% interrupts.CPU172.TLB:TLB_shootdowns
> >>> 373505 ± 4% -21.3% 294120 ± 2% interrupts.CPU173.CAL:Function_call_interrupts
> >>> 513476 ± 5% -14.3% 440170 ± 2% interrupts.CPU173.TLB:TLB_shootdowns
> >>> 368997 ± 3% -21.8% 288377 ± 3% interrupts.CPU174.CAL:Function_call_interrupts
> >>> 505469 ± 3% -14.9% 430016 ± 2% interrupts.CPU174.TLB:TLB_shootdowns
> >>> 364575 ± 3% -22.2% 283750 ± 2% interrupts.CPU175.CAL:Function_call_interrupts
> >>> 502405 ± 2% -15.9% 422772 ± 2% interrupts.CPU175.TLB:TLB_shootdowns
> >>> 372828 ± 2% -22.7% 288143 ± 5% interrupts.CPU176.CAL:Function_call_interrupts
> >>> 512388 -16.6% 427351 ± 6% interrupts.CPU176.TLB:TLB_shootdowns
> >>> 359021 ± 5% -19.6% 288812 ± 5% interrupts.CPU177.CAL:Function_call_interrupts
> >>> 493471 ± 6% -12.7% 430731 ± 5% interrupts.CPU177.TLB:TLB_shootdowns
> >>> 373258 ± 2% -21.7% 292215 ± 4% interrupts.CPU178.CAL:Function_call_interrupts
> >>> 515211 -15.2% 436763 ± 4% interrupts.CPU178.TLB:TLB_shootdowns
> >>> 365487 ± 2% -23.2% 280604 ± 5% interrupts.CPU179.CAL:Function_call_interrupts
> >>> 501964 ± 3% -16.3% 420218 ± 4% interrupts.CPU179.TLB:TLB_shootdowns
> >>> 372708 -21.1% 294057 ± 3% interrupts.CPU18.CAL:Function_call_interrupts
> >>> 514254 -15.1% 436654 ± 3% interrupts.CPU18.TLB:TLB_shootdowns
> >>> 373380 ± 2% -24.3% 282767 ± 4% interrupts.CPU180.CAL:Function_call_interrupts
> >>> 512251 ± 2% -17.9% 420608 ± 4% interrupts.CPU180.TLB:TLB_shootdowns
> >>> 370172 ± 2% -21.5% 290690 ± 4% interrupts.CPU181.CAL:Function_call_interrupts
> >>> 512505 ± 2% -15.3% 434083 ± 3% interrupts.CPU181.TLB:TLB_shootdowns
> >>> 366455 ± 4% -19.9% 293565 ± 4% interrupts.CPU182.CAL:Function_call_interrupts
> >>> 504899 ± 4% -14.3% 432932 ± 4% interrupts.CPU182.TLB:TLB_shootdowns
> >>> 358791 ± 4% -17.3% 296835 ± 3% interrupts.CPU183.CAL:Function_call_interrupts
> >>> 218.50 ± 6% -15.2% 185.25 ± 16% interrupts.CPU183.RES:Rescheduling_interrupts
> >>> 370421 -21.0% 292527 ± 4% interrupts.CPU184.CAL:Function_call_interrupts
> >>> 512081 ± 2% -13.9% 440775 ± 4% interrupts.CPU184.TLB:TLB_shootdowns
> >>> 380469 -23.8% 289932 ± 3% interrupts.CPU185.CAL:Function_call_interrupts
> >>> 524789 -17.5% 433092 ± 3% interrupts.CPU185.TLB:TLB_shootdowns
> >>> 363905 -21.4% 285913 ± 3% interrupts.CPU186.CAL:Function_call_interrupts
> >>> 501044 ± 2% -14.9% 426556 ± 2% interrupts.CPU186.TLB:TLB_shootdowns
> >>> 357395 ± 2% -19.0% 289407 ± 4% interrupts.CPU187.CAL:Function_call_interrupts
> >>> 490749 ± 3% -12.6% 428901 ± 4% interrupts.CPU187.TLB:TLB_shootdowns
> >>> 372403 ± 3% -22.6% 288343 ± 4% interrupts.CPU188.CAL:Function_call_interrupts
> >>> 510433 ± 3% -16.6% 425729 ± 4% interrupts.CPU188.TLB:TLB_shootdowns
> >>> 358028 ± 3% -20.2% 285725 ± 4% interrupts.CPU189.CAL:Function_call_interrupts
> >>> 493248 ± 3% -14.1% 423910 ± 4% interrupts.CPU189.TLB:TLB_shootdowns
> >>> 361091 ± 3% -23.5% 276331 ± 4% interrupts.CPU19.CAL:Function_call_interrupts
> >>> 497677 ± 3% -17.7% 409616 ± 5% interrupts.CPU19.TLB:TLB_shootdowns
> >>> 376111 -23.3% 288565 ± 4% interrupts.CPU190.CAL:Function_call_interrupts
> >>> 517796 -17.1% 429002 ± 5% interrupts.CPU190.TLB:TLB_shootdowns
> >>> 349911 ± 4% -19.1% 283158 ± 3% interrupts.CPU191.CAL:Function_call_interrupts
> >>> 481433 ± 4% -12.1% 423011 ± 3% interrupts.CPU191.TLB:TLB_shootdowns
> >>> 366712 ± 2% -17.9% 301212 ± 4% interrupts.CPU2.CAL:Function_call_interrupts
> >>> 373034 -20.8% 295536 ± 2% interrupts.CPU20.CAL:Function_call_interrupts
> >>> 512958 -15.3% 434477 ± 3% interrupts.CPU20.TLB:TLB_shootdowns
> >>> 369000 ± 2% -19.9% 295594 ± 2% interrupts.CPU21.CAL:Function_call_interrupts
> >>> 507648 ± 2% -13.3% 440039 ± 2% interrupts.CPU21.TLB:TLB_shootdowns
> >>> 370306 -21.5% 290714 ± 2% interrupts.CPU22.CAL:Function_call_interrupts
> >>> 509975 -16.6% 425154 ± 3% interrupts.CPU22.TLB:TLB_shootdowns
> >>> 372626 -19.7% 299172 interrupts.CPU23.CAL:Function_call_interrupts
> >>> 511944 -14.3% 438941 ± 2% interrupts.CPU23.TLB:TLB_shootdowns
> >>> 371118 -22.9% 286120 ± 3% interrupts.CPU24.CAL:Function_call_interrupts
> >>> 512301 -16.9% 425614 ± 4% interrupts.CPU24.TLB:TLB_shootdowns
> >>> 378734 -24.9% 284364 ± 3% interrupts.CPU25.CAL:Function_call_interrupts
> >>> 525281 -19.5% 422978 ± 4% interrupts.CPU25.TLB:TLB_shootdowns
> >>> 370795 ± 5% -23.5% 283485 ± 4% interrupts.CPU26.CAL:Function_call_interrupts
> >>> 512627 ± 5% -18.3% 418656 ± 5% interrupts.CPU26.TLB:TLB_shootdowns
> >>> 374616 -23.7% 285934 ± 3% interrupts.CPU27.CAL:Function_call_interrupts
> >>> 515058 -18.4% 420182 ± 4% interrupts.CPU27.TLB:TLB_shootdowns
> >>> 378059 -24.6% 285008 ± 2% interrupts.CPU28.CAL:Function_call_interrupts
> >>> 527534 -19.4% 425042 ± 2% interrupts.CPU28.TLB:TLB_shootdowns
> >>> 377578 ± 2% -24.9% 283734 ± 6% interrupts.CPU29.CAL:Function_call_interrupts
> >>> 523649 ± 2% -19.1% 423741 ± 7% interrupts.CPU29.TLB:TLB_shootdowns
> >>> 375298 -22.0% 292752 ± 2% interrupts.CPU3.CAL:Function_call_interrupts
> >>> 514849 -16.4% 430172 ± 3% interrupts.CPU3.TLB:TLB_shootdowns
> >>> 375150 ± 2% -22.7% 290143 ± 3% interrupts.CPU30.CAL:Function_call_interrupts
> >>> 521761 ± 2% -16.9% 433680 ± 4% interrupts.CPU30.TLB:TLB_shootdowns
> >>> 370010 ± 5% -22.6% 286365 ± 4% interrupts.CPU31.CAL:Function_call_interrupts
> >>> 509962 ± 5% -16.3% 426983 ± 5% interrupts.CPU31.TLB:TLB_shootdowns
> >>> 363035 ± 4% -21.6% 284521 ± 5% interrupts.CPU32.CAL:Function_call_interrupts
> >>> 501495 ± 4% -15.9% 421831 ± 5% interrupts.CPU32.TLB:TLB_shootdowns
> >>> 372877 ± 3% -24.5% 281642 ± 4% interrupts.CPU33.CAL:Function_call_interrupts
> >>> 513175 ± 2% -18.6% 417560 ± 4% interrupts.CPU33.TLB:TLB_shootdowns
> >>> 375888 ± 3% -23.4% 287791 ± 4% interrupts.CPU34.CAL:Function_call_interrupts
> >>> 521614 ± 3% -17.7% 429046 ± 5% interrupts.CPU34.TLB:TLB_shootdowns
> >>> 363946 ± 2% -20.8% 288121 ± 4% interrupts.CPU35.CAL:Function_call_interrupts
> >>> 505661 ± 2% -15.0% 429936 ± 5% interrupts.CPU35.TLB:TLB_shootdowns
> >>> 370383 ± 4% -24.7% 278947 ± 4% interrupts.CPU36.CAL:Function_call_interrupts
> >>> 514523 ± 3% -19.0% 416639 ± 4% interrupts.CPU36.TLB:TLB_shootdowns
> >>> 370305 -25.3% 276484 ± 2% interrupts.CPU37.CAL:Function_call_interrupts
> >>> 511154 -19.5% 411329 ± 3% interrupts.CPU37.TLB:TLB_shootdowns
> >>> 378332 -25.2% 282855 ± 4% interrupts.CPU38.CAL:Function_call_interrupts
> >>> 523791 -19.7% 420531 ± 5% interrupts.CPU38.TLB:TLB_shootdowns
> >>> 380965 -25.8% 282709 ± 5% interrupts.CPU39.CAL:Function_call_interrupts
> >>> 379.50 ± 2% +11.4% 422.75 ± 4% interrupts.CPU39.RES:Rescheduling_interrupts
> >>> 531148 -20.0% 424896 ± 6% interrupts.CPU39.TLB:TLB_shootdowns
> >>> 363741 ± 3% -18.4% 296646 ± 2% interrupts.CPU4.CAL:Function_call_interrupts
> >>> 500884 ± 4% -12.4% 438774 ± 3% interrupts.CPU4.TLB:TLB_shootdowns
> >>> 374733 ± 2% -25.1% 280819 ± 8% interrupts.CPU40.CAL:Function_call_interrupts
> >>> 519619 ± 3% -18.7% 422706 ± 8% interrupts.CPU40.TLB:TLB_shootdowns
> >>> 372981 ± 2% -24.5% 281487 ± 4% interrupts.CPU41.CAL:Function_call_interrupts
> >>> 515145 ± 3% -19.2% 416012 ± 4% interrupts.CPU41.TLB:TLB_shootdowns
> >>> 380960 -25.3% 284391 ± 3% interrupts.CPU42.CAL:Function_call_interrupts
> >>> 527237 -20.1% 421382 ± 5% interrupts.CPU42.TLB:TLB_shootdowns
> >>> 377520 -27.5% 273752 ± 5% interrupts.CPU43.CAL:Function_call_interrupts
> >>> 519392 -21.6% 406997 ± 7% interrupts.CPU43.TLB:TLB_shootdowns
> >>> 376458 ± 2% -23.6% 287676 ± 4% interrupts.CPU44.CAL:Function_call_interrupts
> >>> 519587 ± 2% -17.5% 428723 ± 5% interrupts.CPU44.TLB:TLB_shootdowns
> >>> 369989 ± 3% -24.6% 278974 interrupts.CPU45.CAL:Function_call_interrupts
> >>> 511621 ± 3% -19.3% 413017 ± 2% interrupts.CPU45.TLB:TLB_shootdowns
> >>> 377794 -24.5% 285412 ± 3% interrupts.CPU46.CAL:Function_call_interrupts
> >>> 522705 ± 2% -18.2% 427565 ± 4% interrupts.CPU46.TLB:TLB_shootdowns
> >>> 366979 ± 4% -21.8% 286837 ± 3% interrupts.CPU47.CAL:Function_call_interrupts
> >>> 507190 ± 4% -15.9% 426315 ± 4% interrupts.CPU47.TLB:TLB_shootdowns
> >>> 363602 ± 2% -23.0% 280084 ± 5% interrupts.CPU48.CAL:Function_call_interrupts
> >>> 505178 -18.3% 412953 ± 5% interrupts.CPU48.TLB:TLB_shootdowns
> >>> 368897 ± 3% -19.2% 298096 ± 4% interrupts.CPU49.CAL:Function_call_interrupts
> >>> 514006 ± 3% -13.2% 446112 ± 5% interrupts.CPU49.TLB:TLB_shootdowns
> >>> 379710 -28.1% 272907 ± 5% interrupts.CPU5.CAL:Function_call_interrupts
> >>> 524347 -23.5% 400998 ± 4% interrupts.CPU5.TLB:TLB_shootdowns
> >>> 364770 -20.0% 291850 interrupts.CPU50.CAL:Function_call_interrupts
> >>> 508585 ± 2% -13.9% 437843 interrupts.CPU50.TLB:TLB_shootdowns
> >>> 376860 -21.0% 297766 ± 3% interrupts.CPU51.CAL:Function_call_interrupts
> >>> 528439 -15.5% 446617 ± 4% interrupts.CPU51.TLB:TLB_shootdowns
> >>> 366276 -22.8% 282721 ± 5% interrupts.CPU52.CAL:Function_call_interrupts
> >>> 297.25 ± 5% +30.0% 386.50 ± 12% interrupts.CPU52.RES:Rescheduling_interrupts
> >>> 506385 -17.0% 420426 ± 6% interrupts.CPU52.TLB:TLB_shootdowns
> >>> 372344 -19.8% 298589 ± 3% interrupts.CPU53.CAL:Function_call_interrupts
> >>> 519959 -14.5% 444559 ± 4% interrupts.CPU53.TLB:TLB_shootdowns
> >>> 379718 -24.1% 288265 ± 3% interrupts.CPU54.CAL:Function_call_interrupts
> >>> 528031 -18.8% 428752 ± 4% interrupts.CPU54.TLB:TLB_shootdowns
> >>> 379550 -26.3% 279735 ± 10% interrupts.CPU55.CAL:Function_call_interrupts
> >>> 528569 ± 2% -21.7% 414007 ± 11% interrupts.CPU55.TLB:TLB_shootdowns
> >>> 377258 ± 2% -21.5% 295996 ± 2% interrupts.CPU56.CAL:Function_call_interrupts
> >>> 526667 ± 2% -16.3% 441035 ± 3% interrupts.CPU56.TLB:TLB_shootdowns
> >>> 354012 ± 4% -18.7% 287867 ± 5% interrupts.CPU57.CAL:Function_call_interrupts
> >>> 492238 ± 4% -12.1% 432431 ± 6% interrupts.CPU57.TLB:TLB_shootdowns
> >>> 377433 ± 2% -21.8% 295201 ± 3% interrupts.CPU58.CAL:Function_call_interrupts
> >>> 527793 -16.9% 438796 ± 3% interrupts.CPU58.TLB:TLB_shootdowns
> >>> 372673 ± 2% -20.4% 296501 ± 6% interrupts.CPU59.CAL:Function_call_interrupts
> >>> 378764 -20.9% 299560 ± 2% interrupts.CPU6.CAL:Function_call_interrupts
> >>> 521987 -14.8% 444983 ± 3% interrupts.CPU6.TLB:TLB_shootdowns
> >>> 379639 ± 2% -21.6% 297666 ± 3% interrupts.CPU60.CAL:Function_call_interrupts
> >>> 532216 -16.4% 444851 ± 4% interrupts.CPU60.TLB:TLB_shootdowns
> >>> 369744 ± 3% -19.7% 296756 ± 4% interrupts.CPU61.CAL:Function_call_interrupts
> >>> 514500 ± 3% -13.5% 445057 ± 5% interrupts.CPU61.TLB:TLB_shootdowns
> >>> 369746 ± 2% -18.7% 300725 interrupts.CPU62.CAL:Function_call_interrupts
> >>> 515909 ± 3% -12.0% 453788 ± 2% interrupts.CPU62.TLB:TLB_shootdowns
> >>> 374140 -22.4% 290449 ± 6% interrupts.CPU63.CAL:Function_call_interrupts
> >>> 521155 -17.2% 431716 ± 6% interrupts.CPU63.TLB:TLB_shootdowns
> >>> 368689 -21.7% 288609 ± 4% interrupts.CPU64.CAL:Function_call_interrupts
> >>> 511522 -16.2% 428713 ± 5% interrupts.CPU64.TLB:TLB_shootdowns
> >>> 373211 -21.1% 294536 ± 3% interrupts.CPU65.CAL:Function_call_interrupts
> >>> 518451 -15.8% 436597 ± 4% interrupts.CPU65.TLB:TLB_shootdowns
> >>> 364982 ± 4% -19.8% 292596 ± 5% interrupts.CPU66.CAL:Function_call_interrupts
> >>> 507898 ± 5% -13.7% 438084 ± 6% interrupts.CPU66.TLB:TLB_shootdowns
> >>> 367480 ± 2% -19.5% 295682 ± 5% interrupts.CPU67.CAL:Function_call_interrupts
> >>> 511792 ± 2% -13.8% 441272 ± 6% interrupts.CPU67.TLB:TLB_shootdowns
> >>> 371986 -21.9% 290419 ± 3% interrupts.CPU68.CAL:Function_call_interrupts
> >>> 519142 ± 2% -16.4% 434174 ± 3% interrupts.CPU68.TLB:TLB_shootdowns
> >>> 379384 ± 2% -21.5% 297668 ± 4% interrupts.CPU69.CAL:Function_call_interrupts
> >>> 530242 ± 3% -16.1% 444670 ± 5% interrupts.CPU69.TLB:TLB_shootdowns
> >>> 365059 ± 2% -18.2% 298651 ± 2% interrupts.CPU7.CAL:Function_call_interrupts
> >>> 505893 ± 3% -11.9% 445643 ± 4% interrupts.CPU7.TLB:TLB_shootdowns
> >>> 371351 -22.3% 288597 ± 2% interrupts.CPU70.CAL:Function_call_interrupts
> >>> 518029 -17.0% 429867 ± 3% interrupts.CPU70.TLB:TLB_shootdowns
> >>> 370449 -20.7% 293815 ± 3% interrupts.CPU71.CAL:Function_call_interrupts
> >>> 517462 -14.2% 443882 ± 4% interrupts.CPU71.TLB:TLB_shootdowns
> >>> 365590 ± 5% -23.9% 278325 ± 5% interrupts.CPU72.CAL:Function_call_interrupts
> >>> 501835 ± 4% -18.6% 408570 ± 6% interrupts.CPU72.TLB:TLB_shootdowns
> >>> 375332 ± 3% -21.1% 296218 interrupts.CPU73.CAL:Function_call_interrupts
> >>> 519638 ± 4% -14.3% 445254 ± 2% interrupts.CPU73.TLB:TLB_shootdowns
> >>> 373354 ± 3% -23.7% 284827 ± 8% interrupts.CPU74.CAL:Function_call_interrupts
> >>> 516028 ± 3% -17.7% 424764 ± 9% interrupts.CPU74.TLB:TLB_shootdowns
> >>> 379734 -23.0% 292343 ± 3% interrupts.CPU75.CAL:Function_call_interrupts
> >>> 522571 -16.6% 435697 ± 3% interrupts.CPU75.TLB:TLB_shootdowns
> >>> 372365 ± 2% -21.8% 291084 ± 2% interrupts.CPU76.CAL:Function_call_interrupts
> >>> 514959 ± 2% -16.0% 432557 ± 2% interrupts.CPU76.TLB:TLB_shootdowns
> >>> 368731 ± 2% -21.2% 290708 ± 5% interrupts.CPU77.CAL:Function_call_interrupts
> >>> 507333 ± 2% -14.7% 432856 ± 5% interrupts.CPU77.TLB:TLB_shootdowns
> >>> 380742 -22.0% 296822 ± 3% interrupts.CPU78.CAL:Function_call_interrupts
> >>> 521680 -15.3% 441613 ± 2% interrupts.CPU78.TLB:TLB_shootdowns
> >>> 366910 ± 2% -22.7% 283595 ± 6% interrupts.CPU79.CAL:Function_call_interrupts
> >>> 505076 ± 2% -15.6% 426308 ± 5% interrupts.CPU79.TLB:TLB_shootdowns
> >>> 371622 ± 2% -20.8% 294416 ± 2% interrupts.CPU8.CAL:Function_call_interrupts
> >>> 512815 ± 3% -15.0% 435931 ± 4% interrupts.CPU8.TLB:TLB_shootdowns
> >>> 379586 -23.6% 290107 ± 5% interrupts.CPU80.CAL:Function_call_interrupts
> >>> 246.00 ± 5% +10.5% 271.75 ± 3% interrupts.CPU80.RES:Rescheduling_interrupts
> >>> 523749 -17.2% 433788 ± 5% interrupts.CPU80.TLB:TLB_shootdowns
> >>> 371407 ± 3% -21.9% 290184 ± 6% interrupts.CPU81.CAL:Function_call_interrupts
> >>> 510768 ± 4% -14.9% 434787 ± 7% interrupts.CPU81.TLB:TLB_shootdowns
> >>> 378362 -22.5% 293095 ± 2% interrupts.CPU82.CAL:Function_call_interrupts
> >>> 518649 -15.5% 438320 ± 3% interrupts.CPU82.TLB:TLB_shootdowns
> >>> 370382 ± 3% -20.3% 295235 ± 3% interrupts.CPU83.CAL:Function_call_interrupts
> >>> 510904 ± 3% -14.0% 439377 ± 2% interrupts.CPU83.TLB:TLB_shootdowns
> >>> 371998 ± 2% -22.6% 287950 ± 4% interrupts.CPU84.CAL:Function_call_interrupts
> >>> 510460 -15.7% 430514 ± 4% interrupts.CPU84.TLB:TLB_shootdowns
> >>> 378255 ± 2% -22.8% 292200 interrupts.CPU85.CAL:Function_call_interrupts
> >>> 519891 ± 2% -15.6% 438869 ± 2% interrupts.CPU85.TLB:TLB_shootdowns
> >>> 377601 ± 2% -21.7% 295607 ± 4% interrupts.CPU86.CAL:Function_call_interrupts
> >>> 521915 ± 2% -15.3% 441959 ± 3% interrupts.CPU86.TLB:TLB_shootdowns
> >>> 375062 ± 2% -23.0% 288613 ± 6% interrupts.CPU87.CAL:Function_call_interrupts
> >>> 513967 ± 2% -16.0% 431606 ± 6% interrupts.CPU87.TLB:TLB_shootdowns
> >>> 379279 ± 2% -24.8% 285288 ± 5% interrupts.CPU88.CAL:Function_call_interrupts
> >>> 521520 ± 3% -18.8% 423239 ± 5% interrupts.CPU88.TLB:TLB_shootdowns
> >>> 377013 ± 2% -21.6% 295478 ± 2% interrupts.CPU89.CAL:Function_call_interrupts
> >>> 518259 ± 3% -14.7% 441827 ± 2% interrupts.CPU89.TLB:TLB_shootdowns
> >>> 373323 -21.1% 294448 ± 2% interrupts.CPU9.CAL:Function_call_interrupts
> >>> 514977 -15.1% 437180 ± 4% interrupts.CPU9.TLB:TLB_shootdowns
> >>> 380953 -23.5% 291559 ± 2% interrupts.CPU90.CAL:Function_call_interrupts
> >>> 523870 -17.4% 432602 ± 2% interrupts.CPU90.TLB:TLB_shootdowns
> >>> 372610 ± 2% -21.3% 293401 ± 3% interrupts.CPU91.CAL:Function_call_interrupts
> >>> 510392 ± 3% -14.5% 436442 ± 2% interrupts.CPU91.TLB:TLB_shootdowns
> >>> 378437 -21.7% 296372 ± 4% interrupts.CPU92.CAL:Function_call_interrupts
> >>> 521211 -15.9% 438214 ± 4% interrupts.CPU92.TLB:TLB_shootdowns
> >>> 375086 ± 4% -22.1% 292268 ± 3% interrupts.CPU93.CAL:Function_call_interrupts
> >>> 517203 ± 5% -15.9% 434905 ± 3% interrupts.CPU93.TLB:TLB_shootdowns
> >>> 375223 -21.2% 295608 ± 2% interrupts.CPU94.CAL:Function_call_interrupts
> >>> 516539 -14.5% 441853 interrupts.CPU94.TLB:TLB_shootdowns
> >>> 378329 ± 2% -23.6% 288891 ± 3% interrupts.CPU95.CAL:Function_call_interrupts
> >>> 521697 ± 2% -17.5% 430177 ± 3% interrupts.CPU95.TLB:TLB_shootdowns
> >>> 367879 ± 4% -20.2% 293729 ± 4% interrupts.CPU96.CAL:Function_call_interrupts
> >>> 505813 ± 5% -14.1% 434328 ± 4% interrupts.CPU96.TLB:TLB_shootdowns
> >>> 358719 ± 2% -21.1% 282945 interrupts.CPU97.CAL:Function_call_interrupts
> >>> 493453 ± 2% -14.7% 420834 ± 2% interrupts.CPU97.TLB:TLB_shootdowns
> >>> 374307 -21.9% 292393 ± 4% interrupts.CPU98.CAL:Function_call_interrupts
> >>> 521876 -17.0% 433274 ± 5% interrupts.CPU98.TLB:TLB_shootdowns
> >>> 363312 ± 3% -20.1% 290174 ± 4% interrupts.CPU99.CAL:Function_call_interrupts
> >>> 502187 ± 3% -14.7% 428295 ± 3% interrupts.CPU99.TLB:TLB_shootdowns
> >>> 98335984 -15.9% 82703091 ± 2% interrupts.TLB:TLB_shootdowns
> >>>
> >>>
> >>>
> >>> ***************************************************************************************************
> >>> lkp-csl-2sp6: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
> >>> =========================================================================================
> >>> bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
> >>> 4k/gcc-9/performance/2pmem/ext4/sync/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/200s/randread/lkp-csl-2sp6/200G/fio-basic/tb/0x5002f01
> >>>
> >>> commit:
> >>> 3fbdbb91fe ("mm/swap: serialize memcg changes in pagevec_lru_move_fn")
> >>> ea4ebd4126 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>>
> >>> 3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d0
> >>> ---------------- ---------------------------
> >>> %stddev %change %stddev
> >>> \ | \
> >>> 1.08 ± 13% -0.5 0.57 ± 15% fio.latency_100us%
> >>> 28.70 ± 5% -13.0 15.65 ± 14% fio.latency_10us%
> >>> 0.03 -0.0 0.03 ± 2% fio.latency_20ms%
> >>> 3.68 ± 2% -0.9 2.80 ± 4% fio.latency_20us%
> >>> 0.53 ± 15% +0.7 1.19 ± 8% fio.latency_250us%
> >>> 0.02 ± 35% +0.1 0.08 ± 29% fio.latency_2us%
> >>> 64.64 ± 2% +12.4 77.05 ± 2% fio.latency_4us%
> >>> 1.32 ± 5% +1.3 2.61 ± 3% fio.latency_50us%
> >>> 15947 -11.4% 14121 fio.read_bw_MBps
> >>> 6336 -9.8% 5712 ± 2% fio.read_clat_90%_us
> >>> 13376 ± 3% +29.7% 17344 fio.read_clat_95%_us
> >>> 78848 ± 6% +48.7% 117248 ± 5% fio.read_clat_99%_us
> >>> 9887 +10.4% 10914 fio.read_clat_mean_us
> >>> 240004 +11.1% 266574 fio.read_clat_stddev
> >>> 4082543 -11.4% 3615227 fio.read_iops
> >>> 6.538e+09 -11.4% 5.792e+09 fio.time.file_system_inputs
> >>> 538.14 ± 3% -15.7% 453.55 ± 3% fio.time.user_time
> >>> 22798 +1.5% 23131 fio.time.voluntary_context_switches
> >>> 8.173e+08 -11.4% 7.24e+08 fio.workload
> >>> 2.77 ± 3% -15.7% 2.34 ± 3% iostat.cpu.user
> >>> 16025599 -11.5% 14178614 vmstat.io.bi
> >>> 3.804e+08 ± 3% -11.5% 3.367e+08 numa-numastat.node1.local_node
> >>> 3.804e+08 ± 3% -11.5% 3.367e+08 numa-numastat.node1.numa_hit
> >>> 0.98 ± 2% -0.1 0.84 ± 3% mpstat.cpu.all.irq%
> >>> 0.06 ± 5% -0.0 0.05 ± 5% mpstat.cpu.all.soft%
> >>> 2.80 ± 3% -0.4 2.36 ± 3% mpstat.cpu.all.usr%
> >>> 148926 ± 31% +40.4% 209149 ± 14% numa-meminfo.node0.Active
> >>> 133269 ± 39% +48.9% 198432 ± 19% numa-meminfo.node0.Active(anon)
> >>> 103443 ± 50% +63.1% 168675 ± 22% numa-meminfo.node0.AnonHugePages
> >>> 127884 ± 40% +50.8% 192787 ± 20% numa-meminfo.node0.AnonPages
> >>> 33318 ± 39% +48.9% 49608 ± 19% numa-vmstat.node0.nr_active_anon
> >>> 31967 ± 40% +50.8% 48202 ± 20% numa-vmstat.node0.nr_anon_pages
> >>> 50.00 ± 50% +64.0% 82.00 ± 22% numa-vmstat.node0.nr_anon_transparent_hugepages
> >>> 89.00 ± 5% +37.6% 122.50 ± 5% numa-vmstat.node0.nr_isolated_file
> >>> 33353 ± 39% +48.9% 49649 ± 19% numa-vmstat.node0.nr_zone_active_anon
> >>> 142.50 ± 13% +383.7% 689.25 ± 67% numa-vmstat.node1.workingset_nodes
> >>> 465083 ± 8% +14.5% 532598 ± 5% sched_debug.cfs_rq:/.load.avg
> >>> 73769 ± 3% +10.1% 81237 ± 2% sched_debug.cfs_rq:/.min_vruntime.avg
> >>> 0.49 ± 9% +11.7% 0.55 ± 4% sched_debug.cfs_rq:/.nr_running.avg
> >>> 0.42 ± 5% +28.3% 0.54 ± 17% sched_debug.cfs_rq:/.nr_spread_over.avg
> >>> 446.60 ± 8% +12.4% 502.06 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.avg
> >>> 0.00 ± 13% +81.6% 0.00 ± 25% sched_debug.cpu.next_balance.stddev
> >>> 236853 ± 2% -10.0% 213272 ± 2% proc-vmstat.allocstall_movable
> >>> 9449747 ± 36% +70.4% 16102167 ± 26% proc-vmstat.compact_daemon_free_scanned
> >>> 9449849 ± 36% +70.4% 16102167 ± 26% proc-vmstat.compact_free_scanned
> >>> 87539 +2.3% 89589 proc-vmstat.nr_active_anon
> >>> 289507 ± 2% +4.5% 302548 ± 4% proc-vmstat.nr_free_pages
> >>> 194.25 ± 4% +23.0% 239.00 ± 6% proc-vmstat.nr_isolated_file
> >>> 87598 +2.3% 89646 proc-vmstat.nr_zone_active_anon
> >>> 7.463e+08 ± 2% -11.0% 6.643e+08 ± 2% proc-vmstat.numa_hit
> >>> 7.462e+08 ± 2% -11.0% 6.643e+08 ± 2% proc-vmstat.numa_local
> >>> 8197 ± 62% -68.3% 2602 ± 36% proc-vmstat.numa_pages_migrated
> >>> 29822579 -13.4% 25839119 proc-vmstat.pgalloc_dma32
> >>> 7.883e+08 -11.3% 6.989e+08 proc-vmstat.pgalloc_normal
> >>> 8.081e+08 -11.5% 7.154e+08 proc-vmstat.pgfree
> >>> 3.269e+09 -11.4% 2.896e+09 proc-vmstat.pgpgin
> >>> 6.064e+08 ± 2% -10.0% 5.459e+08 ± 2% proc-vmstat.pgscan_direct
> >>> 6.606e+08 -9.8% 5.958e+08 proc-vmstat.pgscan_file
> >>> 6.064e+08 ± 2% -10.0% 5.459e+08 ± 2% proc-vmstat.pgsteal_direct
> >>> 6.606e+08 -9.8% 5.958e+08 proc-vmstat.pgsteal_file
> >>> 675.75 ± 12% +108.7% 1410 ± 10% proc-vmstat.workingset_nodes
> >>> 11724 ± 5% -14.6% 10012 ± 6% softirqs.CPU11.RCU
> >>> 11062 ± 14% -19.9% 8862 ± 7% softirqs.CPU12.RCU
> >>> 11261 ± 8% -26.7% 8250 ± 17% softirqs.CPU13.RCU
> >>> 12107 ± 5% -23.1% 9308 ± 14% softirqs.CPU16.RCU
> >>> 6935 ± 20% +71.6% 11902 ± 26% softirqs.CPU16.SCHED
> >>> 11358 ± 10% -24.3% 8596 ± 20% softirqs.CPU17.RCU
> >>> 11037 ± 7% -22.4% 8564 ± 27% softirqs.CPU19.RCU
> >>> 11932 ± 5% -14.2% 10232 ± 6% softirqs.CPU22.RCU
> >>> 7225 ± 12% +129.0% 16545 ± 70% softirqs.CPU24.RCU
> >>> 19773 ± 6% -49.9% 9897 ± 29% softirqs.CPU24.SCHED
> >>> 7284 ± 27% +47.3% 10731 ± 20% softirqs.CPU26.RCU
> >>> 17055 ± 16% -31.2% 11739 ± 38% softirqs.CPU27.SCHED
> >>> 8312 ± 7% +39.4% 11590 ± 11% softirqs.CPU40.RCU
> >>> 10971 ± 9% -27.5% 7952 ± 14% softirqs.CPU44.SCHED
> >>> 10635 ± 18% -42.4% 6123 ± 24% softirqs.CPU47.SCHED
> >>> 19147 ± 16% -48.6% 9847 ± 66% softirqs.CPU55.SCHED
> >>> 5695 ± 5% +48.5% 8459 ± 21% softirqs.CPU61.RCU
> >>> 22689 ± 8% -43.3% 12854 ± 46% softirqs.CPU61.SCHED
> >>> 22605 ± 4% -41.4% 13254 ± 48% softirqs.CPU63.SCHED
> >>> 6243 ± 3% +197.0% 18540 ± 91% softirqs.CPU64.RCU
> >>> 22252 ± 5% -30.2% 15521 ± 42% softirqs.CPU64.SCHED
> >>> 10169 ± 11% -28.3% 7292 ± 27% softirqs.CPU7.RCU
> >>> 23354 ± 5% -31.1% 16103 ± 28% softirqs.CPU70.SCHED
> >>> 8167 ± 11% +127.6% 18591 ± 15% softirqs.CPU72.SCHED
> >>> 9889 ± 11% +59.1% 15732 ± 32% softirqs.CPU73.SCHED
> >>> 15712 ± 12% +36.2% 21397 ± 15% softirqs.CPU95.SCHED
> >>> 4227 ± 36% +214.7% 13304 ± 61% softirqs.NET_RX
> >>> 14.88 -3.2% 14.40 perf-stat.i.MPKI
> >>> 1.266e+10 -8.2% 1.161e+10 perf-stat.i.branch-instructions
> >>> 0.46 -0.0 0.43 perf-stat.i.branch-miss-rate%
> >>> 57438745 -13.4% 49728276 perf-stat.i.branch-misses
> >>> 6.81e+08 -11.4% 6.037e+08 perf-stat.i.cache-misses
> >>> 9.441e+08 -11.6% 8.341e+08 perf-stat.i.cache-references
> >>> 2.16 +9.5% 2.37 perf-stat.i.cpi
> >>> 116.38 -1.7% 114.45 perf-stat.i.cpu-migrations
> >>> 208.53 +12.8% 235.28 perf-stat.i.cycles-between-cache-misses
> >>> 4154710 ± 20% -27.1% 3030632 ± 28% perf-stat.i.dTLB-load-misses
> >>> 1.594e+10 -9.0% 1.451e+10 perf-stat.i.dTLB-loads
> >>> 2128118 ± 4% -16.5% 1777087 ± 6% perf-stat.i.dTLB-store-misses
> >>> 9.067e+09 -11.3% 8.043e+09 perf-stat.i.dTLB-stores
> >>> 34488908 ± 2% -10.8% 30770416 ± 4% perf-stat.i.iTLB-load-misses
> >>> 3095031 -16.3% 2591987 ± 24% perf-stat.i.iTLB-loads
> >>> 6.335e+10 -8.9% 5.774e+10 perf-stat.i.instructions
> >>> 0.46 -8.5% 0.42 perf-stat.i.ipc
> >>> 404.38 -9.4% 366.54 perf-stat.i.metric.M/sec
> >>> 51306220 ± 4% -14.2% 44022960 ± 7% perf-stat.i.node-load-misses
> >>> 1.001e+08 ± 2% -9.5% 90543655 perf-stat.i.node-stores
> >>> 14.90 -3.1% 14.45 perf-stat.overall.MPKI
> >>> 0.45 -0.0 0.43 perf-stat.overall.branch-miss-rate%
> >>> 2.16 +9.5% 2.36 perf-stat.overall.cpi
> >>> 200.79 +12.6% 225.99 perf-stat.overall.cycles-between-cache-misses
> >>> 0.46 -8.6% 0.42 perf-stat.overall.ipc
> >>> 15573 +3.0% 16039 perf-stat.overall.path-length
> >>> 1.259e+10 -8.2% 1.155e+10 perf-stat.ps.branch-instructions
> >>> 57147489 -13.4% 49476429 perf-stat.ps.branch-misses
> >>> 6.776e+08 -11.4% 6.006e+08 perf-stat.ps.cache-misses
> >>> 9.393e+08 -11.6% 8.299e+08 perf-stat.ps.cache-references
> >>> 4134917 ± 20% -27.0% 3016945 ± 28% perf-stat.ps.dTLB-load-misses
> >>> 1.586e+10 -9.0% 1.443e+10 perf-stat.ps.dTLB-loads
> >>> 2117713 ± 4% -16.5% 1768545 ± 6% perf-stat.ps.dTLB-store-misses
> >>> 9.021e+09 -11.3% 8.002e+09 perf-stat.ps.dTLB-stores
> >>> 34313893 ± 2% -10.8% 30612676 ± 4% perf-stat.ps.iTLB-load-misses
> >>> 3079304 -16.3% 2578671 ± 24% perf-stat.ps.iTLB-loads
> >>> 6.303e+10 -8.9% 5.745e+10 perf-stat.ps.instructions
> >>> 51045596 ± 4% -14.2% 43794824 ± 7% perf-stat.ps.node-load-misses
> >>> 99540862 ± 2% -9.5% 90084273 perf-stat.ps.node-stores
> >>> 1.273e+13 -8.8% 1.161e+13 perf-stat.total.instructions
> >>> 0.50 ±173% +8800.0% 44.50 ±162% interrupts.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
> >>> 314.50 ± 23% -30.3% 219.25 ± 35% interrupts.CPU12.RES:Rescheduling_interrupts
> >>> 59.75 ± 64% -87.4% 7.50 ± 72% interrupts.CPU12.TLB:TLB_shootdowns
> >>> 668.75 ± 5% -14.6% 571.25 ± 13% interrupts.CPU13.CAL:Function_call_interrupts
> >>> 375.75 ± 10% -45.8% 203.50 ± 47% interrupts.CPU13.RES:Rescheduling_interrupts
> >>> 377.00 ± 11% -35.3% 243.75 ± 41% interrupts.CPU14.RES:Rescheduling_interrupts
> >>> 395.75 ± 6% -46.3% 212.50 ± 49% interrupts.CPU15.RES:Rescheduling_interrupts
> >>> 370.00 ± 7% -35.0% 240.50 ± 26% interrupts.CPU16.RES:Rescheduling_interrupts
> >>> 372.50 ± 5% -34.5% 244.00 ± 32% interrupts.CPU17.RES:Rescheduling_interrupts
> >>> 383.25 ± 10% -22.4% 297.50 ± 18% interrupts.CPU18.RES:Rescheduling_interrupts
> >>> 376.50 ± 16% -40.5% 224.00 ± 45% interrupts.CPU19.RES:Rescheduling_interrupts
> >>> 369.50 ± 10% -38.8% 226.00 ± 29% interrupts.CPU20.RES:Rescheduling_interrupts
> >>> 388.75 ± 5% -25.1% 291.00 ± 8% interrupts.CPU22.RES:Rescheduling_interrupts
> >>> 146.75 ± 14% +118.6% 320.75 ± 19% interrupts.CPU24.RES:Rescheduling_interrupts
> >>> 3569 ± 15% +60.9% 5743 ± 8% interrupts.CPU25.NMI:Non-maskable_interrupts
> >>> 3569 ± 15% +60.9% 5743 ± 8% interrupts.CPU25.PMI:Performance_monitoring_interrupts
> >>> 4183 ± 44% +75.2% 7327 ± 12% interrupts.CPU31.NMI:Non-maskable_interrupts
> >>> 4183 ± 44% +75.2% 7327 ± 12% interrupts.CPU31.PMI:Performance_monitoring_interrupts
> >>> 4059 ± 40% +64.3% 6671 ± 12% interrupts.CPU33.NMI:Non-maskable_interrupts
> >>> 4059 ± 40% +64.3% 6671 ± 12% interrupts.CPU33.PMI:Performance_monitoring_interrupts
> >>> 0.25 ±173% +17500.0% 44.00 ±165% interrupts.CPU37.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
> >>> 321.50 ± 16% -30.5% 223.50 ± 34% interrupts.CPU4.RES:Rescheduling_interrupts
> >>> 5068 ± 37% +39.9% 7091 ± 12% interrupts.CPU45.NMI:Non-maskable_interrupts
> >>> 5068 ± 37% +39.9% 7091 ± 12% interrupts.CPU45.PMI:Performance_monitoring_interrupts
> >>> 96.25 ± 75% -71.7% 27.25 ± 51% interrupts.CPU5.TLB:TLB_shootdowns
> >>> 2707 ± 66% +145.2% 6637 ± 19% interrupts.CPU51.NMI:Non-maskable_interrupts
> >>> 2707 ± 66% +145.2% 6637 ± 19% interrupts.CPU51.PMI:Performance_monitoring_interrupts
> >>> 67.75 ± 51% -63.1% 25.00 ± 59% interrupts.CPU51.TLB:TLB_shootdowns
> >>> 77.50 ± 30% -61.9% 29.50 ± 63% interrupts.CPU59.TLB:TLB_shootdowns
> >>> 297.75 ± 18% -34.8% 194.25 ± 30% interrupts.CPU6.RES:Rescheduling_interrupts
> >>> 4308 ± 33% +57.6% 6787 ± 15% interrupts.CPU60.NMI:Non-maskable_interrupts
> >>> 4308 ± 33% +57.6% 6787 ± 15% interrupts.CPU60.PMI:Performance_monitoring_interrupts
> >>> 140.00 ± 79% -91.6% 11.75 ± 79% interrupts.CPU60.TLB:TLB_shootdowns
> >>> 72.00 ± 45% -64.6% 25.50 ± 53% interrupts.CPU63.TLB:TLB_shootdowns
> >>> 102.00 ± 37% +79.7% 183.25 ± 44% interrupts.CPU64.RES:Rescheduling_interrupts
> >>> 67.50 ± 33% -64.4% 24.00 ± 63% interrupts.CPU65.TLB:TLB_shootdowns
> >>> 3342 ± 21% +83.3% 6126 ± 21% interrupts.CPU67.NMI:Non-maskable_interrupts
> >>> 3342 ± 21% +83.3% 6126 ± 21% interrupts.CPU67.PMI:Performance_monitoring_interrupts
> >>> 3636 ± 33% +94.5% 7072 ± 11% interrupts.CPU69.NMI:Non-maskable_interrupts
> >>> 3636 ± 33% +94.5% 7072 ± 11% interrupts.CPU69.PMI:Performance_monitoring_interrupts
> >>> 314.50 ± 21% -52.9% 148.25 ± 83% interrupts.CPU7.RES:Rescheduling_interrupts
> >>> 79.00 ± 43% +96.2% 155.00 ± 28% interrupts.CPU70.RES:Rescheduling_interrupts
> >>> 2746 ± 33% +88.6% 5178 ± 34% interrupts.CPU71.NMI:Non-maskable_interrupts
> >>> 2746 ± 33% +88.6% 5178 ± 34% interrupts.CPU71.PMI:Performance_monitoring_interrupts
> >>> 676.00 ± 6% -16.3% 566.00 ± 6% interrupts.CPU72.CAL:Function_call_interrupts
> >>> 315.75 ± 3% -51.9% 152.00 ± 30% interrupts.CPU72.RES:Rescheduling_interrupts
> >>> 276.75 ± 24% -38.0% 171.50 ± 42% interrupts.CPU75.RES:Rescheduling_interrupts
> >>> 641.25 ± 9% -13.9% 552.00 ± 7% interrupts.CPU76.CAL:Function_call_interrupts
> >>> 657.75 ± 6% -17.6% 541.75 ± 5% interrupts.CPU77.CAL:Function_call_interrupts
> >>> 619.50 ± 5% -9.6% 559.75 ± 4% interrupts.CPU80.CAL:Function_call_interrupts
> >>> 241.00 ± 18% -33.6% 160.00 ± 39% interrupts.CPU80.RES:Rescheduling_interrupts
> >>> 631.75 ± 7% -14.8% 538.50 ± 3% interrupts.CPU86.CAL:Function_call_interrupts
> >>> 628.00 ± 3% -15.0% 533.75 ± 5% interrupts.CPU89.CAL:Function_call_interrupts
> >>> 370.50 ± 5% -38.9% 226.25 ± 46% interrupts.CPU9.RES:Rescheduling_interrupts
> >>> 654.50 ± 8% -21.0% 517.25 ± 5% interrupts.CPU95.CAL:Function_call_interrupts
> >>> 238.75 ± 20% -63.0% 88.25 ± 49% interrupts.CPU95.RES:Rescheduling_interrupts
> >>> 9.51 ± 12% -9.5 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 9.45 ± 12% -9.5 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 10.47 ± 13% -5.5 5.01 ± 13% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 10.42 ± 13% -5.5 4.97 ± 13% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
> >>> 10.40 ± 13% -5.4 5.04 ± 13% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 5.11 ± 9% -5.1 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise
> >>> 5.06 ± 9% -5.1 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages
> >>> 9.92 ± 11% -2.7 7.25 ± 13% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.ext4_mpage_readpages.read_pages.page_cache_readahead_unbounded
> >>> 9.34 ± 12% -2.6 6.77 ± 13% perf-profile.calltrace.cycles-pp.pmem_make_request.generic_make_request.submit_bio.ext4_mpage_readpages.read_pages
> >>> 8.47 ± 12% -2.4 6.08 ± 13% perf-profile.calltrace.cycles-pp.pmem_do_read.pmem_make_request.generic_make_request.submit_bio.ext4_mpage_readpages
> >>> 8.38 ± 12% -2.4 6.01 ± 13% perf-profile.calltrace.cycles-pp.__memcpy_mcsafe.pmem_do_read.pmem_make_request.generic_make_request.submit_bio
> >>> 3.16 ± 12% -1.0 2.11 ± 9% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 1.92 ± 10% -0.6 1.29 ± 11% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 1.69 ± 11% -0.6 1.09 ± 12% perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 1.31 ± 12% -0.5 0.81 ± 12% perf-profile.calltrace.cycles-pp.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded
> >>> 1.48 ± 14% -0.5 0.99 ± 9% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 13.92 ± 9% +2.7 16.66 ± 10% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 10.73 ± 11% +3.8 14.52 ± 11% perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read.new_sync_read
> >>> 10.64 ± 11% +3.8 14.43 ± 11% perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 7.12 ± 13% +4.5 11.62 ± 12% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 7.08 ± 13% +4.7 11.73 ± 13% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 0.00 +7.6 7.62 ± 18% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release
> >>> 0.00 +7.7 7.66 ± 18% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages
> >>> 0.00 +7.7 7.66 ± 18% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise
> >>> 0.00 +13.2 13.15 ± 11% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
> >>> 0.00 +13.2 13.21 ± 11% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.00 +13.2 13.21 ± 11% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 10.88 ± 12% -5.6 5.28 ± 12% perf-profile.children.cycles-pp.lru_note_cost
> >>> 9.35 ± 12% -2.6 6.77 ± 13% perf-profile.children.cycles-pp.pmem_make_request
> >>> 8.47 ± 12% -2.4 6.08 ± 13% perf-profile.children.cycles-pp.pmem_do_read
> >>> 8.40 ± 12% -2.4 6.03 ± 13% perf-profile.children.cycles-pp.__memcpy_mcsafe
> >>> 5.36 ± 8% -1.1 4.22 ± 9% perf-profile.children.cycles-pp.__remove_mapping
> >>> 3.17 ± 12% -1.0 2.12 ± 9% perf-profile.children.cycles-pp.__add_to_page_cache_locked
> >>> 2.16 ± 11% -0.7 1.47 ± 11% perf-profile.children.cycles-pp.get_page_from_freelist
> >>> 1.91 ± 12% -0.6 1.26 ± 12% perf-profile.children.cycles-pp.rmqueue
> >>> 1.03 ± 10% -0.6 0.44 ± 8% perf-profile.children.cycles-pp.workingset_eviction
> >>> 1.48 ± 13% -0.5 0.93 ± 12% perf-profile.children.cycles-pp.rmqueue_bulk
> >>> 1.49 ± 14% -0.5 1.00 ± 10% perf-profile.children.cycles-pp.mem_cgroup_charge
> >>> 0.93 ± 12% -0.4 0.49 ± 16% perf-profile.children.cycles-pp._raw_spin_lock
> >>> 1.26 ± 11% -0.4 0.88 ± 8% perf-profile.children.cycles-pp.__mod_lruvec_state
> >>> 0.41 ± 11% -0.2 0.16 ± 8% perf-profile.children.cycles-pp.workingset_age_nonresident
> >>> 0.90 ± 8% -0.2 0.70 ± 9% perf-profile.children.cycles-pp.free_unref_page_list
> >>> 0.80 ± 9% -0.2 0.60 ± 12% perf-profile.children.cycles-pp.free_pcppages_bulk
> >>> 0.51 ± 7% -0.1 0.37 ± 12% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
> >>> 0.46 ± 8% -0.1 0.33 ± 12% perf-profile.children.cycles-pp.uncharge_batch
> >>> 0.37 ± 14% -0.1 0.24 ± 8% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
> >>> 0.41 ± 8% -0.1 0.29 ± 4% perf-profile.children.cycles-pp.unaccount_page_cache_page
> >>> 0.37 ± 7% -0.1 0.26 ± 11% perf-profile.children.cycles-pp.page_counter_cancel
> >>> 0.37 ± 8% -0.1 0.27 ± 12% perf-profile.children.cycles-pp.page_counter_uncharge
> >>> 0.32 ± 5% -0.1 0.22 ± 10% perf-profile.children.cycles-pp.remove_mapping
> >>> 0.24 ± 8% -0.1 0.17 ± 14% perf-profile.children.cycles-pp.__mod_node_page_state
> >>> 0.19 ± 6% -0.0 0.14 ± 15% perf-profile.children.cycles-pp.pagevec_lookup_entries
> >>> 0.19 ± 6% -0.0 0.14 ± 15% perf-profile.children.cycles-pp.find_get_entries
> >>> 0.26 ± 8% -0.0 0.22 ± 11% perf-profile.children.cycles-pp.xas_clear_mark
> >>> 0.17 ± 4% -0.0 0.14 ± 13% perf-profile.children.cycles-pp.percpu_counter_add_batch
> >>> 0.07 ± 7% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__softirqentry_text_start
> >>> 0.09 ± 11% +0.1 0.15 ± 13% perf-profile.children.cycles-pp.__list_add_valid
> >>> 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.lru_add_drain
> >>> 0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.lru_add_drain_cpu
> >>> 13.93 ± 9% +2.7 16.66 ± 10% perf-profile.children.cycles-pp.add_to_page_cache_lru
> >>> 10.73 ± 11% +3.8 14.53 ± 11% perf-profile.children.cycles-pp.lru_cache_add
> >>> 10.68 ± 11% +3.8 14.51 ± 11% perf-profile.children.cycles-pp.__pagevec_lru_add
> >>> 16.07 ± 8% +6.1 22.18 ± 12% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
> >>> 0.00 +21.0 20.96 ± 12% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
> >>> 8.34 ± 12% -2.4 5.98 ± 13% perf-profile.self.cycles-pp.__memcpy_mcsafe
> >>> 1.64 ± 10% -0.4 1.22 ± 12% perf-profile.self.cycles-pp.__list_del_entry_valid
> >>> 0.62 ± 10% -0.3 0.29 ± 9% perf-profile.self.cycles-pp.workingset_eviction
> >>> 0.41 ± 11% -0.2 0.16 ± 8% perf-profile.self.cycles-pp.workingset_age_nonresident
> >>> 0.54 ± 9% -0.2 0.32 ± 12% perf-profile.self.cycles-pp.__add_to_page_cache_locked
> >>> 0.41 ± 10% -0.1 0.28 ± 12% perf-profile.self.cycles-pp.__mod_lruvec_state
> >>> 0.36 ± 15% -0.1 0.23 ± 8% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
> >>> 0.35 ± 11% -0.1 0.25 ± 13% perf-profile.self.cycles-pp.__read_end_io
> >>> 0.33 ± 8% -0.1 0.24 ± 12% perf-profile.self.cycles-pp.page_counter_cancel
> >>> 0.23 ± 8% -0.1 0.16 ± 14% perf-profile.self.cycles-pp.__mod_node_page_state
> >>> 0.19 ± 12% -0.1 0.12 ± 9% perf-profile.self.cycles-pp.mem_cgroup_charge
> >>> 0.17 ± 6% -0.1 0.10 ± 10% perf-profile.self.cycles-pp.unaccount_page_cache_page
> >>> 0.09 ± 21% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.put_file
> >>> 0.15 ± 7% -0.0 0.10 ± 12% perf-profile.self.cycles-pp.release_pages
> >>> 0.15 ± 4% -0.0 0.11 ± 13% perf-profile.self.cycles-pp.find_get_entries
> >>> 0.15 ± 3% -0.0 0.12 ± 14% perf-profile.self.cycles-pp.percpu_counter_add_batch
> >>> 0.09 ± 13% +0.1 0.15 ± 15% perf-profile.self.cycles-pp.__list_add_valid
> >>> 0.19 ± 5% +0.1 0.32 ± 11% perf-profile.self.cycles-pp.__remove_mapping
> >>> 0.45 ± 9% +0.2 0.61 ± 13% perf-profile.self.cycles-pp.__pagevec_lru_add
> >>> 0.25 ± 11% +0.2 0.43 ± 9% perf-profile.self.cycles-pp.isolate_lru_pages
> >>>
> >>>
> >>>
> >>> ***************************************************************************************************
> >>> lkp-skl-fpga01: 104 threads Skylake with 192G memory
> >>> =========================================================================================
> >>> compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase/ucode:
> >>> gcc-9/performance/x86_64-rhel-8.3/debian-10.4-x86_64-20200603.cgz/300s/lkp-skl-fpga01/lru-file-mmap-read/vm-scalability/0x2006906
> >>>
> >>> commit:
> >>> 3fbdbb91fe ("mm/swap: serialize memcg changes in pagevec_lru_move_fn")
> >>> ea4ebd4126 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>>
> >>> 3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d0
> >>> ---------------- ---------------------------
> >>> fail:runs %reproduction fail:runs
> >>> | | |
> >>> 0:4 0% 0:4 perf-profile.children.cycles-pp.error_entry
> >>> :4 2% 0:4 perf-profile.self.cycles-pp.error_entry
> >>> %stddev %change %stddev
> >>> \ | \
> >>> 0.26 ± 9% -32.2% 0.18 ± 27% vm-scalability.free_time
> >>> 139429 -21.5% 109436 ± 3% vm-scalability.median
> >>> 14460271 -21.3% 11382787 ± 3% vm-scalability.throughput
> >>> 560188 -16.1% 469743 ± 10% vm-scalability.time.involuntary_context_switches
> >>> 7637 ± 3% -39.0% 4662 ± 42% vm-scalability.time.major_page_faults
> >>> 87258631 -24.3% 66058668 ± 4% vm-scalability.time.minor_page_faults
> >>> 26902 +2.5% 27585 vm-scalability.time.system_time
> >>> 3001 ± 3% -26.5% 2205 ± 5% vm-scalability.time.user_time
> >>> 12826 ± 4% -36.2% 8184 ± 35% vm-scalability.time.voluntary_context_switches
> >>> 4.345e+09 -21.3% 3.421e+09 ± 3% vm-scalability.workload
> >>> 3301002 ± 2% -23.0% 2541625 ± 3% meminfo.PageTables
> >>> 1.09 -0.1 0.98 ± 3% mpstat.cpu.all.irq%
> >>> 0.06 -0.0 0.05 ± 4% mpstat.cpu.all.soft%
> >>> 8.78 ± 4% -1.9 6.88 ± 6% mpstat.cpu.all.usr%
> >>> 76.75 +2.9% 79.00 vmstat.cpu.sy
> >>> 4106 -17.5% 3388 ± 9% vmstat.system.cs
> >>> 399168 -22.7% 308744 ± 11% vmstat.system.in
> >>> 1664854 ± 2% -23.5% 1274158 numa-meminfo.node0.PageTables
> >>> 31946 ± 79% +141.6% 77192 ± 49% numa-meminfo.node1.AnonHugePages
> >>> 10029 ± 7% -9.6% 9064 ± 7% numa-meminfo.node1.KernelStack
> >>> 1603591 ± 2% -22.7% 1238798 numa-meminfo.node1.PageTables
> >>> 4.357e+08 -26.2% 3.213e+08 ± 10% numa-numastat.node0.local_node
> >>> 4.357e+08 -26.2% 3.214e+08 ± 10% numa-numastat.node0.numa_hit
> >>> 4.575e+08 -28.7% 3.264e+08 ± 11% numa-numastat.node1.local_node
> >>> 4.575e+08 -28.7% 3.264e+08 ± 11% numa-numastat.node1.numa_hit
> >>> 240.25 ± 2% +17.9% 283.25 ± 4% numa-vmstat.node0.nr_isolated_file
> >>> 413586 -23.4% 316934 ± 2% numa-vmstat.node0.nr_page_table_pages
> >>> 2.693e+08 -22.6% 2.085e+08 ± 8% numa-vmstat.node0.numa_hit
> >>> 2.693e+08 -22.6% 2.084e+08 ± 8% numa-vmstat.node0.numa_local
> >>> 2118534 ± 3% -48.6% 1088340 ± 13% numa-vmstat.node0.workingset_nodereclaim
> >>> 238.75 ± 4% +26.7% 302.50 ± 4% numa-vmstat.node1.nr_isolated_file
> >>> 10016 ± 7% -9.6% 9055 ± 7% numa-vmstat.node1.nr_kernel_stack
> >>> 398575 -22.7% 307984 ± 2% numa-vmstat.node1.nr_page_table_pages
> >>> 2.838e+08 -25.4% 2.117e+08 ± 10% numa-vmstat.node1.numa_hit
> >>> 2.837e+08 -25.4% 2.116e+08 ± 10% numa-vmstat.node1.numa_local
> >>> 1642541 ± 2% -46.0% 887485 ± 15% numa-vmstat.node1.workingset_nodereclaim
> >>> 21.70 ± 9% +36.3% 29.57 ± 16% sched_debug.cfs_rq:/.load_avg.avg
> >>> 7.46 -22.0% 5.82 ± 9% sched_debug.cfs_rq:/.load_avg.min
> >>> 78.39 ± 13% +44.6% 113.34 ± 20% sched_debug.cfs_rq:/.load_avg.stddev
> >>> 13986808 ± 3% -13.6% 12090948 ± 12% sched_debug.cfs_rq:/.min_vruntime.min
> >>> 13.75 ± 3% +65.0% 22.69 ± 17% sched_debug.cfs_rq:/.nr_spread_over.avg
> >>> 0.12 ± 57% +3166.7% 4.08 ± 39% sched_debug.cfs_rq:/.nr_spread_over.min
> >>> 1.74 ± 65% +170.6% 4.72 ± 41% sched_debug.cfs_rq:/.removed.load_avg.avg
> >>> 14.42 ± 59% +94.4% 28.03 ± 22% sched_debug.cfs_rq:/.removed.load_avg.stddev
> >>> 782.22 ± 2% -15.0% 664.98 ± 5% sched_debug.cfs_rq:/.util_est_enqueued.avg
> >>> 215.22 ± 7% +13.6% 244.44 ± 6% sched_debug.cfs_rq:/.util_est_enqueued.stddev
> >>> 674675 +12.5% 758767 ± 5% sched_debug.cpu.avg_idle.avg
> >>> 91537 ± 19% +97.7% 180996 ± 19% sched_debug.cpu.avg_idle.min
> >>> 284513 ± 3% -17.5% 234850 ± 8% sched_debug.cpu.avg_idle.stddev
> >>> 7787 -21.3% 6129 ± 11% sched_debug.cpu.nr_switches.avg
> >>> 5205 ± 2% -25.0% 3904 ± 13% sched_debug.cpu.nr_switches.min
> >>> 6412 ± 2% -24.6% 4835 ± 15% sched_debug.cpu.sched_count.avg
> >>> 4393 ± 3% -26.7% 3220 ± 19% sched_debug.cpu.sched_count.min
> >>> 195.36 ± 3% -23.5% 149.47 ± 11% sched_debug.cpu.sched_goidle.avg
> >>> 52.04 ± 12% -33.6% 34.55 ± 17% sched_debug.cpu.sched_goidle.min
> >>> 2786 ± 2% -30.6% 1932 ± 16% sched_debug.cpu.ttwu_count.avg
> >>> 1697 ± 3% -32.5% 1146 ± 18% sched_debug.cpu.ttwu_count.min
> >>> 796.86 ± 4% -16.3% 667.02 ± 10% sched_debug.cpu.ttwu_count.stddev
> >>> 1916 -23.8% 1460 ± 14% sched_debug.cpu.ttwu_local.avg
> >>> 1225 -24.9% 920.19 ± 14% sched_debug.cpu.ttwu_local.min
> >>> 643.48 ± 3% -17.0% 534.06 ± 12% sched_debug.cpu.ttwu_local.stddev
> >>> 110909 -27.2% 80748 ± 4% proc-vmstat.allocstall_movable
> >>> 23225 ± 5% -44.8% 12817 ± 20% proc-vmstat.allocstall_normal
> >>> 13441427 ± 21% -39.9% 8074021 ± 9% proc-vmstat.compact_daemon_free_scanned
> >>> 1874109 ± 13% -24.7% 1411699 ± 7% proc-vmstat.compact_daemon_migrate_scanned
> >>> 965.25 ± 2% -31.4% 662.50 ± 15% proc-vmstat.compact_daemon_wake
> >>> 965.75 ± 14% -35.3% 624.50 ± 34% proc-vmstat.compact_fail
> >>> 14062408 ± 24% -41.8% 8191092 ± 10% proc-vmstat.compact_free_scanned
> >>> 2828497 ± 14% -28.4% 2024600 ± 12% proc-vmstat.compact_isolated
> >>> 1923490 ± 14% -25.6% 1430393 ± 7% proc-vmstat.compact_migrate_scanned
> >>> 977.50 ± 13% -35.6% 629.75 ± 33% proc-vmstat.compact_stall
> >>> 742.25 ± 6% -34.6% 485.50 ± 22% proc-vmstat.kswapd_low_wmark_hit_quickly
> >>> 487.50 +22.5% 597.00 ± 4% proc-vmstat.nr_isolated_file
> >>> 824348 -23.9% 627738 ± 2% proc-vmstat.nr_page_table_pages
> >>> 739409 -6.9% 688682 proc-vmstat.nr_slab_reclaimable
> >>> 8.932e+08 -27.5% 6.477e+08 ± 10% proc-vmstat.numa_hit
> >>> 8.932e+08 -27.5% 6.477e+08 ± 10% proc-vmstat.numa_local
> >>> 21112 ± 31% +113.4% 45059 ± 5% proc-vmstat.numa_pte_updates
> >>> 1663 ± 2% -26.6% 1220 ± 10% proc-vmstat.pageoutrun
> >>> 6387700 -23.0% 4916339 ± 5% proc-vmstat.pgalloc_dma32
> >>> 9.501e+08 -24.2% 7.199e+08 ± 4% proc-vmstat.pgalloc_normal
> >>> 1.179e+08 -24.2% 89382991 ± 4% proc-vmstat.pgfault
> >>> 9.575e+08 -24.2% 7.254e+08 ± 4% proc-vmstat.pgfree
> >>> 7637 ± 3% -39.0% 4662 ± 42% proc-vmstat.pgmajfault
> >>> 1401098 ± 15% -28.4% 1002726 ± 12% proc-vmstat.pgmigrate_success
> >>> 1.755e+09 -28.2% 1.26e+09 ± 6% proc-vmstat.pgscan_direct
> >>> 1.84e+09 -25.2% 1.376e+09 ± 4% proc-vmstat.pgscan_file
> >>> 85331811 ± 2% +35.7% 1.158e+08 ± 22% proc-vmstat.pgscan_kswapd
> >>> 8.853e+08 -25.6% 6.589e+08 ± 4% proc-vmstat.pgsteal_direct
> >>> 9.066e+08 -25.5% 6.751e+08 ± 4% proc-vmstat.pgsteal_file
> >>> 21336560 ± 4% -24.1% 16197937 ± 7% proc-vmstat.pgsteal_kswapd
> >>> 10239079 ± 2% -44.1% 5721845 ± 7% proc-vmstat.slabs_scanned
> >>> 3753509 ± 2% -48.7% 1925639 ± 14% proc-vmstat.workingset_nodereclaim
> >>> 4202505 -7.5% 3887115 proc-vmstat.workingset_nodes
> >>> 1.877e+10 -20.4% 1.495e+10 ± 5% perf-stat.i.branch-instructions
> >>> 36543885 -21.2% 28809680 ± 5% perf-stat.i.branch-misses
> >>> 1.111e+08 -21.0% 87811014 ± 6% perf-stat.i.cache-misses
> >>> 3.975e+08 ± 2% -21.1% 3.136e+08 ± 4% perf-stat.i.cache-references
> >>> 4039 -16.4% 3377 ± 10% perf-stat.i.context-switches
> >>> 4.89 +43.8% 7.03 ± 6% perf-stat.i.cpi
> >>> 3360 +22.0% 4097 ± 3% perf-stat.i.cycles-between-cache-misses
> >>> 0.07 ± 4% -0.0 0.06 ± 5% perf-stat.i.dTLB-load-miss-rate%
> >>> 13903074 ± 7% -30.0% 9734581 ± 14% perf-stat.i.dTLB-load-misses
> >>> 1.892e+10 -20.4% 1.506e+10 ± 5% perf-stat.i.dTLB-loads
> >>> 850301 ± 3% -27.7% 614945 ± 11% perf-stat.i.dTLB-store-misses
> >>> 4.811e+09 -22.2% 3.74e+09 ± 5% perf-stat.i.dTLB-stores
> >>> 1658607 -25.7% 1231640 ± 6% perf-stat.i.iTLB-load-misses
> >>> 882152 ± 5% -31.0% 609079 ± 17% perf-stat.i.iTLB-loads
> >>> 6.721e+10 -20.1% 5.37e+10 ± 5% perf-stat.i.instructions
> >>> 0.37 ± 4% -12.0% 0.32 ± 6% perf-stat.i.ipc
> >>> 20.94 ± 3% -38.4% 12.89 ± 42% perf-stat.i.major-faults
> >>> 412.39 -20.6% 327.51 ± 5% perf-stat.i.metric.M/sec
> >>> 254716 -22.5% 197520 ± 6% perf-stat.i.minor-faults
> >>> 71.26 +1.2 72.42 perf-stat.i.node-load-miss-rate%
> >>> 3008759 -16.9% 2500319 ± 6% perf-stat.i.node-loads
> >>> 47.19 +4.1 51.28 ± 4% perf-stat.i.node-store-miss-rate%
> >>> 5243928 -22.1% 4084488 ± 4% perf-stat.i.node-store-misses
> >>> 9211022 -25.4% 6873218 ± 12% perf-stat.i.node-stores
> >>> 254737 -22.5% 197533 ± 6% perf-stat.i.page-faults
> >>> 3.71 +28.0% 4.76 ± 3% perf-stat.overall.cpi
> >>> 2248 +29.3% 2908 ± 5% perf-stat.overall.cycles-between-cache-misses
> >>> 0.02 ± 3% -0.0 0.02 ± 5% perf-stat.overall.dTLB-store-miss-rate%
> >>> 40671 +8.1% 43974 ± 2% perf-stat.overall.instructions-per-iTLB-miss
> >>> 0.27 -21.8% 0.21 ± 3% perf-stat.overall.ipc
> >>> 70.04 +3.8 73.83 perf-stat.overall.node-load-miss-rate%
> >>> 1.862e+10 -21.7% 1.458e+10 ± 3% perf-stat.ps.branch-instructions
> >>> 36288320 -22.6% 28087388 ± 3% perf-stat.ps.branch-misses
> >>> 1.102e+08 -22.1% 85853787 ± 4% perf-stat.ps.cache-misses
> >>> 3.939e+08 ± 2% -22.3% 3.059e+08 ± 3% perf-stat.ps.cache-references
> >>> 4083 -17.6% 3364 ± 9% perf-stat.ps.context-switches
> >>> 13791307 ± 6% -31.4% 9462889 ± 12% perf-stat.ps.dTLB-load-misses
> >>> 1.878e+10 -21.7% 1.471e+10 ± 3% perf-stat.ps.dTLB-loads
> >>> 841284 ± 3% -29.2% 595799 ± 9% perf-stat.ps.dTLB-store-misses
> >>> 4.781e+09 -23.6% 3.653e+09 ± 4% perf-stat.ps.dTLB-stores
> >>> 1641051 -27.3% 1193786 ± 5% perf-stat.ps.iTLB-load-misses
> >>> 860191 ± 5% -32.5% 580527 ± 16% perf-stat.ps.iTLB-loads
> >>> 6.673e+10 -21.4% 5.245e+10 ± 3% perf-stat.ps.instructions
> >>> 21.84 ± 3% -38.8% 13.36 ± 42% perf-stat.ps.major-faults
> >>> 251794 -24.0% 191382 ± 4% perf-stat.ps.minor-faults
> >>> 2978954 -17.7% 2450438 ± 5% perf-stat.ps.node-loads
> >>> 5260916 -23.0% 4051179 ± 5% perf-stat.ps.node-store-misses
> >>> 9107935 -27.0% 6646932 ± 11% perf-stat.ps.node-stores
> >>> 251816 -24.0% 191395 ± 4% perf-stat.ps.page-faults
> >>> 2.334e+13 -21.5% 1.831e+13 ± 3% perf-stat.total.instructions
> >>> 28.48 ± 10% -13.7 14.83 ± 25% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 28.43 ± 10% -13.7 14.78 ± 25% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
> >>> 28.25 ± 9% -13.3 14.91 ± 25% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 12.93 ± 17% -12.9 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 12.91 ± 17% -12.9 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.79 ± 6% -0.5 0.29 ±100% perf-profile.calltrace.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 2.83 ± 12% +2.5 5.33 ± 33% perf-profile.calltrace.cycles-pp.on_each_cpu_cond_mask.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list
> >>> 2.83 ± 12% +2.5 5.33 ± 33% perf-profile.calltrace.cycles-pp.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 2.83 ± 12% +2.5 5.33 ± 33% perf-profile.calltrace.cycles-pp.arch_tlbbatch_flush.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_lruvec
> >>> 70.11 ± 6% +8.3 78.43 ± 5% perf-profile.calltrace.cycles-pp.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault
> >>> 71.46 ± 5% +8.5 79.92 ± 3% perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
> >>> 71.44 ± 5% +8.5 79.91 ± 3% perf-profile.calltrace.cycles-pp.filemap_fault.__xfs_filemap_fault.__do_fault.do_fault.__handle_mm_fault
> >>> 71.45 ± 5% +8.5 79.92 ± 3% perf-profile.calltrace.cycles-pp.__xfs_filemap_fault.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault
> >>> 16.02 ± 13% +9.0 25.07 ± 12% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault.__do_fault
> >>> 13.50 ± 17% +9.5 23.02 ± 14% perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.filemap_fault.__xfs_filemap_fault
> >>> 13.46 ± 17% +9.5 22.98 ± 14% perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.filemap_fault
> >>> 9.65 ± 61% +9.6 19.25 ± 22% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
> >>> 9.65 ± 61% +9.6 19.26 ± 22% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
> >>> 9.65 ± 61% +9.6 19.26 ± 22% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault
> >>> 9.66 ± 61% +9.6 19.28 ± 22% perf-profile.calltrace.cycles-pp.asm_exc_page_fault
> >>> 0.00 +22.3 22.26 ± 13% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
> >>> 0.00 +22.3 22.29 ± 13% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.00 +22.3 22.29 ± 13% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 30.22 ± 9% -13.9 16.30 ± 25% perf-profile.children.cycles-pp.lru_note_cost
> >>> 1.15 ± 40% -0.9 0.29 ±108% perf-profile.children.cycles-pp.shrink_slab
> >>> 1.10 ± 42% -0.8 0.26 ±119% perf-profile.children.cycles-pp.do_shrink_slab
> >>> 1.06 ± 43% -0.8 0.24 ±121% perf-profile.children.cycles-pp.list_lru_walk_one_irq
> >>> 1.06 ± 44% -0.8 0.24 ±122% perf-profile.children.cycles-pp.__list_lru_walk_one
> >>> 1.05 ± 43% -0.8 0.24 ±122% perf-profile.children.cycles-pp.shadow_lru_isolate
> >>> 1.35 ± 7% -0.5 0.84 ± 2% perf-profile.children.cycles-pp.page_referenced
> >>> 0.80 ± 7% -0.3 0.49 perf-profile.children.cycles-pp.page_referenced_one
> >>> 0.65 ± 4% -0.2 0.47 ± 34% perf-profile.children.cycles-pp._raw_spin_lock
> >>> 0.60 ± 3% -0.2 0.43 ± 16% perf-profile.children.cycles-pp.page_vma_mapped_walk
> >>> 0.18 ± 19% -0.1 0.04 ±100% perf-profile.children.cycles-pp.worker_thread
> >>> 0.17 ± 21% -0.1 0.04 ±100% perf-profile.children.cycles-pp.process_one_work
> >>> 0.17 ± 20% -0.1 0.04 ±100% perf-profile.children.cycles-pp.drain_local_pages_wq
> >>> 0.17 ± 20% -0.1 0.04 ±100% perf-profile.children.cycles-pp.drain_pages_zone
> >>> 0.52 -0.1 0.43 ± 12% perf-profile.children.cycles-pp.__list_del_entry_valid
> >>> 0.28 ± 2% -0.1 0.20 ± 12% perf-profile.children.cycles-pp.down_read
> >>> 0.18 ± 3% -0.0 0.13 ± 19% perf-profile.children.cycles-pp.page_mapping
> >>> 0.16 ± 2% -0.0 0.11 ± 19% perf-profile.children.cycles-pp.___might_sleep
> >>> 3.15 ± 10% +2.6 5.76 ± 31% perf-profile.children.cycles-pp.smp_call_function_many_cond
> >>> 3.27 ± 9% +2.6 5.90 ± 30% perf-profile.children.cycles-pp.try_to_unmap_flush
> >>> 3.27 ± 9% +2.6 5.90 ± 30% perf-profile.children.cycles-pp.arch_tlbbatch_flush
> >>> 3.36 ± 9% +2.7 6.02 ± 30% perf-profile.children.cycles-pp.on_each_cpu_cond_mask
> >>> 70.11 ± 6% +8.3 78.43 ± 5% perf-profile.children.cycles-pp.page_cache_readahead_unbounded
> >>> 71.45 ± 5% +8.5 79.91 ± 3% perf-profile.children.cycles-pp.filemap_fault
> >>> 71.45 ± 5% +8.5 79.91 ± 3% perf-profile.children.cycles-pp.__xfs_filemap_fault
> >>> 71.46 ± 5% +8.5 79.92 ± 3% perf-profile.children.cycles-pp.__do_fault
> >>> 15.42 ± 18% +8.9 24.31 ± 15% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
> >>> 16.07 ± 13% +9.0 25.08 ± 12% perf-profile.children.cycles-pp.add_to_page_cache_lru
> >>> 13.65 ± 16% +9.4 23.08 ± 14% perf-profile.children.cycles-pp.lru_cache_add
> >>> 13.65 ± 16% +9.4 23.08 ± 14% perf-profile.children.cycles-pp.__pagevec_lru_add
> >>> 0.00 +22.4 22.40 ± 13% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
> >>> 0.31 ± 14% -0.1 0.17 ± 65% perf-profile.self.cycles-pp.workingset_eviction
> >>> 0.35 ± 3% -0.1 0.25 ± 11% perf-profile.self.cycles-pp.shrink_page_list
> >>> 0.36 ± 2% -0.1 0.27 ± 16% perf-profile.self.cycles-pp.page_vma_mapped_walk
> >>> 0.23 ± 8% -0.1 0.14 ± 5% perf-profile.self.cycles-pp.page_referenced_one
> >>> 0.51 -0.1 0.42 ± 11% perf-profile.self.cycles-pp.__list_del_entry_valid
> >>> 0.14 ± 24% -0.1 0.06 ± 62% perf-profile.self.cycles-pp.page_add_file_rmap
> >>> 0.22 ± 17% -0.1 0.15 ± 32% perf-profile.self.cycles-pp.__add_to_page_cache_locked
> >>> 0.20 ± 4% -0.1 0.14 ± 11% perf-profile.self.cycles-pp.down_read
> >>> 0.17 ± 4% -0.0 0.12 ± 20% perf-profile.self.cycles-pp.page_mapping
> >>> 0.15 ± 2% -0.0 0.10 ± 17% perf-profile.self.cycles-pp.___might_sleep
> >>> 0.16 ± 2% -0.0 0.12 ± 16% perf-profile.self.cycles-pp._raw_spin_lock
> >>> 0.35 ± 3% +0.0 0.39 ± 4% perf-profile.self.cycles-pp.isolate_lru_pages
> >>> 3.04 ± 10% +2.6 5.62 ± 31% perf-profile.self.cycles-pp.smp_call_function_many_cond
> >>> 13451 ± 4% -18.7% 10931 ± 8% softirqs.CPU10.RCU
> >>> 13708 ± 3% -23.7% 10460 ± 11% softirqs.CPU100.RCU
> >>> 13486 -20.7% 10698 ± 9% softirqs.CPU101.RCU
> >>> 13796 ± 3% -25.5% 10279 ± 9% softirqs.CPU102.RCU
> >>> 13635 ± 3% -27.8% 9841 ± 13% softirqs.CPU103.RCU
> >>> 13649 ± 5% -20.9% 10799 ± 9% softirqs.CPU11.RCU
> >>> 14005 ± 11% -21.8% 10956 ± 11% softirqs.CPU12.RCU
> >>> 14004 ± 5% -23.0% 10780 ± 7% softirqs.CPU13.RCU
> >>> 13721 ± 6% -17.0% 11392 ± 9% softirqs.CPU15.RCU
> >>> 14613 ± 9% -21.9% 11413 ± 6% softirqs.CPU16.RCU
> >>> 14524 ± 5% -26.4% 10684 ± 7% softirqs.CPU19.RCU
> >>> 139021 ± 3% +10.2% 153263 ± 11% softirqs.CPU19.TIMER
> >>> 14587 ± 6% -21.4% 11466 ± 8% softirqs.CPU2.RCU
> >>> 14011 ± 5% -16.6% 11686 ± 13% softirqs.CPU21.RCU
> >>> 13782 ± 6% -23.7% 10513 ± 11% softirqs.CPU22.RCU
> >>> 13775 ± 4% -20.7% 10917 ± 6% softirqs.CPU23.RCU
> >>> 13160 ± 6% -21.1% 10384 ± 10% softirqs.CPU24.RCU
> >>> 12503 ± 4% -16.4% 10457 ± 11% softirqs.CPU27.RCU
> >>> 15550 ± 22% -32.6% 10484 ± 10% softirqs.CPU29.RCU
> >>> 15227 ± 5% -23.6% 11636 ± 12% softirqs.CPU3.RCU
> >>> 14469 ± 5% -23.5% 11064 ± 10% softirqs.CPU30.RCU
> >>> 14106 -24.5% 10655 ± 10% softirqs.CPU31.RCU
> >>> 13865 -21.3% 10914 ± 11% softirqs.CPU32.RCU
> >>> 13899 ± 2% -21.7% 10887 ± 12% softirqs.CPU35.RCU
> >>> 13622 ± 2% -25.0% 10218 ± 12% softirqs.CPU36.RCU
> >>> 14247 ± 2% -24.2% 10800 ± 12% softirqs.CPU37.RCU
> >>> 13728 ± 2% -23.1% 10554 ± 8% softirqs.CPU38.RCU
> >>> 15287 ± 6% -25.7% 11361 ± 7% softirqs.CPU4.RCU
> >>> 13561 -21.5% 10643 ± 7% softirqs.CPU40.RCU
> >>> 13852 ± 2% -22.4% 10749 ± 10% softirqs.CPU41.RCU
> >>> 13475 ± 2% -19.3% 10872 ± 14% softirqs.CPU42.RCU
> >>> 13899 -24.3% 10524 ± 9% softirqs.CPU43.RCU
> >>> 14434 ± 4% -27.3% 10496 ± 10% softirqs.CPU44.RCU
> >>> 13182 ± 5% -23.6% 10074 ± 8% softirqs.CPU46.RCU
> >>> 13201 ± 2% -22.7% 10209 ± 7% softirqs.CPU49.RCU
> >>> 13956 ± 2% -18.1% 11429 ± 10% softirqs.CPU5.RCU
> >>> 12714 ± 3% -16.8% 10573 ± 10% softirqs.CPU50.RCU
> >>> 12950 ± 2% -20.4% 10310 ± 4% softirqs.CPU51.RCU
> >>> 18656 ± 17% -35.7% 11997 ± 29% softirqs.CPU52.RCU
> >>> 13774 ± 8% -26.9% 10069 ± 11% softirqs.CPU54.RCU
> >>> 14959 ± 9% -31.5% 10249 ± 6% softirqs.CPU55.RCU
> >>> 13920 ± 5% -22.2% 10831 ± 6% softirqs.CPU56.RCU
> >>> 12389 -21.9% 9674 ± 8% softirqs.CPU57.RCU
> >>> 13374 ± 6% -27.4% 9709 ± 8% softirqs.CPU58.RCU
> >>> 11983 ± 3% -18.1% 9819 ± 3% softirqs.CPU59.RCU
> >>> 13759 ± 11% -21.1% 10860 ± 11% softirqs.CPU6.RCU
> >>> 13336 ± 5% -21.0% 10532 ± 12% softirqs.CPU60.RCU
> >>> 12879 ± 2% -20.2% 10281 ± 8% softirqs.CPU61.RCU
> >>> 12923 ± 6% -17.8% 10623 ± 6% softirqs.CPU62.RCU
> >>> 12780 ± 4% -19.0% 10348 ± 3% softirqs.CPU63.RCU
> >>> 12774 ± 4% -16.3% 10694 ± 6% softirqs.CPU64.RCU
> >>> 12760 ± 4% -19.3% 10295 ± 3% softirqs.CPU65.RCU
> >>> 13190 ± 7% -19.9% 10569 ± 4% softirqs.CPU67.RCU
> >>> 13164 ± 8% -18.8% 10687 ± 3% softirqs.CPU68.RCU
> >>> 12820 ± 11% -20.5% 10186 ± 4% softirqs.CPU69.RCU
> >>> 13913 ± 3% -24.5% 10501 ± 5% softirqs.CPU7.RCU
> >>> 12773 ± 6% -17.2% 10580 ± 11% softirqs.CPU71.RCU
> >>> 13220 ± 10% -18.0% 10840 ± 7% softirqs.CPU72.RCU
> >>> 12855 ± 6% -13.2% 11154 ± 11% softirqs.CPU73.RCU
> >>> 13151 ± 6% -20.4% 10465 ± 6% softirqs.CPU74.RCU
> >>> 15476 ± 40% -37.3% 9700 ± 8% softirqs.CPU75.RCU
> >>> 11638 ± 4% -19.1% 9413 ± 6% softirqs.CPU76.RCU
> >>> 13437 ± 2% -19.9% 10765 ± 6% softirqs.CPU78.RCU
> >>> 13924 ± 7% -24.0% 10580 ± 7% softirqs.CPU79.RCU
> >>> 13580 ± 2% -22.9% 10466 ± 5% softirqs.CPU80.RCU
> >>> 13852 ± 2% -18.9% 11232 ± 5% softirqs.CPU82.RCU
> >>> 13631 ± 2% -23.2% 10464 ± 12% softirqs.CPU83.RCU
> >>> 13569 -24.9% 10186 ± 6% softirqs.CPU84.RCU
> >>> 13167 -19.8% 10564 ± 12% softirqs.CPU85.RCU
> >>> 13659 ± 5% -22.5% 10583 ± 8% softirqs.CPU87.RCU
> >>> 13739 ± 3% -28.4% 9833 ± 10% softirqs.CPU88.RCU
> >>> 14107 ± 5% -29.1% 10007 ± 7% softirqs.CPU89.RCU
> >>> 13450 ± 3% -25.9% 9967 ± 8% softirqs.CPU90.RCU
> >>> 13833 ± 4% -29.6% 9744 ± 11% softirqs.CPU91.RCU
> >>> 13468 -19.6% 10825 ± 5% softirqs.CPU92.RCU
> >>> 13441 ± 2% -24.1% 10201 ± 9% softirqs.CPU93.RCU
> >>> 13122 ± 2% -21.5% 10304 ± 6% softirqs.CPU94.RCU
> >>> 13555 -21.3% 10674 ± 7% softirqs.CPU95.RCU
> >>> 14165 ± 6% -29.9% 9926 ± 7% softirqs.CPU96.RCU
> >>> 13537 ± 4% -26.7% 9918 ± 5% softirqs.CPU98.RCU
> >>> 13739 ± 12% -22.9% 10586 ± 12% softirqs.CPU99.RCU
> >>> 1430574 ± 2% -21.0% 1130596 ± 6% softirqs.RCU
> >>> 66398118 -28.7% 47342083 ± 5% interrupts.CAL:Function_call_interrupts
> >>> 607336 ± 2% -24.4% 458975 ± 5% interrupts.CPU0.CAL:Function_call_interrupts
> >>> 1868 ± 3% -23.3% 1434 ± 10% interrupts.CPU0.RES:Rescheduling_interrupts
> >>> 794675 ± 2% -22.1% 618688 ± 5% interrupts.CPU0.TLB:TLB_shootdowns
> >>> 614950 ± 2% -26.0% 455078 ± 3% interrupts.CPU1.CAL:Function_call_interrupts
> >>> 1279 ± 5% -35.2% 829.00 ± 22% interrupts.CPU1.RES:Rescheduling_interrupts
> >>> 806824 ± 2% -23.4% 617784 ± 3% interrupts.CPU1.TLB:TLB_shootdowns
> >>> 614681 ± 3% -28.4% 439939 ± 6% interrupts.CPU10.CAL:Function_call_interrupts
> >>> 1212 ± 5% -34.6% 792.50 ± 18% interrupts.CPU10.RES:Rescheduling_interrupts
> >>> 806858 ± 2% -26.6% 592584 ± 5% interrupts.CPU10.TLB:TLB_shootdowns
> >>> 661418 ± 3% -29.8% 464404 ± 6% interrupts.CPU100.CAL:Function_call_interrupts
> >>> 884.25 ± 7% -43.5% 500.00 ± 36% interrupts.CPU100.RES:Rescheduling_interrupts
> >>> 861106 ± 3% -27.5% 623915 ± 6% interrupts.CPU100.TLB:TLB_shootdowns
> >>> 653401 ± 2% -28.3% 468243 ± 6% interrupts.CPU101.CAL:Function_call_interrupts
> >>> 917.50 ± 6% -45.4% 500.50 ± 30% interrupts.CPU101.RES:Rescheduling_interrupts
> >>> 851645 ± 2% -25.7% 632808 ± 6% interrupts.CPU101.TLB:TLB_shootdowns
> >>> 675915 -31.1% 465910 ± 6% interrupts.CPU102.CAL:Function_call_interrupts
> >>> 878.00 ± 4% -44.2% 490.25 ± 35% interrupts.CPU102.RES:Rescheduling_interrupts
> >>> 881333 -28.6% 629560 ± 5% interrupts.CPU102.TLB:TLB_shootdowns
> >>> 644559 ± 2% -32.6% 434481 ± 4% interrupts.CPU103.CAL:Function_call_interrupts
> >>> 1032 ± 11% -40.5% 613.75 ± 25% interrupts.CPU103.RES:Rescheduling_interrupts
> >>> 838778 ± 2% -30.1% 586410 ± 4% interrupts.CPU103.TLB:TLB_shootdowns
> >>> 617666 ± 2% -26.8% 452087 ± 4% interrupts.CPU11.CAL:Function_call_interrupts
> >>> 810537 ± 2% -24.6% 611396 ± 4% interrupts.CPU11.TLB:TLB_shootdowns
> >>> 614834 -26.3% 452926 ± 5% interrupts.CPU12.CAL:Function_call_interrupts
> >>> 1189 ± 4% -29.6% 837.50 ± 23% interrupts.CPU12.RES:Rescheduling_interrupts
> >>> 806814 -24.2% 611271 ± 4% interrupts.CPU12.TLB:TLB_shootdowns
> >>> 619727 ± 2% -27.2% 451223 ± 6% interrupts.CPU13.CAL:Function_call_interrupts
> >>> 1195 ± 4% -34.3% 785.50 ± 22% interrupts.CPU13.RES:Rescheduling_interrupts
> >>> 813300 ± 2% -25.0% 610043 ± 5% interrupts.CPU13.TLB:TLB_shootdowns
> >>> 620147 -27.8% 447799 ± 5% interrupts.CPU14.CAL:Function_call_interrupts
> >>> 1166 ± 4% -31.6% 797.50 ± 21% interrupts.CPU14.RES:Rescheduling_interrupts
> >>> 811424 -25.5% 604177 ± 4% interrupts.CPU14.TLB:TLB_shootdowns
> >>> 615680 ± 2% -29.2% 435758 ± 2% interrupts.CPU15.CAL:Function_call_interrupts
> >>> 1191 ± 4% -34.5% 780.25 ± 23% interrupts.CPU15.RES:Rescheduling_interrupts
> >>> 808711 ± 2% -27.2% 588888 ± 2% interrupts.CPU15.TLB:TLB_shootdowns
> >>> 606636 -26.4% 446249 ± 5% interrupts.CPU16.CAL:Function_call_interrupts
> >>> 1266 ± 8% -36.6% 803.00 ± 22% interrupts.CPU16.RES:Rescheduling_interrupts
> >>> 796636 -24.5% 601193 ± 5% interrupts.CPU16.TLB:TLB_shootdowns
> >>> 624389 -28.6% 445543 ± 4% interrupts.CPU17.CAL:Function_call_interrupts
> >>> 1199 ± 4% -28.3% 860.25 ± 27% interrupts.CPU17.RES:Rescheduling_interrupts
> >>> 819052 -26.5% 601950 ± 4% interrupts.CPU17.TLB:TLB_shootdowns
> >>> 608716 ± 2% -28.1% 437968 ± 9% interrupts.CPU18.CAL:Function_call_interrupts
> >>> 1255 ± 7% -36.3% 800.00 ± 21% interrupts.CPU18.RES:Rescheduling_interrupts
> >>> 799154 ± 2% -26.0% 591127 ± 8% interrupts.CPU18.TLB:TLB_shootdowns
> >>> 616531 -26.4% 453509 ± 6% interrupts.CPU19.CAL:Function_call_interrupts
> >>> 1202 ± 2% -30.7% 833.50 ± 21% interrupts.CPU19.RES:Rescheduling_interrupts
> >>> 809473 -24.4% 611703 ± 6% interrupts.CPU19.TLB:TLB_shootdowns
> >>> 618264 ± 2% -26.3% 455365 ± 5% interrupts.CPU2.CAL:Function_call_interrupts
> >>> 1274 ± 6% -36.5% 809.50 ± 18% interrupts.CPU2.RES:Rescheduling_interrupts
> >>> 811333 ± 2% -24.3% 613812 ± 5% interrupts.CPU2.TLB:TLB_shootdowns
> >>> 614733 ± 2% -27.3% 446736 ± 5% interrupts.CPU20.CAL:Function_call_interrupts
> >>> 1171 ± 4% -31.7% 800.00 ± 20% interrupts.CPU20.RES:Rescheduling_interrupts
> >>> 805833 ± 2% -25.2% 602398 ± 4% interrupts.CPU20.TLB:TLB_shootdowns
> >>> 618591 ± 2% -28.1% 444926 ± 6% interrupts.CPU21.CAL:Function_call_interrupts
> >>> 1191 ± 4% -26.7% 873.50 ± 16% interrupts.CPU21.RES:Rescheduling_interrupts
> >>> 811067 ± 2% -25.9% 601260 ± 6% interrupts.CPU21.TLB:TLB_shootdowns
> >>> 610032 ± 3% -25.6% 454093 ± 5% interrupts.CPU22.CAL:Function_call_interrupts
> >>> 1195 ± 4% -33.2% 798.25 ± 22% interrupts.CPU22.RES:Rescheduling_interrupts
> >>> 800704 ± 3% -23.5% 612325 ± 4% interrupts.CPU22.TLB:TLB_shootdowns
> >>> 622735 -27.6% 451153 ± 4% interrupts.CPU23.CAL:Function_call_interrupts
> >>> 1186 ± 5% -32.1% 804.75 ± 22% interrupts.CPU23.RES:Rescheduling_interrupts
> >>> 817692 -25.5% 609298 ± 4% interrupts.CPU23.TLB:TLB_shootdowns
> >>> 599095 ± 4% -24.6% 451424 ± 4% interrupts.CPU24.CAL:Function_call_interrupts
> >>> 1186 -34.8% 773.50 ± 23% interrupts.CPU24.RES:Rescheduling_interrupts
> >>> 784537 ± 4% -22.1% 610895 ± 4% interrupts.CPU24.TLB:TLB_shootdowns
> >>> 610001 -25.5% 454518 ± 4% interrupts.CPU25.CAL:Function_call_interrupts
> >>> 1199 ± 4% -35.7% 770.75 ± 22% interrupts.CPU25.RES:Rescheduling_interrupts
> >>> 798988 -22.9% 616276 ± 4% interrupts.CPU25.TLB:TLB_shootdowns
> >>> 625365 ± 4% -27.5% 453142 ± 9% interrupts.CPU26.CAL:Function_call_interrupts
> >>> 1180 ± 3% -36.2% 752.75 ± 19% interrupts.CPU26.RES:Rescheduling_interrupts
> >>> 811998 ± 4% -25.0% 608669 ± 8% interrupts.CPU26.TLB:TLB_shootdowns
> >>> 663801 ± 4% -32.7% 446856 ± 9% interrupts.CPU27.CAL:Function_call_interrupts
> >>> 1131 ± 5% -32.0% 769.75 ± 21% interrupts.CPU27.RES:Rescheduling_interrupts
> >>> 865022 ± 4% -30.2% 603409 ± 8% interrupts.CPU27.TLB:TLB_shootdowns
> >>> 661978 ± 2% -31.2% 455117 ± 5% interrupts.CPU28.CAL:Function_call_interrupts
> >>> 1103 ± 3% -30.3% 769.50 ± 23% interrupts.CPU28.RES:Rescheduling_interrupts
> >>> 862876 ± 2% -29.0% 612986 ± 5% interrupts.CPU28.TLB:TLB_shootdowns
> >>> 653822 ± 2% -30.5% 454714 ± 5% interrupts.CPU29.CAL:Function_call_interrupts
> >>> 1250 ± 26% -40.1% 749.25 ± 22% interrupts.CPU29.RES:Rescheduling_interrupts
> >>> 851829 ± 2% -28.0% 613367 ± 5% interrupts.CPU29.TLB:TLB_shootdowns
> >>> 618009 ± 2% -25.5% 460523 ± 5% interrupts.CPU3.CAL:Function_call_interrupts
> >>> 1257 ± 6% -37.6% 784.75 ± 20% interrupts.CPU3.RES:Rescheduling_interrupts
> >>> 811302 ± 2% -23.0% 624821 ± 4% interrupts.CPU3.TLB:TLB_shootdowns
> >>> 655984 ± 3% -28.8% 467002 ± 6% interrupts.CPU30.CAL:Function_call_interrupts
> >>> 1062 ± 6% -31.1% 731.50 ± 20% interrupts.CPU30.RES:Rescheduling_interrupts
> >>> 852527 ± 3% -26.0% 630731 ± 5% interrupts.CPU30.TLB:TLB_shootdowns
> >>> 672657 ± 2% -31.1% 463294 ± 7% interrupts.CPU31.CAL:Function_call_interrupts
> >>> 1063 ± 5% -33.1% 712.00 ± 23% interrupts.CPU31.RES:Rescheduling_interrupts
> >>> 875436 ± 2% -28.8% 623697 ± 7% interrupts.CPU31.TLB:TLB_shootdowns
> >>> 660526 ± 2% -30.9% 456119 ± 6% interrupts.CPU32.CAL:Function_call_interrupts
> >>> 1097 ± 5% -34.2% 721.50 ± 19% interrupts.CPU32.RES:Rescheduling_interrupts
> >>> 860344 ± 2% -28.6% 614488 ± 5% interrupts.CPU32.TLB:TLB_shootdowns
> >>> 672799 -30.6% 467069 ± 6% interrupts.CPU33.CAL:Function_call_interrupts
> >>> 1045 ± 4% -31.7% 714.25 ± 22% interrupts.CPU33.RES:Rescheduling_interrupts
> >>> 876520 -28.1% 630042 ± 5% interrupts.CPU33.TLB:TLB_shootdowns
> >>> 659693 ± 3% -29.4% 465918 ± 7% interrupts.CPU34.CAL:Function_call_interrupts
> >>> 1062 ± 5% -32.9% 712.75 ± 20% interrupts.CPU34.RES:Rescheduling_interrupts
> >>> 858950 ± 3% -26.8% 629047 ± 6% interrupts.CPU34.TLB:TLB_shootdowns
> >>> 653634 -28.1% 469920 ± 6% interrupts.CPU35.CAL:Function_call_interrupts
> >>> 1074 ± 3% -34.3% 706.50 ± 21% interrupts.CPU35.RES:Rescheduling_interrupts
> >>> 850502 -25.1% 636982 ± 5% interrupts.CPU35.TLB:TLB_shootdowns
> >>> 670983 ± 2% -31.3% 460791 ± 7% interrupts.CPU36.CAL:Function_call_interrupts
> >>> 1005 ± 3% -32.0% 683.50 ± 24% interrupts.CPU36.RES:Rescheduling_interrupts
> >>> 872683 ± 2% -28.6% 623242 ± 7% interrupts.CPU36.TLB:TLB_shootdowns
> >>> 665896 ± 2% -31.0% 459690 ± 7% interrupts.CPU37.CAL:Function_call_interrupts
> >>> 1044 ± 5% -32.2% 708.50 ± 24% interrupts.CPU37.RES:Rescheduling_interrupts
> >>> 867134 ± 2% -28.4% 620946 ± 7% interrupts.CPU37.TLB:TLB_shootdowns
> >>> 673423 -32.8% 452817 ± 11% interrupts.CPU38.CAL:Function_call_interrupts
> >>> 1029 ± 3% -29.6% 724.50 ± 11% interrupts.CPU38.RES:Rescheduling_interrupts
> >>> 877063 -30.6% 609068 ± 10% interrupts.CPU38.TLB:TLB_shootdowns
> >>> 672805 -30.6% 466969 ± 6% interrupts.CPU39.CAL:Function_call_interrupts
> >>> 1041 ± 3% -33.0% 697.50 ± 19% interrupts.CPU39.RES:Rescheduling_interrupts
> >>> 875911 -27.8% 632608 ± 6% interrupts.CPU39.TLB:TLB_shootdowns
> >>> 608668 ± 4% -28.7% 434061 ± 4% interrupts.CPU4.CAL:Function_call_interrupts
> >>> 1231 ± 4% -32.8% 827.00 ± 18% interrupts.CPU4.RES:Rescheduling_interrupts
> >>> 798347 ± 4% -26.6% 585995 ± 3% interrupts.CPU4.TLB:TLB_shootdowns
> >>> 674428 ± 2% -31.4% 462505 ± 7% interrupts.CPU40.CAL:Function_call_interrupts
> >>> 1007 ± 4% -34.6% 658.25 ± 24% interrupts.CPU40.RES:Rescheduling_interrupts
> >>> 879115 ± 2% -29.0% 624144 ± 7% interrupts.CPU40.TLB:TLB_shootdowns
> >>> 643767 ± 3% -28.1% 462943 ± 5% interrupts.CPU41.CAL:Function_call_interrupts
> >>> 1024 ± 2% -31.9% 697.25 ± 24% interrupts.CPU41.RES:Rescheduling_interrupts
> >>> 839207 ± 3% -25.7% 623768 ± 5% interrupts.CPU41.TLB:TLB_shootdowns
> >>> 673645 ± 2% -33.6% 446998 ± 3% interrupts.CPU42.CAL:Function_call_interrupts
> >>> 1021 ± 4% -32.9% 685.25 ± 22% interrupts.CPU42.RES:Rescheduling_interrupts
> >>> 877835 ± 2% -31.0% 606123 ± 3% interrupts.CPU42.TLB:TLB_shootdowns
> >>> 669727 -30.7% 464352 ± 6% interrupts.CPU43.CAL:Function_call_interrupts
> >>> 984.25 ± 3% -33.4% 656.00 ± 23% interrupts.CPU43.RES:Rescheduling_interrupts
> >>> 873773 -28.2% 627415 ± 5% interrupts.CPU43.TLB:TLB_shootdowns
> >>> 657530 ± 2% -29.7% 462099 ± 7% interrupts.CPU44.CAL:Function_call_interrupts
> >>> 1036 ± 3% -36.7% 656.00 ± 19% interrupts.CPU44.RES:Rescheduling_interrupts
> >>> 858452 ± 2% -27.5% 622252 ± 7% interrupts.CPU44.TLB:TLB_shootdowns
> >>> 669336 -31.2% 460264 ± 7% interrupts.CPU45.CAL:Function_call_interrupts
> >>> 1022 ± 3% -38.5% 629.25 ± 21% interrupts.CPU45.RES:Rescheduling_interrupts
> >>> 873295 -28.7% 622803 ± 6% interrupts.CPU45.TLB:TLB_shootdowns
> >>> 667880 ± 2% -29.7% 469367 ± 5% interrupts.CPU46.CAL:Function_call_interrupts
> >>> 1033 ± 4% -40.5% 615.00 ± 22% interrupts.CPU46.RES:Rescheduling_interrupts
> >>> 871092 ± 2% -27.3% 633627 ± 5% interrupts.CPU46.TLB:TLB_shootdowns
> >>> 672974 -30.6% 467203 ± 6% interrupts.CPU47.CAL:Function_call_interrupts
> >>> 976.50 ± 2% -37.3% 612.25 ± 24% interrupts.CPU47.RES:Rescheduling_interrupts
> >>> 877711 -28.0% 631758 ± 5% interrupts.CPU47.TLB:TLB_shootdowns
> >>> 657839 ± 2% -29.6% 463271 ± 4% interrupts.CPU48.CAL:Function_call_interrupts
> >>> 1000 ± 3% -36.0% 639.50 ± 25% interrupts.CPU48.RES:Rescheduling_interrupts
> >>> 856238 ± 2% -27.1% 624606 ± 4% interrupts.CPU48.TLB:TLB_shootdowns
> >>> 669436 ± 2% -30.6% 464510 ± 5% interrupts.CPU49.CAL:Function_call_interrupts
> >>> 982.00 -36.9% 620.00 ± 26% interrupts.CPU49.RES:Rescheduling_interrupts
> >>> 872424 ± 2% -28.1% 626960 ± 5% interrupts.CPU49.TLB:TLB_shootdowns
> >>> 611308 ± 2% -27.1% 445888 ± 4% interrupts.CPU5.CAL:Function_call_interrupts
> >>> 1214 ± 3% -26.6% 892.00 ± 25% interrupts.CPU5.RES:Rescheduling_interrupts
> >>> 802805 ± 2% -24.8% 603567 ± 3% interrupts.CPU5.TLB:TLB_shootdowns
> >>> 678589 ± 2% -31.3% 466264 ± 5% interrupts.CPU50.CAL:Function_call_interrupts
> >>> 989.50 ± 2% -36.7% 626.00 ± 26% interrupts.CPU50.RES:Rescheduling_interrupts
> >>> 885146 ± 2% -28.8% 630371 ± 5% interrupts.CPU50.TLB:TLB_shootdowns
> >>> 667630 ± 2% -33.9% 441598 ± 4% interrupts.CPU51.CAL:Function_call_interrupts
> >>> 1010 ± 4% -36.3% 643.25 ± 27% interrupts.CPU51.RES:Rescheduling_interrupts
> >>> 870278 ± 3% -31.6% 595497 ± 4% interrupts.CPU51.TLB:TLB_shootdowns
> >>> 577763 ± 6% -22.5% 447529 ± 3% interrupts.CPU52.CAL:Function_call_interrupts
> >>> 756873 ± 6% -20.1% 604671 ± 3% interrupts.CPU52.TLB:TLB_shootdowns
> >>> 598584 -24.9% 449356 ± 4% interrupts.CPU53.CAL:Function_call_interrupts
> >>> 1246 ± 6% -36.6% 790.25 ± 18% interrupts.CPU53.RES:Rescheduling_interrupts
> >>> 784725 -22.4% 608944 ± 4% interrupts.CPU53.TLB:TLB_shootdowns
> >>> 605885 -24.7% 456389 ± 3% interrupts.CPU54.CAL:Function_call_interrupts
> >>> 1200 ± 4% -40.9% 709.75 ± 20% interrupts.CPU54.RES:Rescheduling_interrupts
> >>> 795232 -22.1% 619278 ± 2% interrupts.CPU54.TLB:TLB_shootdowns
> >>> 616251 -26.3% 454169 ± 5% interrupts.CPU55.CAL:Function_call_interrupts
> >>> 1164 ± 7% -39.4% 705.75 ± 22% interrupts.CPU55.RES:Rescheduling_interrupts
> >>> 807804 -24.3% 611384 ± 6% interrupts.CPU55.TLB:TLB_shootdowns
> >>> 622492 -29.7% 437717 ± 4% interrupts.CPU56.CAL:Function_call_interrupts
> >>> 1199 ± 12% -37.2% 753.50 ± 25% interrupts.CPU56.RES:Rescheduling_interrupts
> >>> 819213 -27.9% 590554 ± 4% interrupts.CPU56.TLB:TLB_shootdowns
> >>> 606582 ± 2% -26.2% 447869 ± 5% interrupts.CPU57.CAL:Function_call_interrupts
> >>> 1230 ± 14% -39.5% 744.50 ± 32% interrupts.CPU57.RES:Rescheduling_interrupts
> >>> 794991 ± 2% -23.9% 605266 ± 4% interrupts.CPU57.TLB:TLB_shootdowns
> >>> 614828 ± 2% -26.1% 454208 ± 4% interrupts.CPU58.CAL:Function_call_interrupts
> >>> 810403 -24.3% 613873 ± 4% interrupts.CPU58.TLB:TLB_shootdowns
> >>> 618791 ± 2% -27.7% 447687 ± 6% interrupts.CPU59.CAL:Function_call_interrupts
> >>> 1132 ± 3% -36.2% 722.75 ± 25% interrupts.CPU59.RES:Rescheduling_interrupts
> >>> 812821 ± 2% -25.6% 604844 ± 5% interrupts.CPU59.TLB:TLB_shootdowns
> >>> 612649 -26.7% 448845 ± 5% interrupts.CPU6.CAL:Function_call_interrupts
> >>> 1236 ± 3% -32.5% 834.75 ± 24% interrupts.CPU6.RES:Rescheduling_interrupts
> >>> 804740 -24.5% 607594 ± 4% interrupts.CPU6.TLB:TLB_shootdowns
> >>> 625450 -27.6% 452891 ± 4% interrupts.CPU60.CAL:Function_call_interrupts
> >>> 1111 -38.4% 684.75 ± 25% interrupts.CPU60.RES:Rescheduling_interrupts
> >>> 822546 -25.7% 611135 ± 3% interrupts.CPU60.TLB:TLB_shootdowns
> >>> 605750 ± 3% -29.3% 428114 ± 11% interrupts.CPU61.CAL:Function_call_interrupts
> >>> 1107 ± 3% -37.4% 693.50 ± 27% interrupts.CPU61.RES:Rescheduling_interrupts
> >>> 793936 ± 2% -27.1% 579088 ± 10% interrupts.CPU61.TLB:TLB_shootdowns
> >>> 624532 -27.6% 451904 ± 5% interrupts.CPU62.CAL:Function_call_interrupts
> >>> 1082 ± 6% -38.7% 663.25 ± 24% interrupts.CPU62.RES:Rescheduling_interrupts
> >>> 820167 -25.4% 612081 ± 5% interrupts.CPU62.TLB:TLB_shootdowns
> >>> 610303 ± 3% -24.9% 458638 ± 4% interrupts.CPU63.CAL:Function_call_interrupts
> >>> 1063 ± 7% -23.5% 813.75 ± 15% interrupts.CPU63.RES:Rescheduling_interrupts
> >>> 800590 ± 4% -22.6% 619496 ± 4% interrupts.CPU63.TLB:TLB_shootdowns
> >>> 614524 -28.1% 442139 ± 6% interrupts.CPU64.CAL:Function_call_interrupts
> >>> 1066 ± 2% -37.5% 666.50 ± 31% interrupts.CPU64.RES:Rescheduling_interrupts
> >>> 807401 -26.1% 596514 ± 6% interrupts.CPU64.TLB:TLB_shootdowns
> >>> 614325 -26.1% 454115 ± 3% interrupts.CPU65.CAL:Function_call_interrupts
> >>> 1100 ± 4% -31.7% 752.00 ± 24% interrupts.CPU65.RES:Rescheduling_interrupts
> >>> 805305 -23.8% 613844 ± 3% interrupts.CPU65.TLB:TLB_shootdowns
> >>> 619961 -27.9% 447205 ± 4% interrupts.CPU66.CAL:Function_call_interrupts
> >>> 1052 ± 3% -37.8% 654.50 ± 29% interrupts.CPU66.RES:Rescheduling_interrupts
> >>> 812798 -25.7% 603782 ± 4% interrupts.CPU66.TLB:TLB_shootdowns
> >>> 613766 ± 3% -26.8% 449523 ± 4% interrupts.CPU67.CAL:Function_call_interrupts
> >>> 1028 ± 3% -34.9% 669.00 ± 28% interrupts.CPU67.RES:Rescheduling_interrupts
> >>> 803930 ± 2% -24.5% 606835 ± 4% interrupts.CPU67.TLB:TLB_shootdowns
> >>> 606034 ± 2% -24.9% 454865 ± 5% interrupts.CPU68.CAL:Function_call_interrupts
> >>> 1076 ± 2% -39.0% 657.00 ± 25% interrupts.CPU68.RES:Rescheduling_interrupts
> >>> 796037 ± 2% -22.6% 615935 ± 4% interrupts.CPU68.TLB:TLB_shootdowns
> >>> 621476 -27.0% 453858 ± 3% interrupts.CPU69.CAL:Function_call_interrupts
> >>> 1026 ± 4% -38.1% 634.75 ± 30% interrupts.CPU69.RES:Rescheduling_interrupts
> >>> 816676 -25.1% 612089 ± 3% interrupts.CPU69.TLB:TLB_shootdowns
> >>> 621231 -27.0% 453506 ± 4% interrupts.CPU7.CAL:Function_call_interrupts
> >>> 1197 ± 6% -33.9% 791.75 ± 20% interrupts.CPU7.RES:Rescheduling_interrupts
> >>> 815204 -24.9% 611972 ± 4% interrupts.CPU7.TLB:TLB_shootdowns
> >>> 599309 ± 2% -24.0% 455281 ± 5% interrupts.CPU70.CAL:Function_call_interrupts
> >>> 1065 ± 8% -33.8% 705.75 ± 25% interrupts.CPU70.RES:Rescheduling_interrupts
> >>> 786231 ± 2% -21.5% 617063 ± 5% interrupts.CPU70.TLB:TLB_shootdowns
> >>> 608047 ± 2% -25.0% 456126 ± 4% interrupts.CPU71.CAL:Function_call_interrupts
> >>> 1093 ± 7% -42.6% 627.50 ± 27% interrupts.CPU71.RES:Rescheduling_interrupts
> >>> 795620 ± 2% -22.6% 615898 ± 3% interrupts.CPU71.TLB:TLB_shootdowns
> >>> 616248 -26.2% 455017 ± 4% interrupts.CPU72.CAL:Function_call_interrupts
> >>> 1054 ± 4% -38.6% 647.25 ± 28% interrupts.CPU72.RES:Rescheduling_interrupts
> >>> 808950 -24.0% 614901 ± 3% interrupts.CPU72.TLB:TLB_shootdowns
> >>> 606467 ± 2% -26.1% 448166 ± 5% interrupts.CPU73.CAL:Function_call_interrupts
> >>> 1086 ± 10% -40.2% 649.00 ± 30% interrupts.CPU73.RES:Rescheduling_interrupts
> >>> 794670 -23.7% 606663 ± 6% interrupts.CPU73.TLB:TLB_shootdowns
> >>> 616940 ± 3% -26.2% 455177 ± 5% interrupts.CPU74.CAL:Function_call_interrupts
> >>> 1253 ± 29% -49.6% 631.25 ± 27% interrupts.CPU74.RES:Rescheduling_interrupts
> >>> 811599 ± 3% -24.0% 616784 ± 5% interrupts.CPU74.TLB:TLB_shootdowns
> >>> 616489 ± 2% -26.9% 450722 ± 4% interrupts.CPU75.CAL:Function_call_interrupts
> >>> 1029 ± 5% -35.2% 666.50 ± 17% interrupts.CPU75.RES:Rescheduling_interrupts
> >>> 810064 -24.7% 610172 ± 4% interrupts.CPU75.TLB:TLB_shootdowns
> >>> 616355 -25.8% 457491 ± 4% interrupts.CPU76.CAL:Function_call_interrupts
> >>> 1023 ± 4% -33.8% 677.25 ± 36% interrupts.CPU76.RES:Rescheduling_interrupts
> >>> 810620 -23.6% 619156 ± 4% interrupts.CPU76.TLB:TLB_shootdowns
> >>> 624080 -26.8% 456856 ± 5% interrupts.CPU77.CAL:Function_call_interrupts
> >>> 988.75 ± 3% -36.5% 627.75 ± 28% interrupts.CPU77.RES:Rescheduling_interrupts
> >>> 819788 -24.8% 616322 ± 4% interrupts.CPU77.TLB:TLB_shootdowns
> >>> 631550 ± 4% -32.6% 425420 ± 7% interrupts.CPU78.CAL:Function_call_interrupts
> >>> 820719 ± 4% -29.9% 575690 ± 6% interrupts.CPU78.TLB:TLB_shootdowns
> >>> 660605 ± 3% -31.2% 454493 ± 7% interrupts.CPU79.CAL:Function_call_interrupts
> >>> 928.00 ± 5% -34.2% 610.75 ± 26% interrupts.CPU79.RES:Rescheduling_interrupts
> >>> 859535 ± 3% -28.4% 615412 ± 7% interrupts.CPU79.TLB:TLB_shootdowns
> >>> 617688 ± 2% -26.1% 456619 ± 5% interrupts.CPU8.CAL:Function_call_interrupts
> >>> 1209 ± 2% -34.1% 796.75 ± 20% interrupts.CPU8.RES:Rescheduling_interrupts
> >>> 810639 -23.8% 617830 ± 4% interrupts.CPU8.TLB:TLB_shootdowns
> >>> 669791 -31.5% 458570 ± 5% interrupts.CPU80.CAL:Function_call_interrupts
> >>> 927.25 ± 5% -35.3% 600.00 ± 33% interrupts.CPU80.RES:Rescheduling_interrupts
> >>> 874389 -29.4% 617229 ± 4% interrupts.CPU80.TLB:TLB_shootdowns
> >>> 674042 ± 2% -31.6% 461104 ± 6% interrupts.CPU81.CAL:Function_call_interrupts
> >>> 927.00 ± 10% -39.4% 561.50 ± 28% interrupts.CPU81.RES:Rescheduling_interrupts
> >>> 879695 ± 2% -29.6% 619679 ± 6% interrupts.CPU81.TLB:TLB_shootdowns
> >>> 655466 ± 4% -29.6% 461556 ± 6% interrupts.CPU82.CAL:Function_call_interrupts
> >>> 925.75 ± 5% -33.5% 616.00 ± 36% interrupts.CPU82.RES:Rescheduling_interrupts
> >>> 853704 ± 4% -26.9% 623793 ± 5% interrupts.CPU82.TLB:TLB_shootdowns
> >>> 674219 ± 2% -30.9% 466041 ± 6% interrupts.CPU83.CAL:Function_call_interrupts
> >>> 871.75 ± 6% -37.2% 547.50 ± 25% interrupts.CPU83.RES:Rescheduling_interrupts
> >>> 877804 ± 2% -28.2% 629984 ± 6% interrupts.CPU83.TLB:TLB_shootdowns
> >>> 655309 ± 2% -30.3% 456993 ± 6% interrupts.CPU84.CAL:Function_call_interrupts
> >>> 856104 ± 3% -28.1% 615182 ± 6% interrupts.CPU84.TLB:TLB_shootdowns
> >>> 671766 ± 3% -32.9% 451067 ± 10% interrupts.CPU85.CAL:Function_call_interrupts
> >>> 883.50 ± 5% -34.9% 575.25 ± 33% interrupts.CPU85.RES:Rescheduling_interrupts
> >>> 876735 ± 3% -30.7% 607471 ± 9% interrupts.CPU85.TLB:TLB_shootdowns
> >>> 670853 -30.7% 465032 ± 7% interrupts.CPU86.CAL:Function_call_interrupts
> >>> 921.50 ± 12% -36.6% 584.50 ± 24% interrupts.CPU86.RES:Rescheduling_interrupts
> >>> 874193 -28.2% 627818 ± 6% interrupts.CPU86.TLB:TLB_shootdowns
> >>> 657685 ± 5% -28.8% 467946 ± 5% interrupts.CPU87.CAL:Function_call_interrupts
> >>> 881.75 ± 6% -40.5% 524.25 ± 31% interrupts.CPU87.RES:Rescheduling_interrupts
> >>> 859055 ± 5% -26.4% 632175 ± 5% interrupts.CPU87.TLB:TLB_shootdowns
> >>> 678590 ± 2% -32.1% 460555 ± 7% interrupts.CPU88.CAL:Function_call_interrupts
> >>> 859.75 -35.6% 553.75 ± 27% interrupts.CPU88.RES:Rescheduling_interrupts
> >>> 884834 ± 2% -30.0% 619389 ± 6% interrupts.CPU88.TLB:TLB_shootdowns
> >>> 666036 ± 2% -31.8% 454258 ± 6% interrupts.CPU89.CAL:Function_call_interrupts
> >>> 839.50 ± 4% -36.2% 535.75 ± 32% interrupts.CPU89.RES:Rescheduling_interrupts
> >>> 867385 ± 3% -29.5% 611132 ± 6% interrupts.CPU89.TLB:TLB_shootdowns
> >>> 609692 -25.1% 456911 ± 6% interrupts.CPU9.CAL:Function_call_interrupts
> >>> 1227 ± 6% -33.1% 821.25 ± 16% interrupts.CPU9.RES:Rescheduling_interrupts
> >>> 797988 -22.6% 617954 ± 6% interrupts.CPU9.TLB:TLB_shootdowns
> >>> 672784 ± 2% -31.4% 461861 ± 8% interrupts.CPU90.CAL:Function_call_interrupts
> >>> 830.50 ± 8% -32.9% 557.50 ± 25% interrupts.CPU90.RES:Rescheduling_interrupts
> >>> 877953 ± 2% -28.7% 625589 ± 7% interrupts.CPU90.TLB:TLB_shootdowns
> >>> 666861 -31.7% 455722 ± 6% interrupts.CPU91.CAL:Function_call_interrupts
> >>> 872.50 ± 6% -35.8% 560.50 ± 25% interrupts.CPU91.RES:Rescheduling_interrupts
> >>> 868790 -29.3% 614241 ± 6% interrupts.CPU91.TLB:TLB_shootdowns
> >>> 667714 ± 3% -29.7% 469573 ± 7% interrupts.CPU92.CAL:Function_call_interrupts
> >>> 830.50 ± 2% -34.1% 547.00 ± 25% interrupts.CPU92.RES:Rescheduling_interrupts
> >>> 870856 ± 2% -27.2% 634059 ± 6% interrupts.CPU92.TLB:TLB_shootdowns
> >>> 660286 ± 3% -29.5% 465421 ± 6% interrupts.CPU93.CAL:Function_call_interrupts
> >>> 1017 ± 24% -48.2% 527.50 ± 30% interrupts.CPU93.RES:Rescheduling_interrupts
> >>> 860012 ± 3% -26.7% 630696 ± 5% interrupts.CPU93.TLB:TLB_shootdowns
> >>> 662201 ± 2% -29.7% 465856 ± 7% interrupts.CPU94.CAL:Function_call_interrupts
> >>> 862.50 ± 3% -28.6% 615.50 ± 9% interrupts.CPU94.RES:Rescheduling_interrupts
> >>> 863236 ± 2% -27.3% 627715 ± 6% interrupts.CPU94.TLB:TLB_shootdowns
> >>> 665120 ± 3% -29.5% 468673 ± 5% interrupts.CPU95.CAL:Function_call_interrupts
> >>> 865847 ± 3% -27.0% 632077 ± 5% interrupts.CPU95.TLB:TLB_shootdowns
> >>> 643229 ± 6% -29.2% 455510 ± 7% interrupts.CPU96.CAL:Function_call_interrupts
> >>> 1065 ± 26% -51.7% 514.50 ± 33% interrupts.CPU96.RES:Rescheduling_interrupts
> >>> 838062 ± 6% -26.6% 615358 ± 7% interrupts.CPU96.TLB:TLB_shootdowns
> >>> 671395 ± 2% -32.3% 454608 ± 8% interrupts.CPU97.CAL:Function_call_interrupts
> >>> 827.75 -34.5% 542.50 ± 32% interrupts.CPU97.RES:Rescheduling_interrupts
> >>> 876031 ± 2% -29.8% 614705 ± 7% interrupts.CPU97.TLB:TLB_shootdowns
> >>> 654123 ± 3% -28.1% 470260 ± 6% interrupts.CPU98.CAL:Function_call_interrupts
> >>> 943.50 ± 22% -39.4% 572.00 ± 39% interrupts.CPU98.RES:Rescheduling_interrupts
> >>> 851795 ± 3% -25.1% 637647 ± 5% interrupts.CPU98.TLB:TLB_shootdowns
> >>> 671793 ± 2% -29.6% 473065 ± 5% interrupts.CPU99.CAL:Function_call_interrupts
> >>> 907.25 ± 18% -42.2% 524.00 ± 31% interrupts.CPU99.RES:Rescheduling_interrupts
> >>> 877957 ± 2% -26.9% 641492 ± 4% interrupts.CPU99.TLB:TLB_shootdowns
> >>> 112129 ± 3% -34.8% 73083 ± 23% interrupts.RES:Rescheduling_interrupts
> >>> 86814581 -26.3% 63943240 ± 4% interrupts.TLB:TLB_shootdowns
> >>>
> >>>
> >>>
> >>> ***************************************************************************************************
> >>> lkp-hsw-4ex1: 144 threads Intel(R) Xeon(R) CPU E7-8890 v3 @ 2.50GHz with 512G memory
> >>> =========================================================================================
> >>> compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase/ucode:
> >>> gcc-9/performance/x86_64-rhel-8.3/debian-10.4-x86_64-20200603.cgz/300s/lkp-hsw-4ex1/lru-file-readtwice/vm-scalability/0x16
> >>>
> >>> commit:
> >>> 3fbdbb91fe ("mm/swap: serialize memcg changes in pagevec_lru_move_fn")
> >>> ea4ebd4126 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>>
> >>> 3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d0
> >>> ---------------- ---------------------------
> >>> %stddev %change %stddev
> >>> \ | \
> >>> 91607 ± 3% -21.4% 72038 ± 2% vm-scalability.median
> >>> 26101154 -19.2% 21091017 vm-scalability.throughput
> >>> 219356 -5.4% 207428 ± 2% vm-scalability.time.minor_page_faults
> >>> 9508 ± 2% +4.1% 9897 vm-scalability.time.percent_of_cpu_this_job_got
> >>> 39498 +2.1% 40314 vm-scalability.time.system_time
> >>> 1610 -18.9% 1305 vm-scalability.time.user_time
> >>> 359929 ± 5% -45.6% 195732 ± 19% vm-scalability.time.voluntary_context_switches
> >>> 7.795e+09 -18.9% 6.321e+09 vm-scalability.workload
> >>> 46533490 ±153% -93.7% 2911530 ± 20% cpuidle.C1.time
> >>> 10739 ± 2% -10.9% 9574 ± 3% vmstat.system.cs
> >>> 0.19 ± 9% -0.1 0.08 ± 27% mpstat.cpu.all.iowait%
> >>> 1.57 ± 4% -0.2 1.38 ± 5% mpstat.cpu.all.irq%
> >>> 0.07 ± 3% -0.0 0.06 ± 9% mpstat.cpu.all.soft%
> >>> 2.62 ± 2% -0.4 2.19 mpstat.cpu.all.usr%
> >>> 7586722 ± 3% -15.4% 6416767 slabinfo.radix_tree_node.active_objs
> >>> 145424 ± 3% -16.9% 120883 slabinfo.radix_tree_node.active_slabs
> >>> 8077136 ± 3% -16.6% 6739280 slabinfo.radix_tree_node.num_objs
> >>> 145424 ± 3% -16.9% 120883 slabinfo.radix_tree_node.num_slabs
> >>> 24041086 ± 18% +100.0% 48087441 ± 42% meminfo.Inactive
> >>> 23765445 ± 18% +101.2% 47811304 ± 42% meminfo.Inactive(file)
> >>> 4712235 ± 3% -16.7% 3923141 meminfo.KReclaimable
> >>> 4712235 ± 3% -16.7% 3923141 meminfo.SReclaimable
> >>> 5024021 ± 3% -15.7% 4233804 meminfo.Slab
> >>> 1.97e+08 ± 3% -20.8% 1.56e+08 ± 8% numa-numastat.node0.local_node
> >>> 1.97e+08 ± 3% -20.8% 1.56e+08 ± 8% numa-numastat.node0.numa_hit
> >>> 2.064e+08 ± 4% -16.7% 1.719e+08 ± 2% numa-numastat.node1.local_node
> >>> 56764189 ± 9% -18.7% 46160102 ± 6% numa-numastat.node1.numa_foreign
> >>> 2.065e+08 ± 4% -16.7% 1.719e+08 ± 2% numa-numastat.node1.numa_hit
> >>> 1.907e+08 ± 5% -20.7% 1.511e+08 ± 4% numa-numastat.node2.local_node
> >>> 48258588 ± 20% -42.6% 27722263 ± 30% numa-numastat.node2.numa_foreign
> >>> 1.907e+08 ± 5% -20.7% 1.512e+08 ± 4% numa-numastat.node2.numa_hit
> >>> 50575101 ± 13% -41.7% 29486952 ± 34% numa-numastat.node3.numa_miss
> >>> 50605753 ± 12% -41.7% 29523675 ± 34% numa-numastat.node3.other_node
> >>> 5792376 ± 21% +108.8% 12091598 ± 33% numa-meminfo.node0.Inactive
> >>> 5661958 ± 23% +112.3% 12019288 ± 33% numa-meminfo.node0.Inactive(file)
> >>> 7721 ± 4% -14.9% 6569 ± 5% numa-meminfo.node0.KernelStack
> >>> 6826472 ± 38% +149.5% 17034531 ± 68% numa-meminfo.node2.Inactive
> >>> 6762353 ± 40% +150.9% 16965036 ± 67% numa-meminfo.node2.Inactive(file)
> >>> 1505881 ± 15% -27.7% 1088714 ± 12% numa-meminfo.node2.KReclaimable
> >>> 1505881 ± 15% -27.7% 1088714 ± 12% numa-meminfo.node2.SReclaimable
> >>> 1572662 ± 14% -26.0% 1163585 ± 12% numa-meminfo.node2.Slab
> >>> 5890794 ± 28% +62.5% 9572332 ± 24% numa-meminfo.node3.Inactive
> >>> 5818831 ± 28% +64.4% 9567679 ± 24% numa-meminfo.node3.Inactive(file)
> >>> 983157 -17.6% 810136 ± 9% numa-meminfo.node3.KReclaimable
> >>> 1678 ± 11% +127.7% 3822 ± 52% numa-meminfo.node3.PageTables
> >>> 983157 -17.6% 810136 ± 9% numa-meminfo.node3.SReclaimable
> >>> 1051678 -16.0% 883336 ± 10% numa-meminfo.node3.Slab
> >>> 552.25 ± 5% -9.8% 498.25 ± 8% syscalls.sys_close.min
> >>> 49342896 ± 11% -1.4e+07 35552958 ± 21% syscalls.sys_close.noise.100%
> >>> 58819670 ± 9% -1.3e+07 45624937 ± 14% syscalls.sys_close.noise.2%
> >>> 57508495 ± 9% -1.3e+07 44265440 ± 15% syscalls.sys_close.noise.25%
> >>> 58728054 ± 10% -1.3e+07 45533386 ± 14% syscalls.sys_close.noise.5%
> >>> 54278890 ± 10% -1.3e+07 41088025 ± 16% syscalls.sys_close.noise.50%
> >>> 51383951 ± 11% -1.3e+07 38397132 ± 19% syscalls.sys_close.noise.75%
> >>> 3445 ± 3% -9.8% 3108 ± 7% syscalls.sys_mmap.min
> >>> 131557 ± 11% -18.4% 107378 ± 8% syscalls.sys_openat.max
> >>> 9.546e+09 ± 7% +1.6e+09 1.119e+10 ± 2% syscalls.sys_read.noise.100%
> >>> 9.602e+09 ± 7% +1.6e+09 1.125e+10 ± 2% syscalls.sys_read.noise.2%
> >>> 9.597e+09 ± 7% +1.6e+09 1.124e+10 ± 2% syscalls.sys_read.noise.25%
> >>> 9.602e+09 ± 7% +1.6e+09 1.125e+10 ± 2% syscalls.sys_read.noise.5%
> >>> 9.582e+09 ± 7% +1.6e+09 1.122e+10 ± 2% syscalls.sys_read.noise.50%
> >>> 9.561e+09 ± 7% +1.6e+09 1.121e+10 ± 2% syscalls.sys_read.noise.75%
> >>> 1398825 ± 23% +111.2% 2954259 ± 31% numa-vmstat.node0.nr_inactive_file
> >>> 7695 ± 4% -15.0% 6543 ± 5% numa-vmstat.node0.nr_kernel_stack
> >>> 1398844 ± 23% +111.2% 2954257 ± 31% numa-vmstat.node0.nr_zone_inactive_file
> >>> 33085799 ± 18% -26.6% 24286468 ± 15% numa-vmstat.node0.numa_foreign
> >>> 1.372e+08 ± 3% -21.6% 1.076e+08 ± 8% numa-vmstat.node0.numa_hit
> >>> 1.372e+08 ± 3% -21.6% 1.075e+08 ± 8% numa-vmstat.node0.numa_local
> >>> 36683647 ± 9% -19.3% 29591849 ± 7% numa-vmstat.node1.numa_foreign
> >>> 1.441e+08 ± 4% -16.6% 1.201e+08 ± 2% numa-vmstat.node1.numa_hit
> >>> 1.44e+08 ± 4% -16.6% 1.2e+08 ± 2% numa-vmstat.node1.numa_local
> >>> 29244498 ± 12% -25.2% 21873834 ± 12% numa-vmstat.node1.numa_miss
> >>> 29336713 ± 12% -25.1% 21962580 ± 11% numa-vmstat.node1.numa_other
> >>> 1666152 ± 39% +150.9% 4180294 ± 67% numa-vmstat.node2.nr_inactive_file
> >>> 245.75 ± 33% +67.8% 412.25 ± 29% numa-vmstat.node2.nr_isolated_file
> >>> 377450 ± 15% -28.0% 271627 ± 12% numa-vmstat.node2.nr_slab_reclaimable
> >>> 1666144 ± 39% +150.9% 4180291 ± 67% numa-vmstat.node2.nr_zone_inactive_file
> >>> 30537851 ± 24% -40.6% 18143140 ± 30% numa-vmstat.node2.numa_foreign
> >>> 1.326e+08 ± 6% -19.4% 1.069e+08 ± 6% numa-vmstat.node2.numa_hit
> >>> 1.325e+08 ± 6% -19.5% 1.067e+08 ± 6% numa-vmstat.node2.numa_local
> >>> 1310014 ± 55% +165.4% 3476453 ± 54% numa-vmstat.node2.workingset_activate
> >>> 1807664 ± 10% -32.4% 1222580 ± 12% numa-vmstat.node2.workingset_nodes
> >>> 1512612 ± 49% +237.6% 5106796 ± 76% numa-vmstat.node2.workingset_refault
> >>> 1430242 ± 28% +66.1% 2375664 ± 24% numa-vmstat.node3.nr_inactive_file
> >>> 413.25 ± 12% +127.2% 938.75 ± 52% numa-vmstat.node3.nr_page_table_pages
> >>> 245535 -18.1% 201102 ± 10% numa-vmstat.node3.nr_slab_reclaimable
> >>> 1430241 ± 28% +66.1% 2375664 ± 24% numa-vmstat.node3.nr_zone_inactive_file
> >>> 31944406 ± 15% -40.6% 18978383 ± 34% numa-vmstat.node3.numa_miss
> >>> 32051332 ± 15% -40.5% 19062197 ± 34% numa-vmstat.node3.numa_other
> >>> 1260576 ± 2% -19.9% 1009504 ± 12% numa-vmstat.node3.workingset_nodes
> >>> 367017 ± 9% -59.9% 147234 ± 36% proc-vmstat.allocstall_movable
> >>> 339.75 ± 36% -51.9% 163.50 ± 29% proc-vmstat.compact_fail
> >>> 399.50 ± 29% -48.3% 206.50 ± 26% proc-vmstat.compact_stall
> >>> 98244136 -5.8% 92584602 ± 6% proc-vmstat.nr_active_file
> >>> 5911386 ± 17% +101.0% 11882498 ± 42% proc-vmstat.nr_inactive_file
> >>> 939.00 ± 4% +18.8% 1115 ± 4% proc-vmstat.nr_isolated_file
> >>> 1177260 ± 3% -17.3% 973681 proc-vmstat.nr_slab_reclaimable
> >>> 98244146 -5.8% 92584626 ± 6% proc-vmstat.nr_zone_active_file
> >>> 5911406 ± 17% +101.0% 11882506 ± 42% proc-vmstat.nr_zone_inactive_file
> >>> 2.018e+08 -21.5% 1.585e+08 proc-vmstat.numa_foreign
> >>> 7.84e+08 -16.5% 6.55e+08 ± 2% proc-vmstat.numa_hit
> >>> 7.839e+08 -16.5% 6.549e+08 ± 2% proc-vmstat.numa_local
> >>> 2.018e+08 -21.5% 1.585e+08 proc-vmstat.numa_miss
> >>> 2.019e+08 -21.5% 1.586e+08 proc-vmstat.numa_other
> >>> 9.612e+08 -20.2% 7.671e+08 proc-vmstat.pgactivate
> >>> 2451081 -22.2% 1906966 ± 6% proc-vmstat.pgalloc_dma32
> >>> 9.853e+08 -17.5% 8.132e+08 ± 2% proc-vmstat.pgalloc_normal
> >>> 8.406e+08 -21.6% 6.591e+08 proc-vmstat.pgdeactivate
> >>> 1740104 ± 2% -4.2% 1666631 proc-vmstat.pgfault
> >>> 9.876e+08 -17.5% 8.15e+08 ± 2% proc-vmstat.pgfree
> >>> 8.406e+08 -21.6% 6.591e+08 proc-vmstat.pgrefill
> >>> 4.795e+08 ± 2% -29.1% 3.4e+08 ± 6% proc-vmstat.pgscan_direct
> >>> 8.501e+08 -20.1% 6.793e+08 ± 2% proc-vmstat.pgscan_file
> >>> 3.706e+08 ± 2% -8.5% 3.393e+08 ± 3% proc-vmstat.pgscan_kswapd
> >>> 4.795e+08 ± 2% -29.1% 3.4e+08 ± 6% proc-vmstat.pgsteal_direct
> >>> 8.501e+08 -20.1% 6.792e+08 ± 2% proc-vmstat.pgsteal_file
> >>> 3.706e+08 ± 2% -8.5% 3.393e+08 ± 3% proc-vmstat.pgsteal_kswapd
> >>> 878572 ±114% -91.0% 79257 proc-vmstat.slabs_scanned
> >>> 5802060 ± 4% -21.8% 4535046 proc-vmstat.workingset_nodes
> >>> 7113793 ± 20% +89.4% 13470474 ± 48% proc-vmstat.workingset_refault
> >>> 78377 ± 51% -85.3% 11545 ±172% sched_debug.cfs_rq:/.MIN_vruntime.avg
> >>> 9150096 ± 57% -81.9% 1660376 ±172% sched_debug.cfs_rq:/.MIN_vruntime.max
> >>> 825961 ± 54% -83.3% 137960 ±172% sched_debug.cfs_rq:/.MIN_vruntime.stddev
> >>> 43.52 ± 8% -14.4% 37.24 ± 5% sched_debug.cfs_rq:/.load_avg.avg
> >>> 2.41 ± 11% -32.7% 1.62 ± 31% sched_debug.cfs_rq:/.load_avg.min
> >>> 78377 ± 51% -85.3% 11545 ±172% sched_debug.cfs_rq:/.max_vruntime.avg
> >>> 9150096 ± 57% -81.9% 1660376 ±172% sched_debug.cfs_rq:/.max_vruntime.max
> >>> 825961 ± 54% -83.3% 137960 ±172% sched_debug.cfs_rq:/.max_vruntime.stddev
> >>> 4797473 ± 3% -22.9% 3696631 ± 5% sched_debug.cfs_rq:/.min_vruntime.stddev
> >>> 1.25 ± 7% -17.5% 1.03 ± 5% sched_debug.cfs_rq:/.nr_running.max
> >>> 69.23 ± 5% -57.2% 29.60 ± 14% sched_debug.cfs_rq:/.nr_spread_over.avg
> >>> 213.41 ± 9% -28.2% 153.14 ± 19% sched_debug.cfs_rq:/.nr_spread_over.max
> >>> 12.53 ± 63% -72.4% 3.46 ± 33% sched_debug.cfs_rq:/.nr_spread_over.min
> >>> 33.58 ± 8% -24.1% 25.50 ± 15% sched_debug.cfs_rq:/.nr_spread_over.stddev
> >>> 62.66 ±100% +123.8% 140.22 ± 12% sched_debug.cfs_rq:/.removed.load_avg.max
> >>> 5225776 ± 22% -80.2% 1035929 ±428% sched_debug.cfs_rq:/.spread0.avg
> >>> 4796032 ± 3% -23.0% 3695101 ± 5% sched_debug.cfs_rq:/.spread0.stddev
> >>> 213869 ± 21% +83.8% 393003 ± 15% sched_debug.cpu.avg_idle.min
> >>> 751.11 ± 4% -18.4% 612.72 ± 6% sched_debug.cpu.clock_task.stddev
> >>> 527.75 +29.4% 682.70 ± 20% sched_debug.cpu.curr->pid.min
> >>> 20277 ± 3% -18.0% 16633 ± 8% sched_debug.cpu.nr_switches.avg
> >>> 42355 ± 3% -23.0% 32600 ± 16% sched_debug.cpu.nr_switches.max
> >>> 7446 ± 12% -32.9% 4994 ± 14% sched_debug.cpu.nr_switches.min
> >>> 4208 ± 8% -26.0% 3116 ± 9% sched_debug.cpu.nr_switches.stddev
> >>> 139.50 ± 12% -50.4% 69.21 ± 21% sched_debug.cpu.nr_uninterruptible.max
> >>> -294.53 -57.8% -124.35 sched_debug.cpu.nr_uninterruptible.min
> >>> 80.14 ± 18% -68.1% 25.57 ± 28% sched_debug.cpu.nr_uninterruptible.stddev
> >>> 19931 ± 3% -19.4% 16061 ± 9% sched_debug.cpu.sched_count.avg
> >>> 38452 ± 7% -23.7% 29333 ± 19% sched_debug.cpu.sched_count.max
> >>> 6544 ± 16% -38.3% 4035 ± 14% sched_debug.cpu.sched_count.min
> >>> 4086 ± 10% -31.9% 2782 ± 12% sched_debug.cpu.sched_count.stddev
> >>> 512.00 ± 7% -49.7% 257.67 ± 32% sched_debug.cpu.sched_goidle.avg
> >>> 116.69 ± 13% -51.2% 56.91 ± 30% sched_debug.cpu.sched_goidle.min
> >>> 5568 ± 7% -41.2% 3272 ± 15% sched_debug.cpu.ttwu_count.avg
> >>> 16587 ± 8% -38.7% 10162 ± 24% sched_debug.cpu.ttwu_count.max
> >>> 1615 ± 34% -45.8% 874.96 ± 15% sched_debug.cpu.ttwu_count.min
> >>> 1487 ± 8% -28.7% 1060 ± 18% sched_debug.cpu.ttwu_count.stddev
> >>> 3726 ± 6% -34.6% 2436 ± 14% sched_debug.cpu.ttwu_local.avg
> >>> 1178 ± 35% -41.6% 687.77 ± 20% sched_debug.cpu.ttwu_local.min
> >>> 76308173 -18.2% 62388290 ± 2% perf-stat.i.branch-misses
> >>> 19.76 ± 2% +3.1 22.88 ± 11% perf-stat.i.cache-miss-rate%
> >>> 96670324 -11.1% 85959307 perf-stat.i.cache-misses
> >>> 3.922e+08 -16.3% 3.282e+08 perf-stat.i.cache-references
> >>> 10114 ± 2% -10.6% 9037 ± 4% perf-stat.i.context-switches
> >>> 677.50 -21.0% 534.90 ± 5% perf-stat.i.cpu-migrations
> >>> 2558 +11.5% 2852 ± 5% perf-stat.i.cycles-between-cache-misses
> >>> 95953959 ± 8% -19.4% 77293478 ± 2% perf-stat.i.dTLB-load-misses
> >>> 11342511 -17.4% 9363813 perf-stat.i.dTLB-store-misses
> >>> 6.201e+09 -16.5% 5.175e+09 perf-stat.i.dTLB-stores
> >>> 18342673 ± 2% -19.8% 14705598 perf-stat.i.iTLB-load-misses
> >>> 931105 ± 20% +61.0% 1498773 ± 13% perf-stat.i.iTLB-loads
> >>> 3926 +74.2% 6839 ± 48% perf-stat.i.instructions-per-iTLB-miss
> >>> 304.35 -3.4% 294.01 perf-stat.i.metric.M/sec
> >>> 63.84 ± 2% +2.6 66.43 ± 2% perf-stat.i.node-load-miss-rate%
> >>> 47274311 ± 5% -10.8% 42146574 ± 2% perf-stat.i.node-load-misses
> >>> 34143532 ± 4% -20.8% 27027914 ± 3% perf-stat.i.node-loads
> >>> 54.49 ± 2% +6.4 60.92 ± 3% perf-stat.i.node-store-miss-rate%
> >>> 8123862 +25.9% 10227413 perf-stat.i.node-store-misses
> >>> 6220121 ± 2% -4.3% 5952608 perf-stat.i.node-stores
> >>> 5.17 -15.0% 4.39 ± 2% perf-stat.overall.MPKI
> >>> 0.43 -0.1 0.35 ± 2% perf-stat.overall.branch-miss-rate%
> >>> 25.05 +1.5 26.52 ± 2% perf-stat.overall.cache-miss-rate%
> >>> 3.62 +4.4% 3.78 perf-stat.overall.cpi
> >>> 2792 +16.1% 3243 perf-stat.overall.cycles-between-cache-misses
> >>> 0.48 ± 10% -0.1 0.39 ± 3% perf-stat.overall.dTLB-load-miss-rate%
> >>> 95.84 -4.2 91.67 perf-stat.overall.iTLB-load-miss-rate%
> >>> 4087 +23.0% 5029 perf-stat.overall.instructions-per-iTLB-miss
> >>> 0.28 -4.3% 0.26 perf-stat.overall.ipc
> >>> 56.78 +6.5 63.29 perf-stat.overall.node-store-miss-rate%
> >>> 4469 +18.1% 5278 perf-stat.overall.path-length
> >>> 78899707 -18.2% 64560747 perf-stat.ps.branch-misses
> >>> 1.041e+08 -11.4% 92236009 perf-stat.ps.cache-misses
> >>> 4.155e+08 -16.3% 3.479e+08 perf-stat.ps.cache-references
> >>> 10747 ± 2% -11.0% 9560 ± 3% perf-stat.ps.context-switches
> >>> 720.57 -21.6% 565.22 ± 5% perf-stat.ps.cpu-migrations
> >>> 1.034e+08 ± 9% -19.7% 83028926 ± 2% perf-stat.ps.dTLB-load-misses
> >>> 2.165e+10 -2.4% 2.112e+10 perf-stat.ps.dTLB-loads
> >>> 12153831 -17.6% 10018640 ± 2% perf-stat.ps.dTLB-store-misses
> >>> 6.602e+09 -16.8% 5.49e+09 perf-stat.ps.dTLB-stores
> >>> 19670289 ± 2% -19.9% 15746457 perf-stat.ps.iTLB-load-misses
> >>> 853947 ± 21% +67.8% 1433226 ± 10% perf-stat.ps.iTLB-loads
> >>> 3903 -1.5% 3847 perf-stat.ps.minor-faults
> >>> 50820856 ± 5% -11.3% 45100014 perf-stat.ps.node-load-misses
> >>> 36819965 ± 4% -21.1% 29042885 ± 3% perf-stat.ps.node-loads
> >>> 8815854 +25.3% 11049885 perf-stat.ps.node-store-misses
> >>> 6711644 -4.5% 6408150 perf-stat.ps.node-stores
> >>> 3903 -1.5% 3847 perf-stat.ps.page-faults
> >>> 3.484e+13 -4.2% 3.336e+13 perf-stat.total.instructions
> >>> 49421 ± 19% -46.9% 26263 ± 29% softirqs.CPU0.RCU
> >>> 204299 ± 8% -14.3% 175047 ± 3% softirqs.CPU0.TIMER
> >>> 56737 ± 42% -57.8% 23937 ± 32% softirqs.CPU1.RCU
> >>> 41623 ± 23% -46.6% 22215 ± 30% softirqs.CPU10.RCU
> >>> 20281 ± 3% -8.8% 18493 ± 4% softirqs.CPU10.SCHED
> >>> 20796 ± 4% -13.8% 17936 ± 2% softirqs.CPU100.SCHED
> >>> 32157 ± 15% -31.4% 22048 ± 27% softirqs.CPU101.RCU
> >>> 20776 ± 4% -12.5% 18170 ± 3% softirqs.CPU102.SCHED
> >>> 31633 ± 13% -33.1% 21172 ± 27% softirqs.CPU103.RCU
> >>> 20718 ± 5% -13.1% 18005 ± 4% softirqs.CPU103.SCHED
> >>> 30533 ± 9% -29.9% 21403 ± 27% softirqs.CPU104.RCU
> >>> 20720 ± 5% -13.1% 18005 ± 3% softirqs.CPU104.SCHED
> >>> 20697 ± 4% -12.0% 18204 ± 2% softirqs.CPU105.SCHED
> >>> 33666 ± 18% -31.7% 22985 ± 25% softirqs.CPU106.RCU
> >>> 20835 ± 5% -13.4% 18036 ± 3% softirqs.CPU106.SCHED
> >>> 32265 ± 10% -27.1% 23527 ± 22% softirqs.CPU107.RCU
> >>> 20673 ± 4% -13.3% 17929 ± 3% softirqs.CPU107.SCHED
> >>> 26076 ± 7% -29.2% 18462 ± 30% softirqs.CPU108.RCU
> >>> 26048 ± 7% -30.9% 18009 ± 29% softirqs.CPU109.RCU
> >>> 42682 ± 27% -48.3% 22082 ± 33% softirqs.CPU11.RCU
> >>> 24950 ± 6% -31.2% 17178 ± 28% softirqs.CPU110.RCU
> >>> 25813 ± 7% -30.9% 17845 ± 29% softirqs.CPU111.RCU
> >>> 30809 ± 13% -29.5% 21720 ± 31% softirqs.CPU112.RCU
> >>> 20630 ± 3% -11.7% 18222 ± 4% softirqs.CPU112.SCHED
> >>> 30625 ± 13% -27.8% 22113 ± 29% softirqs.CPU113.RCU
> >>> 20574 ± 4% -12.2% 18059 ± 4% softirqs.CPU113.SCHED
> >>> 20450 ± 4% -10.8% 18251 ± 4% softirqs.CPU114.SCHED
> >>> 29172 ± 11% -29.0% 20709 ± 28% softirqs.CPU115.RCU
> >>> 20597 ± 3% -12.0% 18135 ± 4% softirqs.CPU115.SCHED
> >>> 29348 ± 9% -29.3% 20743 ± 27% softirqs.CPU116.RCU
> >>> 20689 ± 4% -11.2% 18372 ± 3% softirqs.CPU116.SCHED
> >>> 34479 ± 15% -34.4% 22622 ± 28% softirqs.CPU117.RCU
> >>> 20611 ± 4% -12.2% 18104 ± 5% softirqs.CPU118.SCHED
> >>> 32895 ± 17% -32.5% 22219 ± 34% softirqs.CPU119.RCU
> >>> 20495 ± 4% -11.4% 18167 ± 4% softirqs.CPU119.SCHED
> >>> 39878 ± 25% -43.3% 22627 ± 29% softirqs.CPU12.RCU
> >>> 33086 ± 14% -32.0% 22501 ± 34% softirqs.CPU120.RCU
> >>> 32094 ± 14% -31.1% 22125 ± 32% softirqs.CPU121.RCU
> >>> 20458 ± 3% -11.5% 18113 ± 5% softirqs.CPU121.SCHED
> >>> 31631 ± 12% -30.5% 21991 ± 33% softirqs.CPU122.RCU
> >>> 33119 ± 15% -31.9% 22557 ± 33% softirqs.CPU123.RCU
> >>> 20655 ± 3% -12.5% 18064 ± 5% softirqs.CPU123.SCHED
> >>> 33327 ± 15% -31.0% 23010 ± 30% softirqs.CPU124.RCU
> >>> 32760 ± 15% -30.4% 22790 ± 33% softirqs.CPU125.RCU
> >>> 29780 ± 21% -39.8% 17938 ± 28% softirqs.CPU126.RCU
> >>> 21271 ± 5% -13.2% 18456 ± 5% softirqs.CPU127.SCHED
> >>> 21259 ± 5% -13.2% 18445 ± 4% softirqs.CPU128.SCHED
> >>> 21177 ± 5% -12.0% 18646 ± 4% softirqs.CPU129.SCHED
> >>> 40422 ± 16% -45.6% 22004 ± 29% softirqs.CPU13.RCU
> >>> 29495 ± 13% -26.5% 21686 ± 27% softirqs.CPU131.RCU
> >>> 21225 ± 4% -12.1% 18653 ± 4% softirqs.CPU131.SCHED
> >>> 21147 ± 4% -28.6% 15090 ± 39% softirqs.CPU132.SCHED
> >>> 30611 ± 11% -31.9% 20839 ± 29% softirqs.CPU133.RCU
> >>> 21210 ± 4% -12.0% 18666 ± 4% softirqs.CPU133.SCHED
> >>> 21228 ± 5% -11.5% 18785 ± 5% softirqs.CPU134.SCHED
> >>> 30053 ± 7% -29.0% 21351 ± 32% softirqs.CPU135.RCU
> >>> 21274 ± 5% -12.5% 18607 ± 4% softirqs.CPU135.SCHED
> >>> 29904 ± 12% -28.4% 21417 ± 34% softirqs.CPU136.RCU
> >>> 21201 ± 4% -12.0% 18658 ± 4% softirqs.CPU136.SCHED
> >>> 21319 ± 3% -12.5% 18653 ± 5% softirqs.CPU137.SCHED
> >>> 21191 ± 4% -12.2% 18606 ± 4% softirqs.CPU138.SCHED
> >>> 21409 ± 4% -12.7% 18680 ± 4% softirqs.CPU139.SCHED
> >>> 43264 ± 19% -45.0% 23803 ± 39% softirqs.CPU14.RCU
> >>> 21498 ± 4% -13.1% 18674 ± 4% softirqs.CPU140.SCHED
> >>> 21457 ± 4% -12.9% 18697 ± 4% softirqs.CPU141.SCHED
> >>> 21314 ± 4% -12.3% 18690 ± 4% softirqs.CPU142.SCHED
> >>> 21383 ± 4% -13.8% 18432 ± 5% softirqs.CPU143.SCHED
> >>> 44481 ± 28% -46.9% 23637 ± 24% softirqs.CPU15.RCU
> >>> 20109 ± 3% -8.4% 18412 ± 4% softirqs.CPU15.SCHED
> >>> 20107 ± 3% -8.8% 18334 ± 4% softirqs.CPU16.SCHED
> >>> 31305 ± 9% -23.5% 23961 ± 21% softirqs.CPU18.RCU
> >>> 30141 ± 11% -25.9% 22343 ± 22% softirqs.CPU19.RCU
> >>> 20504 ± 5% -11.7% 18106 ± 3% softirqs.CPU19.SCHED
> >>> 43762 ± 42% -48.6% 22501 ± 30% softirqs.CPU2.RCU
> >>> 184012 ± 3% -9.3% 166869 ± 4% softirqs.CPU2.TIMER
> >>> 19767 ± 6% -11.4% 17520 ± 5% softirqs.CPU21.SCHED
> >>> 20476 ± 5% -13.2% 17780 ± 5% softirqs.CPU22.SCHED
> >>> 31884 ± 11% -22.6% 24681 ± 17% softirqs.CPU23.RCU
> >>> 20435 ± 5% -11.9% 18001 ± 4% softirqs.CPU23.SCHED
> >>> 20483 ± 5% -12.5% 17919 softirqs.CPU24.SCHED
> >>> 20432 ± 4% -12.9% 17794 ± 5% softirqs.CPU25.SCHED
> >>> 20268 ± 6% -12.4% 17753 ± 4% softirqs.CPU26.SCHED
> >>> 20552 ± 4% -13.5% 17776 ± 4% softirqs.CPU27.SCHED
> >>> 20637 ± 4% -14.2% 17712 ± 4% softirqs.CPU28.SCHED
> >>> 20653 ± 5% -14.1% 17751 ± 2% softirqs.CPU29.SCHED
> >>> 41366 ± 20% -44.0% 23160 ± 34% softirqs.CPU3.RCU
> >>> 181952 ± 4% -8.6% 166338 ± 4% softirqs.CPU3.TIMER
> >>> 20572 ± 4% -13.4% 17812 ± 4% softirqs.CPU30.SCHED
> >>> 20763 ± 4% -14.1% 17836 ± 4% softirqs.CPU31.SCHED
> >>> 20588 ± 4% -14.2% 17655 ± 5% softirqs.CPU32.SCHED
> >>> 20604 ± 4% -13.1% 17899 ± 5% softirqs.CPU33.SCHED
> >>> 20575 ± 4% -12.6% 17985 ± 4% softirqs.CPU34.SCHED
> >>> 20527 ± 4% -12.2% 18030 ± 3% softirqs.CPU35.SCHED
> >>> 20509 ± 3% -11.6% 18134 ± 5% softirqs.CPU39.SCHED
> >>> 20487 ± 3% -12.1% 18012 ± 3% softirqs.CPU4.SCHED
> >>> 20504 ± 3% -12.6% 17915 ± 6% softirqs.CPU45.SCHED
> >>> 31606 ± 15% -30.5% 21981 ± 29% softirqs.CPU47.RCU
> >>> 20402 ± 3% -11.3% 18100 ± 5% softirqs.CPU47.SCHED
> >>> 20433 ± 3% -12.0% 17980 ± 5% softirqs.CPU49.SCHED
> >>> 49591 ± 37% -46.1% 26749 ± 50% softirqs.CPU5.RCU
> >>> 181765 ± 4% -7.9% 167376 ± 4% softirqs.CPU5.TIMER
> >>> 20481 ± 3% -11.7% 18090 ± 5% softirqs.CPU50.SCHED
> >>> 20423 ± 3% -19.6% 16418 ± 16% softirqs.CPU52.SCHED
> >>> 33391 ± 18% -36.2% 21298 ± 27% softirqs.CPU54.RCU
> >>> 30439 ± 7% -31.8% 20750 ± 26% softirqs.CPU55.RCU
> >>> 20951 ± 4% -11.3% 18581 ± 4% softirqs.CPU55.SCHED
> >>> 29489 ± 15% -34.0% 19461 ± 26% softirqs.CPU56.RCU
> >>> 20929 ± 4% -11.7% 18484 ± 4% softirqs.CPU56.SCHED
> >>> 38888 ± 42% -44.5% 21568 ± 22% softirqs.CPU57.RCU
> >>> 20913 ± 4% -10.6% 18695 ± 5% softirqs.CPU57.SCHED
> >>> 32907 ± 11% -37.1% 20703 ± 32% softirqs.CPU58.RCU
> >>> 34828 ± 20% -38.2% 21530 ± 27% softirqs.CPU59.RCU
> >>> 20129 ± 3% -10.4% 18033 ± 2% softirqs.CPU6.SCHED
> >>> 31166 ± 19% -34.8% 20309 ± 26% softirqs.CPU60.RCU
> >>> 35488 ± 18% -41.6% 20732 ± 27% softirqs.CPU61.RCU
> >>> 36694 ± 23% -43.7% 20654 ± 29% softirqs.CPU62.RCU
> >>> 20977 ± 3% -11.9% 18483 ± 5% softirqs.CPU63.SCHED
> >>> 30999 ± 25% -36.6% 19642 ± 28% softirqs.CPU64.RCU
> >>> 21146 ± 3% -12.4% 18522 ± 5% softirqs.CPU64.SCHED
> >>> 35390 ± 20% -38.7% 21711 ± 30% softirqs.CPU65.RCU
> >>> 20866 ± 5% -11.1% 18547 ± 5% softirqs.CPU65.SCHED
> >>> 31556 ± 17% -34.9% 20553 ± 31% softirqs.CPU66.RCU
> >>> 21177 ± 5% -12.2% 18591 ± 4% softirqs.CPU66.SCHED
> >>> 33109 ± 24% -37.6% 20668 ± 29% softirqs.CPU67.RCU
> >>> 20986 ± 4% -11.4% 18601 ± 4% softirqs.CPU67.SCHED
> >>> 32653 ± 32% -37.3% 20481 ± 26% softirqs.CPU68.RCU
> >>> 20833 ± 5% -11.8% 18382 ± 5% softirqs.CPU68.SCHED
> >>> 34688 ± 25% -39.6% 20946 ± 31% softirqs.CPU69.RCU
> >>> 20881 ± 5% -11.0% 18575 ± 4% softirqs.CPU69.SCHED
> >>> 37164 ± 15% -42.2% 21486 ± 28% softirqs.CPU7.RCU
> >>> 20341 ± 4% -9.1% 18498 ± 3% softirqs.CPU7.SCHED
> >>> 180522 ± 4% -8.1% 165938 ± 4% softirqs.CPU7.TIMER
> >>> 40003 ± 42% -47.6% 20948 ± 33% softirqs.CPU70.RCU
> >>> 31518 ± 24% -37.8% 19610 ± 29% softirqs.CPU71.RCU
> >>> 21159 ± 5% -36.7% 13384 ± 38% softirqs.CPU71.SCHED
> >>> 33245 ± 18% -38.8% 20347 ± 23% softirqs.CPU72.RCU
> >>> 28594 ± 6% -30.2% 19955 ± 19% softirqs.CPU73.RCU
> >>> 181439 ± 4% -8.7% 165568 ± 4% softirqs.CPU73.TIMER
> >>> 29260 ± 5% -31.3% 20092 ± 22% softirqs.CPU74.RCU
> >>> 20646 ± 4% -10.8% 18406 ± 4% softirqs.CPU74.SCHED
> >>> 182621 ± 3% -9.7% 164949 ± 4% softirqs.CPU74.TIMER
> >>> 29788 ± 6% -30.2% 20806 ± 30% softirqs.CPU75.RCU
> >>> 180784 ± 4% -8.0% 166322 ± 4% softirqs.CPU75.TIMER
> >>> 31468 ± 3% -37.0% 19830 ± 26% softirqs.CPU76.RCU
> >>> 29906 ± 8% -35.1% 19403 ± 27% softirqs.CPU77.RCU
> >>> 181203 ± 4% -8.7% 165455 ± 4% softirqs.CPU77.TIMER
> >>> 29083 ± 9% -30.1% 20320 ± 29% softirqs.CPU79.RCU
> >>> 20596 ± 4% -10.8% 18365 ± 2% softirqs.CPU79.SCHED
> >>> 180165 ± 5% -8.2% 165446 ± 3% softirqs.CPU79.TIMER
> >>> 42944 ± 22% -47.0% 22757 ± 31% softirqs.CPU8.RCU
> >>> 180983 ± 4% -8.2% 166159 ± 4% softirqs.CPU8.TIMER
> >>> 180031 ± 4% -8.1% 165499 ± 3% softirqs.CPU80.TIMER
> >>> 37376 ± 40% -48.4% 19278 ± 25% softirqs.CPU81.RCU
> >>> 30250 ± 9% -32.3% 20465 ± 30% softirqs.CPU82.RCU
> >>> 20547 ± 3% -9.8% 18528 ± 3% softirqs.CPU82.SCHED
> >>> 32541 ± 7% -36.8% 20569 ± 31% softirqs.CPU83.RCU
> >>> 32474 ± 8% -37.2% 20389 ± 31% softirqs.CPU84.RCU
> >>> 31831 ± 8% -36.3% 20278 ± 31% softirqs.CPU85.RCU
> >>> 31892 ± 10% -33.7% 21145 ± 23% softirqs.CPU86.RCU
> >>> 20534 ± 4% -8.8% 18736 ± 3% softirqs.CPU86.SCHED
> >>> 33402 ± 6% -38.3% 20609 ± 31% softirqs.CPU87.RCU
> >>> 33001 ± 9% -37.5% 20631 ± 30% softirqs.CPU88.RCU
> >>> 20614 ± 4% -10.0% 18546 ± 4% softirqs.CPU89.SCHED
> >>> 20431 ± 4% -11.5% 18072 ± 3% softirqs.CPU9.SCHED
> >>> 20806 ± 5% -14.4% 17804 ± 2% softirqs.CPU90.SCHED
> >>> 26998 ± 5% -29.6% 18994 ± 26% softirqs.CPU91.RCU
> >>> 20796 ± 5% -13.4% 18007 ± 3% softirqs.CPU91.SCHED
> >>> 25543 ± 5% -27.6% 18487 ± 29% softirqs.CPU92.RCU
> >>> 20628 ± 4% -12.5% 18052 ± 3% softirqs.CPU92.SCHED
> >>> 26188 ± 7% -26.2% 19334 ± 22% softirqs.CPU93.RCU
> >>> 20423 ± 5% -12.4% 17882 ± 4% softirqs.CPU93.SCHED
> >>> 26926 ± 8% -25.5% 20048 ± 24% softirqs.CPU94.RCU
> >>> 20927 ± 6% -13.3% 18139 ± 3% softirqs.CPU94.SCHED
> >>> 26807 ± 7% -31.8% 18278 ± 30% softirqs.CPU95.RCU
> >>> 20732 ± 5% -12.8% 18083 ± 3% softirqs.CPU95.SCHED
> >>> 29078 ± 7% -31.6% 19901 ± 25% softirqs.CPU96.RCU
> >>> 20679 ± 4% -12.7% 18045 ± 4% softirqs.CPU96.SCHED
> >>> 29028 ± 6% -35.0% 18860 ± 28% softirqs.CPU97.RCU
> >>> 20744 ± 4% -13.3% 17977 ± 3% softirqs.CPU97.SCHED
> >>> 27547 ± 10% -29.8% 19344 ± 30% softirqs.CPU98.RCU
> >>> 30305 ± 11% -33.7% 20106 ± 28% softirqs.CPU99.RCU
> >>> 194435 ± 9% -12.2% 170636 ± 4% softirqs.CPU99.TIMER
> >>> 4622344 ± 8% -30.4% 3215757 ± 29% softirqs.RCU
> >>> 2959150 ± 4% -11.3% 2623541 ± 3% softirqs.SCHED
> >>> 15.67 ± 13% -15.7 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.activate_page.mark_page_accessed.generic_file_buffered_read
> >>> 15.64 ± 13% -15.6 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.activate_page.mark_page_accessed
> >>> 13.62 ± 10% -13.6 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 13.60 ± 10% -13.6 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 14.17 ± 10% -8.1 6.12 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
> >>> 14.18 ± 10% -8.1 6.13 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 13.27 ± 10% -7.7 5.52 ± 16% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 24.33 ± 8% -6.3 18.00 ± 15% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages
> >>> 1.28 ± 22% -0.7 0.55 ± 10% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 1.04 ± 37% -0.7 0.35 ±102% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
> >>> 1.04 ± 37% -0.7 0.34 ±102% perf-profile.calltrace.cycles-pp.drain_local_pages_wq.process_one_work.worker_thread.kthread.ret_from_fork
> >>> 1.03 ± 37% -0.7 0.34 ±102% perf-profile.calltrace.cycles-pp.drain_pages.drain_local_pages_wq.process_one_work.worker_thread.kthread
> >>> 1.04 ± 37% -0.7 0.35 ±102% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
> >>> 1.03 ± 37% -0.7 0.34 ±102% perf-profile.calltrace.cycles-pp.drain_pages_zone.drain_pages.drain_local_pages_wq.process_one_work.worker_thread
> >>> 1.03 ± 37% -0.7 0.34 ±102% perf-profile.calltrace.cycles-pp.free_pcppages_bulk.drain_pages_zone.drain_pages.drain_local_pages_wq.process_one_work
> >>> 0.92 ± 37% -0.6 0.31 ±102% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_pcppages_bulk.drain_pages_zone.drain_pages
> >>> 0.92 ± 37% -0.6 0.31 ±102% perf-profile.calltrace.cycles-pp._raw_spin_lock.free_pcppages_bulk.drain_pages_zone.drain_pages.drain_local_pages_wq
> >>> 2.90 -0.6 2.30 ± 5% perf-profile.calltrace.cycles-pp.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read.xfs_file_buffered_aio_read.xfs_file_read_iter
> >>> 2.89 -0.6 2.30 ± 5% perf-profile.calltrace.cycles-pp.iomap_apply.iomap_readahead.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read
> >>> 2.86 -0.6 2.27 ± 5% perf-profile.calltrace.cycles-pp.iomap_readahead_actor.iomap_apply.iomap_readahead.read_pages.page_cache_readahead_unbounded
> >>> 2.89 -0.6 2.30 ± 5% perf-profile.calltrace.cycles-pp.iomap_readahead.read_pages.page_cache_readahead_unbounded.generic_file_buffered_read.xfs_file_buffered_aio_read
> >>> 2.02 -0.6 1.46 ± 17% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.generic_file_buffered_read.xfs_file_buffered_aio_read.xfs_file_read_iter
> >>> 2.01 -0.6 1.45 ± 17% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.generic_file_buffered_read.xfs_file_buffered_aio_read
> >>> 2.69 -0.6 2.14 ± 5% perf-profile.calltrace.cycles-pp.iomap_readpage_actor.iomap_readahead_actor.iomap_apply.iomap_readahead.read_pages
> >>> 1.99 -0.5 1.47 ± 19% perf-profile.calltrace.cycles-pp.memset_erms.iomap_readpage_actor.iomap_readahead_actor.iomap_apply.iomap_readahead
> >>> 2.17 -0.5 1.70 ± 5% perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_buffered_read.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read
> >>> 1.02 ± 9% -0.4 0.64 ± 11% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
> >>> 0.71 ± 8% +0.6 1.32 ± 11% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
> >>> 88.79 +1.7 90.45 perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
> >>> 88.69 +1.7 90.38 perf-profile.calltrace.cycles-pp.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read.do_syscall_64
> >>> 88.52 +1.7 90.25 perf-profile.calltrace.cycles-pp.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read.ksys_read
> >>> 88.26 +1.8 90.06 perf-profile.calltrace.cycles-pp.generic_file_buffered_read.xfs_file_buffered_aio_read.xfs_file_read_iter.new_sync_read.vfs_read
> >>> 9.77 ± 9% +2.7 12.48 ± 13% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 0.00 +16.8 16.80 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
> >>> 0.00 +16.8 16.83 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.00 +16.8 16.83 ± 14% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 0.00 +18.9 18.87 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.activate_page
> >>> 0.00 +18.9 18.90 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.pagevec_lru_move_fn.activate_page.mark_page_accessed
> >>> 0.00 +18.9 18.90 ± 9% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.pagevec_lru_move_fn.activate_page.mark_page_accessed.generic_file_buffered_read
> >>> 14.47 ± 9% -8.2 6.26 ± 13% perf-profile.children.cycles-pp.lru_note_cost
> >>> 27.36 ± 8% -6.2 21.21 ± 12% perf-profile.children.cycles-pp.shrink_inactive_list
> >>> 2.37 ± 5% -0.7 1.63 ± 9% perf-profile.children.cycles-pp.shrink_page_list
> >>> 1.16 ± 36% -0.7 0.51 ± 52% perf-profile.children.cycles-pp._raw_spin_lock
> >>> 1.32 ± 27% -0.6 0.70 ± 32% perf-profile.children.cycles-pp.free_pcppages_bulk
> >>> 2.89 -0.6 2.30 ± 5% perf-profile.children.cycles-pp.iomap_readahead
> >>> 2.89 -0.6 2.30 ± 5% perf-profile.children.cycles-pp.iomap_apply
> >>> 1.57 ± 7% -0.6 0.98 ± 9% perf-profile.children.cycles-pp.__remove_mapping
> >>> 2.90 -0.6 2.31 ± 5% perf-profile.children.cycles-pp.read_pages
> >>> 1.04 ± 37% -0.6 0.45 ± 58% perf-profile.children.cycles-pp.worker_thread
> >>> 1.04 ± 37% -0.6 0.45 ± 58% perf-profile.children.cycles-pp.drain_local_pages_wq
> >>> 2.86 -0.6 2.27 ± 5% perf-profile.children.cycles-pp.iomap_readahead_actor
> >>> 1.03 ± 37% -0.6 0.45 ± 58% perf-profile.children.cycles-pp.drain_pages
> >>> 1.03 ± 37% -0.6 0.45 ± 58% perf-profile.children.cycles-pp.drain_pages_zone
> >>> 1.04 ± 37% -0.6 0.45 ± 59% perf-profile.children.cycles-pp.process_one_work
> >>> 2.70 -0.6 2.15 ± 5% perf-profile.children.cycles-pp.iomap_readpage_actor
> >>> 2.18 -0.5 1.70 ± 4% perf-profile.children.cycles-pp.copy_page_to_iter
> >>> 2.02 -0.4 1.58 ± 4% perf-profile.children.cycles-pp.copyout
> >>> 2.01 -0.4 1.58 ± 4% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
> >>> 1.03 ± 2% -0.4 0.61 ± 5% perf-profile.children.cycles-pp.workingset_activation
> >>> 2.01 -0.4 1.60 ± 5% perf-profile.children.cycles-pp.memset_erms
> >>> 0.91 -0.3 0.60 ± 3% perf-profile.children.cycles-pp.__add_to_page_cache_locked
> >>> 0.95 ± 9% -0.3 0.65 ± 3% perf-profile.children.cycles-pp.get_page_from_freelist
> >>> 0.89 ± 2% -0.3 0.61 ± 4% perf-profile.children.cycles-pp.workingset_age_nonresident
> >>> 0.77 ± 3% -0.3 0.52 ± 11% perf-profile.children.cycles-pp.__delete_from_page_cache
> >>> 0.33 ± 3% -0.2 0.11 ± 7% perf-profile.children.cycles-pp.mem_cgroup_page_lruvec
> >>> 0.67 ± 6% -0.2 0.46 ± 4% perf-profile.children.cycles-pp.__mod_lruvec_state
> >>> 0.58 ± 12% -0.2 0.39 ± 4% perf-profile.children.cycles-pp.rmqueue
> >>> 0.92 -0.2 0.74 ± 2% perf-profile.children.cycles-pp.syscall_return_via_sysret
> >>> 0.81 ± 2% -0.2 0.64 ± 4% perf-profile.children.cycles-pp.entry_SYSCALL_64
> >>> 0.83 ± 4% -0.2 0.68 ± 6% perf-profile.children.cycles-pp.__list_del_entry_valid
> >>> 0.41 ± 17% -0.1 0.26 ± 5% perf-profile.children.cycles-pp.rmqueue_bulk
> >>> 0.28 ± 7% -0.1 0.13 ± 14% perf-profile.children.cycles-pp.unaccount_page_cache_page
> >>> 0.63 -0.1 0.48 �� 5% perf-profile.children.cycles-pp.pagecache_get_page
> >>> 0.61 -0.1 0.47 ± 4% perf-profile.children.cycles-pp.find_get_entry
> >>> 0.29 -0.1 0.16 ± 6% perf-profile.children.cycles-pp.workingset_eviction
> >>> 0.59 -0.1 0.47 ± 7% perf-profile.children.cycles-pp.iomap_set_range_uptodate
> >>> 0.27 ± 25% -0.1 0.14 ± 40% perf-profile.children.cycles-pp.do_shrink_slab
> >>> 0.60 ± 2% -0.1 0.48 ± 3% perf-profile.children.cycles-pp.ksys_write
> >>> 0.22 ± 24% -0.1 0.10 ± 62% perf-profile.children.cycles-pp.count_shadow_nodes
> >>> 0.59 ± 2% -0.1 0.47 ± 6% perf-profile.children.cycles-pp.xas_load
> >>> 0.50 ± 2% -0.1 0.39 ± 7% perf-profile.children.cycles-pp.syscall_trace_enter
> >>> 0.47 -0.1 0.37 ± 8% perf-profile.children.cycles-pp.xas_store
> >>> 0.48 ± 2% -0.1 0.39 ± 3% perf-profile.children.cycles-pp.__syscall_return_slowpath
> >>> 0.48 ± 2% -0.1 0.39 ± 3% perf-profile.children.cycles-pp.vfs_write
> >>> 0.41 ± 2% -0.1 0.32 ± 3% perf-profile.children.cycles-pp.security_file_permission
> >>> 0.34 -0.1 0.26 ± 4% perf-profile.children.cycles-pp.ftrace_syscall_enter
> >>> 0.30 ± 3% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.xas_create
> >>> 0.23 ± 4% -0.1 0.16 perf-profile.children.cycles-pp.__mod_memcg_state
> >>> 0.26 ± 3% -0.1 0.20 ± 2% perf-profile.children.cycles-pp.mem_cgroup_charge
> >>> 0.24 ± 3% -0.1 0.18 ± 2% perf-profile.children.cycles-pp.common_file_perm
> >>> 0.15 ± 3% -0.1 0.10 ± 5% perf-profile.children.cycles-pp.wake_all_kswapds
> >>> 0.33 -0.1 0.27 ± 3% perf-profile.children.cycles-pp.ftrace_syscall_exit
> >>> 0.11 ± 19% -0.1 0.06 ± 59% perf-profile.children.cycles-pp.start_secondary
> >>> 0.11 ± 19% -0.1 0.06 ± 59% perf-profile.children.cycles-pp.cpuidle_enter
> >>> 0.11 ± 19% -0.1 0.06 ± 59% perf-profile.children.cycles-pp.cpuidle_enter_state
> >>> 0.10 ± 15% -0.1 0.05 ± 59% perf-profile.children.cycles-pp.intel_idle
> >>> 0.11 ± 19% -0.0 0.06 ± 58% perf-profile.children.cycles-pp.secondary_startup_64
> >>> 0.11 ± 19% -0.0 0.06 ± 58% perf-profile.children.cycles-pp.cpu_startup_entry
> >>> 0.11 ± 19% -0.0 0.06 ± 58% perf-profile.children.cycles-pp.do_idle
> >>> 0.49 ± 3% -0.0 0.45 ± 4% perf-profile.children.cycles-pp.__activate_page
> >>> 0.14 ± 3% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.__mod_node_page_state
> >>> 0.09 ± 4% -0.0 0.05 perf-profile.children.cycles-pp.wakeup_kswapd
> >>> 0.19 ± 6% -0.0 0.15 ± 3% perf-profile.children.cycles-pp.fsnotify
> >>> 0.22 -0.0 0.18 ± 6% perf-profile.children.cycles-pp.xa_load
> >>> 0.06 ± 6% -0.0 0.03 ±100% perf-profile.children.cycles-pp.__prepare_exit_to_usermode
> >>> 0.14 -0.0 0.11 ± 4% perf-profile.children.cycles-pp.touch_atime
> >>> 0.13 ± 3% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.xfs_ilock
> >>> 0.12 ± 3% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.trace_buffer_lock_reserve
> >>> 0.11 -0.0 0.08 ± 8% perf-profile.children.cycles-pp.down_read
> >>> 0.14 ± 3% -0.0 0.11 ± 9% perf-profile.children.cycles-pp.xas_start
> >>> 0.14 ± 3% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.__fdget_pos
> >>> 0.09 ± 10% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.unlock_page
> >>> 0.22 -0.0 0.19 ± 3% perf-profile.children.cycles-pp.tick_sched_timer
> >>> 0.11 ± 3% -0.0 0.09 ± 5% perf-profile.children.cycles-pp.__count_memcg_events
> >>> 0.11 -0.0 0.08 ± 5% perf-profile.children.cycles-pp.___might_sleep
> >>> 0.07 ± 7% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.xas_clear_mark
> >>> 0.21 ± 2% -0.0 0.18 ± 3% perf-profile.children.cycles-pp.tick_sched_handle
> >>> 0.12 ± 3% -0.0 0.09 ± 4% perf-profile.children.cycles-pp.__fget_light
> >>> 0.11 -0.0 0.09 ± 5% perf-profile.children.cycles-pp.atime_needs_update
> >>> 0.10 ± 4% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.page_mapping
> >>> 0.09 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.ring_buffer_lock_reserve
> >>> 0.07 -0.0 0.05 perf-profile.children.cycles-pp.up_read
> >>> 0.20 ± 2% -0.0 0.18 ± 2% perf-profile.children.cycles-pp.update_process_times
> >>> 0.13 ± 3% -0.0 0.11 ± 4% perf-profile.children.cycles-pp.__x86_retpoline_rax
> >>> 0.07 ± 5% -0.0 0.05 ± 9% perf-profile.children.cycles-pp.uncharge_batch
> >>> 0.10 -0.0 0.08 ± 5% perf-profile.children.cycles-pp.try_charge
> >>> 0.09 ± 4% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
> >>> 0.09 -0.0 0.07 ± 5% perf-profile.children.cycles-pp.xfs_iunlock
> >>> 0.16 ± 2% -0.0 0.14 ± 3% perf-profile.children.cycles-pp.scheduler_tick
> >>> 0.07 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.__mod_zone_page_state
> >>> 0.06 ± 6% -0.0 0.05 perf-profile.children.cycles-pp.__zone_watermark_ok
> >>> 0.09 -0.0 0.08 ± 5% perf-profile.children.cycles-pp._cond_resched
> >>> 0.32 ± 5% +0.2 0.47 ± 10% perf-profile.children.cycles-pp.move_pages_to_lru
> >>> 89.37 +1.5 90.92 perf-profile.children.cycles-pp.ksys_read
> >>> 89.28 +1.6 90.84 perf-profile.children.cycles-pp.vfs_read
> >>> 88.79 +1.7 90.45 perf-profile.children.cycles-pp.new_sync_read
> >>> 88.69 +1.7 90.39 perf-profile.children.cycles-pp.xfs_file_read_iter
> >>> 88.53 +1.7 90.26 perf-profile.children.cycles-pp.xfs_file_buffered_aio_read
> >>> 88.27 +1.8 90.06 perf-profile.children.cycles-pp.generic_file_buffered_read
> >>> 77.62 +4.7 82.28 perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
> >>> 0.00 +36.0 36.02 ± 11% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
> >>> 2.31 ± 2% -0.5 1.83 ± 3% perf-profile.self.cycles-pp.do_syscall_64
> >>> 2.00 -0.4 1.56 ± 4% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
> >>> 2.00 -0.4 1.59 ± 5% perf-profile.self.cycles-pp.memset_erms
> >>> 0.89 ± 2% -0.3 0.60 ± 3% perf-profile.self.cycles-pp.workingset_age_nonresident
> >>> 0.33 ± 3% -0.2 0.11 ± 7% perf-profile.self.cycles-pp.mem_cgroup_page_lruvec
> >>> 0.92 -0.2 0.73 ± 3% perf-profile.self.cycles-pp.syscall_return_via_sysret
> >>> 0.76 ± 2% -0.2 0.60 ± 4% perf-profile.self.cycles-pp.entry_SYSCALL_64
> >>> 0.82 ± 4% -0.1 0.67 ± 5% perf-profile.self.cycles-pp.__list_del_entry_valid
> >>> 0.24 ± 3% -0.1 0.11 ± 3% perf-profile.self.cycles-pp.__add_to_page_cache_locked
> >>> 0.21 ± 2% -0.1 0.08 ± 8% perf-profile.self.cycles-pp.workingset_eviction
> >>> 0.59 -0.1 0.46 ± 6% perf-profile.self.cycles-pp.iomap_set_range_uptodate
> >>> 0.16 ± 4% -0.1 0.04 ± 59% perf-profile.self.cycles-pp.unaccount_page_cache_page
> >>> 0.17 ± 28% -0.1 0.08 ± 60% perf-profile.self.cycles-pp.count_shadow_nodes
> >>> 0.30 ± 13% -0.1 0.21 ± 6% perf-profile.self.cycles-pp.__mod_lruvec_state
> >>> 0.45 -0.1 0.36 ± 5% perf-profile.self.cycles-pp.xas_load
> >>> 0.29 ± 4% -0.1 0.21 ± 5% perf-profile.self.cycles-pp.get_page_from_freelist
> >>> 0.32 ± 2% -0.1 0.23 ± 4% perf-profile.self.cycles-pp.find_get_entry
> >>> 0.28 -0.1 0.21 ± 3% perf-profile.self.cycles-pp.ftrace_syscall_enter
> >>> 0.22 ± 3% -0.1 0.16 ± 2% perf-profile.self.cycles-pp.__mod_memcg_state
> >>> 0.28 ± 3% -0.1 0.21 ± 9% perf-profile.self.cycles-pp.xas_create
> >>> 0.26 ± 2% -0.1 0.20 ± 6% perf-profile.self.cycles-pp.generic_file_buffered_read
> >>> 0.22 ± 3% -0.1 0.17 ± 16% perf-profile.self.cycles-pp.free_pcppages_bulk
> >>> 0.10 ± 15% -0.1 0.05 ± 59% perf-profile.self.cycles-pp.intel_idle
> >>> 0.20 ± 4% -0.0 0.15 ± 3% perf-profile.self.cycles-pp.common_file_perm
> >>> 0.09 ± 4% -0.0 0.05 perf-profile.self.cycles-pp.wakeup_kswapd
> >>> 0.18 ± 6% -0.0 0.14 ± 5% perf-profile.self.cycles-pp.fsnotify
> >>> 0.14 ± 11% -0.0 0.10 ± 7% perf-profile.self.cycles-pp.__syscall_return_slowpath
> >>> 0.14 ± 3% -0.0 0.10 ± 5% perf-profile.self.cycles-pp.__mod_node_page_state
> >>> 0.25 -0.0 0.21 ± 5% perf-profile.self.cycles-pp.ftrace_syscall_exit
> >>> 0.16 ± 12% -0.0 0.12 ± 3% perf-profile.self.cycles-pp.xfs_file_read_iter
> >>> 0.07 ± 5% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.release_pages
> >>> 0.17 ± 4% -0.0 0.14 ± 8% perf-profile.self.cycles-pp.shrink_page_list
> >>> 0.11 ± 4% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.___might_sleep
> >>> 0.08 ± 5% -0.0 0.05 ± 9% perf-profile.self.cycles-pp.unlock_page
> >>> 0.11 ± 3% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.__count_memcg_events
> >>> 0.11 -0.0 0.09 ± 5% perf-profile.self.cycles-pp.entry_SYSCALL_64_after_hwframe
> >>> 0.06 ± 6% -0.0 0.04 ± 57% perf-profile.self.cycles-pp.down_read
> >>> 0.13 ± 3% -0.0 0.11 ± 6% perf-profile.self.cycles-pp.xas_start
> >>> 0.10 -0.0 0.08 ± 10% perf-profile.self.cycles-pp.page_mapping
> >>> 0.08 -0.0 0.06 ± 7% perf-profile.self.cycles-pp.new_sync_read
> >>> 0.11 ± 4% -0.0 0.09 ± 5% perf-profile.self.cycles-pp.__fget_light
> >>> 0.09 ± 4% -0.0 0.07 perf-profile.self.cycles-pp.vfs_read
> >>> 0.06 -0.0 0.04 ± 57% perf-profile.self.cycles-pp.up_read
> >>> 0.08 ± 8% -0.0 0.06 perf-profile.self.cycles-pp.ring_buffer_lock_reserve
> >>> 0.08 ± 6% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.__remove_mapping
> >>> 0.08 ± 5% -0.0 0.07 ± 7% perf-profile.self.cycles-pp.xas_store
> >>> 0.08 -0.0 0.06 ± 6% perf-profile.self.cycles-pp.mark_page_accessed
> >>> 0.07 -0.0 0.05 ± 8% perf-profile.self.cycles-pp.copy_page_to_iter
> >>> 0.08 ± 5% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.vfs_write
> >>> 0.08 ± 6% -0.0 0.06 perf-profile.self.cycles-pp.__alloc_pages_nodemask
> >>> 0.07 ± 5% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.__mod_zone_page_state
> >>> 0.11 -0.0 0.10 ± 5% perf-profile.self.cycles-pp.__x86_retpoline_rax
> >>> 0.06 -0.0 0.05 perf-profile.self.cycles-pp.rmqueue
> >>> 0.17 ± 4% +0.0 0.20 ± 4% perf-profile.self.cycles-pp.__activate_page
> >>> 0.15 ± 2% +0.1 0.22 ± 6% perf-profile.self.cycles-pp.pagevec_lru_move_fn
> >>> 0.20 ± 3% +0.1 0.33 ± 3% perf-profile.self.cycles-pp.__pagevec_lru_add
> >>> 0.15 ± 7% +0.2 0.33 ± 10% perf-profile.self.cycles-pp.move_pages_to_lru
> >>> 77.62 +4.7 82.28 perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
> >>> 285898 ± 8% -39.5% 172831 ± 26% interrupts.CAL:Function_call_interrupts
> >>> 1546 ± 11% -39.4% 936.50 ± 18% interrupts.CPU0.RES:Rescheduling_interrupts
> >>> 1916 ± 7% -45.6% 1041 ± 22% interrupts.CPU10.CAL:Function_call_interrupts
> >>> 1403 ± 6% -49.2% 713.75 ± 25% interrupts.CPU10.RES:Rescheduling_interrupts
> >>> 1865 ± 8% -40.1% 1117 ± 26% interrupts.CPU100.CAL:Function_call_interrupts
> >>> 983.25 ± 10% -40.4% 586.50 ± 24% interrupts.CPU100.RES:Rescheduling_interrupts
> >>> 1892 ± 6% -39.3% 1148 ± 28% interrupts.CPU101.CAL:Function_call_interrupts
> >>> 961.25 ± 8% -38.1% 595.00 ± 19% interrupts.CPU101.RES:Rescheduling_interrupts
> >>> 1885 ± 8% -41.0% 1112 ± 26% interrupts.CPU102.CAL:Function_call_interrupts
> >>> 7176 ± 16% -30.6% 4983 ± 29% interrupts.CPU102.NMI:Non-maskable_interrupts
> >>> 7176 ± 16% -30.6% 4983 ± 29% interrupts.CPU102.PMI:Performance_monitoring_interrupts
> >>> 991.50 ± 8% -38.1% 613.25 ± 27% interrupts.CPU102.RES:Rescheduling_interrupts
> >>> 1896 ± 6% -42.8% 1084 ± 23% interrupts.CPU103.CAL:Function_call_interrupts
> >>> 1017 ± 10% -42.2% 588.00 ± 24% interrupts.CPU103.RES:Rescheduling_interrupts
> >>> 1881 ± 6% -43.3% 1066 ± 25% interrupts.CPU104.CAL:Function_call_interrupts
> >>> 1076 ± 13% -43.4% 609.25 ± 28% interrupts.CPU104.RES:Rescheduling_interrupts
> >>> 1910 ± 7% -42.6% 1096 ± 25% interrupts.CPU105.CAL:Function_call_interrupts
> >>> 5532 ± 26% -27.1% 4032 interrupts.CPU105.NMI:Non-maskable_interrupts
> >>> 5532 ± 26% -27.1% 4032 interrupts.CPU105.PMI:Performance_monitoring_interrupts
> >>> 969.25 ± 8% -34.9% 631.00 ± 4% interrupts.CPU105.RES:Rescheduling_interrupts
> >>> 1881 ± 8% -39.2% 1144 ± 21% interrupts.CPU106.CAL:Function_call_interrupts
> >>> 1000 ± 7% -41.3% 587.25 ± 21% interrupts.CPU106.RES:Rescheduling_interrupts
> >>> 1906 ± 8% -40.1% 1141 ± 22% interrupts.CPU107.CAL:Function_call_interrupts
> >>> 1005 ± 4% -36.2% 642.00 ± 34% interrupts.CPU107.RES:Rescheduling_interrupts
> >>> 1911 ± 12% -42.7% 1094 ± 19% interrupts.CPU108.CAL:Function_call_interrupts
> >>> 1871 ± 8% -40.6% 1111 ± 23% interrupts.CPU109.CAL:Function_call_interrupts
> >>> 958.00 ± 7% -41.3% 562.50 ± 10% interrupts.CPU109.RES:Rescheduling_interrupts
> >>> 1951 ± 8% -42.1% 1129 ± 29% interrupts.CPU11.CAL:Function_call_interrupts
> >>> 1581 ± 8% -37.1% 994.25 ± 32% interrupts.CPU11.RES:Rescheduling_interrupts
> >>> 1828 ± 11% -38.7% 1121 ± 18% interrupts.CPU110.CAL:Function_call_interrupts
> >>> 4091 ± 2% +69.1% 6917 ± 22% interrupts.CPU110.NMI:Non-maskable_interrupts
> >>> 4091 ± 2% +69.1% 6917 ± 22% interrupts.CPU110.PMI:Performance_monitoring_interrupts
> >>> 920.75 ± 11% -31.8% 627.50 ± 12% interrupts.CPU110.RES:Rescheduling_interrupts
> >>> 1901 ± 10% -42.3% 1097 ± 22% interrupts.CPU111.CAL:Function_call_interrupts
> >>> 941.25 ± 11% -35.8% 604.00 ± 13% interrupts.CPU111.RES:Rescheduling_interrupts
> >>> 1890 ± 9% -42.5% 1087 ± 21% interrupts.CPU112.CAL:Function_call_interrupts
> >>> 935.50 ± 6% -38.9% 571.25 ± 10% interrupts.CPU112.RES:Rescheduling_interrupts
> >>> 1883 ± 10% -46.1% 1014 ± 33% interrupts.CPU113.CAL:Function_call_interrupts
> >>> 944.50 ± 9% -51.3% 460.00 ± 46% interrupts.CPU113.RES:Rescheduling_interrupts
> >>> 1908 ± 9% -41.8% 1110 ± 19% interrupts.CPU114.CAL:Function_call_interrupts
> >>> 1921 ± 8% -40.4% 1145 ± 22% interrupts.CPU115.CAL:Function_call_interrupts
> >>> 904.00 ± 6% -27.6% 654.75 ± 19% interrupts.CPU115.RES:Rescheduling_interrupts
> >>> 1899 ± 9% -43.3% 1076 ± 22% interrupts.CPU116.CAL:Function_call_interrupts
> >>> 934.00 ± 7% -28.8% 664.75 ± 12% interrupts.CPU116.RES:Rescheduling_interrupts
> >>> 1908 ± 9% -38.4% 1175 ± 21% interrupts.CPU117.CAL:Function_call_interrupts
> >>> 945.25 ± 12% -34.0% 624.00 ± 14% interrupts.CPU117.RES:Rescheduling_interrupts
> >>> 1872 ± 8% -38.5% 1151 ± 16% interrupts.CPU118.CAL:Function_call_interrupts
> >>> 1839 ± 10% -41.5% 1077 ± 21% interrupts.CPU119.CAL:Function_call_interrupts
> >>> 1841 ± 6% -39.5% 1114 ± 27% interrupts.CPU12.CAL:Function_call_interrupts
> >>> 6027 ± 30% -33.1% 4033 interrupts.CPU12.NMI:Non-maskable_interrupts
> >>> 6027 ± 30% -33.1% 4033 interrupts.CPU12.PMI:Performance_monitoring_interrupts
> >>> 4034 +57.3% 6343 ± 21% interrupts.CPU120.NMI:Non-maskable_interrupts
> >>> 4034 +57.3% 6343 ± 21% interrupts.CPU120.PMI:Performance_monitoring_interrupts
> >>> 995.00 ± 13% -40.5% 591.75 ± 15% interrupts.CPU120.RES:Rescheduling_interrupts
> >>> 1931 ± 9% -43.8% 1085 ± 21% interrupts.CPU121.CAL:Function_call_interrupts
> >>> 974.50 ± 12% -35.6% 627.75 ± 11% interrupts.CPU121.RES:Rescheduling_interrupts
> >>> 1865 ± 9% -42.1% 1079 ± 21% interrupts.CPU122.CAL:Function_call_interrupts
> >>> 919.75 ± 6% -36.0% 588.50 ± 23% interrupts.CPU122.RES:Rescheduling_interrupts
> >>> 6930 ± 23% -41.5% 4057 interrupts.CPU123.NMI:Non-maskable_interrupts
> >>> 6930 ± 23% -41.5% 4057 interrupts.CPU123.PMI:Performance_monitoring_interrupts
> >>> 1880 ± 8% -41.6% 1098 ± 22% interrupts.CPU124.CAL:Function_call_interrupts
> >>> 909.00 ± 7% -36.6% 576.50 ± 17% interrupts.CPU124.RES:Rescheduling_interrupts
> >>> 1911 ± 10% -42.7% 1094 ± 21% interrupts.CPU125.CAL:Function_call_interrupts
> >>> 930.50 ± 9% -31.5% 637.75 ± 21% interrupts.CPU125.RES:Rescheduling_interrupts
> >>> 2244 ± 24% -53.5% 1043 ± 18% interrupts.CPU126.CAL:Function_call_interrupts
> >>> 766.75 ± 9% -39.0% 467.75 ± 23% interrupts.CPU126.RES:Rescheduling_interrupts
> >>> 1961 ± 11% -55.8% 866.75 ± 32% interrupts.CPU127.CAL:Function_call_interrupts
> >>> 822.25 ± 17% -44.9% 452.75 ± 34% interrupts.CPU127.RES:Rescheduling_interrupts
> >>> 2014 ± 12% -42.8% 1152 ± 26% interrupts.CPU128.CAL:Function_call_interrupts
> >>> 1015 ± 28% -46.7% 540.75 ± 24% interrupts.CPU128.RES:Rescheduling_interrupts
> >>> 2047 ± 9% -46.4% 1098 ± 21% interrupts.CPU129.CAL:Function_call_interrupts
> >>> 870.00 ± 9% -35.0% 565.25 ± 10% interrupts.CPU129.RES:Rescheduling_interrupts
> >>> 1924 ± 7% -42.2% 1112 ± 26% interrupts.CPU13.CAL:Function_call_interrupts
> >>> 1475 ± 2% -41.6% 861.75 ± 19% interrupts.CPU13.RES:Rescheduling_interrupts
> >>> 848.25 ± 14% -36.3% 540.25 ± 13% interrupts.CPU130.RES:Rescheduling_interrupts
> >>> 2098 ± 2% -48.5% 1080 ± 25% interrupts.CPU131.CAL:Function_call_interrupts
> >>> 1062 ± 43% -48.1% 551.50 ± 12% interrupts.CPU131.RES:Rescheduling_interrupts
> >>> 1996 ± 10% -44.6% 1106 ± 24% interrupts.CPU132.CAL:Function_call_interrupts
> >>> 1016 ± 21% -43.0% 579.50 ± 8% interrupts.CPU132.RES:Rescheduling_interrupts
> >>> 2101 ± 15% -44.9% 1157 ± 21% interrupts.CPU133.CAL:Function_call_interrupts
> >>> 1036 ± 24% -47.7% 541.50 ± 16% interrupts.CPU133.RES:Rescheduling_interrupts
> >>> 2012 ± 12% -44.2% 1122 ± 23% interrupts.CPU134.CAL:Function_call_interrupts
> >>> 792.50 ± 5% -19.7% 636.25 ± 14% interrupts.CPU134.RES:Rescheduling_interrupts
> >>> 1960 ± 10% -44.3% 1091 ± 27% interrupts.CPU135.CAL:Function_call_interrupts
> >>> 881.25 ± 19% -33.0% 590.50 ± 14% interrupts.CPU135.RES:Rescheduling_interrupts
> >>> 1985 ± 10% -45.0% 1092 ± 21% interrupts.CPU136.CAL:Function_call_interrupts
> >>> 6900 ± 21% -28.6% 4927 ± 29% interrupts.CPU136.NMI:Non-maskable_interrupts
> >>> 6900 ± 21% -28.6% 4927 ± 29% interrupts.CPU136.PMI:Performance_monitoring_interrupts
> >>> 1058 ± 32% -50.7% 521.75 ± 10% interrupts.CPU136.RES:Rescheduling_interrupts
> >>> 2018 ± 6% -45.5% 1100 ± 25% interrupts.CPU137.CAL:Function_call_interrupts
> >>> 805.50 ± 15% -28.6% 574.75 ± 10% interrupts.CPU137.RES:Rescheduling_interrupts
> >>> 1930 ± 9% -42.0% 1119 ± 25% interrupts.CPU138.CAL:Function_call_interrupts
> >>> 4247 ± 9% +41.1% 5992 ± 32% interrupts.CPU138.NMI:Non-maskable_interrupts
> >>> 4247 ± 9% +41.1% 5992 ± 32% interrupts.CPU138.PMI:Performance_monitoring_interrupts
> >>> 2080 ± 12% -46.2% 1119 ± 24% interrupts.CPU139.CAL:Function_call_interrupts
> >>> 1051 ± 41% -48.7% 540.00 ± 9% interrupts.CPU139.RES:Rescheduling_interrupts
> >>> 1924 ± 8% -43.2% 1092 ± 25% interrupts.CPU14.CAL:Function_call_interrupts
> >>> 1463 ± 8% -37.8% 909.50 ± 15% interrupts.CPU14.RES:Rescheduling_interrupts
> >>> 2020 ± 8% -44.8% 1115 ± 24% interrupts.CPU140.CAL:Function_call_interrupts
> >>> 894.50 ± 20% -33.7% 593.50 ± 15% interrupts.CPU140.RES:Rescheduling_interrupts
> >>> 2075 ± 14% -47.2% 1096 ± 25% interrupts.CPU141.CAL:Function_call_interrupts
> >>> 975.25 ± 21% -41.6% 569.75 ± 13% interrupts.CPU141.RES:Rescheduling_interrupts
> >>> 849.25 ± 11% -28.6% 606.50 ± 8% interrupts.CPU142.RES:Rescheduling_interrupts
> >>> 2440 ± 11% -50.3% 1213 ± 21% interrupts.CPU143.CAL:Function_call_interrupts
> >>> 881.00 ± 10% -34.1% 580.50 ± 8% interrupts.CPU143.RES:Rescheduling_interrupts
> >>> 1916 ± 8% -41.0% 1131 ± 20% interrupts.CPU15.CAL:Function_call_interrupts
> >>> 1608 ± 11% -48.5% 827.50 ± 20% interrupts.CPU15.RES:Rescheduling_interrupts
> >>> 1917 ± 8% -41.3% 1125 ± 26% interrupts.CPU16.CAL:Function_call_interrupts
> >>> 1441 ± 3% -41.9% 837.75 ± 19% interrupts.CPU16.RES:Rescheduling_interrupts
> >>> 6074 ± 31% -29.2% 4303 ± 10% interrupts.CPU17.NMI:Non-maskable_interrupts
> >>> 6074 ± 31% -29.2% 4303 ± 10% interrupts.CPU17.PMI:Performance_monitoring_interrupts
> >>> 1547 ± 12% -45.7% 839.75 ± 14% interrupts.CPU17.RES:Rescheduling_interrupts
> >>> 2273 ± 9% -43.4% 1287 ± 18% interrupts.CPU19.CAL:Function_call_interrupts
> >>> 1438 ± 6% -44.3% 800.50 ± 18% interrupts.CPU19.RES:Rescheduling_interrupts
> >>> 2008 ± 9% -40.5% 1195 ± 26% interrupts.CPU2.CAL:Function_call_interrupts
> >>> 1964 ± 12% -37.7% 1223 ± 28% interrupts.CPU20.CAL:Function_call_interrupts
> >>> 2065 ± 7% -38.7% 1266 ± 19% interrupts.CPU21.CAL:Function_call_interrupts
> >>> 1362 ± 9% -38.4% 839.50 ± 22% interrupts.CPU21.RES:Rescheduling_interrupts
> >>> 2038 ± 7% -40.4% 1214 ± 24% interrupts.CPU22.CAL:Function_call_interrupts
> >>> 1411 ± 7% -44.2% 787.25 ± 22% interrupts.CPU22.RES:Rescheduling_interrupts
> >>> 2052 ± 6% -40.9% 1212 ± 22% interrupts.CPU23.CAL:Function_call_interrupts
> >>> 2017 ± 8% -41.8% 1174 ± 23% interrupts.CPU24.CAL:Function_call_interrupts
> >>> 2032 ± 7% -42.9% 1160 ± 25% interrupts.CPU25.CAL:Function_call_interrupts
> >>> 1432 ± 6% -46.9% 760.50 ± 14% interrupts.CPU25.RES:Rescheduling_interrupts
> >>> 1966 ± 7% -40.3% 1174 ± 27% interrupts.CPU26.CAL:Function_call_interrupts
> >>> 1397 ± 5% -42.3% 805.50 ± 19% interrupts.CPU26.RES:Rescheduling_interrupts
> >>> 1975 ± 5% -41.1% 1162 ± 24% interrupts.CPU27.CAL:Function_call_interrupts
> >>> 1537 ± 25% -47.0% 815.50 ± 20% interrupts.CPU27.RES:Rescheduling_interrupts
> >>> 1982 ± 7% -42.1% 1148 ± 23% interrupts.CPU28.CAL:Function_call_interrupts
> >>> 1405 ± 10% -38.6% 862.50 ± 22% interrupts.CPU28.RES:Rescheduling_interrupts
> >>> 2002 ± 5% -41.3% 1175 ± 28% interrupts.CPU29.CAL:Function_call_interrupts
> >>> 1391 ± 6% -38.7% 853.25 ± 18% interrupts.CPU29.RES:Rescheduling_interrupts
> >>> 1960 ± 11% -41.0% 1155 ± 29% interrupts.CPU3.CAL:Function_call_interrupts
> >>> 1469 ± 5% -40.6% 872.00 ± 21% interrupts.CPU3.RES:Rescheduling_interrupts
> >>> 2014 ± 6% -41.5% 1178 ± 23% interrupts.CPU30.CAL:Function_call_interrupts
> >>> 1405 ± 8% -42.2% 812.75 ± 20% interrupts.CPU30.RES:Rescheduling_interrupts
> >>> 2023 ± 4% -44.3% 1126 ± 23% interrupts.CPU31.CAL:Function_call_interrupts
> >>> 1950 ± 7% -42.0% 1132 ± 21% interrupts.CPU32.CAL:Function_call_interrupts
> >>> 1399 ± 5% -35.5% 903.00 ± 24% interrupts.CPU32.RES:Rescheduling_interrupts
> >>> 1967 ± 7% -42.9% 1123 ± 24% interrupts.CPU33.CAL:Function_call_interrupts
> >>> 1446 ± 10% -43.7% 815.00 ± 18% interrupts.CPU33.RES:Rescheduling_interrupts
> >>> 1937 ± 8% -41.9% 1126 ± 25% interrupts.CPU34.CAL:Function_call_interrupts
> >>> 1412 ± 10% -35.4% 911.75 ± 26% interrupts.CPU34.RES:Rescheduling_interrupts
> >>> 2372 ± 31% -51.4% 1153 ± 25% interrupts.CPU35.CAL:Function_call_interrupts
> >>> 1395 ± 6% -38.7% 855.00 ± 17% interrupts.CPU35.RES:Rescheduling_interrupts
> >>> 2092 ± 7% -49.4% 1059 ± 4% interrupts.CPU36.CAL:Function_call_interrupts
> >>> 4142 ± 2% +59.2% 6595 ± 22% interrupts.CPU36.NMI:Non-maskable_interrupts
> >>> 4142 ± 2% +59.2% 6595 ± 22% interrupts.CPU36.PMI:Performance_monitoring_interrupts
> >>> 2122 ± 10% -41.3% 1245 ± 25% interrupts.CPU37.CAL:Function_call_interrupts
> >>> 1350 ± 5% -40.6% 802.25 ± 14% interrupts.CPU37.RES:Rescheduling_interrupts
> >>> 2408 ± 19% -52.0% 1154 ± 17% interrupts.CPU38.CAL:Function_call_interrupts
> >>> 1240 ± 13% -35.9% 795.00 ± 16% interrupts.CPU38.RES:Rescheduling_interrupts
> >>> 2061 ± 12% -36.2% 1314 ± 32% interrupts.CPU39.CAL:Function_call_interrupts
> >>> 1270 ± 7% -35.6% 818.50 ± 16% interrupts.CPU39.RES:Rescheduling_interrupts
> >>> 2030 ± 8% -43.2% 1152 ± 24% interrupts.CPU4.CAL:Function_call_interrupts
> >>> 1439 ± 7% -35.3% 932.00 ± 25% interrupts.CPU4.RES:Rescheduling_interrupts
> >>> 1362 ± 8% -43.4% 771.25 ± 10% interrupts.CPU40.RES:Rescheduling_interrupts
> >>> 2033 ± 7% -46.5% 1088 ± 26% interrupts.CPU41.CAL:Function_call_interrupts
> >>> 6964 ± 20% -32.3% 4712 ± 23% interrupts.CPU41.NMI:Non-maskable_interrupts
> >>> 6964 ± 20% -32.3% 4712 ± 23% interrupts.CPU41.PMI:Performance_monitoring_interrupts
> >>> 1294 ± 10% -36.8% 817.25 ± 19% interrupts.CPU41.RES:Rescheduling_interrupts
> >>> 1989 ± 9% -42.4% 1145 ± 17% interrupts.CPU42.CAL:Function_call_interrupts
> >>> 1303 ± 9% -35.8% 836.50 ± 12% interrupts.CPU42.RES:Rescheduling_interrupts
> >>> 2016 ± 9% -42.9% 1150 ± 16% interrupts.CPU43.CAL:Function_call_interrupts
> >>> 1331 ± 12% -37.0% 838.50 ± 17% interrupts.CPU43.RES:Rescheduling_interrupts
> >>> 1999 ± 10% -44.9% 1101 ± 22% interrupts.CPU44.CAL:Function_call_interrupts
> >>> 7077 ± 21% -42.5% 4070 ± 2% interrupts.CPU44.NMI:Non-maskable_interrupts
> >>> 7077 ± 21% -42.5% 4070 ± 2% interrupts.CPU44.PMI:Performance_monitoring_interrupts
> >>> 1317 ± 8% -39.2% 801.00 ± 20% interrupts.CPU44.RES:Rescheduling_interrupts
> >>> 2034 ± 9% -42.9% 1162 ± 19% interrupts.CPU45.CAL:Function_call_interrupts
> >>> 1309 ± 8% -37.0% 825.00 ± 12% interrupts.CPU45.RES:Rescheduling_interrupts
> >>> 2009 ± 9% -43.1% 1144 ± 17% interrupts.CPU46.CAL:Function_call_interrupts
> >>> 1294 ± 9% -38.6% 794.75 ± 16% interrupts.CPU46.RES:Rescheduling_interrupts
> >>> 1951 ± 8% -42.0% 1132 ± 22% interrupts.CPU47.CAL:Function_call_interrupts
> >>> 1331 ± 5% -41.0% 786.25 ± 13% interrupts.CPU47.RES:Rescheduling_interrupts
> >>> 1993 ± 7% -43.8% 1119 ± 23% interrupts.CPU48.CAL:Function_call_interrupts
> >>> 1322 ± 13% -42.9% 755.25 ± 17% interrupts.CPU48.RES:Rescheduling_interrupts
> >>> 2024 ± 9% -43.2% 1150 ± 22% interrupts.CPU49.CAL:Function_call_interrupts
> >>> 4172 ± 6% +42.0% 5925 ± 31% interrupts.CPU49.NMI:Non-maskable_interrupts
> >>> 4172 ± 6% +42.0% 5925 ± 31% interrupts.CPU49.PMI:Performance_monitoring_interrupts
> >>> 1276 ± 9% -37.2% 801.25 ± 11% interrupts.CPU49.RES:Rescheduling_interrupts
> >>> 1997 ± 7% -41.8% 1162 ± 24% interrupts.CPU5.CAL:Function_call_interrupts
> >>> 1670 ± 18% -47.6% 875.00 ± 16% interrupts.CPU5.RES:Rescheduling_interrupts
> >>> 2019 ± 8% -43.6% 1139 ± 18% interrupts.CPU50.CAL:Function_call_interrupts
> >>> 7398 ± 9% -33.4% 4929 ± 30% interrupts.CPU50.NMI:Non-maskable_interrupts
> >>> 7398 ± 9% -33.4% 4929 ± 30% interrupts.CPU50.PMI:Performance_monitoring_interrupts
> >>> 1311 ± 13% -40.2% 783.75 ± 23% interrupts.CPU50.RES:Rescheduling_interrupts
> >>> 1979 ± 10% -42.7% 1133 ± 20% interrupts.CPU51.CAL:Function_call_interrupts
> >>> 1266 ± 6% -39.4% 768.00 ± 18% interrupts.CPU51.RES:Rescheduling_interrupts
> >>> 1990 ± 10% -42.1% 1152 ± 23% interrupts.CPU52.CAL:Function_call_interrupts
> >>> 1244 ± 5% -32.4% 841.00 ± 12% interrupts.CPU52.RES:Rescheduling_interrupts
> >>> 1938 ± 8% -41.5% 1134 ± 18% interrupts.CPU53.CAL:Function_call_interrupts
> >>> 1235 ± 11% -34.2% 812.50 ± 10% interrupts.CPU53.RES:Rescheduling_interrupts
> >>> 2400 ± 15% -54.9% 1082 ± 12% interrupts.CPU54.CAL:Function_call_interrupts
> >>> 1132 ± 10% -57.9% 476.25 ± 52% interrupts.CPU54.RES:Rescheduling_interrupts
> >>> 2032 ± 13% -39.7% 1225 ± 31% interrupts.CPU55.CAL:Function_call_interrupts
> >>> 4022 +48.7% 5983 ± 31% interrupts.CPU55.NMI:Non-maskable_interrupts
> >>> 4022 +48.7% 5983 ± 31% interrupts.CPU55.PMI:Performance_monitoring_interrupts
> >>> 1135 ± 10% -36.5% 720.75 ± 25% interrupts.CPU55.RES:Rescheduling_interrupts
> >>> 2113 ± 11% -41.9% 1227 ± 29% interrupts.CPU56.CAL:Function_call_interrupts
> >>> 4948 ± 32% +58.2% 7827 ± 3% interrupts.CPU56.NMI:Non-maskable_interrupts
> >>> 4948 ± 32% +58.2% 7827 ± 3% interrupts.CPU56.PMI:Performance_monitoring_interrupts
> >>> 1185 ± 16% -41.4% 694.75 ± 16% interrupts.CPU56.RES:Rescheduling_interrupts
> >>> 2196 ± 12% -47.1% 1162 ± 24% interrupts.CPU57.CAL:Function_call_interrupts
> >>> 1181 ± 13% -41.3% 693.75 ± 13% interrupts.CPU57.RES:Rescheduling_interrupts
> >>> 2182 ± 10% -48.3% 1128 ± 23% interrupts.CPU58.CAL:Function_call_interrupts
> >>> 1163 ± 12% -35.5% 750.00 ± 14% interrupts.CPU58.RES:Rescheduling_interrupts
> >>> 2042 ± 10% -36.2% 1302 ± 21% interrupts.CPU59.CAL:Function_call_interrupts
> >>> 1143 ± 15% -39.8% 689.00 ± 14% interrupts.CPU59.RES:Rescheduling_interrupts
> >>> 1932 ± 9% -29.9% 1354 ± 29% interrupts.CPU6.CAL:Function_call_interrupts
> >>> 1445 ± 11% -48.7% 742.00 ± 47% interrupts.CPU6.RES:Rescheduling_interrupts
> >>> 2090 ± 10% -45.9% 1131 ± 24% interrupts.CPU60.CAL:Function_call_interrupts
> >>> 1126 ± 11% -39.6% 680.50 ± 8% interrupts.CPU60.RES:Rescheduling_interrupts
> >>> 2103 ± 12% -45.4% 1147 ± 24% interrupts.CPU61.CAL:Function_call_interrupts
> >>> 1111 ± 11% -41.7% 647.75 ± 14% interrupts.CPU61.RES:Rescheduling_interrupts
> >>> 2298 ± 15% -50.8% 1130 ± 23% interrupts.CPU62.CAL:Function_call_interrupts
> >>> 1064 ± 11% -37.0% 671.00 ± 13% interrupts.CPU62.RES:Rescheduling_interrupts
> >>> 2042 ± 10% -45.6% 1112 ± 24% interrupts.CPU63.CAL:Function_call_interrupts
> >>> 1021 ± 16% -36.0% 653.00 ± 14% interrupts.CPU63.RES:Rescheduling_interrupts
> >>> 2135 ± 4% -48.1% 1107 ± 23% interrupts.CPU64.CAL:Function_call_interrupts
> >>> 1159 ± 19% -42.3% 668.75 ± 15% interrupts.CPU64.RES:Rescheduling_interrupts
> >>> 2124 ± 12% -45.7% 1153 ± 28% interrupts.CPU65.CAL:Function_call_interrupts
> >>> 1132 ± 9% -37.6% 707.00 ± 11% interrupts.CPU65.RES:Rescheduling_interrupts
> >>> 2058 ± 10% -44.2% 1148 ± 26% interrupts.CPU66.CAL:Function_call_interrupts
> >>> 1163 ± 23% -48.4% 600.00 ± 13% interrupts.CPU66.RES:Rescheduling_interrupts
> >>> 2477 ± 32% -52.9% 1165 ± 23% interrupts.CPU67.CAL:Function_call_interrupts
> >>> 1090 ± 14% -36.5% 692.50 ± 19% interrupts.CPU67.RES:Rescheduling_interrupts
> >>> 2024 ± 9% -45.7% 1100 ± 26% interrupts.CPU68.CAL:Function_call_interrupts
> >>> 1062 ± 18% -38.7% 651.00 ± 10% interrupts.CPU68.RES:Rescheduling_interrupts
> >>> 2135 ± 12% -47.3% 1124 ± 26% interrupts.CPU69.CAL:Function_call_interrupts
> >>> 1106 ± 9% -40.6% 657.00 ± 20% interrupts.CPU69.RES:Rescheduling_interrupts
> >>> 1978 ± 8% -44.7% 1094 ± 24% interrupts.CPU7.CAL:Function_call_interrupts
> >>> 1518 ± 5% -42.6% 871.50 ± 14% interrupts.CPU7.RES:Rescheduling_interrupts
> >>> 2016 ± 9% -42.0% 1169 ± 23% interrupts.CPU70.CAL:Function_call_interrupts
> >>> 1122 ± 15% -41.8% 653.50 ± 21% interrupts.CPU70.RES:Rescheduling_interrupts
> >>> 2056 ± 10% -45.7% 1117 ± 26% interrupts.CPU71.CAL:Function_call_interrupts
> >>> 1122 ± 20% -38.3% 692.25 ± 10% interrupts.CPU71.RES:Rescheduling_interrupts
> >>> 1970 ± 6% -43.8% 1107 ± 35% interrupts.CPU72.CAL:Function_call_interrupts
> >>> 1077 ± 6% -51.0% 528.00 ± 24% interrupts.CPU72.RES:Rescheduling_interrupts
> >>> 1896 ± 8% -42.9% 1081 ± 25% interrupts.CPU73.CAL:Function_call_interrupts
> >>> 1103 ± 3% -51.4% 536.50 ± 22% interrupts.CPU73.RES:Rescheduling_interrupts
> >>> 1852 ± 8% -42.1% 1072 ± 24% interrupts.CPU74.CAL:Function_call_interrupts
> >>> 1156 ± 9% -46.5% 619.00 ± 19% interrupts.CPU74.RES:Rescheduling_interrupts
> >>> 2158 ± 27% -49.8% 1083 ± 27% interrupts.CPU75.CAL:Function_call_interrupts
> >>> 1117 ± 5% -45.7% 606.50 ± 26% interrupts.CPU75.RES:Rescheduling_interrupts
> >>> 1864 ± 9% -35.3% 1206 ± 34% interrupts.CPU76.CAL:Function_call_interrupts
> >>> 1057 ± 3% -32.4% 714.75 ± 30% interrupts.CPU76.RES:Rescheduling_interrupts
> >>> 1837 ± 5% -38.2% 1136 ± 27% interrupts.CPU77.CAL:Function_call_interrupts
> >>> 981.75 ± 10% -32.5% 663.00 ± 19% interrupts.CPU77.RES:Rescheduling_interrupts
> >>> 1841 ± 10% -40.4% 1097 ± 23% interrupts.CPU78.CAL:Function_call_interrupts
> >>> 1820 ± 8% -40.9% 1075 ± 22% interrupts.CPU79.CAL:Function_call_interrupts
> >>> 1924 ± 7% -42.9% 1099 ± 25% interrupts.CPU8.CAL:Function_call_interrupts
> >>> 1503 ± 5% -43.2% 853.50 ± 13% interrupts.CPU8.RES:Rescheduling_interrupts
> >>> 1849 ± 7% -42.3% 1068 ± 27% interrupts.CPU80.CAL:Function_call_interrupts
> >>> 1264 ± 15% -47.6% 662.75 ± 27% interrupts.CPU80.RES:Rescheduling_interrupts
> >>> 1828 ± 7% -43.6% 1031 ± 26% interrupts.CPU81.CAL:Function_call_interrupts
> >>> 1023 ± 5% -35.2% 663.25 ± 19% interrupts.CPU81.RES:Rescheduling_interrupts
> >>> 1834 ± 9% -44.2% 1023 ± 26% interrupts.CPU82.CAL:Function_call_interrupts
> >>> 1061 ± 10% -37.7% 662.00 ± 30% interrupts.CPU82.RES:Rescheduling_interrupts
> >>> 1807 ± 9% -33.0% 1210 ± 38% interrupts.CPU83.CAL:Function_call_interrupts
> >>> 1855 ± 8% -42.5% 1066 ± 26% interrupts.CPU84.CAL:Function_call_interrupts
> >>> 1010 ± 6% -43.6% 570.00 ± 19% interrupts.CPU84.RES:Rescheduling_interrupts
> >>> 1831 ± 8% -40.6% 1088 ± 28% interrupts.CPU85.CAL:Function_call_interrupts
> >>> 1106 ± 3% -35.1% 718.25 ± 27% interrupts.CPU85.RES:Rescheduling_interrupts
> >>> 1813 ± 9% -39.0% 1106 ± 26% interrupts.CPU86.CAL:Function_call_interrupts
> >>> 7029 ± 21% -41.7% 4099 ± 2% interrupts.CPU86.NMI:Non-maskable_interrupts
> >>> 7029 ± 21% -41.7% 4099 ± 2% interrupts.CPU86.PMI:Performance_monitoring_interrupts
> >>> 1029 ± 6% -33.4% 686.25 ± 25% interrupts.CPU86.RES:Rescheduling_interrupts
> >>> 1878 ± 10% -40.1% 1124 ± 25% interrupts.CPU87.CAL:Function_call_interrupts
> >>> 1864 ± 10% -41.5% 1090 ± 25% interrupts.CPU88.CAL:Function_call_interrupts
> >>> 1221 ± 10% -54.3% 557.75 ± 18% interrupts.CPU88.RES:Rescheduling_interrupts
> >>> 1853 ± 7% -38.7% 1136 ± 24% interrupts.CPU89.CAL:Function_call_interrupts
> >>> 1237 ± 16% -43.9% 694.25 ± 27% interrupts.CPU89.RES:Rescheduling_interrupts
> >>> 1941 ± 7% -37.3% 1217 ± 31% interrupts.CPU9.CAL:Function_call_interrupts
> >>> 1433 ± 5% -39.8% 863.50 ± 22% interrupts.CPU9.RES:Rescheduling_interrupts
> >>> 1941 ± 5% -53.1% 911.25 ± 22% interrupts.CPU90.CAL:Function_call_interrupts
> >>> 1528 ± 70% -73.6% 404.25 ± 47% interrupts.CPU90.RES:Rescheduling_interrupts
> >>> 1975 ± 7% -39.8% 1188 ± 19% interrupts.CPU91.CAL:Function_call_interrupts
> >>> 979.25 ± 9% -42.0% 567.75 ± 23% interrupts.CPU91.RES:Rescheduling_interrupts
> >>> 1899 ± 7% -39.8% 1143 ± 24% interrupts.CPU92.CAL:Function_call_interrupts
> >>> 1003 ± 9% -42.4% 578.25 ± 20% interrupts.CPU92.RES:Rescheduling_interrupts
> >>> 1914 ± 6% -36.0% 1226 ± 21% interrupts.CPU93.CAL:Function_call_interrupts
> >>> 1005 ± 7% -39.0% 613.00 ± 31% interrupts.CPU93.RES:Rescheduling_interrupts
> >>> 1930 ± 5% -40.1% 1155 ± 18% interrupts.CPU94.CAL:Function_call_interrupts
> >>> 978.75 ± 9% -39.3% 594.00 ± 24% interrupts.CPU94.RES:Rescheduling_interrupts
> >>> 1911 ± 7% -40.9% 1129 ± 26% interrupts.CPU95.CAL:Function_call_interrupts
> >>> 1008 ± 10% -36.3% 642.25 ± 32% interrupts.CPU95.RES:Rescheduling_interrupts
> >>> 1933 ± 4% -43.5% 1093 ± 27% interrupts.CPU96.CAL:Function_call_interrupts
> >>> 1016 ± 7% -40.4% 606.00 ± 21% interrupts.CPU96.RES:Rescheduling_interrupts
> >>> 1912 ± 8% -39.7% 1154 ± 26% interrupts.CPU97.CAL:Function_call_interrupts
> >>> 1054 ± 8% -50.0% 526.75 ± 14% interrupts.CPU97.RES:Rescheduling_interrupts
> >>> 1877 ± 9% -40.0% 1127 ± 23% interrupts.CPU98.CAL:Function_call_interrupts
> >>> 1005 ± 9% -43.4% 568.75 ± 23% interrupts.CPU98.RES:Rescheduling_interrupts
> >>> 1934 ± 7% -39.1% 1178 ± 24% interrupts.CPU99.CAL:Function_call_interrupts
> >>> 976.50 ± 12% -41.6% 570.75 ± 24% interrupts.CPU99.RES:Rescheduling_interrupts
> >>> 165898 ± 7% -38.5% 102101 ± 13% interrupts.RES:Rescheduling_interrupts
> >>>
> >>>
> >>>
> >>> ***************************************************************************************************
> >>> lkp-csl-2sp6: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
> >>> =========================================================================================
> >>> bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
> >>> 2M/gcc-9/performance/2pmem/btrfs/sync/x86_64-rhel-8.3/50%/debian-10.4-x86_64-20200603.cgz/200s/randread/lkp-csl-2sp6/100G/fio-basic/tb/0x5002f01
> >>>
> >>> commit:
> >>> 3fbdbb91fe ("mm/swap: serialize memcg changes in pagevec_lru_move_fn")
> >>> ea4ebd4126 ("mm/lru: replace pgdat lru_lock with lruvec lock")
> >>>
> >>> 3fbdbb91fe4781ab ea4ebd4126d0c2d82f1210f18d0
> >>> ---------------- ---------------------------
> >>> %stddev %change %stddev
> >>> \ | \
> >>> 46.88 ± 2% +3.2 50.09 fio.latency_10ms%
> >>> 1.80 ± 3% +1.4 3.22 ± 12% fio.latency_20ms%
> >>> 7.87 ± 2% -1.5 6.34 fio.latency_2ms%
> >>> 37.10 ± 3% -3.0 34.09 ± 2% fio.latency_4ms%
> >>> 14806 -8.6% 13532 fio.read_bw_MBps
> >>> 8552448 +12.6% 9633792 ± 3% fio.read_clat_90%_us
> >>> 31195136 +4.0% 32440320 fio.read_clat_99%_us
> >>> 5833410 +6.0% 6182861 fio.read_clat_mean_us
> >>> 6025215 +2.2% 6159306 fio.read_clat_stddev
> >>> 7403 -8.6% 6766 fio.read_iops
> >>> 6.068e+09 -8.6% 5.548e+09 fio.time.file_system_inputs
> >>> 260084 ± 2% -8.3% 238511 fio.time.involuntary_context_switches
> >>> 22.96 -15.9% 19.32 ± 2% fio.time.user_time
> >>> 41808773 ± 7% -23.3% 32070967 ± 2% fio.time.voluntary_context_switches
> >>> 1481500 -8.6% 1354435 fio.workload
> >>> 38.45 +5.5% 40.56 iostat.cpu.idle
> >>> 61.31 -3.4% 59.25 iostat.cpu.system
> >>> 3.326e+08 ± 2% -9.8% 3.001e+08 numa-numastat.node0.local_node
> >>> 3.326e+08 ± 2% -9.8% 3.002e+08 numa-numastat.node0.numa_hit
> >>> 1.29 -0.2 1.12 ± 2% mpstat.cpu.all.irq%
> >>> 0.10 ± 2% -0.0 0.08 ± 2% mpstat.cpu.all.soft%
> >>> 0.14 -0.0 0.12 ± 2% mpstat.cpu.all.usr%
> >>> 1.568e+08 ± 88% -64.5% 55712899 ± 7% cpuidle.C1.time
> >>> 12999543 ± 12% -31.4% 8921678 ± 4% cpuidle.C1.usage
> >>> 72143072 ± 6% -26.3% 53174253 ± 4% cpuidle.POLL.time
> >>> 23033747 ± 7% -24.6% 17363759 ± 4% cpuidle.POLL.usage
> >>> 152.25 ± 4% -29.7% 107.00 ± 6% numa-vmstat.node0.nr_isolated_file
> >>> 136.75 ± 4% -22.1% 106.50 ± 8% numa-vmstat.node1.nr_isolated_file
> >>> 1.805e+08 ± 8% -13.4% 1.564e+08 ± 2% numa-vmstat.node1.numa_hit
> >>> 1.804e+08 ± 8% -13.4% 1.562e+08 ± 2% numa-vmstat.node1.numa_local
> >>> 3000 ± 5% +27.2% 3816 ± 15% slabinfo.blkdev_ioc.active_objs
> >>> 3177 ± 6% +28.7% 4089 ± 14% slabinfo.blkdev_ioc.num_objs
> >>> 7920 ± 20% +24.3% 9848 ± 6% slabinfo.pid_namespace.active_objs
> >>> 7924 ± 20% +24.3% 9848 ± 6% slabinfo.pid_namespace.num_objs
> >>> 38.00 +5.9% 40.25 vmstat.cpu.id
> >>> 60.75 -3.3% 58.75 vmstat.cpu.sy
> >>> 14891160 -8.5% 13631155 vmstat.io.bi
> >>> 441283 ± 6% -22.1% 343631 ± 2% vmstat.system.cs
> >>> 1241 ± 6% +272.7% 4626 ±120% sched_debug.cpu.avg_idle.min
> >>> 6.92 ± 26% -43.1% 3.94 ± 25% sched_debug.cpu.clock.stddev
> >>> 522458 ± 10% -24.2% 395790 ± 11% sched_debug.cpu.nr_switches.avg
> >>> 756359 ± 10% -21.0% 597479 ± 12% sched_debug.cpu.nr_switches.max
> >>> 328023 ± 11% -24.8% 246643 ± 16% sched_debug.cpu.nr_switches.min
> >>> 91523 ± 4% -21.9% 71442 ± 11% sched_debug.cpu.nr_switches.stddev
> >>> -55.00 -14.7% -46.90 sched_debug.cpu.nr_uninterruptible.min
> >>> 520790 ± 11% -24.3% 394068 ± 11% sched_debug.cpu.sched_count.avg
> >>> 751355 ± 10% -21.3% 591615 ± 12% sched_debug.cpu.sched_count.max
> >>> 326809 ± 11% -25.5% 243634 ± 17% sched_debug.cpu.sched_count.min
> >>> 91193 ± 4% -22.3% 70850 ± 11% sched_debug.cpu.sched_count.stddev
> >>> 258998 ± 10% -24.4% 195886 ± 11% sched_debug.cpu.sched_goidle.avg
> >>> 373844 ± 10% -21.2% 294422 ± 12% sched_debug.cpu.sched_goidle.max
> >>> 162329 ± 11% -25.5% 120946 ± 17% sched_debug.cpu.sched_goidle.min
> >>> 45452 ± 4% -22.3% 35314 ± 11% sched_debug.cpu.sched_goidle.stddev
> >>> 260586 ± 11% -24.3% 197159 ± 11% sched_debug.cpu.ttwu_count.avg
> >>> 422930 ± 4% -17.7% 348121 ± 5% sched_debug.cpu.ttwu_count.max
> >>> 66827 ± 4% -21.3% 52594 ± 9% sched_debug.cpu.ttwu_count.stddev
> >>> 110066 ± 2% -12.7% 96037 proc-vmstat.allocstall_movable
> >>> 4454 ± 2% -10.4% 3993 proc-vmstat.kswapd_low_wmark_hit_quickly
> >>> 292.00 -25.9% 216.25 ± 3% proc-vmstat.nr_isolated_file
> >>> 118837 +0.9% 119849 proc-vmstat.nr_shmem
> >>> 6.666e+08 ± 2% -8.8% 6.077e+08 proc-vmstat.numa_hit
> >>> 6.666e+08 ± 2% -8.8% 6.076e+08 proc-vmstat.numa_local
> >>> 4513 ± 2% -9.9% 4067 proc-vmstat.pageoutrun
> >>> 20601 ± 3% +7.8% 22209 proc-vmstat.pgactivate
> >>> 26765890 -9.3% 24265002 ± 2% proc-vmstat.pgalloc_dma32
> >>> 7.325e+08 -8.6% 6.696e+08 proc-vmstat.pgalloc_normal
> >>> 7.488e+08 -8.7% 6.835e+08 proc-vmstat.pgfree
> >>> 3.034e+09 -8.6% 2.772e+09 proc-vmstat.pgpgin
> >>> 2.83e+08 ± 2% -12.8% 2.469e+08 proc-vmstat.pgscan_direct
> >>> 3.511e+08 -8.6% 3.211e+08 proc-vmstat.pgscan_file
> >>> 68119113 ± 3% +8.9% 74197570 ± 3% proc-vmstat.pgscan_kswapd
> >>> 2.83e+08 ± 2% -12.8% 2.468e+08 proc-vmstat.pgsteal_direct
> >>> 3.511e+08 -8.6% 3.21e+08 proc-vmstat.pgsteal_file
> >>> 68117747 ± 3% +8.9% 74195767 ± 3% proc-vmstat.pgsteal_kswapd
> >>> 52132 ± 8% -10.0% 46909 ± 2% proc-vmstat.slabs_scanned
> >>> 23767 ± 14% -15.3% 20124 ± 7% softirqs.CPU17.SCHED
> >>> 23134 ± 6% -11.1% 20569 ± 8% softirqs.CPU19.SCHED
> >>> 9011 ± 10% +40.7% 12683 ± 14% softirqs.CPU2.RCU
> >>> 77551 +22.8% 95259 ± 9% softirqs.CPU2.TIMER
> >>> 22489 ± 4% -17.1% 18638 ± 5% softirqs.CPU22.SCHED
> >>> 8289 ± 6% +24.7% 10335 ± 13% softirqs.CPU23.RCU
> >>> 23230 ± 5% -15.6% 19609 ± 11% softirqs.CPU26.SCHED
> >>> 22972 ± 3% -10.3% 20604 ± 3% softirqs.CPU28.SCHED
> >>> 23775 ± 9% -19.1% 19240 ± 4% softirqs.CPU31.SCHED
> >>> 21803 ± 4% -17.6% 17961 ± 5% softirqs.CPU36.SCHED
> >>> 22611 ± 9% -10.2% 20313 ± 7% softirqs.CPU40.SCHED
> >>> 22472 ± 7% -14.0% 19328 ± 6% softirqs.CPU43.SCHED
> >>> 21909 ± 5% -18.4% 17887 ± 5% softirqs.CPU44.SCHED
> >>> 21340 ± 5% -15.6% 18015 ± 3% softirqs.CPU45.SCHED
> >>> 77584 ± 2% +15.8% 89855 ± 15% softirqs.CPU48.TIMER
> >>> 8824 ± 5% +23.7% 10916 ± 12% softirqs.CPU50.RCU
> >>> 76664 +13.2% 86787 ± 10% softirqs.CPU50.TIMER
> >>> 22653 ± 9% -17.8% 18616 ± 5% softirqs.CPU54.SCHED
> >>> 22550 ± 4% -11.2% 20016 ± 7% softirqs.CPU60.SCHED
> >>> 23618 ± 7% -18.6% 19231 ± 8% softirqs.CPU72.SCHED
> >>> 23470 ± 5% -15.0% 19960 ± 6% softirqs.CPU78.SCHED
> >>> 22129 ± 6% -6.4% 20721 ± 5% softirqs.CPU8.SCHED
> >>> 22382 ± 6% -16.9% 18608 ± 8% softirqs.CPU80.SCHED
> >>> 22561 ± 3% -9.9% 20338 ± 6% softirqs.CPU86.SCHED
> >>> 23091 ± 4% -9.3% 20950 ± 8% softirqs.CPU88.SCHED
> >>> 24245 ± 4% -10.1% 21809 ± 4% softirqs.CPU90.SCHED
> >>> 24165 ± 2% -8.8% 22030 ± 2% softirqs.CPU95.SCHED
> >>> 30.19 -4.4% 28.86 perf-stat.i.MPKI
> >>> 9.378e+09 -5.2% 8.894e+09 perf-stat.i.branch-instructions
> >>> 0.41 -0.0 0.37 perf-stat.i.branch-miss-rate%
> >>> 37768008 ± 2% -15.0% 32086731 perf-stat.i.branch-misses
> >>> 9.972e+08 -9.5% 9.025e+08 perf-stat.i.cache-misses
> >>> 1.495e+09 -10.1% 1.343e+09 perf-stat.i.cache-references
> >>> 446916 ± 6% -22.4% 346764 ± 2% perf-stat.i.context-switches
> >>> 3.42 +2.6% 3.51 perf-stat.i.cpi
> >>> 1.679e+11 -3.5% 1.619e+11 perf-stat.i.cpu-cycles
> >>> 241.08 -10.1% 216.75 perf-stat.i.cpu-migrations
> >>> 176.23 +6.3% 187.27 perf-stat.i.cycles-between-cache-misses
> >>> 4967728 ± 4% -12.5% 4345152 ± 6% perf-stat.i.dTLB-load-misses
> >>> 1.326e+10 -6.2% 1.244e+10 perf-stat.i.dTLB-loads
> >>> 6.494e+09 -9.3% 5.888e+09 perf-stat.i.dTLB-stores
> >>> 4723741 ± 2% -10.4% 4231661 ± 2% perf-stat.i.iTLB-load-misses
> >>> 3768979 ± 3% -10.0% 3390755 perf-stat.i.iTLB-loads
> >>> 4.942e+10 -6.1% 4.643e+10 perf-stat.i.instructions
> >>> 0.30 -2.6% 0.29 perf-stat.i.ipc
> >>> 1.75 -3.5% 1.69 perf-stat.i.metric.GHz
> >>> 322.33 -6.7% 300.58 perf-stat.i.metric.M/sec
> >>> 1.014e+08 ± 2% -11.3% 89973060 ± 2% perf-stat.i.node-loads
> >>> 1.357e+08 ± 3% -9.5% 1.229e+08 perf-stat.i.node-stores
> >>> 30.25 -4.3% 28.94 perf-stat.overall.MPKI
> >>> 0.40 -0.0 0.36 perf-stat.overall.branch-miss-rate%
> >>> 3.40 +2.7% 3.49 perf-stat.overall.cpi
> >>> 168.31 +6.6% 179.40 perf-stat.overall.cycles-between-cache-misses
> >>> 0.29 -2.6% 0.29 perf-stat.overall.ipc
> >>> 6693725 +2.8% 6879677 perf-stat.overall.path-length
> >>> 9.331e+09 -5.2% 8.849e+09 perf-stat.ps.branch-instructions
> >>> 37570323 ± 2% -15.0% 31932437 perf-stat.ps.branch-misses
> >>> 9.924e+08 -9.5% 8.981e+08 perf-stat.ps.cache-misses
> >>> 1.487e+09 -10.1% 1.337e+09 perf-stat.ps.cache-references
> >>> 445089 ± 6% -22.3% 346017 ± 2% perf-stat.ps.context-switches
> >>> 1.67e+11 -3.5% 1.611e+11 perf-stat.ps.cpu-cycles
> >>> 239.89 -10.0% 215.88 perf-stat.ps.cpu-migrations
> >>> 4940211 ± 4% -12.6% 4319640 ± 6% perf-stat.ps.dTLB-load-misses
> >>> 1.319e+10 -6.2% 1.238e+10 perf-stat.ps.dTLB-loads
> >>> 6.462e+09 -9.3% 5.859e+09 perf-stat.ps.dTLB-stores
> >>> 4701299 ± 2% -10.4% 4213779 ± 2% perf-stat.ps.iTLB-load-misses
> >>> 3751568 ± 3% -10.0% 3377466 perf-stat.ps.iTLB-loads
> >>> 4.917e+10 -6.1% 4.619e+10 perf-stat.ps.instructions
> >>> 1.009e+08 ± 2% -11.3% 89499955 ± 2% perf-stat.ps.node-loads
> >>> 1.351e+08 ± 3% -9.5% 1.223e+08 perf-stat.ps.node-stores
> >>> 9.916e+12 -6.0% 9.317e+12 perf-stat.total.instructions
> >>> 6338585 ± 7% -14.1% 5447734 ± 2% interrupts.CAL:Function_call_interrupts
> >>> 6074 ± 10% -16.9% 5050 ± 10% interrupts.CPU0.RES:Rescheduling_interrupts
> >>> 5623 ± 6% -18.8% 4567 ± 9% interrupts.CPU10.RES:Rescheduling_interrupts
> >>> 78594 ± 9% -29.4% 55513 ± 12% interrupts.CPU12.CAL:Function_call_interrupts
> >>> 7133 ± 9% -33.5% 4740 ± 16% interrupts.CPU12.RES:Rescheduling_interrupts
> >>> 76970 ± 3% -24.9% 57781 ± 11% interrupts.CPU13.CAL:Function_call_interrupts
> >>> 7437 -30.6% 5161 ± 9% interrupts.CPU13.RES:Rescheduling_interrupts
> >>> 82683 ± 9% -24.2% 62688 ± 16% interrupts.CPU15.CAL:Function_call_interrupts
> >>> 7510 ± 5% -30.4% 5230 ± 18% interrupts.CPU15.RES:Rescheduling_interrupts
> >>> 6408 ± 5% -14.8% 5456 ± 9% interrupts.CPU17.RES:Rescheduling_interrupts
> >>> 7170 ± 7% -22.6% 5551 ± 5% interrupts.CPU19.RES:Rescheduling_interrupts
> >>> 5717 ± 8% -18.7% 4650 ± 17% interrupts.CPU2.RES:Rescheduling_interrupts
> >>> 7150 ± 3% -19.9% 5730 ± 11% interrupts.CPU20.RES:Rescheduling_interrupts
> >>> 7137 ± 7% -17.2% 5910 ± 11% interrupts.CPU22.RES:Rescheduling_interrupts
> >>> 7590 ± 13% -31.4% 5206 ± 20% interrupts.CPU23.RES:Rescheduling_interrupts
> >>> 58400 ± 7% -15.5% 49369 ± 11% interrupts.CPU24.CAL:Function_call_interrupts
> >>> 6055 ± 6% -31.1% 4174 ± 11% interrupts.CPU24.RES:Rescheduling_interrupts
> >>> 5723 ± 11% -21.0% 4521 ± 14% interrupts.CPU25.RES:Rescheduling_interrupts
> >>> 72.25 ± 59% +221.5% 232.25 ± 59% interrupts.CPU27.TLB:TLB_shootdowns
> >>> 5896 ± 10% -16.5% 4925 ± 6% interrupts.CPU28.RES:Rescheduling_interrupts
> >>> 6624 ± 14% -36.9% 4182 ± 41% interrupts.CPU29.NMI:Non-maskable_interrupts
> >>> 6624 ± 14% -36.9% 4182 ± 41% interrupts.CPU29.PMI:Performance_monitoring_interrupts
> >>> 6191 ± 17% -28.8% 4408 ± 13% interrupts.CPU29.RES:Rescheduling_interrupts
> >>> 69116 ± 6% -14.3% 59244 ± 11% interrupts.CPU3.CAL:Function_call_interrupts
> >>> 6280 ± 6% -19.0% 5085 ± 15% interrupts.CPU3.RES:Rescheduling_interrupts
> >>> 5571 ± 9% -23.3% 4271 ± 15% interrupts.CPU30.RES:Rescheduling_interrupts
> >>> 6097 ± 18% -27.7% 4410 ± 3% interrupts.CPU31.RES:Rescheduling_interrupts
> >>> 5916 ± 10% -21.8% 4624 ± 7% interrupts.CPU34.RES:Rescheduling_interrupts
> >>> 5697 ± 15% -24.2% 4317 ± 10% interrupts.CPU35.RES:Rescheduling_interrupts
> >>> 6147 ± 14% -15.6% 5188 ± 10% interrupts.CPU36.RES:Rescheduling_interrupts
> >>> 69725 ± 19% -20.6% 55396 ± 6% interrupts.CPU38.CAL:Function_call_interrupts
> >>> 3980 ± 35% +66.4% 6625 ± 16% interrupts.CPU38.NMI:Non-maskable_interrupts
> >>> 3980 ± 35% +66.4% 6625 ± 16% interrupts.CPU38.PMI:Performance_monitoring_interrupts
> >>> 6462 ± 11% -29.6% 4550 ± 3% interrupts.CPU38.RES:Rescheduling_interrupts
> >>> 3648 ± 49% +65.7% 6043 ± 29% interrupts.CPU39.NMI:Non-maskable_interrupts
> >>> 3648 ± 49% +65.7% 6043 ± 29% interrupts.CPU39.PMI:Performance_monitoring_interrupts
> >>> 6161 ± 11% -22.6% 4767 ± 12% interrupts.CPU4.RES:Rescheduling_interrupts
> >>> 5666 ± 3% -16.8% 4715 ± 5% interrupts.CPU40.RES:Rescheduling_interrupts
> >>> 5817 ± 10% -18.1% 4767 ± 5% interrupts.CPU41.RES:Rescheduling_interrupts
> >>> 6649 ± 15% -23.6% 5083 ± 4% interrupts.CPU42.RES:Rescheduling_interrupts
> >>> 6109 ± 5% -17.9% 5012 ± 13% interrupts.CPU43.RES:Rescheduling_interrupts
> >>> 6506 ± 11% -28.0% 4685 ± 5% interrupts.CPU44.RES:Rescheduling_interrupts
> >>> 4154 ± 30% +56.6% 6506 ± 15% interrupts.CPU45.NMI:Non-maskable_interrupts
> >>> 4154 ± 30% +56.6% 6506 ± 15% interrupts.CPU45.PMI:Performance_monitoring_interrupts
> >>> 6421 ± 10% -20.7% 5089 ± 5% interrupts.CPU45.RES:Rescheduling_interrupts
> >>> 5867 ± 5% -22.4% 4551 ± 4% interrupts.CPU46.RES:Rescheduling_interrupts
> >>> 6352 ± 8% -24.1% 4818 ± 7% interrupts.CPU47.RES:Rescheduling_interrupts
> >>> 7690 ± 8% -28.1% 5533 ± 18% interrupts.CPU48.RES:Rescheduling_interrupts
> >>> 81636 ± 8% -25.7% 60675 ± 14% interrupts.CPU49.CAL:Function_call_interrupts
> >>> 7979 ± 12% -29.8% 5601 ± 11% interrupts.CPU49.RES:Rescheduling_interrupts
> >>> 6800 ± 11% -19.4% 5479 ± 5% interrupts.CPU5.RES:Rescheduling_interrupts
> >>> 7672 ± 8% -22.1% 5980 ± 13% interrupts.CPU50.RES:Rescheduling_interrupts
> >>> 49.25 ± 27% +236.5% 165.75 ± 81% interrupts.CPU50.TLB:TLB_shootdowns
> >>> 7394 ± 7% -21.7% 5787 ± 11% interrupts.CPU51.RES:Rescheduling_interrupts
> >>> 7469 ± 7% -19.5% 6011 ± 14% interrupts.CPU52.RES:Rescheduling_interrupts
> >>> 71699 ± 8% -25.4% 53470 ± 19% interrupts.CPU53.CAL:Function_call_interrupts
> >>> 6795 ± 10% -30.8% 4701 ± 13% interrupts.CPU53.RES:Rescheduling_interrupts
> >>> 5551 ± 22% +29.5% 7191 ± 8% interrupts.CPU54.NMI:Non-maskable_interrupts
> >>> 5551 ± 22% +29.5% 7191 ± 8% interrupts.CPU54.PMI:Performance_monitoring_interrupts
> >>> 6992 ± 16% -29.9% 4901 ± 7% interrupts.CPU56.RES:Rescheduling_interrupts
> >>> 72948 ± 8% -17.4% 60290 ± 13% interrupts.CPU57.CAL:Function_call_interrupts
> >>> 7311 ± 7% -21.9% 5707 ± 10% interrupts.CPU57.RES:Rescheduling_interrupts
> >>> 88966 ± 7% -26.8% 65154 ± 9% interrupts.CPU58.CAL:Function_call_interrupts
> >>> 8504 ± 7% -30.4% 5917 ± 3% interrupts.CPU58.RES:Rescheduling_interrupts
> >>> 76404 ± 4% -25.6% 56871 ± 14% interrupts.CPU59.CAL:Function_call_interrupts
> >>> 7661 ± 5% -31.3% 5262 ± 6% interrupts.CPU59.RES:Rescheduling_interrupts
> >>> 69173 ± 8% -26.1% 51102 ± 20% interrupts.CPU6.CAL:Function_call_interrupts
> >>> 6431 ± 4% -32.9% 4312 ± 13% interrupts.CPU6.RES:Rescheduling_interrupts
> >>> 6469 ± 9% -18.8% 5254 ± 13% interrupts.CPU61.RES:Rescheduling_interrupts
> >>> 6923 ± 12% -26.0% 5123 ± 5% interrupts.CPU62.RES:Rescheduling_interrupts
> >>> 6338 ± 5% -17.8% 5211 ± 14% interrupts.CPU63.RES:Rescheduling_interrupts
> >>> 44.25 ± 70% +74.6% 77.25 ± 32% interrupts.CPU64.TLB:TLB_shootdowns
> >>> 68283 ± 7% -16.9% 56712 ± 7% interrupts.CPU65.CAL:Function_call_interrupts
> >>> 7218 ± 3% -28.0% 5196 ± 7% interrupts.CPU65.RES:Rescheduling_interrupts
> >>> 74537 ± 9% -26.1% 55076 ± 15% interrupts.CPU66.CAL:Function_call_interrupts
> >>> 5539 ± 13% +19.9% 6644 ± 5% interrupts.CPU66.NMI:Non-maskable_interrupts
> >>> 5539 ± 13% +19.9% 6644 ± 5% interrupts.CPU66.PMI:Performance_monitoring_interrupts
> >>> 7089 ± 8% -31.5% 4859 ± 18% interrupts.CPU66.RES:Rescheduling_interrupts
> >>> 4338 ± 29% +59.1% 6903 ± 11% interrupts.CPU67.NMI:Non-maskable_interrupts
> >>> 4338 ± 29% +59.1% 6903 ± 11% interrupts.CPU67.PMI:Performance_monitoring_interrupts
> >>> 6425 ± 5% -22.6% 4971 ± 11% interrupts.CPU67.RES:Rescheduling_interrupts
> >>> 6361 ± 10% -27.6% 4606 ± 8% interrupts.CPU7.RES:Rescheduling_interrupts
> >>> 72410 -32.3% 49040 ± 17% interrupts.CPU70.CAL:Function_call_interrupts
> >>> 7201 ± 5% -35.8% 4621 ± 15% interrupts.CPU70.RES:Rescheduling_interrupts
> >>> 4936 ± 28% +39.5% 6885 ± 7% interrupts.CPU72.NMI:Non-maskable_interrupts
> >>> 4936 ± 28% +39.5% 6885 ± 7% interrupts.CPU72.PMI:Performance_monitoring_interrupts
> >>> 6997 ± 20% -32.7% 4710 ± 22% interrupts.CPU73.RES:Rescheduling_interrupts
> >>> 6267 ± 15% -25.2% 4690 ± 6% interrupts.CPU74.RES:Rescheduling_interrupts
> >>> 6014 ± 7% -29.0% 4272 ± 10% interrupts.CPU75.RES:Rescheduling_interrupts
> >>> 6249 ± 14% -24.7% 4706 ± 13% interrupts.CPU76.RES:Rescheduling_interrupts
> >>> 4987 ± 26% +47.2% 7339 ± 5% interrupts.CPU77.NMI:Non-maskable_interrupts
> >>> 4987 ± 26% +47.2% 7339 ± 5% interrupts.CPU77.PMI:Performance_monitoring_interrupts
> >>> 6092 ± 15% -24.1% 4624 ± 18% interrupts.CPU77.RES:Rescheduling_interrupts
> >>> 6651 ± 11% -25.7% 4943 ± 10% interrupts.CPU78.RES:Rescheduling_interrupts
> >>> 6315 ± 23% -27.9% 4555 ± 6% interrupts.CPU79.RES:Rescheduling_interrupts
> >>> 4801 ± 31% +40.8% 6758 ± 13% interrupts.CPU80.NMI:Non-maskable_interrupts
> >>> 4801 ± 31% +40.8% 6758 ± 13% interrupts.CPU80.PMI:Performance_monitoring_interrupts
> >>> 65268 ± 7% -27.8% 47144 ± 13% interrupts.CPU81.CAL:Function_call_interrupts
> >>> 6346 ± 4% -34.8% 4139 ± 7% interrupts.CPU81.RES:Rescheduling_interrupts
> >>> 5805 ± 15% -22.5% 4501 ± 5% interrupts.CPU82.RES:Rescheduling_interrupts
> >>> 6031 ± 21% -39.0% 3679 ± 41% interrupts.CPU84.NMI:Non-maskable_interrupts
> >>> 6031 ± 21% -39.0% 3679 ± 41% interrupts.CPU84.PMI:Performance_monitoring_interrupts
> >>> 5498 ± 15% -27.9% 3965 ± 10% interrupts.CPU84.RES:Rescheduling_interrupts
> >>> 65496 ± 18% -20.4% 52160 ± 14% interrupts.CPU85.CAL:Function_call_interrupts
> >>> 6580 ± 13% -28.3% 4718 ± 14% interrupts.CPU85.RES:Rescheduling_interrupts
> >>> 7358 ± 3% -56.5% 3200 ± 14% interrupts.CPU86.NMI:Non-maskable_interrupts
> >>> 7358 ± 3% -56.5% 3200 ± 14% interrupts.CPU86.PMI:Performance_monitoring_interrupts
> >>> 7043 ± 22% -33.3% 4699 ± 19% interrupts.CPU87.RES:Rescheduling_interrupts
> >>> 6319 ± 16% -31.5% 4326 ± 10% interrupts.CPU88.RES:Rescheduling_interrupts
> >>> 68196 ± 5% -16.0% 57308 ± 9% interrupts.CPU9.CAL:Function_call_interrupts
> >>> 6286 ± 5% -21.8% 4918 ± 7% interrupts.CPU9.RES:Rescheduling_interrupts
> >>> 5524 ± 15% -26.1% 4081 ± 12% interrupts.CPU90.RES:Rescheduling_interrupts
> >>> 6494 ± 22% -34.0% 4283 ± 7% interrupts.CPU91.RES:Rescheduling_interrupts
> >>> 58513 ± 20% -24.6% 44103 ± 12% interrupts.CPU93.CAL:Function_call_interrupts
> >>> 5851 ± 10% -32.8% 3934 ± 8% interrupts.CPU93.RES:Rescheduling_interrupts
> >>> 4205 ± 15% +37.5% 5780 ± 7% interrupts.CPU95.NMI:Non-maskable_interrupts
> >>> 4205 ± 15% +37.5% 5780 ± 7% interrupts.CPU95.PMI:Performance_monitoring_interrupts
> >>> 191.25 ± 3% +9.2% 208.75 ± 6% interrupts.IWI:IRQ_work_interrupts
> >>> 619735 ± 6% -23.5% 473856 ± 2% interrupts.RES:Rescheduling_interrupts
> >>> 23.01 ± 7% -6.3 16.68 ± 7% perf-profile.calltrace.cycles-pp.__alloc_pages_nodemask.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read.new_sync_read
> >>> 6.08 ± 8% -6.1 0.00 perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 6.03 ± 8% -6.0 0.00 perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 11.18 ± 6% -4.1 7.04 ± 9% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 5.53 ± 10% -3.6 1.92 ± 9% perf-profile.calltrace.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read
> >>> 5.27 ± 11% -3.5 1.73 ± 10% perf-profile.calltrace.cycles-pp.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded.force_page_cache_readahead
> >>> 4.94 ± 11% -3.5 1.49 ± 11% perf-profile.calltrace.cycles-pp.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages_nodemask.page_cache_readahead_unbounded
> >>> 4.14 ± 12% -3.2 0.91 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.rmqueue_bulk.rmqueue.get_page_from_freelist
> >>> 4.14 ± 12% -3.2 0.92 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock.rmqueue_bulk.rmqueue.get_page_from_freelist.__alloc_pages_nodemask
> >>> 14.24 ± 6% -3.0 11.22 ± 6% perf-profile.calltrace.cycles-pp.read_pages.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read.new_sync_read
> >>> 14.23 ± 6% -3.0 11.21 ± 6% perf-profile.calltrace.cycles-pp.extent_readahead.read_pages.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read
> >>> 17.36 ± 6% -2.7 14.67 ± 7% perf-profile.calltrace.cycles-pp.__alloc_pages_slowpath.__alloc_pages_nodemask.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read
> >>> 11.78 ± 6% -2.5 9.23 ± 6% perf-profile.calltrace.cycles-pp.generic_make_request.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio
> >>> 11.76 ± 6% -2.5 9.22 ± 6% perf-profile.calltrace.cycles-pp.pmem_make_request.generic_make_request.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook
> >>> 11.56 ± 6% -2.5 9.04 ± 6% perf-profile.calltrace.cycles-pp.pmem_do_read.pmem_make_request.generic_make_request.submit_bio.btrfs_map_bio
> >>> 11.45 ± 6% -2.5 8.96 ± 5% perf-profile.calltrace.cycles-pp.__memcpy_mcsafe.pmem_do_read.pmem_make_request.generic_make_request.submit_bio
> >>> 16.85 ± 6% -2.5 14.40 ± 7% perf-profile.calltrace.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.page_cache_readahead_unbounded.force_page_cache_readahead
> >>> 16.84 ± 6% -2.4 14.39 ± 7% perf-profile.calltrace.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
> >>> 16.84 ± 6% -2.4 14.39 ± 7% perf-profile.calltrace.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.page_cache_readahead_unbounded
> >>> 16.71 ± 6% -2.4 14.32 ± 7% perf-profile.calltrace.cycles-pp.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
> >>> 16.70 ± 6% -2.4 14.30 ± 7% perf-profile.calltrace.cycles-pp.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages.try_to_free_pages
> >>> 6.50 ± 4% -2.0 4.53 ± 12% perf-profile.calltrace.cycles-pp.btrfs_releasepage.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 6.39 ± 4% -1.9 4.45 ± 12% perf-profile.calltrace.cycles-pp.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list.shrink_lruvec
> >>> 3.86 ± 9% -1.9 1.92 ± 8% perf-profile.calltrace.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 8.36 ± 5% -1.8 6.56 ± 6% perf-profile.calltrace.cycles-pp.__do_readpage.extent_readahead.read_pages.page_cache_readahead_unbounded.force_page_cache_readahead
> >>> 7.77 ± 5% -1.7 6.08 ± 6% perf-profile.calltrace.cycles-pp.submit_extent_page.__do_readpage.extent_readahead.read_pages.page_cache_readahead_unbounded
> >>> 6.79 ± 5% -1.5 5.26 ± 6% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.__do_readpage.extent_readahead.read_pages
> >>> 6.79 ± 5% -1.5 5.26 ± 6% perf-profile.calltrace.cycles-pp.btrfs_submit_bio_hook.submit_one_bio.submit_extent_page.__do_readpage.extent_readahead
> >>> 2.68 ± 10% -1.5 1.17 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_lruvec
> >>> 7.10 ± 6% -1.5 5.59 ± 6% perf-profile.calltrace.cycles-pp.copy_page_to_iter.generic_file_buffered_read.new_sync_read.vfs_read.ksys_read
> >>> 6.67 ± 6% -1.5 5.17 ± 6% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.submit_extent_page.__do_readpage
> >>> 6.65 ± 6% -1.5 5.15 ± 6% perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.submit_extent_page
> >>> 6.98 ± 7% -1.5 5.49 ± 6% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 6.94 ± 6% -1.5 5.46 ± 6% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.generic_file_buffered_read.new_sync_read
> >>> 2.51 ± 11% -1.5 1.04 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__remove_mapping.shrink_page_list.shrink_inactive_list
> >>> 5.24 ± 6% -1.1 4.17 ± 6% perf-profile.calltrace.cycles-pp.btrfs_submit_bio_hook.submit_one_bio.extent_readahead.read_pages.page_cache_readahead_unbounded
> >>> 5.24 ± 6% -1.1 4.17 ± 6% perf-profile.calltrace.cycles-pp.submit_one_bio.extent_readahead.read_pages.page_cache_readahead_unbounded.force_page_cache_readahead
> >>> 5.14 ± 7% -1.0 4.09 ± 6% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_readahead.read_pages
> >>> 5.13 ± 7% -1.0 4.08 ± 6% perf-profile.calltrace.cycles-pp.submit_bio.btrfs_map_bio.btrfs_submit_bio_hook.submit_one_bio.extent_readahead
> >>> 3.15 ± 4% -0.9 2.20 ± 12% perf-profile.calltrace.cycles-pp.__clear_extent_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list
> >>> 1.79 ± 7% -0.9 0.92 ± 10% perf-profile.calltrace.cycles-pp.free_unref_page_list.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise
> >>> 1.70 ± 8% -0.8 0.86 ± 10% perf-profile.calltrace.cycles-pp.free_pcppages_bulk.free_unref_page_list.release_pages.__pagevec_release.invalidate_mapping_pages
> >>> 2.98 ± 7% -0.8 2.14 ± 9% perf-profile.calltrace.cycles-pp.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 2.93 ± 7% -0.8 2.10 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec
> >>> 2.95 ± 7% -0.8 2.12 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.lru_note_cost.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 2.69 ± 4% -0.8 1.87 ± 14% perf-profile.calltrace.cycles-pp.test_range_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list.shrink_inactive_list
> >>> 2.58 ± 4% -0.8 1.78 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock.__clear_extent_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list
> >>> 2.46 ± 4% -0.8 1.70 ± 14% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.__clear_extent_bit.try_release_extent_mapping.btrfs_releasepage
> >>> 2.45 ± 4% -0.8 1.69 ± 14% perf-profile.calltrace.cycles-pp._raw_spin_lock.test_range_bit.try_release_extent_mapping.btrfs_releasepage.shrink_page_list
> >>> 2.38 ± 4% -0.7 1.64 ± 15% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.test_range_bit.try_release_extent_mapping.btrfs_releasepage
> >>> 2.42 ± 3% -0.6 1.84 ± 5% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
> >>> 2.31 ± 3% -0.6 1.76 ± 5% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
> >>> 3.90 ± 3% -0.5 3.36 ± 6% perf-profile.calltrace.cycles-pp.ret_from_fork
> >>> 3.90 ± 3% -0.5 3.36 ± 6% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
> >>> 2.26 ± 2% -0.5 1.71 ± 4% perf-profile.calltrace.cycles-pp.end_workqueue_fn.btrfs_work_helper.process_one_work.worker_thread.kthread
> >>> 2.26 ± 2% -0.5 1.72 ± 4% perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
> >>> 2.23 ± 2% -0.5 1.70 ± 5% perf-profile.calltrace.cycles-pp.end_bio_extent_readpage.end_workqueue_fn.btrfs_work_helper.process_one_work.worker_thread
> >>> 1.81 ± 2% -0.5 1.33 ± 9% perf-profile.calltrace.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read
> >>> 1.90 ± 3% -0.4 1.50 ± 4% perf-profile.calltrace.cycles-pp.crc_128
> >>> 1.00 ± 7% -0.2 0.79 ± 7% perf-profile.calltrace.cycles-pp.pagecache_get_page.generic_file_buffered_read.new_sync_read.vfs_read.ksys_read
> >>> 0.63 ± 4% -0.2 0.42 ± 58% perf-profile.calltrace.cycles-pp.__remove_mapping.remove_mapping.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64
> >>> 0.63 ± 3% -0.2 0.42 ± 58% perf-profile.calltrace.cycles-pp.remove_mapping.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64
> >>> 0.75 -0.2 0.54 ± 8% perf-profile.calltrace.cycles-pp.mem_cgroup_charge.__add_to_page_cache_locked.add_to_page_cache_lru.page_cache_readahead_unbounded.force_page_cache_readahead
> >>> 0.99 ± 7% -0.2 0.78 ± 7% perf-profile.calltrace.cycles-pp.find_get_entry.pagecache_get_page.generic_file_buffered_read.new_sync_read.vfs_read
> >>> 0.73 ± 2% -0.2 0.54 ± 3% perf-profile.calltrace.cycles-pp.crc_42
> >>> 0.98 ± 6% -0.2 0.80 ± 7% perf-profile.calltrace.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_lruvec.shrink_node.balance_pgdat
> >>> 0.84 ± 5% -0.1 0.70 ± 5% perf-profile.calltrace.cycles-pp.btrfs_bio_fits_in_stripe.submit_extent_page.__do_readpage.extent_readahead.read_pages
> >>> 0.82 ± 4% -0.1 0.69 ± 5% perf-profile.calltrace.cycles-pp.btrfs_get_io_geometry.btrfs_bio_fits_in_stripe.submit_extent_page.__do_readpage.extent_readahead
> >>> 0.71 ± 4% -0.1 0.59 ± 4% perf-profile.calltrace.cycles-pp.btrfs_get_chunk_map.btrfs_get_io_geometry.btrfs_bio_fits_in_stripe.submit_extent_page.__do_readpage
> >>> 4.46 ± 7% +2.0 6.42 ± 13% perf-profile.calltrace.cycles-pp.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64
> >>> 4.46 ± 7% +2.0 6.43 ± 13% perf-profile.calltrace.cycles-pp.__pagevec_release.invalidate_mapping_pages.generic_fadvise.ksys_fadvise64_64.__x64_sys_fadvise64
> >>> 2.12 ± 8% +2.6 4.68 ± 9% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node
> >>> 2.14 ± 8% +2.6 4.70 ± 9% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_lruvec.shrink_node.do_try_to_free_pages
> >>> 20.09 ± 22% +4.3 24.44 ± 22% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
> >>> 0.00 +4.9 4.95 ± 16% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release
> >>> 0.00 +5.0 4.97 ± 16% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages
> >>> 0.00 +5.0 4.97 ± 16% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.release_pages.__pagevec_release.invalidate_mapping_pages.generic_fadvise
> >>> 8.91 ± 6% +8.8 17.74 ± 12% perf-profile.calltrace.cycles-pp.add_to_page_cache_lru.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read.new_sync_read
> >>> 7.06 ± 8% +9.3 16.39 ± 12% perf-profile.calltrace.cycles-pp.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.force_page_cache_readahead.generic_file_buffered_read
> >>> 7.00 ± 8% +9.3 16.33 ± 12% perf-profile.calltrace.cycles-pp.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded.force_page_cache_readahead
> >>> 0.00 +15.1 15.11 ± 12% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add
> >>> 0.00 +15.2 15.17 ± 12% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru
> >>> 0.00 +15.2 15.17 ± 12% perf-profile.calltrace.cycles-pp.lock_page_lruvec_irqsave.__pagevec_lru_add.lru_cache_add.add_to_page_cache_lru.page_cache_readahead_unbounded
> >>> 23.09 ± 7% -6.4 16.73 ± 7% perf-profile.children.cycles-pp.__alloc_pages_nodemask
> >>> 11.44 ± 7% -6.0 5.48 ± 13% perf-profile.children.cycles-pp._raw_spin_lock
> >>> 12.21 ± 6% -4.4 7.86 ± 8% perf-profile.children.cycles-pp.shrink_page_list
> >>> 6.00 ± 10% -3.8 2.17 ± 9% perf-profile.children.cycles-pp.get_page_from_freelist
> >>> 5.72 ± 10% -3.8 1.96 ± 9% perf-profile.children.cycles-pp.rmqueue
> >>> 5.32 ± 10% -3.6 1.67 ± 11% perf-profile.children.cycles-pp.rmqueue_bulk
> >>> 14.23 ± 6% -3.0 11.21 ± 6% perf-profile.children.cycles-pp.extent_readahead
> >>> 14.24 ± 6% -3.0 11.22 ± 6% perf-profile.children.cycles-pp.read_pages
> >>> 17.42 ± 6% -2.7 14.71 ± 7% perf-profile.children.cycles-pp.__alloc_pages_slowpath
> >>> 12.03 ± 6% -2.6 9.43 ± 6% perf-profile.children.cycles-pp.submit_one_bio
> >>> 12.02 ± 6% -2.6 9.43 ± 6% perf-profile.children.cycles-pp.btrfs_submit_bio_hook
> >>> 11.81 ± 6% -2.6 9.26 ± 6% perf-profile.children.cycles-pp.btrfs_map_bio
> >>> 11.78 ± 6% -2.6 9.23 ± 6% perf-profile.children.cycles-pp.generic_make_request
> >>> 11.78 ± 6% -2.6 9.23 ± 6% perf-profile.children.cycles-pp.submit_bio
> >>> 11.77 ± 6% -2.5 9.22 ± 6% perf-profile.children.cycles-pp.pmem_make_request
> >>> 11.57 ± 6% -2.5 9.05 ± 5% perf-profile.children.cycles-pp.pmem_do_read
> >>> 11.47 ± 6% -2.5 8.97 ± 6% perf-profile.children.cycles-pp.__memcpy_mcsafe
> >>> 16.90 ± 6% -2.5 14.44 ± 7% perf-profile.children.cycles-pp.try_to_free_pages
> >>> 16.89 ± 6% -2.5 14.43 ± 7% perf-profile.children.cycles-pp.do_try_to_free_pages
> >>> 4.81 ± 8% -2.1 2.69 ± 8% perf-profile.children.cycles-pp.__remove_mapping
> >>> 7.38 ± 4% -2.1 5.27 ± 11% perf-profile.children.cycles-pp.btrfs_releasepage
> >>> 7.20 ± 4% -2.1 5.13 ± 11% perf-profile.children.cycles-pp.try_release_extent_mapping
> >>> 8.36 ± 5% -1.8 6.57 ± 6% perf-profile.children.cycles-pp.__do_readpage
> >>> 7.77 ± 5% -1.7 6.08 ± 6% perf-profile.children.cycles-pp.submit_extent_page
> >>> 7.11 ± 6% -1.5 5.60 ± 6% perf-profile.children.cycles-pp.copy_page_to_iter
> >>> 6.98 ± 7% -1.5 5.49 ± 6% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
> >>> 6.98 ± 6% -1.5 5.50 ± 6% perf-profile.children.cycles-pp.copyout
> >>> 3.73 ± 4% -1.0 2.69 ± 11% perf-profile.children.cycles-pp.__clear_extent_bit
> >>> 2.36 ± 6% -1.0 1.33 ± 8% perf-profile.children.cycles-pp.free_unref_page_list
> >>> 2.23 ± 7% -1.0 1.21 ± 9% perf-profile.children.cycles-pp.free_pcppages_bulk
> >>> 3.15 ± 4% -0.9 2.24 ± 12% perf-profile.children.cycles-pp.test_range_bit
> >>> 3.19 ± 6% -0.9 2.33 ± 9% perf-profile.children.cycles-pp.lru_note_cost
> >>> 2.42 ± 3% -0.6 1.84 ± 5% perf-profile.children.cycles-pp.worker_thread
> >>> 2.31 ± 3% -0.6 1.76 ± 5% perf-profile.children.cycles-pp.process_one_work
> >>> 3.90 ± 3% -0.5 3.36 ± 6% perf-profile.children.cycles-pp.ret_from_fork
> >>> 3.90 ± 3% -0.5 3.36 ± 6% perf-profile.children.cycles-pp.kthread
> >>> 2.26 ± 2% -0.5 1.71 ± 4% perf-profile.children.cycles-pp.end_workqueue_fn
> >>> 2.26 ± 2% -0.5 1.72 ± 4% perf-profile.children.cycles-pp.btrfs_work_helper
> >>> 2.23 ± 2% -0.5 1.70 ± 4% perf-profile.children.cycles-pp.end_bio_extent_readpage
> >>> 1.82 ± 2% -0.5 1.34 ± 9% perf-profile.children.cycles-pp.__add_to_page_cache_locked
> >>> 2.02 ± 3% -0.4 1.60 ± 4% perf-profile.children.cycles-pp.crc_128
> >>> 1.66 ± 5% -0.4 1.26 ± 7% perf-profile.children.cycles-pp.__list_del_entry_valid
> >>> 1.13 ± 2% -0.3 0.88 ± 3% perf-profile.children.cycles-pp.crc_42
> >>> 1.17 ± 4% -0.3 0.92 ± 10% perf-profile.children.cycles-pp.__delete_from_page_cache
> >>> 1.11 ± 4% -0.2 0.86 ± 15% perf-profile.children.cycles-pp.__mod_lruvec_state
> >>> 0.76 -0.2 0.54 ± 8% perf-profile.children.cycles-pp.mem_cgroup_charge
> >>> 0.99 ± 7% -0.2 0.78 ± 7% perf-profile.children.cycles-pp.find_get_entry
> >>> 1.00 ± 7% -0.2 0.79 ± 7% perf-profile.children.cycles-pp.pagecache_get_page
> >>> 0.60 ± 3% -0.2 0.41 ± 2% perf-profile.children.cycles-pp.crc_96
> >>> 0.42 ± 6% -0.2 0.23 ± 7% perf-profile.children.cycles-pp.workingset_eviction
> >>> 0.56 ± 9% -0.2 0.39 ± 5% perf-profile.children.cycles-pp.wake_up_page_bit
> >>> 0.59 ± 7% -0.2 0.42 ± 5% perf-profile.children.cycles-pp.try_to_wake_up
> >>> 0.52 ± 8% -0.2 0.36 ± 5% perf-profile.children.cycles-pp.__wake_up_common
> >>> 0.51 ± 8% -0.2 0.35 ± 5% perf-profile.children.cycles-pp.autoremove_wake_function
> >>> 0.69 ± 4% -0.1 0.54 ± 7% perf-profile.children.cycles-pp.xas_load
> >>> 0.57 ± 4% -0.1 0.42 ± 3% perf-profile.children.cycles-pp.crc_72
> >>> 0.84 ± 5% -0.1 0.70 ± 5% perf-profile.children.cycles-pp.btrfs_bio_fits_in_stripe
> >>> 0.82 ± 4% -0.1 0.69 ± 5% perf-profile.children.cycles-pp.btrfs_get_io_geometry
> >>> 0.65 ± 6% -0.1 0.52 ± 6% perf-profile.children.cycles-pp.xas_store
> >>> 0.55 ± 5% -0.1 0.42 ± 8% perf-profile.children.cycles-pp.__etree_search
> >>> 0.59 ± 8% -0.1 0.46 ± 7% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
> >>> 0.45 ± 9% -0.1 0.32 ± 4% perf-profile.children.cycles-pp.ttwu_do_activate
> >>> 0.40 ± 6% -0.1 0.28 ± 5% perf-profile.children.cycles-pp.__sched_text_start
> >>> 0.72 ± 4% -0.1 0.60 ± 4% perf-profile.children.cycles-pp.btrfs_get_chunk_map
> >>> 0.43 ± 4% -0.1 0.32 ± 4% perf-profile.children.cycles-pp.crc_88
> >>> 0.44 ± 9% -0.1 0.32 ± 3% perf-profile.children.cycles-pp.enqueue_task_fair
> >>> 0.45 -0.1 0.33 ± 9% perf-profile.children.cycles-pp.__mod_memcg_state
> >>> 0.41 ± 8% -0.1 0.30 ± 4% perf-profile.children.cycles-pp.enqueue_entity
> >>> 0.51 ± 7% -0.1 0.40 ± 7% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
> >>> 0.64 ± 4% -0.1 0.53 ± 11% perf-profile.children.cycles-pp.remove_mapping
> >>> 0.53 ± 6% -0.1 0.43 ± 7% perf-profile.children.cycles-pp.asm_call_on_stack
> >>> 0.40 ± 6% -0.1 0.30 ± 2% perf-profile.children.cycles-pp.crc_80
> >>> 0.46 ± 4% -0.1 0.36 ± 4% perf-profile.children.cycles-pp.crc_32
> >>> 0.35 ± 7% -0.1 0.27 ± 5% perf-profile.children.cycles-pp.crc_16
> >>> 0.48 ± 3% -0.1 0.40 ± 4% perf-profile.children.cycles-pp.crc_104
> >>> 0.27 ± 10% -0.1 0.18 ± 10% perf-profile.children.cycles-pp.poll_idle
> >>> 0.41 ± 7% -0.1 0.33 ± 9% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
> >>> 0.35 ± 7% -0.1 0.27 ± 5% perf-profile.children.cycles-pp.crc_40
> >>> 0.30 ± 4% -0.1 0.22 ± 4% perf-profile.children.cycles-pp.crc_48
> >>> 0.37 ± 2% -0.1 0.29 ± 5% perf-profile.children.cycles-pp.crc_8
> >>> 0.32 ± 3% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.try_charge
> >>> 0.32 ± 9% -0.1 0.24 ± 4% perf-profile.children.cycles-pp.__account_scheduler_latency
> >>> 0.40 ± 5% -0.1 0.33 ± 4% perf-profile.children.cycles-pp._raw_read_lock
> >>> 0.40 ± 7% -0.1 0.32 ± 9% perf-profile.children.cycles-pp.hrtimer_interrupt
> >>> 0.34 ± 7% -0.1 0.26 ± 6% perf-profile.children.cycles-pp.crc_56
> >>> 0.28 ± 4% -0.1 0.20 ± 8% perf-profile.children.cycles-pp.unlock_page
> >>> 0.41 ± 4% -0.1 0.33 ± 7% perf-profile.children.cycles-pp.clear_state_bit
> >>> 0.41 ± 4% -0.1 0.34 ± 9% perf-profile.children.cycles-pp.crc_112
> >>> 0.36 ± 2% -0.1 0.28 ± 7% perf-profile.children.cycles-pp.mem_cgroup_uncharge_list
> >>> 0.30 ± 7% -0.1 0.22 ± 7% perf-profile.children.cycles-pp.xas_create
> >>> 0.31 -0.1 0.24 ± 9% perf-profile.children.cycles-pp.uncharge_batch
> >>> 0.36 ± 8% -0.1 0.29 ± 6% perf-profile.children.cycles-pp.crc_24
> >>> 0.46 ± 5% -0.1 0.39 ± 6% perf-profile.children.cycles-pp.crc_64
> >>> 0.42 ± 4% -0.1 0.35 ± 4% perf-profile.children.cycles-pp.crc_41
> >>> 0.24 ± 8% -0.1 0.17 ± 7% perf-profile.children.cycles-pp.schedule
> >>> 0.24 ± 5% -0.1 0.17 ± 8% perf-profile.children.cycles-pp._raw_write_lock
> >>> 0.27 ± 7% -0.1 0.21 ± 2% perf-profile.children.cycles-pp.crc_120
> >>> 0.48 ± 3% -0.1 0.42 ± 8% perf-profile.children.cycles-pp.invalidate_inode_page
> >>> 0.19 ± 9% -0.1 0.13 ± 12% perf-profile.children.cycles-pp.stack_trace_save_tsk
> >>> 0.17 ± 7% -0.1 0.11 ± 6% perf-profile.children.cycles-pp.workingset_age_nonresident
> >>> 0.23 ± 4% -0.1 0.17 ± 8% perf-profile.children.cycles-pp.__count_memcg_events
> >>> 0.36 ± 3% -0.1 0.30 ± 7% perf-profile.children.cycles-pp.pagevec_lookup_entries
> >>> 0.36 ± 3% -0.1 0.30 ± 7% perf-profile.children.cycles-pp.find_get_entries
> >>> 0.24 ± 5% -0.1 0.18 ± 6% perf-profile.children.cycles-pp.xa_load
> >>> 0.24 ± 2% -0.1 0.18 ± 9% perf-profile.children.cycles-pp.page_counter_uncharge
> >>> 0.23 ± 2% -0.1 0.18 ± 8% perf-profile.children.cycles-pp.page_counter_cancel
> >>> 0.18 ± 2% -0.1 0.12 ± 8% perf-profile.children.cycles-pp.page_counter_try_charge
> >>> 0.17 ± 7% -0.1 0.12 ± 11% perf-profile.children.cycles-pp.arch_stack_walk
> >>> 0.14 ± 11% -0.1 0.09 ± 4% perf-profile.children.cycles-pp.io_schedule
> >>> 0.14 ± 5% -0.1 0.09 ± 9% perf-profile.children.cycles-pp.get_mem_cgroup_from_mm
> >>> 0.30 ± 5% -0.1 0.24 ± 4% perf-profile.children.cycles-pp.crc_20
> >>> 0.28 ± 8% -0.1 0.23 ± 8% perf-profile.children.cycles-pp.__hrtimer_run_queues
> >>> 0.20 ± 8% -0.0 0.15 ± 8% perf-profile.children.cycles-pp.kmem_cache_alloc
> >>> 0.18 ± 4% -0.0 0.13 ± 8% perf-profile.children.cycles-pp.mem_cgroup_charge_statistics
> >>> 0.18 ± 2% -0.0 0.13 ± 8% perf-profile.children.cycles-pp.split_state
> >>> 0.16 ± 7% -0.0 0.11 ± 3% perf-profile.children.cycles-pp.schedule_idle
> >>> 0.13 ± 5% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.crc_36
> >>> 0.22 ± 9% -0.0 0.17 ± 10% perf-profile.children.cycles-pp.tick_sched_timer
> >>> 0.22 ± 5% -0.0 0.18 ± 4% perf-profile.children.cycles-pp.__set_extent_bit
> >>> 0.21 ± 3% -0.0 0.17 ± 4% perf-profile.children.cycles-pp.crc_12
> >>> 0.20 ± 9% -0.0 0.16 ± 9% perf-profile.children.cycles-pp.tick_sched_handle
> >>> 0.21 ± 7% -0.0 0.17 ± 8% perf-profile.children.cycles-pp.__lookup_extent_mapping
> >>> 0.17 ± 6% -0.0 0.13 ± 7% perf-profile.children.cycles-pp.alloc_extent_state
> >>> 0.11 ± 7% -0.0 0.07 ± 14% perf-profile.children.cycles-pp.unwind_next_frame
> >>> 0.18 ± 3% -0.0 0.14 ± 9% perf-profile.children.cycles-pp.__mod_node_page_state
> >>> 0.19 ± 6% -0.0 0.15 ± 9% perf-profile.children.cycles-pp.update_process_times
> >>> 0.13 ± 5% -0.0 0.10 ± 5% perf-profile.children.cycles-pp.pick_next_task_fair
> >>> 0.15 ± 4% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.crc_38
> >>> 0.15 ± 6% -0.0 0.12 ± 7% perf-profile.children.cycles-pp.lock_extent_bits
> >>> 0.14 ± 5% -0.0 0.11 ± 12% perf-profile.children.cycles-pp.crc_29
> >>> 0.19 ± 3% -0.0 0.16 ± 6% perf-profile.children.cycles-pp.free_extent_map
> >>> 0.20 ± 3% -0.0 0.17 ± 8% perf-profile.children.cycles-pp.btrfs_lookup_bio_sums
> >>> 0.19 ± 2% -0.0 0.16 ± 4% perf-profile.children.cycles-pp.btrfs_readpage_end_io_hook
> >>> 0.17 ± 7% -0.0 0.14 ± 6% perf-profile.children.cycles-pp.btrfs_lock_and_flush_ordered_range
> >>> 0.10 ± 4% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.menu_select
> >>> 0.15 ± 5% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.crc_37
> >>> 0.14 ± 3% -0.0 0.11 ± 12% perf-profile.children.cycles-pp.crc_30
> >>> 0.07 ± 10% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.dequeue_task_fair
> >>> 0.13 ± 6% -0.0 0.10 ± 4% perf-profile.children.cycles-pp.crc_127
> >>> 0.10 ± 5% -0.0 0.07 ± 7% perf-profile.children.cycles-pp.crc_95
> >>> 0.07 ± 12% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.newidle_balance
> >>> 0.10 ± 8% -0.0 0.08 ± 6% perf-profile.children.cycles-pp.free_extent_state
> >>> 0.10 ± 4% -0.0 0.07 perf-profile.children.cycles-pp.crc_28
> >>> 0.10 ± 4% -0.0 0.07 perf-profile.children.cycles-pp.crc_10
> >>> 0.18 ± 3% -0.0 0.15 ± 9% perf-profile.children.cycles-pp.clean_io_failure
> >>> 0.14 ± 3% -0.0 0.11 ± 6% perf-profile.children.cycles-pp.kmem_cache_free
> >>> 0.13 ± 9% -0.0 0.10 ± 10% perf-profile.children.cycles-pp.scheduler_tick
> >>> 0.11 ± 4% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.crc_18
> >>> 0.09 ± 20% -0.0 0.06 ± 6% perf-profile.children.cycles-pp.ktime_get
> >>> 0.15 ± 5% -0.0 0.13 ± 9% perf-profile.children.cycles-pp.count_range_bits
> >>> 0.10 ± 4% -0.0 0.07 ± 5% perf-profile.children.cycles-pp.update_load_avg
> >>> 0.08 ± 14% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.irq_exit_rcu
> >>> 0.15 ± 3% -0.0 0.12 ± 3% perf-profile.children.cycles-pp.check_data_csum
> >>> 0.10 ± 10% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.__mod_zone_page_state
> >>> 0.10 ± 4% -0.0 0.08 ± 8% perf-profile.children.cycles-pp.btrfs_search_slot
> >>> 0.08 ± 5% -0.0 0.06 perf-profile.children.cycles-pp.crc_87
> >>> 0.12 ± 3% -0.0 0.10 ± 5% perf-profile.children.cycles-pp.crc_22
> >>> 0.12 ± 3% -0.0 0.10 ± 5% perf-profile.children.cycles-pp.crc_21
> >>> 0.09 ± 8% -0.0 0.07 ± 10% perf-profile.children.cycles-pp.crc_111
> >>> 0.20 ± 2% -0.0 0.18 ± 4% perf-profile.children.cycles-pp.__crc32c_pcl_intel_finup
> >>> 0.08 ± 6% -0.0 0.06 ± 9% perf-profile.children.cycles-pp.crc_119
> >>> 0.11 ± 4% -0.0 0.09 ± 10% perf-profile.children.cycles-pp.btrfs_lookup_csum
> >>> 0.08 ± 22% -0.0 0.06 ± 15% perf-profile.children.cycles-pp.clockevents_program_event
> >>> 0.13 ± 3% -0.0 0.11 ± 7% perf-profile.children.cycles-pp.crc_103
> >>> 0.11 ± 4% -0.0 0.10 ± 8% perf-profile.children.cycles-pp.___might_sleep
> >>> 0.08 ± 5% -0.0 0.07 ± 12% perf-profile.children.cycles-pp.task_tick_fair
> >>> 0.07 ± 6% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.read_block_for_search
> >>> 5.68 ± 6% +1.9 7.54 ± 9% perf-profile.children.cycles-pp._raw_spin_lock_irq
> >>> 4.55 ± 6% +2.0 6.50 ± 13% perf-profile.children.cycles-pp.release_pages
> >>> 4.46 ± 7% +2.0 6.43 ± 13% perf-profile.children.cycles-pp.__pagevec_release
> >>> 20.34 ± 21% +4.5 24.80 ± 22% perf-profile.children.cycles-pp.intel_idle
> >>> 27.22 ± 7% +6.5 33.73 ± 9% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
> >>> 8.91 ± 6% +8.8 17.75 ± 12% perf-profile.children.cycles-pp.add_to_page_cache_lru
> >>> 7.07 ± 8% +9.3 16.41 ± 12% perf-profile.children.cycles-pp.lru_cache_add
> >>> 7.02 ± 8% +9.4 16.39 ± 12% perf-profile.children.cycles-pp.__pagevec_lru_add
> >>> 11.19 ± 7% +10.4 21.62 ± 13% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
> >>> 0.00 +20.2 20.21 ± 13% perf-profile.children.cycles-pp.lock_page_lruvec_irqsave
> >>> 11.37 ± 6% -2.5 8.89 ± 6% perf-profile.self.cycles-pp.__memcpy_mcsafe
> >>> 6.92 ± 7% -1.5 5.45 ± 6% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
> >>> 2.01 ± 3% -0.4 1.60 ± 4% perf-profile.self.cycles-pp.crc_128
> >>> 1.75 ± 4% -0.4 1.36 ± 5% perf-profile.self.cycles-pp.generic_file_buffered_read
> >>> 1.65 ± 5% -0.4 1.26 ± 7% perf-profile.self.cycles-pp.__list_del_entry_valid
> >>> 1.07 ± 5% -0.3 0.81 ± 4% perf-profile.self.cycles-pp.end_bio_extent_readpage
> >>> 1.13 ± 2% -0.3 0.88 ± 3% perf-profile.self.cycles-pp.crc_42
> >>> 0.59 ± 3% -0.2 0.41 ± 2% perf-profile.self.cycles-pp.crc_96
> >>> 0.76 ± 7% -0.2 0.61 ± 7% perf-profile.self.cycles-pp.find_get_entry
> >>> 0.56 ± 3% -0.1 0.42 ± 3% perf-profile.self.cycles-pp.crc_72
> >>> 0.54 ± 5% -0.1 0.41 ± 8% perf-profile.self.cycles-pp.__etree_search
> >>> 0.59 ± 4% -0.1 0.46 ± 6% perf-profile.self.cycles-pp.xas_load
> >>> 0.25 ± 7% -0.1 0.13 ± 9% perf-profile.self.cycles-pp.workingset_eviction
> >>> 0.43 ± 5% -0.1 0.31 ± 5% perf-profile.self.cycles-pp.crc_88
> >>> 0.45 -0.1 0.33 ± 9% perf-profile.self.cycles-pp.__mod_memcg_state
> >>> 0.43 ± 6% -0.1 0.32 ± 8% perf-profile.self.cycles-pp.extent_readahead
> >>> 0.56 ± 4% -0.1 0.45 ± 5% perf-profile.self.cycles-pp._raw_spin_lock
> >>> 0.40 ± 6% -0.1 0.30 ± 2% perf-profile.self.cycles-pp.crc_80
> >>> 0.62 -0.1 0.52 ± 7% perf-profile.self.cycles-pp.free_pcppages_bulk
> >>> 0.46 ± 3% -0.1 0.36 ± 4% perf-profile.self.cycles-pp.crc_32
> >>> 0.26 ± 8% -0.1 0.17 ± 11% perf-profile.self.cycles-pp.poll_idle
> >>> 0.48 ± 2% -0.1 0.39 ± 4% perf-profile.self.cycles-pp.crc_104
> >>> 0.35 ± 6% -0.1 0.26 ± 4% perf-profile.self.cycles-pp.crc_16
> >>> 0.30 ± 4% -0.1 0.22 ± 3% perf-profile.self.cycles-pp.crc_48
> >>> 0.35 ± 6% -0.1 0.27 ± 4% perf-profile.self.cycles-pp.crc_40
> >>> 0.28 ± 4% -0.1 0.20 ± 9% perf-profile.self.cycles-pp.unlock_page
> >>> 0.34 ± 7% -0.1 0.26 ± 7% perf-profile.self.cycles-pp.crc_56
> >>> 0.41 ± 5% -0.1 0.33 ± 10% perf-profile.self.cycles-pp.crc_112
> >>> 0.36 -0.1 0.28 ± 4% perf-profile.self.cycles-pp.crc_8
> >>> 0.40 ± 4% -0.1 0.32 ± 5% perf-profile.self.cycles-pp._raw_read_lock
> >>> 0.25 ± 5% -0.1 0.18 ± 8% perf-profile.self.cycles-pp.get_page_from_freelist
> >>> 0.24 ± 5% -0.1 0.17 ± 8% perf-profile.self.cycles-pp._raw_write_lock
> >>> 0.27 ± 6% -0.1 0.20 ± 2% perf-profile.self.cycles-pp.crc_120
> >>> 0.23 ± 8% -0.1 0.16 ± 7% perf-profile.self.cycles-pp.__remove_mapping
> >>> 0.46 ± 4% -0.1 0.39 ± 5% perf-profile.self.cycles-pp.crc_64
> >>> 0.35 ± 7% -0.1 0.29 ± 5% perf-profile.self.cycles-pp.crc_24
> >>> 0.27 ± 6% -0.1 0.20 ± 7% perf-profile.self.cycles-pp.xas_create
> >>> 0.33 ± 3% -0.1 0.27 ± 8% perf-profile.self.cycles-pp.find_get_entries
> >>> 0.17 ± 7% -0.1 0.11 ± 7% perf-profile.self.cycles-pp.workingset_age_nonresident
> >>> 0.39 ± 4% -0.1 0.33 ± 7% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
> >>> 0.33 ± 6% -0.1 0.27 ± 5% perf-profile.self.cycles-pp.__do_readpage
> >>> 0.23 ± 4% -0.1 0.17 ± 8% perf-profile.self.cycles-pp.__count_memcg_events
> >>> 0.14 ± 5% -0.1 0.09 ± 9% perf-profile.self.cycles-pp.get_mem_cgroup_from_mm
> >>> 0.29 ± 4% -0.1 0.24 ± 5% perf-profile.self.cycles-pp.crc_20
> >>> 0.21 ± 3% -0.0 0.16 ± 7% perf-profile.self.cycles-pp.page_counter_cancel
> >>> 0.12 ± 4% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.crc_36
> >>> 0.16 ± 7% -0.0 0.11 ± 6% perf-profile.self.cycles-pp.try_release_extent_mapping
> >>> 0.07 ± 10% -0.0 0.03 ±100% perf-profile.self.cycles-pp.__sched_text_start
> >>> 0.21 ± 7% -0.0 0.17 ± 6% perf-profile.self.cycles-pp.__lookup_extent_mapping
> >>> 0.21 ± 5% -0.0 0.17 ± 4% perf-profile.self.cycles-pp.crc_12
> >>> 0.15 ± 4% -0.0 0.11 ± 9% perf-profile.self.cycles-pp.page_counter_try_charge
> >>> 0.18 ± 2% -0.0 0.14 ± 10% perf-profile.self.cycles-pp.__mod_node_page_state
> >>> 0.12 ± 9% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.rmqueue_bulk
> >>> 0.19 ± 3% -0.0 0.15 ± 5% perf-profile.self.cycles-pp.free_extent_map
> >>> 0.18 ± 3% -0.0 0.15 ± 7% perf-profile.self.cycles-pp.btrfs_releasepage
> >>> 0.17 ± 6% -0.0 0.14 ± 8% perf-profile.self.cycles-pp.release_pages
> >>> 0.14 ± 3% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.split_state
> >>> 0.16 ± 5% -0.0 0.12 ± 6% perf-profile.self.cycles-pp.xas_store
> >>> 0.15 ± 5% -0.0 0.11 ± 4% perf-profile.self.cycles-pp.crc_38
> >>> 0.14 ± 3% -0.0 0.11 ± 10% perf-profile.self.cycles-pp.crc_30
> >>> 0.20 ± 4% -0.0 0.18 ± 4% perf-profile.self.cycles-pp.btrfs_get_chunk_map
> >>> 0.13 ± 5% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.rmqueue
> >>> 0.13 ± 9% -0.0 0.10 ± 8% perf-profile.self.cycles-pp.kmem_cache_alloc
> >>> 0.14 ± 3% -0.0 0.11 ± 9% perf-profile.self.cycles-pp.try_charge
> >>> 0.10 ± 4% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.crc_18
> >>> 0.10 ± 5% -0.0 0.07 ± 10% perf-profile.self.cycles-pp.mem_cgroup_charge
> >>> 0.11 -0.0 0.09 ± 9% perf-profile.self.cycles-pp.___might_sleep
> >>> 0.09 -0.0 0.07 ± 6% perf-profile.self.cycles-pp.__delete_from_page_cache
> >>> 0.09 ± 7% -0.0 0.07 ± 6% perf-profile.self.cycles-pp.crc_10
> >>> 0.06 -0.0 0.04 ± 57% perf-profile.self.cycles-pp.rb_erase
> >>> 0.11 -0.0 0.09 ± 7% perf-profile.self.cycles-pp.crc_22
> >>> 0.10 ± 7% -0.0 0.08 ± 8% perf-profile.self.cycles-pp.__mod_zone_page_state
> >>> 0.15 ± 5% -0.0 0.13 ± 3% perf-profile.self.cycles-pp._raw_spin_lock_irq
> >>> 0.10 ± 5% -0.0 0.08 ± 6% perf-profile.self.cycles-pp.pmem_do_read
> >>> 0.17 ± 2% -0.0 0.15 ± 4% perf-profile.self.cycles-pp.kernel_fpu_begin
> >>> 0.10 ± 7% -0.0 0.08 ± 5% perf-profile.self.cycles-pp.kmem_cache_free
> >>> 0.08 -0.0 0.06 ± 13% perf-profile.self.cycles-pp.clear_state_bit
> >>> 0.09 ± 4% -0.0 0.07 perf-profile.self.cycles-pp.crc_28
> >>> 0.08 ± 5% -0.0 0.06 ± 6% perf-profile.self.cycles-pp.__alloc_pages_nodemask
> >>> 0.07 ± 5% -0.0 0.06 ± 7% perf-profile.self.cycles-pp.check_data_csum
> >>> 0.08 ± 5% +0.0 0.10 ± 7% perf-profile.self.cycles-pp.__list_add_valid
> >>> 0.14 ± 7% +0.1 0.23 ± 7% perf-profile.self.cycles-pp.isolate_lru_pages
> >>> 0.34 ± 6% +0.3 0.60 ± 9% perf-profile.self.cycles-pp.__pagevec_lru_add
> >>> 20.34 ± 21% +4.5 24.80 ± 22% perf-profile.self.cycles-pp.intel_idle
> >>> 27.19 ± 7% +6.5 33.71 ± 9% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
> >>>
> >>>
> >>>
> >>>
> >>>
> >>> Disclaimer:
> >>> Results have been estimated based on internal Intel analysis and are provided
> >>> for informational purposes only. Any difference in system hardware or software
> >>> design or configuration may affect actual performance.
> >>>
> >>>
> >>> Thanks,
> >>> Rong Chen
> >>>
1 year, 1 month
- 1
- 0
[block] 54529aac98: fsmark.files_per_sec -13.6% regression
by kernel test robot
Greeting,
FYI, we noticed a -13.6% regression of fsmark.files_per_sec due to commit:
commit: 54529aac984de8d3928810c85b575efac0f9d616 ("[PATCH 07/14] block: make QUEUE_SYSFS_BIT_FNS a little more useful")
url: https://github.com/0day-ci/linux/commits/Christoph-Hellwig/fs-remove-the-...
base: https://git.kernel.org/cgit/linux/kernel/git/axboe/linux-block.git for-next
in testcase: fsmark
on test machine: 192 threads Cooper Lake with 128G memory
with following parameters:
iterations: 1x
nr_threads: 1t
disk: 1BRD_32G
fs: btrfs
filesize: 4K
test_size: 4G
sync_method: fsyncBeforeClose
nr_files_per_directory: 1fpd
cpufreq_governor: performance
ucode: 0x86000017
test-description: The fsmark is a file system benchmark to test synchronous write workloads, for example, mail servers workload.
test-url: https://sourceforge.net/projects/fsmark/
In addition to that, the commit also has significant impact on the following tests:
+------------------+-------------------------------------------------------------+
| testcase: change | fio-basic: fio.write_iops 993.0% improvement |
| test machine | 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory |
| test parameters | bs=4k |
| | cpufreq_governor=performance |
| | disk=1SSD |
| | fs=btrfs |
| | ioengine=sync |
| | nr_task=8 |
| | runtime=300s |
| | rw=randwrite |
| | test_size=512g |
| | ucode=0x4002f01 |
+------------------+-------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/disk/filesize/fs/iterations/kconfig/nr_files_per_directory/nr_threads/rootfs/sync_method/tbox_group/test_size/testcase/ucode:
gcc-9/performance/1BRD_32G/4K/btrfs/1x/x86_64-rhel-8.3/1fpd/1t/debian-10.4-x86_64-20200603.cgz/fsyncBeforeClose/lkp-cpx-4s1/4G/fsmark/0x86000017
commit:
f8d6c28b2a ("block: lift setting the readahead size into the block layer")
54529aac98 ("block: make QUEUE_SYSFS_BIT_FNS a little more useful")
f8d6c28b2a8e1156 54529aac984de8d3928810c85b5
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
0:4 -1% 0:4 perf-profile.children.cycles-pp.error_entry
%stddev %change %stddev
\ | \
17751926 +8.9% 19337948 fsmark.app_overhead
6346 -13.6% 5483 fsmark.files_per_sec
165.15 +14.7% 189.42 fsmark.time.elapsed_time
165.15 +14.7% 189.42 fsmark.time.elapsed_time.max
24782 ± 2% +16.3% 28832 fsmark.time.involuntary_context_switches
151.13 +15.2% 174.14 fsmark.time.system_time
1147770 +11.2% 1276761 fsmark.time.voluntary_context_switches
26.68 -1.8% 26.20 boot-time.dhcp
1094 ± 37% -48.7% 561.25 ± 50% numa-meminfo.node2.PageTables
47861180 -9.2% 43467411 meminfo.MemFree
17734610 +24.8% 22128380 ± 3% meminfo.Memused
500290 +66.6% 833499 vmstat.io.bo
47896231 -9.2% 43485212 vmstat.memory.free
48955 +21.0% 59253 vmstat.system.cs
100261 +18.1% 118396 slabinfo.radix_tree_node.active_objs
1798 +18.0% 2122 slabinfo.radix_tree_node.active_slabs
100759 +18.0% 118876 slabinfo.radix_tree_node.num_objs
1798 +18.0% 2122 slabinfo.radix_tree_node.num_slabs
38615161 +89.9% 73314982 ± 2% cpuidle.C1.time
3109557 +58.2% 4920768 cpuidle.C1.usage
3.027e+10 +14.3% 3.459e+10 cpuidle.C1E.time
64384612 +14.0% 73424957 cpuidle.C1E.usage
420763 ± 7% +23.8% 521103 ± 11% cpuidle.POLL.time
1001776 +4.1% 1042639 proc-vmstat.nr_active_file
12993 +1.9% 13240 proc-vmstat.nr_dirty
1343494 -8.2% 1233140 proc-vmstat.nr_dirty_background_threshold
2690273 -8.2% 2469297 proc-vmstat.nr_dirty_threshold
11965705 -9.2% 10868385 proc-vmstat.nr_free_pages
1001776 +4.1% 1042640 proc-vmstat.nr_zone_active_file
13032 +2.0% 13297 proc-vmstat.nr_zone_write_pending
1940119 ± 2% +72.5% 3346705 ± 9% proc-vmstat.numa_foreign
4131750 +10.3% 4559084 ± 6% proc-vmstat.numa_hit
4038575 +10.6% 4465938 ± 6% proc-vmstat.numa_local
1940119 ± 2% +72.5% 3346705 ± 9% proc-vmstat.numa_miss
2033294 ± 2% +69.2% 3439851 ± 9% proc-vmstat.numa_other
950436 +6.2% 1009835 ± 6% proc-vmstat.pgactivate
6711546 ± 2% +28.4% 8614751 ± 2% proc-vmstat.pgalloc_normal
665913 +14.7% 764043 proc-vmstat.pgfault
83920002 +91.2% 1.604e+08 proc-vmstat.pgpgout
9.16 +7.3% 9.82 perf-stat.i.MPKI
1.25e+09 -6.7% 1.167e+09 perf-stat.i.branch-instructions
11477332 -5.2% 10880556 ± 2% perf-stat.i.branch-misses
49712 +21.0% 60163 perf-stat.i.context-switches
2.95 +7.3% 3.17 ± 2% perf-stat.i.cpi
1.615e+09 -4.9% 1.536e+09 perf-stat.i.dTLB-loads
8.427e+08 -5.4% 7.973e+08 perf-stat.i.dTLB-stores
6.372e+09 -6.9% 5.93e+09 perf-stat.i.instructions
1516 -6.2% 1422 perf-stat.i.instructions-per-iTLB-miss
0.34 -6.9% 0.32 ± 2% perf-stat.i.ipc
19.67 -5.5% 18.59 perf-stat.i.metric.M/sec
63.85 +4.9 68.72 ± 3% perf-stat.i.node-load-miss-rate%
930657 ± 5% -14.6% 795230 ± 12% perf-stat.i.node-loads
472374 ± 2% +31.6% 621845 ± 9% perf-stat.i.node-store-misses
972412 ± 3% +9.0% 1060090 ± 6% perf-stat.i.node-stores
8.97 +7.5% 9.64 perf-stat.overall.MPKI
2.90 +7.4% 3.12 ± 2% perf-stat.overall.cpi
1515 -6.3% 1419 perf-stat.overall.instructions-per-iTLB-miss
0.34 -6.8% 0.32 ± 2% perf-stat.overall.ipc
1.243e+09 -6.6% 1.16e+09 perf-stat.ps.branch-instructions
11419074 -5.2% 10822847 ± 2% perf-stat.ps.branch-misses
49384 +21.1% 59799 perf-stat.ps.context-switches
1.606e+09 -4.8% 1.528e+09 perf-stat.ps.dTLB-loads
8.377e+08 -5.3% 7.931e+08 perf-stat.ps.dTLB-stores
6.334e+09 -6.9% 5.898e+09 perf-stat.ps.instructions
924849 ± 5% -14.5% 790976 ± 12% perf-stat.ps.node-loads
469241 ± 2% +31.8% 618470 ± 9% perf-stat.ps.node-store-misses
966794 ± 3% +9.1% 1054708 ± 6% perf-stat.ps.node-stores
1.05e+12 +6.9% 1.123e+12 perf-stat.total.instructions
11038 ± 22% +25.7% 13880 ± 23% sched_debug.cfs_rq:/.load.avg
230.71 ± 20% -42.7% 132.22 ± 10% sched_debug.cfs_rq:/.load_avg.avg
21506 ± 20% -51.5% 10427 ± 6% sched_debug.cfs_rq:/.load_avg.max
2086 ± 20% -49.5% 1052 ± 8% sched_debug.cfs_rq:/.load_avg.stddev
93248 ± 14% +39.6% 130209 sched_debug.cpu.clock.avg
93261 ± 14% +39.6% 130221 sched_debug.cpu.clock.max
93235 ± 14% +39.6% 130198 sched_debug.cpu.clock.min
92126 ± 14% +39.2% 128251 sched_debug.cpu.clock_task.avg
92856 ± 14% +39.5% 129536 sched_debug.cpu.clock_task.max
83568 ± 15% +42.4% 119014 sched_debug.cpu.clock_task.min
797.56 ± 7% +27.5% 1016 ± 4% sched_debug.cpu.clock_task.stddev
5007 ± 8% +23.4% 6180 sched_debug.cpu.curr->pid.max
562.64 ± 2% +7.9% 607.19 ± 4% sched_debug.cpu.curr->pid.stddev
13542 ± 25% +122.7% 30158 sched_debug.cpu.nr_switches.avg
525933 ± 27% +49.2% 784862 ± 9% sched_debug.cpu.nr_switches.max
848.29 ± 32% +40.3% 1190 ± 15% sched_debug.cpu.nr_switches.min
48875 ± 24% +81.5% 88697 ± 5% sched_debug.cpu.nr_switches.stddev
11890 ± 28% +139.7% 28500 sched_debug.cpu.sched_count.avg
519219 ± 28% +50.2% 779702 ± 10% sched_debug.cpu.sched_count.max
222.04 ± 23% +69.1% 375.56 ± 6% sched_debug.cpu.sched_count.min
48367 ± 24% +82.7% 88372 ± 6% sched_debug.cpu.sched_count.stddev
5870 ± 28% +140.5% 14121 sched_debug.cpu.sched_goidle.avg
253647 ± 28% +50.3% 381213 ± 10% sched_debug.cpu.sched_goidle.max
83.21 ± 22% +70.5% 141.88 ± 7% sched_debug.cpu.sched_goidle.min
23845 ± 24% +83.4% 43739 ± 6% sched_debug.cpu.sched_goidle.stddev
5911 ± 28% +140.1% 14194 sched_debug.cpu.ttwu_count.avg
373905 ± 29% +112.3% 793765 ± 10% sched_debug.cpu.ttwu_count.max
84.08 ± 25% +74.2% 146.50 ± 7% sched_debug.cpu.ttwu_count.min
29382 ± 28% +123.8% 65763 ± 7% sched_debug.cpu.ttwu_count.stddev
204.86 ± 25% +68.6% 345.39 sched_debug.cpu.ttwu_local.avg
6318 ± 28% +44.3% 9115 ± 5% sched_debug.cpu.ttwu_local.max
76.42 ± 24% +67.7% 128.19 ± 4% sched_debug.cpu.ttwu_local.min
451.44 ± 28% +46.2% 660.22 ± 4% sched_debug.cpu.ttwu_local.stddev
93236 ± 14% +39.6% 130198 sched_debug.cpu_clk
92489 ± 14% +40.0% 129450 sched_debug.ktime
93635 ± 14% +39.5% 130601 sched_debug.sched_clk
332710 +14.6% 381386 interrupts.CPU0.LOC:Local_timer_interrupts
332760 +14.6% 381375 interrupts.CPU1.LOC:Local_timer_interrupts
332744 +14.6% 381431 interrupts.CPU10.LOC:Local_timer_interrupts
332675 +14.6% 381345 interrupts.CPU100.LOC:Local_timer_interrupts
332711 +14.6% 381337 interrupts.CPU101.LOC:Local_timer_interrupts
332687 +14.6% 381338 interrupts.CPU102.LOC:Local_timer_interrupts
332686 +14.6% 381306 interrupts.CPU103.LOC:Local_timer_interrupts
332673 +14.6% 381359 interrupts.CPU104.LOC:Local_timer_interrupts
332692 +14.6% 381284 interrupts.CPU105.LOC:Local_timer_interrupts
332672 +14.6% 381322 interrupts.CPU106.LOC:Local_timer_interrupts
332662 +14.6% 381373 interrupts.CPU107.LOC:Local_timer_interrupts
332692 +14.6% 381320 interrupts.CPU108.LOC:Local_timer_interrupts
332660 +14.6% 381331 interrupts.CPU109.LOC:Local_timer_interrupts
332696 +14.6% 381321 interrupts.CPU11.LOC:Local_timer_interrupts
95.00 ±109% -72.4% 26.25 ±135% interrupts.CPU11.RES:Rescheduling_interrupts
332674 +14.6% 381351 interrupts.CPU110.LOC:Local_timer_interrupts
332712 +14.6% 381322 interrupts.CPU111.LOC:Local_timer_interrupts
332671 +14.6% 381355 interrupts.CPU112.LOC:Local_timer_interrupts
332660 +14.6% 381389 interrupts.CPU113.LOC:Local_timer_interrupts
332658 +14.6% 381317 interrupts.CPU114.LOC:Local_timer_interrupts
332659 +14.6% 381322 interrupts.CPU115.LOC:Local_timer_interrupts
332659 +14.6% 381304 interrupts.CPU116.LOC:Local_timer_interrupts
332636 +14.6% 381350 interrupts.CPU117.LOC:Local_timer_interrupts
332644 +14.6% 381353 interrupts.CPU118.LOC:Local_timer_interrupts
332658 +14.6% 381306 interrupts.CPU119.LOC:Local_timer_interrupts
332608 +14.6% 381178 interrupts.CPU12.LOC:Local_timer_interrupts
332661 +14.6% 381292 interrupts.CPU120.LOC:Local_timer_interrupts
332697 +14.6% 381360 interrupts.CPU121.LOC:Local_timer_interrupts
332680 +14.6% 381351 interrupts.CPU122.LOC:Local_timer_interrupts
332663 +14.6% 381299 interrupts.CPU123.LOC:Local_timer_interrupts
332668 +14.6% 381367 interrupts.CPU124.LOC:Local_timer_interrupts
332675 +14.6% 381272 interrupts.CPU125.LOC:Local_timer_interrupts
332663 +14.6% 381267 interrupts.CPU126.LOC:Local_timer_interrupts
332671 +14.6% 381311 interrupts.CPU127.LOC:Local_timer_interrupts
332734 +14.6% 381284 interrupts.CPU128.LOC:Local_timer_interrupts
332665 +14.6% 381279 interrupts.CPU129.LOC:Local_timer_interrupts
332720 +14.6% 381445 interrupts.CPU13.LOC:Local_timer_interrupts
332666 +14.6% 381276 interrupts.CPU130.LOC:Local_timer_interrupts
332642 +14.6% 381277 interrupts.CPU131.LOC:Local_timer_interrupts
332671 +14.6% 381297 interrupts.CPU132.LOC:Local_timer_interrupts
332664 +14.6% 381276 interrupts.CPU133.LOC:Local_timer_interrupts
332691 +14.6% 381296 interrupts.CPU134.LOC:Local_timer_interrupts
332689 +14.6% 381270 interrupts.CPU135.LOC:Local_timer_interrupts
332573 +14.6% 381248 interrupts.CPU136.LOC:Local_timer_interrupts
9.50 ± 49% +381.6% 45.75 ±103% interrupts.CPU136.RES:Rescheduling_interrupts
332643 +14.6% 381263 interrupts.CPU137.LOC:Local_timer_interrupts
332654 +14.6% 381233 interrupts.CPU138.LOC:Local_timer_interrupts
332657 +14.6% 381274 interrupts.CPU139.LOC:Local_timer_interrupts
332653 +14.7% 381411 interrupts.CPU14.LOC:Local_timer_interrupts
332673 +14.6% 381277 interrupts.CPU140.LOC:Local_timer_interrupts
332655 +14.6% 381276 interrupts.CPU141.LOC:Local_timer_interrupts
332548 +14.7% 381277 interrupts.CPU142.LOC:Local_timer_interrupts
332658 +14.6% 381277 interrupts.CPU143.LOC:Local_timer_interrupts
332701 +14.6% 381360 interrupts.CPU144.LOC:Local_timer_interrupts
332698 +14.6% 381314 interrupts.CPU145.LOC:Local_timer_interrupts
332696 +14.6% 381314 interrupts.CPU146.LOC:Local_timer_interrupts
332711 +14.6% 381362 interrupts.CPU147.LOC:Local_timer_interrupts
332700 +14.6% 381328 interrupts.CPU148.LOC:Local_timer_interrupts
332700 +14.6% 381312 interrupts.CPU149.LOC:Local_timer_interrupts
332727 +14.6% 381299 interrupts.CPU15.LOC:Local_timer_interrupts
332703 +14.6% 381352 interrupts.CPU150.LOC:Local_timer_interrupts
332696 +14.6% 381295 interrupts.CPU151.LOC:Local_timer_interrupts
332800 +14.6% 381300 interrupts.CPU152.LOC:Local_timer_interrupts
332710 +14.6% 381291 interrupts.CPU153.LOC:Local_timer_interrupts
332727 +14.6% 381302 interrupts.CPU154.LOC:Local_timer_interrupts
332711 +14.6% 381291 interrupts.CPU155.LOC:Local_timer_interrupts
332761 +14.6% 381291 interrupts.CPU156.LOC:Local_timer_interrupts
332686 +14.6% 381282 interrupts.CPU157.LOC:Local_timer_interrupts
332681 +14.6% 381299 interrupts.CPU158.LOC:Local_timer_interrupts
332713 +14.6% 381340 interrupts.CPU159.LOC:Local_timer_interrupts
332695 +14.6% 381344 interrupts.CPU16.LOC:Local_timer_interrupts
332720 +14.6% 381292 interrupts.CPU160.LOC:Local_timer_interrupts
332689 +14.6% 381290 interrupts.CPU161.LOC:Local_timer_interrupts
332711 +14.6% 381275 interrupts.CPU162.LOC:Local_timer_interrupts
332691 +14.6% 381276 interrupts.CPU163.LOC:Local_timer_interrupts
332685 +14.6% 381288 interrupts.CPU164.LOC:Local_timer_interrupts
332794 +14.6% 381316 interrupts.CPU165.LOC:Local_timer_interrupts
332691 +14.6% 381274 interrupts.CPU166.LOC:Local_timer_interrupts
332686 +14.6% 381280 interrupts.CPU167.LOC:Local_timer_interrupts
332709 +14.6% 381291 interrupts.CPU168.LOC:Local_timer_interrupts
332683 +14.6% 381304 interrupts.CPU169.LOC:Local_timer_interrupts
332700 +14.6% 381292 interrupts.CPU17.LOC:Local_timer_interrupts
332729 +14.6% 381304 interrupts.CPU170.LOC:Local_timer_interrupts
332745 +14.6% 381315 interrupts.CPU171.LOC:Local_timer_interrupts
332728 +14.6% 381314 interrupts.CPU172.LOC:Local_timer_interrupts
332664 +14.6% 381293 interrupts.CPU173.LOC:Local_timer_interrupts
332721 +14.6% 381283 interrupts.CPU174.LOC:Local_timer_interrupts
332708 +14.6% 381281 interrupts.CPU175.LOC:Local_timer_interrupts
332691 +14.6% 381285 interrupts.CPU176.LOC:Local_timer_interrupts
332675 +14.6% 381292 interrupts.CPU177.LOC:Local_timer_interrupts
332664 +14.6% 381296 interrupts.CPU178.LOC:Local_timer_interrupts
332660 +14.6% 381287 interrupts.CPU179.LOC:Local_timer_interrupts
332652 +14.6% 381318 interrupts.CPU18.LOC:Local_timer_interrupts
332664 +14.6% 381282 interrupts.CPU180.LOC:Local_timer_interrupts
332566 +14.7% 381290 interrupts.CPU181.LOC:Local_timer_interrupts
7.00 ± 17% +607.1% 49.50 ±105% interrupts.CPU181.RES:Rescheduling_interrupts
332645 +14.6% 381288 interrupts.CPU182.LOC:Local_timer_interrupts
332671 +14.6% 381283 interrupts.CPU183.LOC:Local_timer_interrupts
10.25 ± 25% +509.8% 62.50 ±119% interrupts.CPU183.RES:Rescheduling_interrupts
332705 +14.6% 381294 interrupts.CPU184.LOC:Local_timer_interrupts
332699 +14.6% 381334 interrupts.CPU185.LOC:Local_timer_interrupts
332645 +14.6% 381330 interrupts.CPU186.LOC:Local_timer_interrupts
332644 +14.6% 381306 interrupts.CPU187.LOC:Local_timer_interrupts
332655 +14.6% 381268 interrupts.CPU188.LOC:Local_timer_interrupts
332645 +14.6% 381357 interrupts.CPU189.LOC:Local_timer_interrupts
13.25 ± 20% +207.5% 40.75 ± 87% interrupts.CPU189.RES:Rescheduling_interrupts
332697 +14.6% 381311 interrupts.CPU19.LOC:Local_timer_interrupts
332661 +14.6% 381300 interrupts.CPU190.LOC:Local_timer_interrupts
332826 +14.6% 381443 interrupts.CPU191.LOC:Local_timer_interrupts
332687 +14.6% 381405 interrupts.CPU2.LOC:Local_timer_interrupts
332683 +14.6% 381333 interrupts.CPU20.LOC:Local_timer_interrupts
332671 +14.6% 381325 interrupts.CPU21.LOC:Local_timer_interrupts
332703 +14.6% 381238 interrupts.CPU22.LOC:Local_timer_interrupts
332696 +14.6% 381347 interrupts.CPU23.LOC:Local_timer_interrupts
332653 +14.6% 381286 interrupts.CPU24.LOC:Local_timer_interrupts
332709 +14.6% 381354 interrupts.CPU25.LOC:Local_timer_interrupts
332675 +14.6% 381329 interrupts.CPU26.LOC:Local_timer_interrupts
332742 +14.6% 381338 interrupts.CPU27.LOC:Local_timer_interrupts
332699 +14.6% 381378 interrupts.CPU28.LOC:Local_timer_interrupts
332735 +14.6% 381336 interrupts.CPU29.LOC:Local_timer_interrupts
332595 +14.7% 381338 interrupts.CPU3.LOC:Local_timer_interrupts
332700 +14.6% 381348 interrupts.CPU30.LOC:Local_timer_interrupts
8.25 ± 85% +430.3% 43.75 ± 94% interrupts.CPU30.RES:Rescheduling_interrupts
332708 +14.6% 381250 interrupts.CPU31.LOC:Local_timer_interrupts
332722 +14.6% 381214 interrupts.CPU32.LOC:Local_timer_interrupts
332682 +14.6% 381300 interrupts.CPU33.LOC:Local_timer_interrupts
332680 +14.6% 381288 interrupts.CPU34.LOC:Local_timer_interrupts
332677 +14.6% 381283 interrupts.CPU35.LOC:Local_timer_interrupts
332731 +14.6% 381287 interrupts.CPU36.LOC:Local_timer_interrupts
332680 +14.6% 381286 interrupts.CPU37.LOC:Local_timer_interrupts
332698 +14.6% 381287 interrupts.CPU38.LOC:Local_timer_interrupts
332690 +14.6% 381287 interrupts.CPU39.LOC:Local_timer_interrupts
332719 +14.6% 381410 interrupts.CPU4.LOC:Local_timer_interrupts
332662 +14.6% 381283 interrupts.CPU40.LOC:Local_timer_interrupts
332695 +14.6% 381286 interrupts.CPU41.LOC:Local_timer_interrupts
332688 +14.6% 381286 interrupts.CPU42.LOC:Local_timer_interrupts
332673 +14.6% 381287 interrupts.CPU43.LOC:Local_timer_interrupts
332705 +14.6% 381305 interrupts.CPU44.LOC:Local_timer_interrupts
332706 +14.6% 381285 interrupts.CPU45.LOC:Local_timer_interrupts
332692 +14.6% 381295 interrupts.CPU46.LOC:Local_timer_interrupts
332697 +14.6% 381368 interrupts.CPU47.LOC:Local_timer_interrupts
332712 +14.6% 381297 interrupts.CPU48.LOC:Local_timer_interrupts
332706 +14.6% 381312 interrupts.CPU49.LOC:Local_timer_interrupts
332709 +14.6% 381387 interrupts.CPU5.LOC:Local_timer_interrupts
332738 +14.6% 381286 interrupts.CPU50.LOC:Local_timer_interrupts
332723 +14.6% 381308 interrupts.CPU51.LOC:Local_timer_interrupts
332698 +14.6% 381319 interrupts.CPU52.LOC:Local_timer_interrupts
332708 +14.6% 381311 interrupts.CPU53.LOC:Local_timer_interrupts
332702 +14.6% 381325 interrupts.CPU54.LOC:Local_timer_interrupts
332699 +14.6% 381305 interrupts.CPU55.LOC:Local_timer_interrupts
332722 +14.6% 381223 interrupts.CPU56.LOC:Local_timer_interrupts
332716 +14.6% 381336 interrupts.CPU57.LOC:Local_timer_interrupts
332711 +14.6% 381322 interrupts.CPU58.LOC:Local_timer_interrupts
332740 +14.6% 381308 interrupts.CPU59.LOC:Local_timer_interrupts
332702 +14.6% 381330 interrupts.CPU6.LOC:Local_timer_interrupts
332720 +14.6% 381313 interrupts.CPU60.LOC:Local_timer_interrupts
332703 +14.6% 381309 interrupts.CPU61.LOC:Local_timer_interrupts
332709 +14.6% 381312 interrupts.CPU62.LOC:Local_timer_interrupts
332705 +14.6% 381319 interrupts.CPU63.LOC:Local_timer_interrupts
332744 +14.6% 381299 interrupts.CPU64.LOC:Local_timer_interrupts
332748 +14.6% 381300 interrupts.CPU65.LOC:Local_timer_interrupts
332751 +14.6% 381297 interrupts.CPU66.LOC:Local_timer_interrupts
332722 +14.6% 381307 interrupts.CPU67.LOC:Local_timer_interrupts
332708 +14.6% 381295 interrupts.CPU68.LOC:Local_timer_interrupts
332721 +14.6% 381322 interrupts.CPU69.LOC:Local_timer_interrupts
332638 +14.6% 381198 interrupts.CPU7.LOC:Local_timer_interrupts
332707 +14.6% 381360 interrupts.CPU70.LOC:Local_timer_interrupts
332703 +14.6% 381334 interrupts.CPU71.LOC:Local_timer_interrupts
332682 +14.6% 381285 interrupts.CPU72.LOC:Local_timer_interrupts
332701 +14.6% 381330 interrupts.CPU73.LOC:Local_timer_interrupts
332671 +14.6% 381332 interrupts.CPU74.LOC:Local_timer_interrupts
332757 +14.6% 381305 interrupts.CPU75.LOC:Local_timer_interrupts
332733 +14.6% 381306 interrupts.CPU76.LOC:Local_timer_interrupts
332665 +14.6% 381317 interrupts.CPU77.LOC:Local_timer_interrupts
332672 +14.6% 381343 interrupts.CPU78.LOC:Local_timer_interrupts
332664 +14.6% 381310 interrupts.CPU79.LOC:Local_timer_interrupts
332715 +14.6% 381404 interrupts.CPU8.LOC:Local_timer_interrupts
332628 +14.6% 381316 interrupts.CPU80.LOC:Local_timer_interrupts
332571 +14.7% 381315 interrupts.CPU81.LOC:Local_timer_interrupts
332668 +14.6% 381303 interrupts.CPU82.LOC:Local_timer_interrupts
6.25 ± 36% +492.0% 37.00 ±118% interrupts.CPU82.RES:Rescheduling_interrupts
332676 +14.6% 381345 interrupts.CPU83.LOC:Local_timer_interrupts
332676 +14.6% 381302 interrupts.CPU84.LOC:Local_timer_interrupts
7.00 ± 17% +675.0% 54.25 ±127% interrupts.CPU84.RES:Rescheduling_interrupts
332689 +14.6% 381314 interrupts.CPU85.LOC:Local_timer_interrupts
332681 +14.6% 381213 interrupts.CPU86.LOC:Local_timer_interrupts
9.00 ± 23% +377.8% 43.00 ±107% interrupts.CPU86.RES:Rescheduling_interrupts
332673 +14.6% 381348 interrupts.CPU87.LOC:Local_timer_interrupts
332669 +14.6% 381382 interrupts.CPU88.LOC:Local_timer_interrupts
332676 +14.6% 381330 interrupts.CPU89.LOC:Local_timer_interrupts
332676 +14.6% 381320 interrupts.CPU9.LOC:Local_timer_interrupts
332677 +14.6% 381337 interrupts.CPU90.LOC:Local_timer_interrupts
7.00 ± 17% +760.7% 60.25 ±143% interrupts.CPU90.RES:Rescheduling_interrupts
332716 +14.6% 381324 interrupts.CPU91.LOC:Local_timer_interrupts
332678 +14.6% 381318 interrupts.CPU92.LOC:Local_timer_interrupts
332679 +14.6% 381313 interrupts.CPU93.LOC:Local_timer_interrupts
332680 +14.6% 381307 interrupts.CPU94.LOC:Local_timer_interrupts
332739 +14.6% 381288 interrupts.CPU95.LOC:Local_timer_interrupts
7.00 ± 22% +967.9% 74.75 ±138% interrupts.CPU95.RES:Rescheduling_interrupts
332660 +14.6% 381292 interrupts.CPU96.LOC:Local_timer_interrupts
332715 +14.6% 381374 interrupts.CPU97.LOC:Local_timer_interrupts
332670 +14.6% 381336 interrupts.CPU98.LOC:Local_timer_interrupts
332669 +14.6% 381401 interrupts.CPU99.LOC:Local_timer_interrupts
63876342 +14.6% 73212105 interrupts.LOC:Local_timer_interrupts
15573 ± 4% +20.6% 18773 ± 3% interrupts.RES:Rescheduling_interrupts
17.28 ± 3% -3.9 13.36 ± 16% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
17.26 ± 3% -3.9 13.34 ± 16% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.39 ± 4% -2.9 10.50 ± 16% perf-profile.calltrace.cycles-pp.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.39 ± 4% -2.9 10.50 ± 16% perf-profile.calltrace.cycles-pp.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.38 ± 4% -2.9 10.50 ± 16% perf-profile.calltrace.cycles-pp.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.64 ± 2% -1.3 3.35 ± 18% perf-profile.calltrace.cycles-pp.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
4.63 ± 2% -1.3 3.34 ± 18% perf-profile.calltrace.cycles-pp.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync.__x64_sys_fsync
4.56 ± 2% -1.3 3.30 ± 18% perf-profile.calltrace.cycles-pp.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file.do_fsync
2.16 ± 5% -1.2 0.99 ± 19% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages
4.36 ± 4% -1.1 3.27 ± 18% perf-profile.calltrace.cycles-pp.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents
4.35 ± 4% -1.1 3.27 ± 18% perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range
1.12 ± 7% -0.9 0.26 ±100% perf-profile.calltrace.cycles-pp.btrfs_check_node.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages
2.02 -0.6 1.45 ± 18% perf-profile.calltrace.cycles-pp.btrfs_truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
1.99 -0.6 1.44 ± 17% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
1.89 ± 2% -0.5 1.38 ± 17% perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.btrfs_log_inode.btrfs_log_inode_parent
0.95 ± 5% -0.5 0.45 ± 57% perf-profile.calltrace.cycles-pp.check_leaf.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.btree_write_cache_pages
1.88 ± 2% -0.5 1.38 ± 17% perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items.btrfs_log_inode
0.74 ± 8% -0.4 0.32 ±100% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_update_root.btrfs_sync_log.btrfs_sync_file.do_fsync
0.71 ± 7% -0.4 0.31 ±100% perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_update_root.btrfs_sync_log.btrfs_sync_file
0.90 ± 2% -0.4 0.50 ± 59% perf-profile.calltrace.cycles-pp.copy_extent_buffer_full.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_truncate_inode_items
0.71 ± 7% -0.4 0.31 ±100% perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_update_root.btrfs_sync_log
0.90 ± 2% -0.4 0.50 ± 59% perf-profile.calltrace.cycles-pp.copy_page.copy_extent_buffer_full.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot
1.68 ± 2% -0.4 1.28 ± 23% perf-profile.calltrace.cycles-pp.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.66 ± 5% -0.4 0.27 ±100% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.22 ± 7% -0.4 0.85 ± 14% perf-profile.calltrace.cycles-pp.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.22 ± 7% -0.4 0.85 ± 14% perf-profile.calltrace.cycles-pp.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.18 ± 8% -0.4 0.82 ± 15% perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.18 ± 8% -0.4 0.82 ± 15% perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
0.62 ± 7% -0.4 0.27 ±100% perf-profile.calltrace.cycles-pp.btrfs_add_link.btrfs_mkdir.vfs_mkdir.do_mkdirat.do_syscall_64
0.60 ± 7% -0.3 0.26 ±100% perf-profile.calltrace.cycles-pp.btrfs_insert_dir_item.btrfs_add_link.btrfs_mkdir.vfs_mkdir.do_mkdirat
1.01 ± 7% -0.3 0.68 ± 13% perf-profile.calltrace.cycles-pp.start_ordered_ops.btrfs_sync_file.do_fsync.__x64_sys_fsync.do_syscall_64
1.00 ± 7% -0.3 0.68 ± 13% perf-profile.calltrace.cycles-pp.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file.do_fsync.__x64_sys_fsync
0.99 ± 7% -0.3 0.67 ± 13% perf-profile.calltrace.cycles-pp.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file
1.00 ± 7% -0.3 0.68 ± 13% perf-profile.calltrace.cycles-pp.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops.btrfs_sync_file.do_fsync
0.99 ± 7% -0.3 0.67 ± 13% perf-profile.calltrace.cycles-pp.extent_writepages.do_writepages.__filemap_fdatawrite_range.btrfs_fdatawrite_range.start_ordered_ops
0.79 ± 8% -0.3 0.47 ± 57% perf-profile.calltrace.cycles-pp.btrfs_create.path_openat.do_filp_open.do_sys_openat2.do_sys_open
1.32 -0.3 1.01 ± 24% perf-profile.calltrace.cycles-pp.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.75 ± 8% -0.3 0.45 ± 59% perf-profile.calltrace.cycles-pp.btrfs_update_root.btrfs_sync_log.btrfs_sync_file.do_fsync.__x64_sys_fsync
1.30 -0.3 1.00 ± 23% perf-profile.calltrace.cycles-pp.btrfs_mkdir.vfs_mkdir.do_mkdirat.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.30 ± 3% -0.3 1.01 ± 21% perf-profile.calltrace.cycles-pp.copy_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe.btrfs_sync_file
0.83 ± 4% -0.3 0.54 ± 58% perf-profile.calltrace.cycles-pp.log_csums.copy_items.btrfs_log_inode.btrfs_log_inode_parent.btrfs_log_dentry_safe
0.68 ± 5% -0.3 0.41 ± 58% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.68 ± 5% -0.3 0.41 ± 58% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.84 ± 6% +0.1 0.94 ± 2% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack
0.00 +0.7 0.66 ± 15% perf-profile.calltrace.cycles-pp.btrfs_map_bio.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb
0.68 ± 8% +1.0 1.73 ± 17% perf-profile.calltrace.cycles-pp.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range.btrfs_write_marked_extents
0.00 +1.3 1.26 ± 14% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages
0.00 +1.3 1.26 ± 14% perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages
0.00 +1.4 1.37 ± 16% perf-profile.calltrace.cycles-pp.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages.__filemap_fdatawrite_range
80.22 +3.8 83.98 ± 2% perf-profile.calltrace.cycles-pp.secondary_startup_64
17.50 ± 3% -3.9 13.56 ± 16% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
17.48 ± 3% -3.9 13.55 ± 16% perf-profile.children.cycles-pp.do_syscall_64
13.39 ± 4% -2.9 10.50 ± 16% perf-profile.children.cycles-pp.do_fsync
13.39 ± 4% -2.9 10.50 ± 16% perf-profile.children.cycles-pp.__x64_sys_fsync
13.38 ± 4% -2.9 10.50 ± 16% perf-profile.children.cycles-pp.btrfs_sync_file
4.64 ± 2% -1.3 3.35 ± 18% perf-profile.children.cycles-pp.btrfs_log_dentry_safe
4.63 ± 2% -1.3 3.34 ± 18% perf-profile.children.cycles-pp.btrfs_log_inode_parent
4.57 ± 2% -1.3 3.30 ± 18% perf-profile.children.cycles-pp.btrfs_log_inode
5.26 ± 2% -1.2 4.01 ± 17% perf-profile.children.cycles-pp.btrfs_search_slot
3.26 -0.8 2.43 ± 18% perf-profile.children.cycles-pp.btrfs_cow_block
3.25 -0.8 2.42 ± 18% perf-profile.children.cycles-pp.__btrfs_cow_block
1.22 ± 8% -0.8 0.40 ± 21% perf-profile.children.cycles-pp.btrfs_commit_transaction
2.33 ± 6% -0.7 1.67 ± 17% perf-profile.children.cycles-pp.btree_csum_one_bio
0.87 ± 8% -0.6 0.25 ± 22% perf-profile.children.cycles-pp.btrfs_finish_extent_commit
0.86 ± 8% -0.6 0.24 ± 23% perf-profile.children.cycles-pp.unpin_extent_range
0.86 ± 8% -0.6 0.24 ± 23% perf-profile.children.cycles-pp.__btrfs_add_free_space
0.85 ± 8% -0.6 0.24 ± 23% perf-profile.children.cycles-pp.steal_from_bitmap
2.02 -0.6 1.45 ± 18% perf-profile.children.cycles-pp.btrfs_truncate_inode_items
1.24 ± 5% -0.6 0.68 ± 2% perf-profile.children.cycles-pp._find_next_bit
1.56 -0.5 1.07 ± 17% perf-profile.children.cycles-pp.copy_page
1.56 -0.5 1.07 ± 17% perf-profile.children.cycles-pp.copy_extent_buffer_full
1.68 ± 2% -0.4 1.28 ± 23% perf-profile.children.cycles-pp.do_mkdirat
1.23 ± 8% -0.4 0.86 ± 14% perf-profile.children.cycles-pp.do_sys_openat2
1.23 ± 8% -0.4 0.86 ± 14% perf-profile.children.cycles-pp.do_sys_open
1.19 ± 8% -0.4 0.83 ± 15% perf-profile.children.cycles-pp.path_openat
1.19 ± 8% -0.4 0.84 ± 15% perf-profile.children.cycles-pp.do_filp_open
1.14 ± 5% -0.4 0.79 ± 13% perf-profile.children.cycles-pp.check_leaf
1.01 ± 7% -0.3 0.68 ± 13% perf-profile.children.cycles-pp.start_ordered_ops
1.01 ± 7% -0.3 0.68 ± 13% perf-profile.children.cycles-pp.btrfs_fdatawrite_range
0.99 ± 6% -0.3 0.67 ± 13% perf-profile.children.cycles-pp.extent_writepages
1.39 ± 4% -0.3 1.07 ± 13% perf-profile.children.cycles-pp.btrfs_insert_empty_items
1.32 -0.3 1.01 ± 24% perf-profile.children.cycles-pp.vfs_mkdir
1.31 -0.3 1.00 ± 23% perf-profile.children.cycles-pp.btrfs_mkdir
1.14 ± 7% -0.3 0.84 ± 20% perf-profile.children.cycles-pp.btrfs_check_node
1.40 ± 3% -0.3 1.11 ± 8% perf-profile.children.cycles-pp._raw_spin_lock
1.30 ± 3% -0.3 1.02 ± 21% perf-profile.children.cycles-pp.copy_items
1.04 ± 7% -0.3 0.77 ± 19% perf-profile.children.cycles-pp.read_extent_buffer
0.67 ± 5% -0.2 0.43 ± 23% perf-profile.children.cycles-pp.btrfs_new_inode
0.82 ± 7% -0.2 0.59 ± 20% perf-profile.children.cycles-pp.btrfs_add_link
0.80 ± 8% -0.2 0.58 ± 15% perf-profile.children.cycles-pp.btrfs_create
0.77 ± 7% -0.2 0.55 ± 22% perf-profile.children.cycles-pp.btrfs_insert_dir_item
0.59 ± 9% -0.2 0.41 ± 8% perf-profile.children.cycles-pp.btrfs_submit_bio_hook
0.75 ± 8% -0.2 0.57 ± 14% perf-profile.children.cycles-pp.btrfs_update_root
0.65 ± 4% -0.2 0.47 ± 18% perf-profile.children.cycles-pp.btrfs_file_write_iter
0.49 ± 5% -0.2 0.31 ± 23% perf-profile.children.cycles-pp.btrfs_commit_inode_delayed_items
0.67 ± 5% -0.2 0.48 ± 18% perf-profile.children.cycles-pp.new_sync_write
0.69 ± 5% -0.2 0.51 ± 18% perf-profile.children.cycles-pp.ksys_write
0.69 ± 4% -0.2 0.51 ± 17% perf-profile.children.cycles-pp.vfs_write
0.83 ± 4% -0.2 0.66 ± 20% perf-profile.children.cycles-pp.log_csums
0.62 ± 7% -0.2 0.46 ± 21% perf-profile.children.cycles-pp.insert_with_overflow
0.55 ± 7% -0.2 0.39 ± 19% perf-profile.children.cycles-pp.btrfs_buffered_write
0.47 ± 9% -0.2 0.32 ± 15% perf-profile.children.cycles-pp.kmem_cache_alloc
0.54 ± 3% -0.1 0.40 ± 12% perf-profile.children.cycles-pp.btrfs_get_32
0.73 ± 8% -0.1 0.58 ± 15% perf-profile.children.cycles-pp.read_block_for_search
0.39 ± 3% -0.1 0.26 ± 20% perf-profile.children.cycles-pp.extent_write_cache_pages
0.59 ± 5% -0.1 0.47 ± 14% perf-profile.children.cycles-pp.setup_items_for_insert
0.46 ± 3% -0.1 0.33 ± 9% perf-profile.children.cycles-pp.alloc_extent_buffer
0.34 ± 4% -0.1 0.22 ± 21% perf-profile.children.cycles-pp.__extent_writepage
0.47 ± 6% -0.1 0.35 ± 23% perf-profile.children.cycles-pp.__btrfs_btree_balance_dirty
0.23 ± 8% -0.1 0.12 ± 21% perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction
0.46 ± 5% -0.1 0.34 ± 13% perf-profile.children.cycles-pp.generic_bin_search
0.37 ± 11% -0.1 0.26 ± 21% perf-profile.children.cycles-pp.btrfs_get_64
0.45 ± 7% -0.1 0.34 ± 22% perf-profile.children.cycles-pp.__percpu_counter_sum
0.46 ± 6% -0.1 0.35 ± 22% perf-profile.children.cycles-pp.__percpu_counter_compare
0.56 ± 8% -0.1 0.46 ± 10% perf-profile.children.cycles-pp.find_extent_buffer
0.33 ± 4% -0.1 0.23 ± 16% perf-profile.children.cycles-pp.split_leaf
0.34 ± 10% -0.1 0.24 ± 7% perf-profile.children.cycles-pp.pagecache_get_page
0.29 ± 11% -0.1 0.20 ± 13% perf-profile.children.cycles-pp.__set_extent_bit
0.27 ± 7% -0.1 0.17 ± 23% perf-profile.children.cycles-pp.writepage_delalloc
0.28 ± 14% -0.1 0.19 ± 24% perf-profile.children.cycles-pp.btrfs_reserve_extent
0.17 ± 17% -0.1 0.09 ± 18% perf-profile.children.cycles-pp.new_inode
0.25 ± 10% -0.1 0.16 ± 23% perf-profile.children.cycles-pp.set_extent_bit
0.17 ± 19% -0.1 0.08 ± 24% perf-profile.children.cycles-pp.new_inode_pseudo
0.16 ± 18% -0.1 0.08 ± 21% perf-profile.children.cycles-pp.alloc_inode
0.28 ± 9% -0.1 0.20 ± 28% perf-profile.children.cycles-pp.btrfs_check_ref_name_override
0.20 ± 9% -0.1 0.12 ± 17% perf-profile.children.cycles-pp.btrfs_wait_ordered_range
0.37 ± 2% -0.1 0.29 ± 11% perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
0.21 ± 9% -0.1 0.14 ± 16% perf-profile.children.cycles-pp.btrfs_get_token_32
0.23 ± 15% -0.1 0.16 ± 25% perf-profile.children.cycles-pp.find_free_extent
0.23 ± 8% -0.1 0.15 ± 24% perf-profile.children.cycles-pp.btrfs_run_delalloc_range
0.19 ± 21% -0.1 0.12 ± 27% perf-profile.children.cycles-pp.__slab_alloc
0.14 ± 21% -0.1 0.06 ± 20% perf-profile.children.cycles-pp.btrfs_alloc_inode
0.21 ± 4% -0.1 0.14 ± 28% perf-profile.children.cycles-pp.__test_set_page_writeback
0.18 ± 22% -0.1 0.11 ± 24% perf-profile.children.cycles-pp.___slab_alloc
0.17 ± 24% -0.1 0.10 ± 33% perf-profile.children.cycles-pp.allocate_slab
0.17 ± 24% -0.1 0.10 ± 33% perf-profile.children.cycles-pp.new_slab
0.22 ± 5% -0.1 0.15 ± 24% perf-profile.children.cycles-pp.cow_file_range
0.27 ± 12% -0.1 0.20 ± 13% perf-profile.children.cycles-pp.__alloc_pages_nodemask
0.19 ± 9% -0.1 0.12 ± 20% perf-profile.children.cycles-pp.check_extent_data_item
0.16 ± 10% -0.1 0.10 ± 18% perf-profile.children.cycles-pp.btrfs_start_ordered_extent
0.09 ± 19% -0.1 0.03 ±102% perf-profile.children.cycles-pp.add_to_page_cache_lru
0.25 ± 7% -0.1 0.19 ± 20% perf-profile.children.cycles-pp.btrfs_lookup
0.25 ± 7% -0.1 0.19 ± 20% perf-profile.children.cycles-pp.btrfs_lookup_dentry
0.17 ± 7% -0.1 0.11 ± 21% perf-profile.children.cycles-pp.cpumask_next
0.16 ± 4% -0.1 0.10 ± 12% perf-profile.children.cycles-pp.memzero_extent_buffer
0.24 ± 11% -0.1 0.18 ± 14% perf-profile.children.cycles-pp.get_page_from_freelist
0.26 ± 5% -0.1 0.21 ± 5% perf-profile.children.cycles-pp.end_bio_extent_writepage
0.33 ± 3% -0.1 0.27 ± 12% perf-profile.children.cycles-pp.set_extent_buffer_dirty
0.17 ± 12% -0.1 0.11 ± 23% perf-profile.children.cycles-pp.clear_page_dirty_for_io
0.10 ± 12% -0.1 0.05 ± 62% perf-profile.children.cycles-pp.___might_sleep
0.11 ± 17% -0.1 0.06 ± 63% perf-profile.children.cycles-pp.alloc_extent_state
0.08 ± 10% -0.1 0.03 ±100% perf-profile.children.cycles-pp.__x64_sys_gettimeofday
0.28 ± 4% -0.1 0.23 ± 14% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.18 ± 15% -0.1 0.13 ± 14% perf-profile.children.cycles-pp.btrfs_search_forward
0.14 ± 9% -0.1 0.09 ± 12% perf-profile.children.cycles-pp.push_leaf_right
0.13 ± 10% -0.0 0.08 ± 10% perf-profile.children.cycles-pp.__clear_extent_bit
0.10 ± 12% -0.0 0.05 ± 59% perf-profile.children.cycles-pp.fill_inode_item
0.09 ± 8% -0.0 0.05 ± 62% perf-profile.children.cycles-pp.crc32c_pcl_intel_update
0.11 ± 10% -0.0 0.06 ± 58% perf-profile.children.cycles-pp.__mod_lruvec_state
0.09 ± 13% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.check_inode_key
0.07 ± 10% -0.0 0.03 ±100% perf-profile.children.cycles-pp.inode_tree_add
0.07 ± 6% -0.0 0.03 ±100% perf-profile.children.cycles-pp.__extent_writepage_io
0.15 ± 7% -0.0 0.11 ± 15% perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
0.23 ± 6% -0.0 0.19 ± 7% perf-profile.children.cycles-pp.end_extent_writepage
0.23 ± 6% -0.0 0.19 ± 7% perf-profile.children.cycles-pp.btrfs_writepage_endio_finish_ordered
0.17 ± 6% -0.0 0.13 ± 15% perf-profile.children.cycles-pp.btrfs_set_token_32
0.07 ± 6% -0.0 0.03 ±100% perf-profile.children.cycles-pp.read
0.08 ± 21% -0.0 0.04 ± 63% perf-profile.children.cycles-pp.copy_user_enhanced_fast_string
0.59 ± 3% -0.0 0.55 ± 2% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.07 ± 7% -0.0 0.03 ±100% perf-profile.children.cycles-pp.kernel_fpu_begin
0.08 ± 15% -0.0 0.04 ± 58% perf-profile.children.cycles-pp.clear_extent_bit
0.11 ± 10% -0.0 0.07 ± 17% perf-profile.children.cycles-pp.__push_leaf_right
0.09 ± 19% -0.0 0.05 ± 60% perf-profile.children.cycles-pp.btrfs_free_path
0.10 ± 12% -0.0 0.07 ± 6% perf-profile.children.cycles-pp.btrfs_read_node_slot
0.09 ± 38% -0.0 0.05 ± 8% perf-profile.children.cycles-pp.drop_objectid_items
0.09 ± 9% -0.0 0.06 ± 14% perf-profile.children.cycles-pp.read_tree_block
0.09 ± 14% -0.0 0.06 ± 17% perf-profile.children.cycles-pp.btrfs_log_all_xattrs
0.10 ± 5% -0.0 0.07 ± 13% perf-profile.children.cycles-pp.write_extent_buffer
0.10 ± 21% -0.0 0.07 ± 26% perf-profile.children.cycles-pp.prepare_pages
0.07 ± 19% -0.0 0.04 ± 57% perf-profile.children.cycles-pp.__xa_set_mark
0.09 ± 7% -0.0 0.07 ± 16% perf-profile.children.cycles-pp.__vfs_getxattr
0.12 ± 7% -0.0 0.10 ± 11% perf-profile.children.cycles-pp.clear_page_erms
0.05 ± 9% +0.0 0.08 ± 8% perf-profile.children.cycles-pp.btrfs_block_rsv_release
0.11 ± 7% +0.0 0.14 ± 7% perf-profile.children.cycles-pp.nr_iowait_cpu
0.08 ± 21% +0.0 0.11 ± 4% perf-profile.children.cycles-pp.rcu_eqs_exit
0.29 ± 7% +0.0 0.32 ± 5% perf-profile.children.cycles-pp.schedule
0.15 ± 20% +0.1 0.21 ± 19% perf-profile.children.cycles-pp.start_transaction
0.13 ± 17% +0.1 0.20 ± 10% perf-profile.children.cycles-pp.schedule_idle
0.43 ± 6% +0.1 0.52 ± 4% perf-profile.children.cycles-pp.__sched_text_start
0.86 ± 6% +0.1 0.96 ± 2% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.23 ± 5% +0.1 0.34 ± 15% perf-profile.children.cycles-pp.__queue_work
0.07 ± 10% +0.1 0.18 ± 21% perf-profile.children.cycles-pp.btrfs_use_block_rsv
0.23 ± 4% +0.2 0.39 ± 7% perf-profile.children.cycles-pp.queue_work_on
0.31 ± 5% +0.2 0.47 ± 21% perf-profile.children.cycles-pp.brd_lookup_page
0.12 ± 33% +0.2 0.31 ± 20% perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes
0.00 +0.2 0.23 ± 13% perf-profile.children.cycles-pp.__btrfs_run_delayed_items
0.13 ± 31% +0.3 0.45 ± 17% perf-profile.children.cycles-pp.flush_space
0.13 ± 31% +0.3 0.48 ± 17% perf-profile.children.cycles-pp.btrfs_async_reclaim_metadata_space
0.69 ± 8% +1.0 1.73 ± 17% perf-profile.children.cycles-pp.write_one_eb
0.19 ± 14% +1.2 1.39 ± 16% perf-profile.children.cycles-pp.submit_extent_page
80.22 +3.8 83.98 ± 2% perf-profile.children.cycles-pp.secondary_startup_64
80.22 +3.8 83.98 ± 2% perf-profile.children.cycles-pp.cpu_startup_entry
80.22 +3.8 83.98 ± 2% perf-profile.children.cycles-pp.do_idle
1.23 ± 5% -0.6 0.67 ± 3% perf-profile.self.cycles-pp._find_next_bit
1.53 ± 2% -0.5 1.04 ± 20% perf-profile.self.cycles-pp.copy_page
1.03 ± 6% -0.3 0.76 ± 19% perf-profile.self.cycles-pp.read_extent_buffer
1.29 ± 3% -0.2 1.08 ± 8% perf-profile.self.cycles-pp._raw_spin_lock
0.45 ± 3% -0.1 0.30 ± 17% perf-profile.self.cycles-pp.btrfs_get_32
0.29 ± 8% -0.1 0.19 ± 19% perf-profile.self.cycles-pp.__percpu_counter_sum
0.29 ± 14% -0.1 0.19 ± 17% perf-profile.self.cycles-pp.btrfs_get_64
0.35 ± 9% -0.1 0.27 ± 15% perf-profile.self.cycles-pp.generic_bin_search
0.23 ± 4% -0.1 0.17 ± 26% perf-profile.self.cycles-pp.__btrfs_cow_block
0.18 ± 11% -0.1 0.12 ± 15% perf-profile.self.cycles-pp.btrfs_get_token_32
0.16 ± 2% -0.1 0.10 ± 12% perf-profile.self.cycles-pp.memzero_extent_buffer
0.10 ± 8% -0.1 0.04 ± 59% perf-profile.self.cycles-pp.___might_sleep
0.17 ± 9% -0.1 0.12 ± 24% perf-profile.self.cycles-pp.check_leaf
0.17 ± 12% -0.0 0.12 ± 17% perf-profile.self.cycles-pp.kmem_cache_alloc
0.08 ± 21% -0.0 0.04 ± 60% perf-profile.self.cycles-pp.copy_user_enhanced_fast_string
0.15 ± 7% -0.0 0.11 ± 14% perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
0.11 ± 11% -0.0 0.08 ± 10% perf-profile.self.cycles-pp.hrtimer_interrupt
0.09 ± 7% -0.0 0.07 ± 13% perf-profile.self.cycles-pp.write_extent_buffer
0.06 ± 6% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.__sched_text_start
0.11 ± 7% +0.0 0.14 ± 8% perf-profile.self.cycles-pp.nr_iowait_cpu
0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.btrfs_end_bio
0.17 ± 4% +0.1 0.27 ± 20% perf-profile.self.cycles-pp.brd_lookup_page
23336 ± 4% +12.3% 26214 ± 2% softirqs.CPU10.SCHED
37060 ± 7% +20.4% 44626 ± 3% softirqs.CPU100.RCU
72376 ± 4% +14.2% 82628 ± 6% softirqs.CPU100.TIMER
38158 ± 6% +15.8% 44173 ± 4% softirqs.CPU101.RCU
23419 +12.2% 26282 ± 3% softirqs.CPU101.SCHED
72977 ± 3% +13.2% 82640 ± 6% softirqs.CPU101.TIMER
36452 ± 6% +19.1% 43426 ± 5% softirqs.CPU102.RCU
22891 +14.4% 26190 ± 2% softirqs.CPU102.SCHED
71951 ± 3% +14.9% 82691 ± 5% softirqs.CPU102.TIMER
36585 ± 7% +18.9% 43489 ± 4% softirqs.CPU103.RCU
22931 +13.7% 26076 ± 3% softirqs.CPU103.SCHED
71487 ± 3% +14.9% 82163 ± 6% softirqs.CPU103.TIMER
37494 ± 4% +16.7% 43759 ± 4% softirqs.CPU104.RCU
72362 ± 4% +12.6% 81512 ± 5% softirqs.CPU104.TIMER
36511 ± 7% +20.3% 43910 ± 3% softirqs.CPU105.RCU
72600 ± 4% +13.9% 82663 ± 6% softirqs.CPU105.TIMER
36685 ± 6% +20.4% 44154 ± 4% softirqs.CPU106.RCU
22849 ± 2% +14.1% 26063 ± 2% softirqs.CPU106.SCHED
71776 ± 3% +14.4% 82085 ± 6% softirqs.CPU106.TIMER
37203 ± 6% +18.7% 44163 ± 3% softirqs.CPU107.RCU
20913 ± 18% +24.9% 26121 ± 3% softirqs.CPU107.SCHED
71859 ± 4% +15.2% 82784 ± 6% softirqs.CPU107.TIMER
36749 ± 5% +18.5% 43545 ± 6% softirqs.CPU108.RCU
22983 +13.3% 26051 ± 3% softirqs.CPU108.SCHED
71500 ± 3% +16.2% 83050 ± 7% softirqs.CPU108.TIMER
37174 ± 3% +18.0% 43869 ± 3% softirqs.CPU109.RCU
71426 ± 4% +15.6% 82585 ± 6% softirqs.CPU109.TIMER
38693 ± 8% +18.2% 45720 softirqs.CPU11.RCU
22879 +11.8% 25589 softirqs.CPU11.SCHED
36400 ± 8% +21.7% 44307 ± 3% softirqs.CPU110.RCU
23017 +14.3% 26311 ± 3% softirqs.CPU110.SCHED
71941 ± 4% +15.1% 82776 ± 6% softirqs.CPU110.TIMER
36644 ± 7% +18.6% 43477 ± 4% softirqs.CPU111.RCU
22935 +13.3% 25995 ± 2% softirqs.CPU111.SCHED
71704 ± 4% +14.8% 82352 ± 5% softirqs.CPU111.TIMER
34791 ± 7% +19.1% 41428 ± 3% softirqs.CPU112.RCU
22931 +13.7% 26072 ± 3% softirqs.CPU112.SCHED
71843 ± 4% +14.2% 82016 ± 6% softirqs.CPU112.TIMER
35167 ± 6% +17.6% 41349 ± 3% softirqs.CPU113.RCU
23073 ± 2% +12.9% 26057 ± 3% softirqs.CPU113.SCHED
36049 ± 5% +19.2% 42957 softirqs.CPU114.RCU
20819 ± 18% +26.7% 26374 ± 2% softirqs.CPU114.SCHED
71628 ± 4% +15.8% 82917 ± 6% softirqs.CPU114.TIMER
34911 ± 7% +21.0% 42248 ± 2% softirqs.CPU115.RCU
70742 ± 5% +15.8% 81922 ± 5% softirqs.CPU115.TIMER
35469 ± 6% +18.9% 42188 softirqs.CPU116.RCU
23098 +12.9% 26082 ± 2% softirqs.CPU116.SCHED
36436 ± 3% +13.3% 41297 ± 3% softirqs.CPU117.RCU
20572 ± 18% +29.1% 26559 softirqs.CPU117.SCHED
72220 ± 3% +24.7% 90085 ± 8% softirqs.CPU117.TIMER
35180 ± 6% +18.7% 41774 ± 2% softirqs.CPU118.RCU
22950 ± 2% +13.7% 26085 ± 3% softirqs.CPU118.SCHED
72136 ± 4% +13.7% 82032 ± 6% softirqs.CPU118.TIMER
34925 ± 6% +21.6% 42479 ± 5% softirqs.CPU119.RCU
22776 ± 2% +13.7% 25902 ± 2% softirqs.CPU119.SCHED
71796 ± 4% +14.2% 82002 ± 6% softirqs.CPU119.TIMER
38918 ± 9% +17.0% 45550 softirqs.CPU12.RCU
22765 +13.3% 25791 ± 3% softirqs.CPU12.SCHED
36632 ± 4% +15.0% 42126 ± 2% softirqs.CPU121.RCU
23637 ± 3% +10.9% 26208 ± 2% softirqs.CPU121.SCHED
36278 ± 4% +17.1% 42476 ± 3% softirqs.CPU122.RCU
23705 +9.9% 26063 ± 2% softirqs.CPU122.SCHED
36158 ± 4% +14.5% 41387 ± 3% softirqs.CPU123.RCU
23593 ± 2% +10.5% 26059 ± 2% softirqs.CPU123.SCHED
36018 ± 4% +14.9% 41372 ± 3% softirqs.CPU124.RCU
21282 ± 20% +22.4% 26043 ± 2% softirqs.CPU124.SCHED
35677 ± 4% +16.5% 41581 ± 3% softirqs.CPU125.RCU
21802 ± 16% +19.9% 26146 ± 2% softirqs.CPU125.SCHED
35555 ± 5% +17.9% 41903 ± 3% softirqs.CPU126.RCU
23628 +10.1% 26006 ± 2% softirqs.CPU126.SCHED
35465 ± 4% +15.4% 40937 ± 5% softirqs.CPU127.RCU
23621 +10.8% 26167 ± 2% softirqs.CPU127.SCHED
37576 ± 4% +15.8% 43504 ± 4% softirqs.CPU128.RCU
23632 +10.7% 26157 ± 2% softirqs.CPU128.SCHED
37710 ± 3% +14.6% 43203 ± 3% softirqs.CPU129.RCU
23662 +10.6% 26178 ± 2% softirqs.CPU129.SCHED
39596 ± 7% +16.8% 46237 softirqs.CPU13.RCU
22709 +12.1% 25461 ± 2% softirqs.CPU13.SCHED
37673 ± 5% +14.4% 43105 ± 4% softirqs.CPU130.RCU
23669 +9.0% 25800 ± 3% softirqs.CPU130.SCHED
37396 ± 5% +15.8% 43323 ± 4% softirqs.CPU131.RCU
23551 ± 2% +10.5% 26027 ± 2% softirqs.CPU131.SCHED
37645 ± 3% +13.6% 42781 ± 4% softirqs.CPU132.RCU
23679 +9.6% 25963 ± 2% softirqs.CPU132.SCHED
36737 ± 4% +16.3% 42734 ± 4% softirqs.CPU133.RCU
23518 ± 2% +11.0% 26110 ± 2% softirqs.CPU133.SCHED
36985 ± 4% +18.8% 43939 ± 2% softirqs.CPU134.RCU
23471 ± 2% +11.7% 26218 ± 2% softirqs.CPU134.SCHED
37888 ± 2% +15.1% 43606 ± 4% softirqs.CPU135.RCU
23588 +10.3% 26025 ± 2% softirqs.CPU135.SCHED
37660 ± 5% +15.2% 43382 ± 4% softirqs.CPU136.RCU
23541 ± 2% +10.6% 26031 ± 2% softirqs.CPU136.SCHED
37788 ± 5% +16.7% 44099 ± 4% softirqs.CPU137.RCU
23576 ± 2% +10.6% 26085 ± 2% softirqs.CPU137.SCHED
37342 ± 5% +15.9% 43284 ± 4% softirqs.CPU138.RCU
23612 ± 2% +10.5% 26099 ± 2% softirqs.CPU138.SCHED
37334 ± 4% +15.6% 43160 softirqs.CPU139.RCU
23611 ± 2% +10.9% 26196 ± 2% softirqs.CPU139.SCHED
39043 ± 10% +16.0% 45285 softirqs.CPU14.RCU
22623 +12.7% 25501 softirqs.CPU14.SCHED
37910 ± 3% +15.6% 43818 ± 3% softirqs.CPU140.RCU
23741 +9.9% 26096 ± 2% softirqs.CPU140.SCHED
37385 ± 5% +15.9% 43314 ± 2% softirqs.CPU141.RCU
23644 +10.2% 26055 ± 2% softirqs.CPU141.SCHED
37687 ± 4% +14.7% 43214 ± 2% softirqs.CPU142.RCU
23584 +10.9% 26146 ± 2% softirqs.CPU142.SCHED
37464 ± 4% +15.4% 43242 ± 3% softirqs.CPU143.RCU
23566 ± 2% +10.3% 25996 ± 2% softirqs.CPU143.SCHED
40618 ± 5% +11.8% 45399 ± 3% softirqs.CPU144.RCU
38922 +14.9% 44714 ± 3% softirqs.CPU145.RCU
23349 ± 2% +12.8% 26328 ± 3% softirqs.CPU145.SCHED
37845 ± 4% +18.6% 44899 ± 3% softirqs.CPU146.RCU
37671 ± 3% +15.5% 43498 ± 6% softirqs.CPU147.RCU
22851 ± 5% +14.4% 26151 ± 3% softirqs.CPU147.SCHED
37970 ± 2% +15.0% 43682 ± 5% softirqs.CPU148.RCU
23319 ± 2% +12.3% 26190 ± 3% softirqs.CPU148.SCHED
37415 ± 5% +17.2% 43849 ± 6% softirqs.CPU149.RCU
20611 ± 18% +26.8% 26135 ± 3% softirqs.CPU149.SCHED
37987 ± 9% +19.2% 45267 softirqs.CPU15.RCU
22407 +13.9% 25527 softirqs.CPU15.SCHED
37807 ± 4% +14.6% 43309 ± 6% softirqs.CPU150.RCU
23166 ± 3% +12.2% 26004 ± 3% softirqs.CPU150.SCHED
39077 ± 7% +14.0% 44559 ± 6% softirqs.CPU151.RCU
23259 ± 3% +12.5% 26171 ± 3% softirqs.CPU151.SCHED
38494 ± 2% +15.8% 44559 ± 5% softirqs.CPU152.RCU
23514 ± 3% +11.7% 26263 ± 2% softirqs.CPU152.SCHED
38100 ± 2% +16.3% 44296 ± 4% softirqs.CPU153.RCU
23340 ± 3% +12.4% 26244 ± 2% softirqs.CPU153.SCHED
37440 ± 5% +17.5% 43999 ± 6% softirqs.CPU154.RCU
19448 ± 30% +34.6% 26179 ± 2% softirqs.CPU154.SCHED
38227 ± 3% +15.3% 44062 ± 5% softirqs.CPU155.RCU
23320 ± 3% +12.4% 26201 ± 3% softirqs.CPU155.SCHED
37553 ± 5% +18.3% 44424 ± 5% softirqs.CPU156.RCU
23197 ± 2% +13.1% 26244 ± 2% softirqs.CPU156.SCHED
37353 ± 5% +20.4% 44987 ± 4% softirqs.CPU157.RCU
23166 ± 2% +13.8% 26353 softirqs.CPU157.SCHED
37654 ± 4% +17.4% 44190 ± 6% softirqs.CPU158.RCU
23158 ± 3% +13.3% 26250 ± 2% softirqs.CPU158.SCHED
38038 ± 2% +16.8% 44436 ± 4% softirqs.CPU159.RCU
23278 ± 2% +12.9% 26277 ± 2% softirqs.CPU159.SCHED
37825 ± 5% +17.2% 44334 ± 4% softirqs.CPU16.RCU
22657 ± 2% +12.3% 25436 softirqs.CPU16.SCHED
37508 ± 6% +16.2% 43574 ± 7% softirqs.CPU160.RCU
23213 ± 3% +12.7% 26153 ± 2% softirqs.CPU160.SCHED
38423 ± 2% +13.1% 43467 ± 7% softirqs.CPU161.RCU
23571 ± 3% +11.0% 26162 ± 2% softirqs.CPU161.SCHED
37438 ± 4% +15.3% 43184 ± 8% softirqs.CPU162.RCU
23250 ± 3% +11.8% 25986 ± 3% softirqs.CPU162.SCHED
37704 ± 4% +15.9% 43713 ± 5% softirqs.CPU163.RCU
23230 ± 2% +12.8% 26202 ± 2% softirqs.CPU163.SCHED
37535 ± 5% +16.0% 43549 ± 6% softirqs.CPU164.RCU
37824 ± 5% +16.0% 43879 ± 6% softirqs.CPU165.RCU
23221 ± 2% +13.1% 26261 ± 2% softirqs.CPU165.SCHED
37490 ± 5% +15.9% 43458 ± 7% softirqs.CPU166.RCU
23155 ± 3% +13.3% 26223 ± 2% softirqs.CPU166.SCHED
37588 ± 6% +15.1% 43267 ± 7% softirqs.CPU167.RCU
23221 ± 3% +12.7% 26170 ± 2% softirqs.CPU167.SCHED
35517 ± 2% +22.4% 43476 ± 5% softirqs.CPU168.RCU
23310 ± 2% +16.1% 27051 softirqs.CPU168.SCHED
76093 ± 8% +13.8% 86580 softirqs.CPU168.TIMER
35691 +18.6% 42316 ± 3% softirqs.CPU169.RCU
23288 ± 2% +15.2% 26818 softirqs.CPU169.SCHED
76751 ± 8% +13.0% 86714 ± 2% softirqs.CPU169.TIMER
37125 ± 7% +19.9% 44524 ± 4% softirqs.CPU17.RCU
22629 +12.0% 25345 softirqs.CPU17.SCHED
35606 ± 2% +17.0% 41656 ± 3% softirqs.CPU170.RCU
23461 ± 2% +13.3% 26582 softirqs.CPU170.SCHED
35976 +16.4% 41875 ± 3% softirqs.CPU171.RCU
23419 ± 2% +14.1% 26718 softirqs.CPU171.SCHED
35525 ± 2% +17.7% 41829 ± 3% softirqs.CPU172.RCU
23331 ± 2% +13.8% 26555 softirqs.CPU172.SCHED
35040 ± 2% +17.2% 41052 ± 5% softirqs.CPU173.RCU
23809 ± 2% +11.0% 26433 ± 2% softirqs.CPU173.SCHED
35464 ± 2% +16.0% 41153 ± 4% softirqs.CPU174.RCU
23458 ± 3% +12.6% 26412 softirqs.CPU174.SCHED
35984 ± 3% +13.7% 40924 ± 5% softirqs.CPU175.RCU
23623 ± 2% +11.5% 26343 ± 2% softirqs.CPU175.SCHED
23485 ± 2% +12.5% 26417 ± 2% softirqs.CPU176.SCHED
37325 +13.8% 42467 ± 6% softirqs.CPU177.RCU
23422 ± 2% +13.0% 26459 ± 2% softirqs.CPU177.SCHED
37252 +15.8% 43134 ± 5% softirqs.CPU178.RCU
23362 ± 2% +13.4% 26497 softirqs.CPU178.SCHED
23398 ± 2% +13.0% 26438 ± 2% softirqs.CPU179.SCHED
77017 ± 9% +11.9% 86217 ± 2% softirqs.CPU179.TIMER
38417 ± 6% +16.0% 44570 ± 4% softirqs.CPU18.RCU
22927 ± 3% +11.1% 25465 softirqs.CPU18.SCHED
37203 +14.4% 42565 ± 6% softirqs.CPU180.RCU
23461 ± 2% +13.1% 26536 softirqs.CPU180.SCHED
36948 +16.0% 42862 ± 4% softirqs.CPU181.RCU
20978 ± 20% +26.3% 26496 softirqs.CPU181.SCHED
76051 ± 8% +15.5% 87850 ± 2% softirqs.CPU181.TIMER
37023 +15.8% 42889 ± 4% softirqs.CPU182.RCU
23354 ± 2% +13.8% 26573 softirqs.CPU182.SCHED
37052 +15.3% 42710 ± 5% softirqs.CPU183.RCU
23340 ± 2% +13.2% 26425 ± 2% softirqs.CPU183.SCHED
37500 ± 2% +15.3% 43245 ± 4% softirqs.CPU184.RCU
23303 ± 2% +13.9% 26547 softirqs.CPU184.SCHED
37722 ± 2% +14.2% 43089 ± 5% softirqs.CPU185.RCU
23411 ± 2% +12.8% 26415 ± 2% softirqs.CPU185.SCHED
37432 ± 3% +13.4% 42436 ± 5% softirqs.CPU186.RCU
23261 ± 2% +13.8% 26466 softirqs.CPU186.SCHED
37440 ± 2% +16.2% 43509 ± 7% softirqs.CPU187.RCU
23350 ± 2% +13.5% 26513 softirqs.CPU187.SCHED
77139 ± 8% +12.4% 86739 softirqs.CPU187.TIMER
37036 +15.5% 42762 ± 5% softirqs.CPU188.RCU
23398 ± 2% +13.2% 26478 ± 2% softirqs.CPU188.SCHED
37092 +15.5% 42852 ± 6% softirqs.CPU189.RCU
23406 ± 2% +13.5% 26562 ± 2% softirqs.CPU189.SCHED
76788 ± 9% +13.0% 86780 ± 2% softirqs.CPU189.TIMER
37797 ± 6% +20.8% 45658 ± 4% softirqs.CPU19.RCU
37235 +17.3% 43659 ± 8% softirqs.CPU190.RCU
23416 ± 2% +13.1% 26484 ± 2% softirqs.CPU190.SCHED
76806 ± 9% +12.9% 86678 softirqs.CPU190.TIMER
37436 +15.0% 43044 ± 6% softirqs.CPU191.RCU
23377 ± 2% +12.9% 26404 ± 2% softirqs.CPU191.SCHED
76873 ± 8% +13.1% 86951 softirqs.CPU191.TIMER
24154 ± 4% +11.6% 26960 ± 5% softirqs.CPU2.SCHED
37715 ± 4% +18.5% 44682 ± 4% softirqs.CPU20.RCU
37334 ± 7% +20.6% 45015 ± 3% softirqs.CPU21.RCU
22774 +12.6% 25636 ± 2% softirqs.CPU21.SCHED
37209 ± 7% +18.6% 44117 ± 3% softirqs.CPU22.RCU
22842 +11.1% 25385 softirqs.CPU22.SCHED
36989 ± 8% +20.4% 44542 ± 3% softirqs.CPU23.RCU
22408 +13.4% 25414 ± 2% softirqs.CPU23.SCHED
38552 ± 7% +16.4% 44873 ± 4% softirqs.CPU27.RCU
38113 ± 5% +16.2% 44294 ± 4% softirqs.CPU28.RCU
36818 ± 4% +21.1% 44594 ± 3% softirqs.CPU29.RCU
21560 ± 21% +21.5% 26203 ± 4% softirqs.CPU3.SCHED
37247 ± 4% +18.8% 44250 ± 4% softirqs.CPU30.RCU
37095 ± 4% +17.3% 43501 ± 8% softirqs.CPU31.RCU
23029 ± 2% +12.5% 25914 ± 2% softirqs.CPU31.SCHED
41431 ± 3% +14.9% 47594 ± 2% softirqs.CPU32.RCU
39993 +19.4% 47763 softirqs.CPU33.RCU
40773 ± 2% +15.9% 47242 softirqs.CPU34.RCU
40747 ± 2% +16.5% 47480 softirqs.CPU35.RCU
41402 +15.3% 47742 softirqs.CPU36.RCU
41868 ± 3% +14.4% 47901 softirqs.CPU37.RCU
40723 +17.7% 47935 softirqs.CPU38.RCU
41219 ± 2% +15.3% 47544 softirqs.CPU39.RCU
41121 ± 4% +10.4% 45417 softirqs.CPU4.RCU
23445 ± 4% +9.5% 25678 softirqs.CPU4.SCHED
40413 +17.1% 47316 softirqs.CPU40.RCU
40777 ± 2% +17.0% 47714 softirqs.CPU41.RCU
41548 ± 2% +15.2% 47866 softirqs.CPU42.RCU
41292 +16.0% 47893 softirqs.CPU43.RCU
41525 ± 3% +13.3% 47055 softirqs.CPU44.RCU
40733 ± 2% +15.7% 47132 softirqs.CPU45.RCU
40454 +17.5% 47527 softirqs.CPU46.RCU
40582 +15.7% 46961 softirqs.CPU47.RCU
74808 ± 6% +7.6% 80484 ± 4% softirqs.CPU48.TIMER
39358 ± 8% +17.4% 46210 softirqs.CPU5.RCU
22888 ± 2% +11.7% 25577 ± 2% softirqs.CPU5.SCHED
42157 ± 4% +19.9% 50540 ± 11% softirqs.CPU50.RCU
42221 ± 4% +15.0% 48568 ± 4% softirqs.CPU51.RCU
41570 ± 2% +16.5% 48416 ± 2% softirqs.CPU52.RCU
23013 ± 2% +11.5% 25653 ± 2% softirqs.CPU52.SCHED
41498 +16.0% 48155 ± 2% softirqs.CPU53.RCU
22925 ± 2% +11.5% 25566 softirqs.CPU53.SCHED
40689 ± 2% +20.3% 48965 ± 5% softirqs.CPU54.RCU
22868 ± 2% +12.8% 25793 ± 2% softirqs.CPU54.SCHED
40553 +18.6% 48079 ± 2% softirqs.CPU55.RCU
22865 ± 2% +12.1% 25628 ± 2% softirqs.CPU55.SCHED
40568 +19.2% 48339 ± 3% softirqs.CPU56.RCU
22890 ± 2% +12.3% 25697 softirqs.CPU56.SCHED
41044 +16.8% 47944 ± 2% softirqs.CPU57.RCU
22986 ± 2% +11.2% 25565 softirqs.CPU57.SCHED
40776 +19.7% 48815 softirqs.CPU58.RCU
22916 ± 2% +11.5% 25559 softirqs.CPU58.SCHED
41186 +17.6% 48451 ± 2% softirqs.CPU59.RCU
22939 ± 2% +11.5% 25583 softirqs.CPU59.SCHED
38904 ± 8% +19.0% 46315 softirqs.CPU6.RCU
22878 ± 2% +11.7% 25564 ± 3% softirqs.CPU6.SCHED
39689 +19.8% 47555 ± 2% softirqs.CPU60.RCU
22936 ± 2% +11.5% 25585 softirqs.CPU60.SCHED
40190 +18.9% 47783 ± 2% softirqs.CPU61.RCU
40331 +18.5% 47778 ± 2% softirqs.CPU62.RCU
22847 ± 2% +11.9% 25561 softirqs.CPU62.SCHED
40616 +18.2% 48015 ± 2% softirqs.CPU63.RCU
22895 ± 2% +12.1% 25668 softirqs.CPU63.SCHED
39812 ± 2% +15.3% 45906 ± 3% softirqs.CPU64.RCU
22938 ± 2% +11.6% 25605 softirqs.CPU64.SCHED
40162 ± 3% +15.6% 46409 ± 4% softirqs.CPU65.RCU
22949 ± 2% +11.3% 25536 softirqs.CPU65.SCHED
39068 ± 5% +17.0% 45717 ± 4% softirqs.CPU66.RCU
22966 ± 2% +12.0% 25732 ± 2% softirqs.CPU66.SCHED
39653 ± 3% +17.2% 46480 ± 3% softirqs.CPU67.RCU
22857 ± 2% +12.6% 25739 ± 2% softirqs.CPU67.SCHED
39752 ± 2% +15.2% 45788 ± 3% softirqs.CPU68.RCU
22960 ± 2% +11.4% 25582 softirqs.CPU68.SCHED
40083 +14.3% 45820 ± 3% softirqs.CPU69.RCU
23027 ± 2% +11.1% 25587 softirqs.CPU69.SCHED
39790 ± 12% +19.6% 47584 ± 2% softirqs.CPU7.RCU
39400 ± 4% +18.4% 46646 ± 3% softirqs.CPU70.RCU
22875 ± 2% +12.5% 25729 softirqs.CPU70.SCHED
40221 ± 3% +15.2% 46339 ± 3% softirqs.CPU71.RCU
23196 ± 2% +10.3% 25579 softirqs.CPU71.SCHED
38088 ± 2% +104.1% 77745 ± 74% softirqs.CPU72.RCU
22775 ± 2% +43.9% 32770 ± 39% softirqs.CPU72.SCHED
37394 ± 2% +33.9% 50070 ± 21% softirqs.CPU73.RCU
22540 ± 2% +20.3% 27124 ± 10% softirqs.CPU73.SCHED
37147 ± 2% +20.5% 44764 ± 3% softirqs.CPU74.RCU
22567 ± 3% +14.8% 25902 ± 3% softirqs.CPU74.SCHED
37254 ± 3% +18.5% 44164 ± 2% softirqs.CPU75.RCU
22518 ± 2% +14.7% 25838 ± 3% softirqs.CPU75.SCHED
37196 ± 2% +16.9% 43495 ± 2% softirqs.CPU76.RCU
22474 ± 2% +13.9% 25605 softirqs.CPU76.SCHED
37634 ± 3% +15.1% 43319 ± 3% softirqs.CPU77.RCU
20355 ± 19% +25.2% 25491 softirqs.CPU77.SCHED
37561 ± 2% +15.6% 43428 ± 3% softirqs.CPU78.RCU
37383 ± 3% +17.5% 43937 softirqs.CPU79.RCU
22520 ± 2% +13.6% 25577 softirqs.CPU79.SCHED
38851 ± 8% +17.7% 45730 softirqs.CPU8.RCU
22688 +12.5% 25532 softirqs.CPU8.SCHED
38049 +16.3% 44269 ± 3% softirqs.CPU80.RCU
22511 ± 2% +14.0% 25651 softirqs.CPU80.SCHED
38445 +16.3% 44698 ± 2% softirqs.CPU81.RCU
22534 ± 2% +13.7% 25626 softirqs.CPU81.SCHED
38367 +18.0% 45261 softirqs.CPU82.RCU
22543 ± 2% +13.6% 25608 softirqs.CPU82.SCHED
38628 +16.9% 45158 ± 2% softirqs.CPU83.RCU
22497 ± 2% +13.2% 25462 softirqs.CPU83.SCHED
38136 +18.2% 45067 softirqs.CPU84.RCU
22189 ± 3% +15.8% 25692 softirqs.CPU84.SCHED
38459 +16.2% 44671 ± 3% softirqs.CPU85.RCU
22578 ± 2% +13.3% 25572 softirqs.CPU85.SCHED
38472 ± 2% +15.5% 44432 ± 3% softirqs.CPU86.RCU
22668 ± 2% +12.5% 25512 softirqs.CPU86.SCHED
38427 +15.8% 44517 ± 2% softirqs.CPU87.RCU
22511 ± 2% +13.0% 25431 softirqs.CPU87.SCHED
38795 ± 2% +15.9% 44976 softirqs.CPU88.RCU
22446 ± 2% +14.2% 25629 softirqs.CPU88.SCHED
39034 +17.1% 45723 softirqs.CPU89.RCU
22422 ± 2% +14.0% 25569 softirqs.CPU89.SCHED
39295 ± 5% +16.6% 45827 ± 2% softirqs.CPU9.RCU
22890 ± 2% +11.4% 25508 softirqs.CPU9.SCHED
38748 +17.1% 45365 softirqs.CPU90.RCU
22384 ± 2% +15.4% 25822 softirqs.CPU90.SCHED
38370 +16.7% 44793 softirqs.CPU91.RCU
22412 ± 2% +13.7% 25493 softirqs.CPU91.SCHED
38256 +16.0% 44386 ± 2% softirqs.CPU92.RCU
22484 ± 2% +13.5% 25510 softirqs.CPU92.SCHED
38592 ± 2% +15.2% 44446 ± 3% softirqs.CPU93.RCU
22485 ± 2% +12.9% 25388 softirqs.CPU93.SCHED
38636 +15.8% 44729 ± 3% softirqs.CPU94.RCU
22631 ± 2% +12.4% 25427 softirqs.CPU94.SCHED
39104 +14.7% 44866 ± 5% softirqs.CPU95.RCU
39894 ± 3% +13.4% 45224 ± 5% softirqs.CPU96.RCU
39210 ± 2% +15.8% 45419 ± 5% softirqs.CPU97.RCU
23501 ± 3% +12.9% 26539 ± 3% softirqs.CPU97.SCHED
70819 ± 4% +15.5% 81767 ± 5% softirqs.CPU97.TIMER
37452 ± 3% +17.9% 44143 ± 2% softirqs.CPU98.RCU
23119 ± 2% +13.6% 26253 ± 3% softirqs.CPU98.SCHED
71306 ± 2% +15.7% 82467 ± 6% softirqs.CPU98.TIMER
37239 ± 4% +17.6% 43794 ± 2% softirqs.CPU99.RCU
23219 ± 2% +12.8% 26190 ± 2% softirqs.CPU99.SCHED
72423 ± 3% +13.9% 82474 ± 6% softirqs.CPU99.TIMER
7528698 +16.2% 8745025 softirqs.RCU
4441833 +11.8% 4964631 softirqs.SCHED
14417750 ± 4% +9.3% 15759607 softirqs.TIMER
fsmark.time.system_time
180 +---------------------------------------------------------------------+
| O O O O O O |
175 |-+ O O O O O O O O O O O O |
| |
170 |-+ O O O |
| |
165 |-+ |
| |
160 |-+ |
| |
155 |-+ + +.. |
| +..+.+. + + : +.+.+..+.+. .+.+.+.. .+. .+.+. .+.|
150 |++ +..+ +..+. : +. + +. +..+.+.+. |
| + |
145 +---------------------------------------------------------------------+
fsmark.time.elapsed_time
200 +---------------------------------------------------------------------+
| O |
195 |-+ O |
190 |-O O O O O O O O |
| O O O O O O O O O |
185 |-+ O O |
| O |
180 |-+ |
| |
175 |-+ |
170 |-+ |
| +.. + +.. |
165 |:+ +.+.+.. + + .+ : +.+.+..+.+. .+.+.+..+.+. .+.+. .+. .+..+.|
|: + +. + : +. +. +. + |
160 +---------------------------------------------------------------------+
fsmark.time.elapsed_time.max
200 +---------------------------------------------------------------------+
| O |
195 |-+ O |
190 |-O O O O O O O O |
| O O O O O O O O O |
185 |-+ O O |
| O |
180 |-+ |
| |
175 |-+ |
170 |-+ |
| +.. + +.. |
165 |:+ +.+.+.. + + .+ : +.+.+..+.+. .+.+.+..+.+. .+.+. .+. .+..+.|
|: + +. + : +. +. +. + |
160 +---------------------------------------------------------------------+
fsmark.time.voluntary_context_switches
1.3e+06 +----------------------------------------------------------------+
| O O O O O |
1.28e+06 |-+ O O O O O O O O O O O O |
1.26e+06 |-+ O O O O O |
| |
1.24e+06 |-+ |
| |
1.22e+06 |-+ |
| |
1.2e+06 |-+ |
1.18e+06 |-+ |
| |
1.16e+06 |-+ +. |
|.+.+..+. .+.+. .+..+.+.+.+.+.+..+. .+. + +..+.+.+.+.+.+.. .+.+.|
1.14e+06 +----------------------------------------------------------------+
fsmark.files_per_sec
6600 +--------------------------------------------------------------------+
|: |
6400 |:+ .+ +. .+. .+. .+..+. .+.+.+.+.. |
| +..+.+.+. + + +. +.+..+.+.+..+ +.+..+.+ +.+. +.|
6200 |-+ + |
| |
6000 |-+ |
| |
5800 |-+ |
| |
5600 |-+ O |
| O O O O O O O O O O O O O O O |
5400 |-O O O O O |
| O |
5200 +--------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2ap1: 192 threads Intel(R) Xeon(R) CPU @ 2.20GHz with 192G memory
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/ucode:
4k/gcc-9/performance/1SSD/btrfs/sync/x86_64-rhel-8.3/8/debian-10.4-x86_64-20200603.cgz/300s/randwrite/lkp-csl-2ap1/512g/fio-basic/0x4002f01
commit:
f8d6c28b2a ("block: lift setting the readahead size into the block layer")
54529aac98 ("block: make QUEUE_SYSFS_BIT_FNS a little more useful")
f8d6c28b2a8e1156 54529aac984de8d3928810c85b5
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 kmsg.ACPI_Error
:4 8% 0:4 perf-profile.children.cycles-pp.error_entry
:4 5% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
0.01 ± 58% +10.6 10.63 ± 9% fio.latency_100us%
51.65 ± 6% -51.1 0.58 ± 4% fio.latency_10ms%
0.02 ± 87% +0.8 0.86 ± 7% fio.latency_10us%
32.23 ± 11% -32.1 0.16 ± 7% fio.latency_20ms%
0.00 ±173% +3.1 3.14 ± 56% fio.latency_20us%
0.00 ±173% +2.8 2.83 ± 3% fio.latency_250us%
0.02 ± 82% +0.2 0.23 ± 7% fio.latency_2ms%
12.31 ± 7% -12.2 0.12 ± 12% fio.latency_50ms%
0.02 ± 28% +78.8 78.79 fio.latency_50us%
23.52 ± 3% +1179.5% 300.87 fio.time.elapsed_time
23.52 ± 3% +1179.5% 300.87 fio.time.elapsed_time.max
8.00 -100.0% 0.00 fio.time.exit_status
132284 +14274.3% 19014850 ± 2% fio.time.file_system_outputs
142.50 ± 5% -82.1% 25.50 ± 4% fio.time.percent_of_cpu_this_job_got
0.68 ± 4% +6643.4% 45.86 ± 2% fio.time.system_time
19211 +11893.5% 2304104 ± 4% fio.time.voluntary_context_switches
16460 +14337.0% 2376400 ± 2% fio.workload
2.83 ± 3% +993.7% 30.93 ± 2% fio.write_bw_MBps
20840448 ± 2% -99.7% 61056 fio.write_clat_90%_us
23068672 ± 2% -99.1% 196608 fio.write_clat_95%_us
26411008 -75.1% 6586368 ± 6% fio.write_clat_99%_us
11056088 ± 3% -90.9% 1010419 ± 2% fio.write_clat_mean_us
5848402 ± 3% +119.9% 12862343 ± 3% fio.write_clat_stddev
724.45 ± 3% +993.0% 7918 ± 2% fio.write_iops
1.88 ± 2% +43.6% 2.70 ± 8% iostat.cpu.system
107585 ± 15% +348.6% 482655 ± 3% vmstat.io.bo
1649211 +424.5% 8650204 vmstat.memory.cache
14676 ± 8% +554.5% 96054 ± 2% vmstat.system.cs
8012640 ± 10% +4267.8% 3.5e+08 ± 11% cpuidle.C1.time
64455 ± 8% +22724.8% 14711844 ± 10% cpuidle.C1.usage
171217 ± 6% +9942.7% 17194801 ±153% cpuidle.POLL.time
42308 ± 6% +5631.7% 2424981 ±136% cpuidle.POLL.usage
0.01 ± 22% -0.0 0.00 ±173% mpstat.cpu.all.iowait%
1.49 +0.3 1.77 ± 12% mpstat.cpu.all.irq%
0.21 -0.0 0.17 ± 2% mpstat.cpu.all.soft%
0.21 ± 8% +0.6 0.77 mpstat.cpu.all.sys%
0.85 ± 5% -0.8 0.08 ± 7% mpstat.cpu.all.usr%
167858 ± 67% +1154.4% 2105580 ± 67% numa-numastat.node0.local_node
183324 ± 55% +1054.5% 2116435 ± 67% numa-numastat.node0.numa_hit
30888 ± 39% +2842.5% 908884 ±107% numa-numastat.node1.local_node
57286 ± 16% +1527.4% 932306 ±103% numa-numastat.node1.numa_hit
19238 ± 78% +4941.8% 969971 ±112% numa-numastat.node2.local_node
42546 ± 18% +2245.6% 997984 ±109% numa-numastat.node2.numa_hit
9.50 ±110% +52163.2% 4965 ± 58% numa-vmstat.node0.nr_dirty
11440 ± 92% +6398.6% 743442 ± 87% numa-vmstat.node0.nr_inactive_file
30062 ± 14% +237.3% 101404 ± 59% numa-vmstat.node0.nr_slab_unreclaimable
11440 ± 92% +6398.6% 743442 ± 87% numa-vmstat.node0.nr_zone_inactive_file
11.50 ±120% +46078.3% 5310 ± 59% numa-vmstat.node0.nr_zone_write_pending
454661 ± 14% +106.9% 940779 ± 57% numa-vmstat.node1.numa_hit
60255 +581.0% 410314 ±127% numa-vmstat.node2.nr_file_pages
48974 ± 96% -96.0% 1947 ± 33% numa-vmstat.node3.nr_mapped
55.75 ± 97% +35017.5% 19578 ± 58% numa-meminfo.node0.Dirty
45683 ± 92% +6408.1% 2973075 ± 87% numa-meminfo.node0.Inactive(file)
120285 ± 14% +237.2% 405548 ± 59% numa-meminfo.node0.SUnreclaim
167194 ± 18% +352.7% 756837 ± 68% numa-meminfo.node0.Slab
88.50 ±116% +946.6% 926.25 ± 75% numa-meminfo.node0.Writeback
241015 +581.0% 1641234 ±127% numa-meminfo.node2.FilePages
4900 ± 94% +27922.1% 1373152 ±150% numa-meminfo.node2.Inactive
126.75 ±138% +42075.7% 53457 ± 73% numa-meminfo.node3.AnonHugePages
195556 ± 96% -96.0% 7800 ± 33% numa-meminfo.node3.Mapped
391075 ± 2% +242.7% 1340070 meminfo.Active
383506 ± 2% -16.0% 322083 meminfo.Active(anon)
7568 ± 8% +13350.8% 1017986 meminfo.Active(file)
84823 ± 7% +150.7% 212623 meminfo.AnonHugePages
382110 ± 2% -17.5% 315194 meminfo.AnonPages
1533425 +418.0% 7943860 meminfo.Cached
127.25 ± 85% +21697.4% 27737 ± 3% meminfo.Dirty
541161 +996.8% 5935426 ± 2% meminfo.Inactive
151550 +3539.4% 5515485 ± 2% meminfo.Inactive(file)
131567 +424.9% 690598 meminfo.KReclaimable
4029450 +177.4% 11177188 meminfo.Memused
7554 ± 3% -38.9% 4617 meminfo.PageTables
131567 +424.9% 690598 meminfo.SReclaimable
347533 +148.4% 863208 meminfo.SUnreclaim
479100 +224.3% 1553806 meminfo.Slab
233.75 ± 72% +544.3% 1506 ± 3% meminfo.Writeback
178754 ± 3% -70.9% 52052 ± 2% meminfo.max_used_kB
95883 ± 2% -16.0% 80513 proc-vmstat.nr_active_anon
1891 ± 8% +13355.1% 254502 proc-vmstat.nr_active_file
95539 ± 2% -17.5% 78789 proc-vmstat.nr_anon_pages
40.75 ± 8% +153.4% 103.25 proc-vmstat.nr_anon_transparent_hugepages
662355 ± 13% +2858.1% 19592962 ± 3% proc-vmstat.nr_dirtied
32.00 ± 85% +21068.0% 6773 ± 4% proc-vmstat.nr_dirty
383376 +418.2% 1986627 proc-vmstat.nr_file_pages
48424268 -3.7% 46636528 proc-vmstat.nr_free_pages
97409 +7.4% 104645 proc-vmstat.nr_inactive_anon
37888 +3541.9% 1379854 ± 2% proc-vmstat.nr_inactive_file
102723 +6.8% 109689 proc-vmstat.nr_mapped
1889 ± 3% -38.8% 1156 proc-vmstat.nr_page_table_pages
97886 +8.8% 106528 proc-vmstat.nr_shmem
32895 +425.0% 172714 proc-vmstat.nr_slab_reclaimable
86888 +148.4% 215854 proc-vmstat.nr_slab_unreclaimable
56.75 ± 71% +625.1% 411.50 ± 2% proc-vmstat.nr_writeback
662685 ± 13% +2847.8% 19534416 ± 3% proc-vmstat.nr_written
95883 ± 2% -16.0% 80513 proc-vmstat.nr_zone_active_anon
1891 ± 8% +13355.1% 254502 proc-vmstat.nr_zone_active_file
97409 +7.4% 104645 proc-vmstat.nr_zone_inactive_anon
37888 +3541.9% 1379854 ± 2% proc-vmstat.nr_zone_inactive_file
24.75 ± 88% +29648.5% 7362 ± 3% proc-vmstat.nr_zone_write_pending
504181 ± 3% +749.5% 4283048 ± 2% proc-vmstat.numa_hit
411017 ± 3% +919.3% 4189581 ± 2% proc-vmstat.numa_local
114824 ± 17% +86.5% 214154 ± 3% proc-vmstat.pgactivate
496476 ± 3% +870.7% 4819481 proc-vmstat.pgalloc_normal
322549 +320.6% 1356514 proc-vmstat.pgfault
404143 ± 4% +361.1% 1863546 proc-vmstat.pgfree
2727761 ± 13% +5274.4% 1.466e+08 ± 3% proc-vmstat.pgpgout
9.336e+08 ± 3% +83.8% 1.716e+09 ± 5% perf-stat.i.branch-instructions
9432178 +80.2% 16996652 ± 15% perf-stat.i.cache-misses
39024949 ± 2% +123.4% 87179267 ± 45% perf-stat.i.cache-references
14747 ± 7% +555.9% 96725 ± 2% perf-stat.i.context-switches
4.26 ± 2% -53.8% 1.97 ± 12% perf-stat.i.cpi
266.31 -21.3% 209.72 perf-stat.i.cpu-migrations
1928 ± 3% -46.7% 1027 ± 4% perf-stat.i.cycles-between-cache-misses
0.01 ± 13% +0.1 0.09 ± 66% perf-stat.i.dTLB-load-miss-rate%
134104 ± 14% +1375.2% 1978299 ± 61% perf-stat.i.dTLB-load-misses
1.115e+09 ± 5% +99.2% 2.222e+09 ± 4% perf-stat.i.dTLB-loads
5.321e+08 ± 5% +109.0% 1.112e+09 ± 4% perf-stat.i.dTLB-stores
4.63e+09 ± 3% +89.1% 8.758e+09 ± 5% perf-stat.i.instructions
998.21 ± 4% +71.7% 1714 ± 19% perf-stat.i.instructions-per-iTLB-miss
0.26 ± 3% +97.5% 0.52 ± 14% perf-stat.i.ipc
1.53 ± 7% -32.6% 1.03 ± 5% perf-stat.i.metric.K/sec
13.68 ± 4% +95.9% 26.81 ± 4% perf-stat.i.metric.M/sec
8800 -54.0% 4048 perf-stat.i.minor-faults
90.77 -39.9 50.90 ± 45% perf-stat.i.node-load-miss-rate%
153794 ± 19% +1166.2% 1947374 ± 54% perf-stat.i.node-loads
80.08 ± 3% -40.1 39.98 ± 56% perf-stat.i.node-store-miss-rate%
62705 ± 13% +474.6% 360324 ± 39% perf-stat.i.node-stores
8800 -54.0% 4048 perf-stat.i.page-faults
2.22 ± 3% -1.1 1.08 ± 51% perf-stat.overall.branch-miss-rate%
4.29 ± 3% -53.8% 1.98 ± 11% perf-stat.overall.cpi
2106 ± 3% -51.2% 1027 ± 4% perf-stat.overall.cycles-between-cache-misses
0.01 ± 11% +0.1 0.09 ± 65% perf-stat.overall.dTLB-load-miss-rate%
999.21 ± 4% +71.5% 1713 ± 19% perf-stat.overall.instructions-per-iTLB-miss
0.23 ± 3% +119.7% 0.51 ± 13% perf-stat.overall.ipc
90.45 -39.7 50.76 ± 45% perf-stat.overall.node-load-miss-rate%
75.99 ± 2% -35.9 40.08 ± 55% perf-stat.overall.node-store-miss-rate%
6517909 -83.0% 1107486 ± 3% perf-stat.overall.path-length
8.955e+08 ± 3% +91.0% 1.71e+09 ± 5% perf-stat.ps.branch-instructions
9042845 +87.3% 16939980 ± 15% perf-stat.ps.cache-misses
37409555 ± 2% +132.3% 86888536 ± 45% perf-stat.ps.cache-references
14129 ± 7% +582.3% 96408 ± 2% perf-stat.ps.context-switches
183945 +4.0% 191354 perf-stat.ps.cpu-clock
255.33 -18.1% 209.10 perf-stat.ps.cpu-migrations
128676 ± 14% +1432.2% 1971598 ± 61% perf-stat.ps.dTLB-load-misses
1.07e+09 ± 4% +107.1% 2.215e+09 ± 4% perf-stat.ps.dTLB-loads
5.101e+08 ± 5% +117.3% 1.109e+09 ± 4% perf-stat.ps.dTLB-stores
4.441e+09 ± 3% +96.5% 8.729e+09 ± 5% perf-stat.ps.instructions
8474 -52.3% 4038 perf-stat.ps.minor-faults
147537 ± 18% +1215.4% 1940671 ± 54% perf-stat.ps.node-loads
60290 ± 13% +495.7% 359127 ± 39% perf-stat.ps.node-stores
8474 -52.3% 4038 perf-stat.ps.page-faults
183945 +4.0% 191354 perf-stat.ps.task-clock
1.073e+11 +2354.7% 2.634e+12 ± 5% perf-stat.total.instructions
0.70 ± 34% +2.8e+05% 1981 ± 15% sched_debug.cfs_rq:/.exec_clock.avg
28.37 ± 37% +36569.2% 10403 ± 14% sched_debug.cfs_rq:/.exec_clock.max
3.22 ± 25% +76913.6% 2476 ± 12% sched_debug.cfs_rq:/.exec_clock.stddev
1670 ± 28% +1670.3% 29569 ± 18% sched_debug.cfs_rq:/.load.avg
49868 ± 22% +1631.4% 863438 sched_debug.cfs_rq:/.load.max
6915 ± 10% +1859.9% 135538 ± 8% sched_debug.cfs_rq:/.load.stddev
59795 ± 3% +42.9% 85423 ± 2% sched_debug.cfs_rq:/.min_vruntime.avg
82225 ± 4% +25.6% 103292 sched_debug.cfs_rq:/.min_vruntime.max
33527 ± 27% +76.6% 59221 ± 19% sched_debug.cfs_rq:/.min_vruntime.min
141.33 ± 30% -66.2% 47.79 ± 6% sched_debug.cfs_rq:/.runnable_avg.avg
1120 ± 14% -38.5% 689.36 ± 4% sched_debug.cfs_rq:/.runnable_avg.max
235.83 ± 14% -50.2% 117.37 ± 3% sched_debug.cfs_rq:/.runnable_avg.stddev
140.81 ± 30% -66.1% 47.70 ± 6% sched_debug.cfs_rq:/.util_avg.avg
1119 ± 14% -38.4% 689.27 ± 4% sched_debug.cfs_rq:/.util_avg.max
235.51 ± 14% -50.2% 117.31 ± 3% sched_debug.cfs_rq:/.util_avg.stddev
829.50 -48.8% 424.72 ± 32% sched_debug.cfs_rq:/.util_est_enqueued.max
86.99 ± 14% -45.6% 47.32 ± 30% sched_debug.cfs_rq:/.util_est_enqueued.stddev
2530164 ± 48% -52.4% 1204917 ± 8% sched_debug.cpu.avg_idle.max
2063 ± 6% +2333.0% 50205 ± 92% sched_debug.cpu.avg_idle.min
328400 ± 29% -32.6% 221320 ± 11% sched_debug.cpu.avg_idle.stddev
43166 +312.4% 178032 ± 8% sched_debug.cpu.clock.avg
43190 +312.2% 178045 ± 8% sched_debug.cpu.clock.max
43140 +312.7% 178019 ± 8% sched_debug.cpu.clock.min
14.81 ± 21% -48.4% 7.64 ± 7% sched_debug.cpu.clock.stddev
43018 +307.5% 175286 ± 8% sched_debug.cpu.clock_task.avg
43162 +309.7% 176824 ± 8% sched_debug.cpu.clock_task.max
35239 +374.5% 167206 ± 7% sched_debug.cpu.clock_task.min
733.52 ± 3% +53.5% 1126 ± 20% sched_debug.cpu.clock_task.stddev
3600 +120.5% 7939 ± 6% sched_debug.cpu.curr->pid.max
1860093 ± 49% -60.7% 731047 ± 15% sched_debug.cpu.max_idle_balance_cost.max
176803 ± 87% -85.0% 26544 ± 55% sched_debug.cpu.max_idle_balance_cost.stddev
0.00 ± 15% -49.0% 0.00 ± 3% sched_debug.cpu.next_balance.stddev
0.04 ± 25% -51.7% 0.02 ± 16% sched_debug.cpu.nr_running.avg
0.20 ± 13% -31.0% 0.14 ± 6% sched_debug.cpu.nr_running.stddev
1655 +4610.3% 77993 ± 6% sched_debug.cpu.nr_switches.avg
11537 ± 15% +5972.4% 700592 ± 9% sched_debug.cpu.nr_switches.max
512.25 ± 25% +205.8% 1566 ± 7% sched_debug.cpu.nr_switches.min
1163 ± 6% +11814.6% 138586 ± 7% sched_debug.cpu.nr_switches.stddev
0.01 ±122% +693.3% 0.04 ± 4% sched_debug.cpu.nr_uninterruptible.avg
-56.00 -47.4% -29.45 sched_debug.cpu.nr_uninterruptible.min
23.40 ± 71% +3.3e+05% 76414 ± 6% sched_debug.cpu.sched_count.avg
3461 ± 72% +20056.5% 697668 ± 9% sched_debug.cpu.sched_count.max
262.10 ± 73% +52693.5% 138370 ± 7% sched_debug.cpu.sched_count.stddev
11.70 ± 71% +3.3e+05% 38143 ± 6% sched_debug.cpu.sched_goidle.avg
1731 ± 72% +20028.3% 348570 ± 9% sched_debug.cpu.sched_goidle.max
131.13 ± 73% +52628.4% 69142 ± 7% sched_debug.cpu.sched_goidle.stddev
17.01 ± 85% +2.2e+05% 38124 ± 6% sched_debug.cpu.ttwu_count.avg
1939 ± 74% +17590.0% 343054 ± 9% sched_debug.cpu.ttwu_count.max
162.46 ± 78% +42822.7% 69733 ± 6% sched_debug.cpu.ttwu_count.stddev
0.13 ± 59% +2.5e+06% 3222 ± 11% sched_debug.cpu.ttwu_local.avg
9.50 ± 82% +4.1e+05% 39215 ± 16% sched_debug.cpu.ttwu_local.max
0.83 ± 68% +8.1e+05% 6746 ± 7% sched_debug.cpu.ttwu_local.stddev
43145 +312.6% 178019 ± 8% sched_debug.cpu_clk
42272 +319.1% 177145 ± 8% sched_debug.ktime
43503 +310.0% 178377 ± 8% sched_debug.sched_clk
20452 ± 4% +6489.8% 1347781 ± 2% slabinfo.Acpi-State.active_objs
400.75 ± 4% +6501.8% 26456 ± 2% slabinfo.Acpi-State.active_slabs
20462 ± 4% +6494.0% 1349317 ± 2% slabinfo.Acpi-State.num_objs
400.75 ± 4% +6501.8% 26456 ± 2% slabinfo.Acpi-State.num_slabs
542.50 ± 7% +91.9% 1041 ± 22% slabinfo.biovec-max.active_objs
566.75 ± 8% +91.3% 1084 ± 23% slabinfo.biovec-max.num_objs
1627 ± 4% +300.8% 6520 ± 26% slabinfo.blkdev_ioc.active_objs
42.00 ± 5% +323.2% 177.75 ± 26% slabinfo.blkdev_ioc.active_slabs
1648 ± 4% +322.0% 6956 ± 26% slabinfo.blkdev_ioc.num_objs
42.00 ± 5% +323.2% 177.75 ± 26% slabinfo.blkdev_ioc.num_slabs
1198 ± 7% +1193.1% 15501 ± 27% slabinfo.btrfs_ordered_extent.active_objs
30.50 ± 7% +1208.2% 399.00 ± 27% slabinfo.btrfs_ordered_extent.active_slabs
1198 ± 7% +1200.0% 15584 ± 27% slabinfo.btrfs_ordered_extent.num_objs
30.50 ± 7% +1208.2% 399.00 ± 27% slabinfo.btrfs_ordered_extent.num_slabs
2770 +44.8% 4012 ± 19% slabinfo.buffer_head.active_objs
2926 +38.1% 4041 ± 19% slabinfo.buffer_head.num_objs
2121 ± 2% +66.3% 3527 ± 14% slabinfo.dmaengine-unmap-16.active_objs
2121 ± 2% +66.3% 3527 ± 14% slabinfo.dmaengine-unmap-16.num_objs
916.75 ± 6% +12.6% 1032 ± 3% slabinfo.file_lock_cache.active_objs
916.75 ± 6% +12.6% 1032 ± 3% slabinfo.file_lock_cache.num_objs
6444 ± 4% +191.6% 18791 ± 23% slabinfo.fsnotify_mark_connector.active_objs
50.00 ± 4% +195.5% 147.75 ± 23% slabinfo.fsnotify_mark_connector.active_slabs
6444 ± 4% +194.4% 18975 ± 22% slabinfo.fsnotify_mark_connector.num_objs
50.00 ± 4% +195.5% 147.75 ± 23% slabinfo.fsnotify_mark_connector.num_slabs
2831 ± 6% +198.2% 8444 ± 26% slabinfo.khugepaged_mm_slot.active_objs
81.00 ± 5% +193.8% 238.00 ± 26% slabinfo.khugepaged_mm_slot.active_slabs
2933 ± 5% +192.8% 8590 ± 26% slabinfo.khugepaged_mm_slot.num_objs
81.00 ± 5% +193.8% 238.00 ± 26% slabinfo.khugepaged_mm_slot.num_slabs
13293 ± 2% +38.2% 18373 ± 5% slabinfo.kmalloc-1k.active_objs
417.50 ± 2% +39.4% 582.00 ± 5% slabinfo.kmalloc-1k.active_slabs
13381 ± 2% +39.3% 18646 ± 5% slabinfo.kmalloc-1k.num_objs
417.50 ± 2% +39.4% 582.00 ± 5% slabinfo.kmalloc-1k.num_slabs
5546 ± 4% +5.1% 5829 ± 2% slabinfo.kmalloc-rcl-64.active_objs
5546 ± 4% +5.1% 5829 ± 2% slabinfo.kmalloc-rcl-64.num_objs
2413 ± 4% +99.5% 4813 ± 13% slabinfo.mnt_cache.active_objs
2413 ± 4% +99.5% 4814 ± 13% slabinfo.mnt_cache.num_objs
63.00 +207.1% 193.50 ± 16% slabinfo.nfs_read_data.active_objs
63.00 +207.1% 193.50 ± 16% slabinfo.nfs_read_data.num_objs
7194 ± 19% +477.8% 41568 ± 15% slabinfo.numa_policy.active_objs
115.75 ± 19% +494.6% 688.25 ± 15% slabinfo.numa_policy.active_slabs
7210 ± 19% +492.3% 42712 ± 15% slabinfo.numa_policy.num_objs
115.75 ± 19% +494.6% 688.25 ± 15% slabinfo.numa_policy.num_slabs
27102 ± 2% +9805.3% 2684621 ± 2% slabinfo.pid_namespace.active_objs
486.25 ± 2% +9760.2% 47945 ± 2% slabinfo.pid_namespace.active_slabs
27261 ± 2% +9749.0% 2684951 ± 2% slabinfo.pid_namespace.num_objs
486.25 ± 2% +9760.2% 47945 ± 2% slabinfo.pid_namespace.num_slabs
44107 +2207.4% 1017721 slabinfo.radix_tree_node.active_objs
787.25 +2209.0% 18177 slabinfo.radix_tree_node.active_slabs
44119 +2207.3% 1017966 slabinfo.radix_tree_node.num_objs
787.25 +2209.0% 18177 slabinfo.radix_tree_node.num_slabs
688.75 ± 9% +46.1% 1006 ± 8% slabinfo.skbuff_fclone_cache.active_objs
688.75 ± 9% +46.1% 1006 ± 8% slabinfo.skbuff_fclone_cache.num_objs
18421 +43.2% 26371 slabinfo.vmap_area.active_objs
288.00 +43.3% 412.75 slabinfo.vmap_area.active_slabs
18480 +43.1% 26451 slabinfo.vmap_area.num_objs
288.00 +43.3% 412.75 slabinfo.vmap_area.num_slabs
75.50 ± 51% +1125.2% 925.00 ± 84% interrupts.31:PCI-MSI.524289-edge.eth0-TxRx-0
104.25 ± 27% +6685.4% 7073 ±151% interrupts.33:PCI-MSI.524291-edge.eth0-TxRx-2
76.00 ± 51% +3560.9% 2782 ±131% interrupts.34:PCI-MSI.524292-edge.eth0-TxRx-3
49.00 ± 4% +1132.7% 604.00 interrupts.9:IO-APIC.9-fasteoi.acpi
179254 ± 2% +133.6% 418691 ± 13% interrupts.CAL:Function_call_interrupts
1147 ± 23% +202.5% 3469 ± 61% interrupts.CPU0.CAL:Function_call_interrupts
49381 ± 3% +987.1% 536845 ± 21% interrupts.CPU0.LOC:Local_timer_interrupts
1.50 ±173% +18650.0% 281.25 ± 40% interrupts.CPU0.NMI:Non-maskable_interrupts
1.50 ±173% +18650.0% 281.25 ± 40% interrupts.CPU0.PMI:Performance_monitoring_interrupts
16.50 ± 64% +1804.5% 314.25 ± 89% interrupts.CPU0.RES:Rescheduling_interrupts
49.00 ± 4% +1132.7% 604.00 interrupts.CPU1.9:IO-APIC.9-fasteoi.acpi
1280 ± 55% +435.2% 6854 ± 55% interrupts.CPU1.CAL:Function_call_interrupts
49635 ± 3% +981.4% 536765 ± 21% interrupts.CPU1.LOC:Local_timer_interrupts
1.00 ±100% +45525.0% 456.25 ± 65% interrupts.CPU1.NMI:Non-maskable_interrupts
1.00 ±100% +45525.0% 456.25 ± 65% interrupts.CPU1.PMI:Performance_monitoring_interrupts
18.00 ±110% +5736.1% 1050 ± 91% interrupts.CPU1.RES:Rescheduling_interrupts
75.50 ± 51% +1125.2% 925.00 ± 84% interrupts.CPU10.31:PCI-MSI.524289-edge.eth0-TxRx-0
49206 ± 3% +992.3% 537492 ± 21% interrupts.CPU10.LOC:Local_timer_interrupts
858.75 +514.8% 5279 ± 80% interrupts.CPU100.CAL:Function_call_interrupts
49478 ± 3% +983.3% 535977 ± 22% interrupts.CPU100.LOC:Local_timer_interrupts
8.00 ±137% +58053.1% 4652 ± 98% interrupts.CPU100.RES:Rescheduling_interrupts
859.25 +274.4% 3217 ± 42% interrupts.CPU101.CAL:Function_call_interrupts
49288 ± 3% +988.3% 536385 ± 21% interrupts.CPU101.LOC:Local_timer_interrupts
9.50 ±144% +26613.2% 2537 ± 74% interrupts.CPU101.RES:Rescheduling_interrupts
857.75 +343.3% 3802 ± 78% interrupts.CPU102.CAL:Function_call_interrupts
49294 ± 3% +986.2% 535457 ± 22% interrupts.CPU102.LOC:Local_timer_interrupts
9.25 ± 74% +38713.5% 3590 ±103% interrupts.CPU102.RES:Rescheduling_interrupts
875.75 +410.6% 4471 ± 80% interrupts.CPU103.CAL:Function_call_interrupts
49184 ± 3% +989.9% 536056 ± 22% interrupts.CPU103.LOC:Local_timer_interrupts
55.75 ±116% +7516.1% 4246 ±101% interrupts.CPU103.RES:Rescheduling_interrupts
871.75 ± 4% +541.6% 5592 ± 79% interrupts.CPU104.CAL:Function_call_interrupts
49253 ± 3% +987.7% 535737 ± 22% interrupts.CPU104.LOC:Local_timer_interrupts
17.75 ±144% +32245.1% 5741 ± 95% interrupts.CPU104.RES:Rescheduling_interrupts
49276 ± 3% +988.2% 536221 ± 22% interrupts.CPU105.LOC:Local_timer_interrupts
879.75 ± 4% +267.6% 3234 ± 73% interrupts.CPU106.CAL:Function_call_interrupts
49261 ± 3% +989.7% 536797 ± 21% interrupts.CPU106.LOC:Local_timer_interrupts
26.75 ± 99% +10216.8% 2759 ±108% interrupts.CPU106.RES:Rescheduling_interrupts
899.00 ± 6% +335.4% 3914 ± 68% interrupts.CPU107.CAL:Function_call_interrupts
49265 ± 3% +988.4% 536200 ± 21% interrupts.CPU107.LOC:Local_timer_interrupts
871.25 ± 7% +350.8% 3927 ± 55% interrupts.CPU108.CAL:Function_call_interrupts
49259 ± 3% +987.2% 535540 ± 22% interrupts.CPU108.LOC:Local_timer_interrupts
34.75 ±163% +11149.6% 3909 ± 81% interrupts.CPU108.RES:Rescheduling_interrupts
49268 ± 3% +988.4% 536234 ± 22% interrupts.CPU109.LOC:Local_timer_interrupts
0.25 ±173% +2.5e+05% 614.00 ± 38% interrupts.CPU109.NMI:Non-maskable_interrupts
0.25 ±173% +2.5e+05% 614.00 ± 38% interrupts.CPU109.PMI:Performance_monitoring_interrupts
85.75 ±164% +2859.5% 2537 ± 98% interrupts.CPU109.RES:Rescheduling_interrupts
1232 ± 50% +101.6% 2483 ± 59% interrupts.CPU11.CAL:Function_call_interrupts
49302 ± 3% +990.5% 537634 ± 21% interrupts.CPU11.LOC:Local_timer_interrupts
0.75 ±110% +56766.7% 426.50 ± 58% interrupts.CPU11.NMI:Non-maskable_interrupts
0.75 ±110% +56766.7% 426.50 ± 58% interrupts.CPU11.PMI:Performance_monitoring_interrupts
7.00 ±109% +9578.6% 677.50 ± 99% interrupts.CPU11.RES:Rescheduling_interrupts
878.75 ± 5% +314.1% 3638 ± 71% interrupts.CPU110.CAL:Function_call_interrupts
49271 ± 3% +988.4% 536248 ± 21% interrupts.CPU110.LOC:Local_timer_interrupts
28.50 ±105% +12543.9% 3603 ±108% interrupts.CPU110.RES:Rescheduling_interrupts
899.75 ± 4% +255.2% 3196 ± 46% interrupts.CPU111.CAL:Function_call_interrupts
49271 ± 3% +986.9% 535521 ± 22% interrupts.CPU111.LOC:Local_timer_interrupts
66.50 ±151% +3644.0% 2489 ± 82% interrupts.CPU111.RES:Rescheduling_interrupts
902.00 ± 4% +225.4% 2935 ± 40% interrupts.CPU112.CAL:Function_call_interrupts
49268 ± 3% +987.5% 535818 ± 22% interrupts.CPU112.LOC:Local_timer_interrupts
120.75 ±155% +1744.1% 2226 ± 79% interrupts.CPU112.RES:Rescheduling_interrupts
909.00 ± 11% +227.9% 2980 ± 72% interrupts.CPU113.CAL:Function_call_interrupts
49270 ± 3% +988.6% 536338 ± 21% interrupts.CPU113.LOC:Local_timer_interrupts
143.50 ±171% +1817.2% 2751 ±103% interrupts.CPU113.RES:Rescheduling_interrupts
867.50 ± 4% +159.9% 2254 ± 55% interrupts.CPU114.CAL:Function_call_interrupts
49289 ± 3% +987.4% 535968 ± 22% interrupts.CPU114.LOC:Local_timer_interrupts
2.00 ±106% +86737.5% 1736 ±107% interrupts.CPU114.RES:Rescheduling_interrupts
891.00 ± 6% +197.1% 2647 ± 57% interrupts.CPU115.CAL:Function_call_interrupts
49260 ± 3% +988.6% 536235 ± 21% interrupts.CPU115.LOC:Local_timer_interrupts
45.50 ±138% +3636.8% 1700 ± 92% interrupts.CPU115.RES:Rescheduling_interrupts
871.50 ± 4% +230.5% 2880 ± 78% interrupts.CPU116.CAL:Function_call_interrupts
49265 ± 3% +989.0% 536484 ± 21% interrupts.CPU116.LOC:Local_timer_interrupts
1.50 ± 74% +1.7e+05% 2600 ±116% interrupts.CPU116.RES:Rescheduling_interrupts
869.25 ± 4% +337.2% 3800 ± 74% interrupts.CPU117.CAL:Function_call_interrupts
49274 ± 3% +986.5% 535378 ± 22% interrupts.CPU117.LOC:Local_timer_interrupts
0.25 ±173% +2.2e+05% 561.75 ± 83% interrupts.CPU117.NMI:Non-maskable_interrupts
0.25 ±173% +2.2e+05% 561.75 ± 83% interrupts.CPU117.PMI:Performance_monitoring_interrupts
896.50 ± 7% +375.8% 4265 ± 79% interrupts.CPU118.CAL:Function_call_interrupts
49275 ± 3% +988.4% 536312 ± 21% interrupts.CPU118.LOC:Local_timer_interrupts
17.00 ±163% +17627.9% 3013 ±122% interrupts.CPU118.RES:Rescheduling_interrupts
873.00 ± 6% +292.3% 3424 ± 99% interrupts.CPU119.CAL:Function_call_interrupts
49264 ± 3% +988.6% 536311 ± 21% interrupts.CPU119.LOC:Local_timer_interrupts
1.50 ±173% +23416.7% 352.75 ± 65% interrupts.CPU119.NMI:Non-maskable_interrupts
1.50 ±173% +23416.7% 352.75 ± 65% interrupts.CPU119.PMI:Performance_monitoring_interrupts
2.00 ± 61% +1.5e+05% 3040 ±134% interrupts.CPU119.RES:Rescheduling_interrupts
104.25 ± 27% +6685.4% 7073 ±151% interrupts.CPU12.33:PCI-MSI.524291-edge.eth0-TxRx-2
49217 ± 3% +990.1% 536526 ± 21% interrupts.CPU12.LOC:Local_timer_interrupts
49259 ± 3% +1092.8% 587552 ± 4% interrupts.CPU120.LOC:Local_timer_interrupts
0.75 ± 57% +1.1e+05% 812.00 ±171% interrupts.CPU120.RES:Rescheduling_interrupts
49258 ± 3% +1099.9% 591035 ± 3% interrupts.CPU121.LOC:Local_timer_interrupts
0.25 ±173% +2.4e+05% 604.25 ±171% interrupts.CPU121.RES:Rescheduling_interrupts
49250 ± 3% +1100.0% 590986 ± 3% interrupts.CPU122.LOC:Local_timer_interrupts
0.50 ±173% +34600.0% 173.50 ± 34% interrupts.CPU122.NMI:Non-maskable_interrupts
0.50 ±173% +34600.0% 173.50 ± 34% interrupts.CPU122.PMI:Performance_monitoring_interrupts
0.75 ±173% +1e+05% 762.50 ±170% interrupts.CPU122.RES:Rescheduling_interrupts
49270 ± 3% +1097.6% 590043 ± 4% interrupts.CPU123.LOC:Local_timer_interrupts
1.00 ± 70% +75425.0% 755.25 ±170% interrupts.CPU123.RES:Rescheduling_interrupts
49146 ± 2% +1101.2% 590359 ± 4% interrupts.CPU124.LOC:Local_timer_interrupts
0.25 ±173% +54900.0% 137.50 ± 42% interrupts.CPU124.NMI:Non-maskable_interrupts
0.25 ±173% +54900.0% 137.50 ± 42% interrupts.CPU124.PMI:Performance_monitoring_interrupts
853.50 +62.1% 1383 ± 58% interrupts.CPU125.CAL:Function_call_interrupts
49248 ± 3% +1095.0% 588506 ± 4% interrupts.CPU125.LOC:Local_timer_interrupts
1.75 ± 47% +23000.0% 404.25 ±170% interrupts.CPU125.RES:Rescheduling_interrupts
839.00 ± 3% +138.3% 1999 ± 73% interrupts.CPU126.CAL:Function_call_interrupts
49235 ± 3% +1095.9% 588790 ± 4% interrupts.CPU126.LOC:Local_timer_interrupts
1.75 ± 62% +44085.7% 773.25 ±171% interrupts.CPU126.RES:Rescheduling_interrupts
847.75 +129.3% 1943 ± 59% interrupts.CPU127.CAL:Function_call_interrupts
49233 ± 3% +1092.1% 586903 ± 5% interrupts.CPU127.LOC:Local_timer_interrupts
1.50 ± 74% +21533.3% 324.50 ±165% interrupts.CPU127.RES:Rescheduling_interrupts
49238 ± 3% +1089.3% 585574 ± 5% interrupts.CPU128.LOC:Local_timer_interrupts
49155 ± 3% +1096.4% 588084 ± 4% interrupts.CPU129.LOC:Local_timer_interrupts
76.00 ± 51% +3560.9% 2782 ±131% interrupts.CPU13.34:PCI-MSI.524292-edge.eth0-TxRx-3
49321 ± 3% +991.3% 538223 ± 22% interrupts.CPU13.LOC:Local_timer_interrupts
17.75 ±101% +4026.8% 732.50 ± 83% interrupts.CPU13.RES:Rescheduling_interrupts
849.75 ± 2% +63.2% 1386 ± 59% interrupts.CPU130.CAL:Function_call_interrupts
49248 ± 3% +1094.3% 588155 ± 4% interrupts.CPU130.LOC:Local_timer_interrupts
49233 ± 3% +1098.6% 590125 ± 4% interrupts.CPU131.LOC:Local_timer_interrupts
1.75 ± 74% +65700.0% 1151 ±171% interrupts.CPU131.RES:Rescheduling_interrupts
49232 ± 3% +1094.0% 587826 ± 4% interrupts.CPU132.LOC:Local_timer_interrupts
842.75 ± 2% +172.7% 2298 ±104% interrupts.CPU133.CAL:Function_call_interrupts
49233 ± 3% +1100.3% 590953 ± 3% interrupts.CPU133.LOC:Local_timer_interrupts
1.50 ± 57% +74066.7% 1112 ±171% interrupts.CPU133.RES:Rescheduling_interrupts
862.75 +109.0% 1803 ± 85% interrupts.CPU134.CAL:Function_call_interrupts
49237 ± 3% +1099.6% 590629 ± 3% interrupts.CPU134.LOC:Local_timer_interrupts
850.00 ± 2% +205.9% 2599 ± 68% interrupts.CPU135.CAL:Function_call_interrupts
49233 ± 3% +1096.3% 588961 ± 4% interrupts.CPU135.LOC:Local_timer_interrupts
1.50 ± 74% +63083.3% 947.75 ±169% interrupts.CPU135.RES:Rescheduling_interrupts
852.50 +94.8% 1660 ± 76% interrupts.CPU136.CAL:Function_call_interrupts
49223 ± 3% +1097.2% 589295 ± 4% interrupts.CPU136.LOC:Local_timer_interrupts
1.25 ± 87% +48480.0% 607.25 ±169% interrupts.CPU136.RES:Rescheduling_interrupts
49237 ± 3% +1093.0% 587396 ± 4% interrupts.CPU137.LOC:Local_timer_interrupts
1.75 ± 24% +10814.3% 191.00 ±166% interrupts.CPU137.RES:Rescheduling_interrupts
848.25 ± 2% +116.7% 1838 ± 55% interrupts.CPU138.CAL:Function_call_interrupts
49234 ± 3% +1092.7% 587201 ± 5% interrupts.CPU138.LOC:Local_timer_interrupts
1.50 ± 74% +48583.3% 730.25 ±105% interrupts.CPU138.RES:Rescheduling_interrupts
847.75 ± 2% +54.2% 1307 ± 52% interrupts.CPU139.CAL:Function_call_interrupts
49225 ± 3% +1091.9% 586707 ± 5% interrupts.CPU139.LOC:Local_timer_interrupts
3.75 ± 22% +8800.0% 333.75 ±168% interrupts.CPU139.RES:Rescheduling_interrupts
1226 ± 37% +167.1% 3275 ± 57% interrupts.CPU14.CAL:Function_call_interrupts
49381 ± 3% +986.7% 536610 ± 21% interrupts.CPU14.LOC:Local_timer_interrupts
0.50 ±100% +94550.0% 473.25 ± 60% interrupts.CPU14.NMI:Non-maskable_interrupts
0.50 ±100% +94550.0% 473.25 ± 60% interrupts.CPU14.PMI:Performance_monitoring_interrupts
8.75 ± 79% +9505.7% 840.50 ± 82% interrupts.CPU14.RES:Rescheduling_interrupts
49230 ± 3% +1096.2% 588919 ± 4% interrupts.CPU140.LOC:Local_timer_interrupts
49249 ± 3% +1098.5% 590271 ± 4% interrupts.CPU141.LOC:Local_timer_interrupts
1.50 ±137% +38050.0% 572.25 ±170% interrupts.CPU141.RES:Rescheduling_interrupts
49235 ± 3% +1093.6% 587678 ± 4% interrupts.CPU142.LOC:Local_timer_interrupts
3.00 ± 33% +21441.7% 646.25 ±170% interrupts.CPU142.RES:Rescheduling_interrupts
49232 ± 3% +1095.9% 588791 ± 4% interrupts.CPU143.LOC:Local_timer_interrupts
0.75 ±110% +1.3e+05% 939.50 ±171% interrupts.CPU143.RES:Rescheduling_interrupts
858.00 ± 3% +69.4% 1453 ± 65% interrupts.CPU144.CAL:Function_call_interrupts
49259 ± 3% +975.2% 529624 ± 24% interrupts.CPU144.LOC:Local_timer_interrupts
0.25 ±173% +1.5e+05% 382.00 ±118% interrupts.CPU144.NMI:Non-maskable_interrupts
0.25 ±173% +1.5e+05% 382.00 ±118% interrupts.CPU144.PMI:Performance_monitoring_interrupts
2.50 ± 91% +29930.0% 750.75 ±170% interrupts.CPU144.RES:Rescheduling_interrupts
853.25 ± 4% +73.1% 1476 ± 66% interrupts.CPU145.CAL:Function_call_interrupts
49240 ± 3% +976.4% 530009 ± 24% interrupts.CPU145.LOC:Local_timer_interrupts
1.00 ± 70% +65025.0% 651.25 ±170% interrupts.CPU145.RES:Rescheduling_interrupts
49234 ± 3% +976.3% 529907 ± 24% interrupts.CPU146.LOC:Local_timer_interrupts
1.75 ± 74% +57600.0% 1009 ±171% interrupts.CPU146.RES:Rescheduling_interrupts
49231 ± 3% +976.5% 529979 ± 24% interrupts.CPU147.LOC:Local_timer_interrupts
1.75 ± 84% +23085.7% 405.75 ±161% interrupts.CPU147.RES:Rescheduling_interrupts
849.75 ± 4% +97.5% 1678 ± 79% interrupts.CPU148.CAL:Function_call_interrupts
49231 ± 3% +977.0% 530203 ± 24% interrupts.CPU148.LOC:Local_timer_interrupts
2.00 ± 61% +45387.5% 909.75 ±167% interrupts.CPU148.RES:Rescheduling_interrupts
861.00 ± 2% +72.4% 1484 ± 65% interrupts.CPU149.CAL:Function_call_interrupts
49230 ± 3% +976.8% 530110 ± 24% interrupts.CPU149.LOC:Local_timer_interrupts
1.75 ± 47% +33414.3% 586.50 ±168% interrupts.CPU149.RES:Rescheduling_interrupts
49385 ± 3% +984.8% 535734 ± 22% interrupts.CPU15.LOC:Local_timer_interrupts
0.25 ±173% +1.6e+05% 392.00 ± 91% interrupts.CPU15.NMI:Non-maskable_interrupts
0.25 ±173% +1.6e+05% 392.00 ± 91% interrupts.CPU15.PMI:Performance_monitoring_interrupts
49233 ± 3% +976.8% 530160 ± 24% interrupts.CPU150.LOC:Local_timer_interrupts
1.75 ± 47% +44571.4% 781.75 ±167% interrupts.CPU150.RES:Rescheduling_interrupts
49234 ± 3% +977.4% 530438 ± 24% interrupts.CPU151.LOC:Local_timer_interrupts
2.00 ± 79% +36600.0% 734.00 ±166% interrupts.CPU151.RES:Rescheduling_interrupts
859.75 ± 3% +139.2% 2056 ± 70% interrupts.CPU152.CAL:Function_call_interrupts
49244 ± 3% +977.2% 530471 ± 24% interrupts.CPU152.LOC:Local_timer_interrupts
1.75 ± 74% +58214.3% 1020 ±169% interrupts.CPU152.RES:Rescheduling_interrupts
49242 ± 3% +976.2% 529944 ± 24% interrupts.CPU153.LOC:Local_timer_interrupts
49231 ± 3% +976.3% 529853 ± 24% interrupts.CPU154.LOC:Local_timer_interrupts
861.50 ± 3% +99.8% 1721 ± 81% interrupts.CPU155.CAL:Function_call_interrupts
49232 ± 3% +976.2% 529830 ± 24% interrupts.CPU155.LOC:Local_timer_interrupts
2.00 ± 61% +41700.0% 836.00 ±170% interrupts.CPU155.RES:Rescheduling_interrupts
846.50 ± 3% +136.5% 2002 ± 95% interrupts.CPU156.CAL:Function_call_interrupts
49230 ± 3% +977.4% 530387 ± 24% interrupts.CPU156.LOC:Local_timer_interrupts
2.25 ±110% +57455.6% 1295 ±172% interrupts.CPU156.RES:Rescheduling_interrupts
49229 ± 3% +977.1% 530266 ± 24% interrupts.CPU157.LOC:Local_timer_interrupts
1.50 ±137% +97883.3% 1469 ±171% interrupts.CPU157.RES:Rescheduling_interrupts
49230 ± 3% +976.5% 529955 ± 24% interrupts.CPU158.LOC:Local_timer_interrupts
1.50 ±100% +1e+05% 1546 ±171% interrupts.CPU158.RES:Rescheduling_interrupts
49242 ± 3% +976.6% 530162 ± 24% interrupts.CPU159.LOC:Local_timer_interrupts
1.25 ± 66% +1.2e+05% 1515 ±172% interrupts.CPU159.RES:Rescheduling_interrupts
834.75 ± 2% +240.9% 2845 ± 54% interrupts.CPU16.CAL:Function_call_interrupts
49318 ± 3% +985.0% 535107 ± 22% interrupts.CPU16.LOC:Local_timer_interrupts
1.50 ± 57% +1.7e+05% 2587 ± 86% interrupts.CPU16.RES:Rescheduling_interrupts
854.00 ± 3% +69.0% 1443 ± 64% interrupts.CPU160.CAL:Function_call_interrupts
49229 ± 3% +977.1% 530250 ± 24% interrupts.CPU160.LOC:Local_timer_interrupts
0.75 ± 57% +76633.3% 575.50 ±171% interrupts.CPU160.RES:Rescheduling_interrupts
865.00 ± 4% +191.4% 2520 ±110% interrupts.CPU161.CAL:Function_call_interrupts
49229 ± 3% +977.0% 530180 ± 24% interrupts.CPU161.LOC:Local_timer_interrupts
1.75 ± 62% +95642.9% 1675 ±172% interrupts.CPU161.RES:Rescheduling_interrupts
49231 ± 3% +976.4% 529906 ± 24% interrupts.CPU162.LOC:Local_timer_interrupts
49737 ± 4% +965.5% 529926 ± 24% interrupts.CPU163.LOC:Local_timer_interrupts
2.00 ± 35% +55175.0% 1105 ±172% interrupts.CPU163.RES:Rescheduling_interrupts
49232 ± 3% +976.8% 530140 ± 24% interrupts.CPU164.LOC:Local_timer_interrupts
49231 ± 3% +976.8% 530124 ± 24% interrupts.CPU165.LOC:Local_timer_interrupts
0.25 ±173% +8.5e+05% 2134 ±172% interrupts.CPU165.RES:Rescheduling_interrupts
867.25 ± 3% +138.7% 2070 ± 61% interrupts.CPU166.CAL:Function_call_interrupts
49229 ± 3% +977.3% 530338 ± 24% interrupts.CPU166.LOC:Local_timer_interrupts
0.50 ±173% +29000.0% 145.50 ± 26% interrupts.CPU166.NMI:Non-maskable_interrupts
0.50 ±173% +29000.0% 145.50 ± 26% interrupts.CPU166.PMI:Performance_monitoring_interrupts
1.75 ± 47% +63400.0% 1111 ±126% interrupts.CPU166.RES:Rescheduling_interrupts
846.25 ± 4% +15.2% 974.75 ± 13% interrupts.CPU167.CAL:Function_call_interrupts
49230 ± 3% +976.9% 530156 ± 24% interrupts.CPU167.LOC:Local_timer_interrupts
1.25 ± 66% +7940.0% 100.50 ±150% interrupts.CPU167.RES:Rescheduling_interrupts
49280 ± 3% +977.0% 530766 ± 23% interrupts.CPU168.LOC:Local_timer_interrupts
49295 ± 3% +977.3% 531046 ± 23% interrupts.CPU169.LOC:Local_timer_interrupts
838.75 +383.2% 4053 ± 68% interrupts.CPU17.CAL:Function_call_interrupts
49310 ± 3% +986.6% 535789 ± 22% interrupts.CPU17.LOC:Local_timer_interrupts
1.75 ± 47% +1.9e+05% 3398 ±104% interrupts.CPU17.RES:Rescheduling_interrupts
49318 ± 3% +985.5% 535352 ± 22% interrupts.CPU170.LOC:Local_timer_interrupts
49299 ± 3% +977.7% 531310 ± 23% interrupts.CPU171.LOC:Local_timer_interrupts
49316 ± 3% +976.6% 530933 ± 23% interrupts.CPU172.LOC:Local_timer_interrupts
49258 ± 3% +977.8% 530893 ± 23% interrupts.CPU173.LOC:Local_timer_interrupts
49244 ± 3% +977.8% 530761 ± 23% interrupts.CPU174.LOC:Local_timer_interrupts
49249 ± 3% +983.5% 533635 ± 22% interrupts.CPU175.LOC:Local_timer_interrupts
1.75 ±173% +10557.1% 186.50 ± 20% interrupts.CPU175.NMI:Non-maskable_interrupts
1.75 ±173% +10557.1% 186.50 ± 20% interrupts.CPU175.PMI:Performance_monitoring_interrupts
49251 ± 3% +978.1% 530997 ± 23% interrupts.CPU176.LOC:Local_timer_interrupts
49280 ± 3% +977.6% 531024 ± 23% interrupts.CPU177.LOC:Local_timer_interrupts
49257 ± 3% +978.0% 530974 ± 23% interrupts.CPU178.LOC:Local_timer_interrupts
49262 ± 3% +977.7% 530914 ± 23% interrupts.CPU179.LOC:Local_timer_interrupts
817.75 ± 2% +338.9% 3589 ±104% interrupts.CPU18.CAL:Function_call_interrupts
49319 ± 3% +986.4% 535796 ± 22% interrupts.CPU18.LOC:Local_timer_interrupts
49258 ± 3% +977.9% 530945 ± 23% interrupts.CPU180.LOC:Local_timer_interrupts
49265 ± 3% +977.4% 530813 ± 23% interrupts.CPU181.LOC:Local_timer_interrupts
0.75 ±173% +24666.7% 185.75 ± 21% interrupts.CPU181.NMI:Non-maskable_interrupts
1.00 ±173% +18475.0% 185.75 ± 21% interrupts.CPU181.PMI:Performance_monitoring_interrupts
49255 ± 3% +976.8% 530355 ± 24% interrupts.CPU182.LOC:Local_timer_interrupts
0.25 ±173% +41200.0% 103.25 ±163% interrupts.CPU182.RES:Rescheduling_interrupts
49261 ± 3% +977.8% 530924 ± 23% interrupts.CPU183.LOC:Local_timer_interrupts
49261 ± 3% +976.9% 530468 ± 24% interrupts.CPU184.LOC:Local_timer_interrupts
49256 ± 3% +977.2% 530580 ± 24% interrupts.CPU185.LOC:Local_timer_interrupts
49239 ± 3% +976.7% 530145 ± 24% interrupts.CPU186.LOC:Local_timer_interrupts
49253 ± 3% +976.7% 530291 ± 24% interrupts.CPU187.LOC:Local_timer_interrupts
0.75 ±173% +17800.0% 134.25 ± 36% interrupts.CPU187.NMI:Non-maskable_interrupts
0.75 ±173% +17800.0% 134.25 ± 36% interrupts.CPU187.PMI:Performance_monitoring_interrupts
201.25 ± 21% -49.7% 101.25 ± 53% interrupts.CPU187.TLB:TLB_shootdowns
49258 ± 3% +975.9% 529965 ± 24% interrupts.CPU188.LOC:Local_timer_interrupts
49243 ± 3% +976.4% 530057 ± 24% interrupts.CPU189.LOC:Local_timer_interrupts
845.00 ± 2% +373.0% 3997 ± 77% interrupts.CPU19.CAL:Function_call_interrupts
49293 ± 3% +986.8% 535726 ± 22% interrupts.CPU19.LOC:Local_timer_interrupts
0.50 ±173% +62850.0% 314.75 ± 56% interrupts.CPU19.NMI:Non-maskable_interrupts
0.50 ±173% +62850.0% 314.75 ± 56% interrupts.CPU19.PMI:Performance_monitoring_interrupts
49253 ± 3% +977.3% 530619 ± 23% interrupts.CPU190.LOC:Local_timer_interrupts
4.25 ± 73% +1882.4% 84.25 ±150% interrupts.CPU190.RES:Rescheduling_interrupts
49292 ± 3% +976.9% 530802 ± 24% interrupts.CPU191.LOC:Local_timer_interrupts
1.00 +10875.0% 109.75 ± 10% interrupts.CPU191.NMI:Non-maskable_interrupts
1.00 +10875.0% 109.75 ± 10% interrupts.CPU191.PMI:Performance_monitoring_interrupts
49407 ± 3% +986.3% 536729 ± 21% interrupts.CPU2.LOC:Local_timer_interrupts
15.75 ± 83% +2901.6% 472.75 ±128% interrupts.CPU2.RES:Rescheduling_interrupts
880.50 ± 12% +327.7% 3766 ± 46% interrupts.CPU20.CAL:Function_call_interrupts
49280 ± 3% +989.2% 536784 ± 21% interrupts.CPU20.LOC:Local_timer_interrupts
2.50 ± 44% +1.3e+05% 3186 ± 74% interrupts.CPU20.RES:Rescheduling_interrupts
840.25 ± 3% +449.4% 4616 ± 52% interrupts.CPU21.CAL:Function_call_interrupts
49301 ± 3% +988.3% 536547 ± 21% interrupts.CPU21.LOC:Local_timer_interrupts
0.25 ±173% +3.1e+05% 771.25 ± 94% interrupts.CPU21.NMI:Non-maskable_interrupts
0.25 ±173% +3.1e+05% 771.25 ± 94% interrupts.CPU21.PMI:Performance_monitoring_interrupts
3.50 ±111% +96621.4% 3385 ±102% interrupts.CPU21.RES:Rescheduling_interrupts
49349 ± 3% +984.7% 535289 ± 22% interrupts.CPU22.LOC:Local_timer_interrupts
1.75 ± 74% +1.9e+05% 3255 ± 87% interrupts.CPU22.RES:Rescheduling_interrupts
830.75 ± 2% +289.2% 3233 ± 60% interrupts.CPU23.CAL:Function_call_interrupts
49327 ± 3% +987.0% 536170 ± 21% interrupts.CPU23.LOC:Local_timer_interrupts
0.25 ±173% +1.7e+05% 435.75 ± 95% interrupts.CPU23.NMI:Non-maskable_interrupts
0.25 ±173% +1.7e+05% 435.75 ± 95% interrupts.CPU23.PMI:Performance_monitoring_interrupts
3.25 ± 70% +94638.5% 3079 ± 90% interrupts.CPU23.RES:Rescheduling_interrupts
49319 ± 3% +1101.4% 592500 ± 3% interrupts.CPU24.LOC:Local_timer_interrupts
2.25 ± 48% +15066.7% 341.25 ±167% interrupts.CPU24.RES:Rescheduling_interrupts
49277 ± 3% +1103.6% 593107 ± 3% interrupts.CPU25.LOC:Local_timer_interrupts
0.50 ±100% +25600.0% 128.50 ±157% interrupts.CPU25.RES:Rescheduling_interrupts
810.75 ± 2% +769.0% 7045 ±147% interrupts.CPU26.CAL:Function_call_interrupts
49295 ± 3% +1102.1% 592559 ± 3% interrupts.CPU26.LOC:Local_timer_interrupts
0.00 +1.9e+104% 189.00 ± 33% interrupts.CPU26.NMI:Non-maskable_interrupts
0.00 +1.9e+104% 189.00 ± 33% interrupts.CPU26.PMI:Performance_monitoring_interrupts
0.75 ±110% +20766.7% 156.50 ±162% interrupts.CPU26.RES:Rescheduling_interrupts
876.25 ± 10% +1298.6% 12255 ±143% interrupts.CPU27.CAL:Function_call_interrupts
49253 ± 3% +1102.4% 592217 ± 3% interrupts.CPU27.LOC:Local_timer_interrupts
0.00 +1.7e+104% 172.50 ± 37% interrupts.CPU27.NMI:Non-maskable_interrupts
0.00 +1.7e+104% 172.50 ± 37% interrupts.CPU27.PMI:Performance_monitoring_interrupts
2.25 ± 72% +9722.2% 221.00 ±160% interrupts.CPU27.RES:Rescheduling_interrupts
49252 ± 3% +1100.1% 591086 ± 3% interrupts.CPU28.LOC:Local_timer_interrupts
0.50 ±100% +35800.0% 179.50 ±165% interrupts.CPU28.RES:Rescheduling_interrupts
49288 ± 3% +1099.7% 591292 ± 3% interrupts.CPU29.LOC:Local_timer_interrupts
1.25 ±103% +9940.0% 125.50 ±161% interrupts.CPU29.RES:Rescheduling_interrupts
49318 ± 3% +990.2% 537664 ± 22% interrupts.CPU3.LOC:Local_timer_interrupts
0.25 ±173% +2.5e+05% 628.25 ± 66% interrupts.CPU3.NMI:Non-maskable_interrupts
0.25 ±173% +2.5e+05% 628.25 ± 66% interrupts.CPU3.PMI:Performance_monitoring_interrupts
13.75 ± 78% +5141.8% 720.75 ± 93% interrupts.CPU3.RES:Rescheduling_interrupts
49291 ± 3% +1101.3% 592123 ± 3% interrupts.CPU30.LOC:Local_timer_interrupts
0.25 ±173% +81200.0% 203.25 ±165% interrupts.CPU30.RES:Rescheduling_interrupts
49290 ± 3% +1102.1% 592509 ± 3% interrupts.CPU31.LOC:Local_timer_interrupts
0.25 ±173% +70300.0% 176.00 ± 19% interrupts.CPU31.NMI:Non-maskable_interrupts
0.25 ±173% +70300.0% 176.00 ± 19% interrupts.CPU31.PMI:Performance_monitoring_interrupts
0.25 ±173% +96300.0% 241.00 ±167% interrupts.CPU31.RES:Rescheduling_interrupts
49275 ± 3% +1100.9% 591757 ± 3% interrupts.CPU32.LOC:Local_timer_interrupts
829.00 +82.7% 1514 ± 66% interrupts.CPU33.CAL:Function_call_interrupts
49261 ± 3% +1096.7% 589490 ± 4% interrupts.CPU33.LOC:Local_timer_interrupts
0.25 ±173% +70500.0% 176.50 ± 20% interrupts.CPU33.NMI:Non-maskable_interrupts
0.25 ±173% +70500.0% 176.50 ± 20% interrupts.CPU33.PMI:Performance_monitoring_interrupts
1.00 ± 70% +11100.0% 112.00 ±144% interrupts.CPU33.RES:Rescheduling_interrupts
49275 ± 3% +1096.4% 589503 ± 4% interrupts.CPU34.LOC:Local_timer_interrupts
3.00 ±122% +2333.3% 73.00 ±147% interrupts.CPU34.RES:Rescheduling_interrupts
816.00 ± 2% +120.3% 1798 ± 87% interrupts.CPU35.CAL:Function_call_interrupts
49277 ± 3% +1099.3% 590974 ± 3% interrupts.CPU35.LOC:Local_timer_interrupts
1.25 ± 87% +12140.0% 153.00 ±155% interrupts.CPU35.RES:Rescheduling_interrupts
50.00 ± 90% +548.5% 324.25 ±115% interrupts.CPU35.TLB:TLB_shootdowns
49271 ± 3% +1094.2% 588423 ± 4% interrupts.CPU36.LOC:Local_timer_interrupts
0.75 ±110% +28466.7% 214.25 ±159% interrupts.CPU36.RES:Rescheduling_interrupts
49275 ± 3% +1100.6% 591617 ± 3% interrupts.CPU37.LOC:Local_timer_interrupts
1.50 ±100% +8150.0% 123.75 ±162% interrupts.CPU37.RES:Rescheduling_interrupts
830.00 ± 2% +121.1% 1835 ± 87% interrupts.CPU38.CAL:Function_call_interrupts
49271 ± 3% +1100.3% 591415 ± 3% interrupts.CPU38.LOC:Local_timer_interrupts
0.75 ±173% +25933.3% 195.25 ±165% interrupts.CPU38.RES:Rescheduling_interrupts
49257 ± 3% +1099.4% 590788 ± 3% interrupts.CPU39.LOC:Local_timer_interrupts
1.50 ±100% +17783.3% 268.25 ±167% interrupts.CPU39.RES:Rescheduling_interrupts
49326 ± 3% +989.1% 537216 ± 21% interrupts.CPU4.LOC:Local_timer_interrupts
9.75 ± 74% +11100.0% 1092 ± 98% interrupts.CPU4.RES:Rescheduling_interrupts
49270 ± 3% +1103.2% 592804 ± 3% interrupts.CPU40.LOC:Local_timer_interrupts
2.00 ±117% +86125.0% 1724 ±172% interrupts.CPU40.RES:Rescheduling_interrupts
833.75 ± 2% +108.8% 1741 ± 83% interrupts.CPU41.CAL:Function_call_interrupts
49275 ± 3% +1097.8% 590204 ± 4% interrupts.CPU41.LOC:Local_timer_interrupts
49276 ± 3% +1099.1% 590869 ± 3% interrupts.CPU42.LOC:Local_timer_interrupts
49273 ± 3% +1101.7% 592123 ± 3% interrupts.CPU43.LOC:Local_timer_interrupts
0.25 ±173% +2e+05% 491.50 ±171% interrupts.CPU43.RES:Rescheduling_interrupts
49301 ± 3% +1094.9% 589108 ± 4% interrupts.CPU44.LOC:Local_timer_interrupts
49291 ± 3% +1097.1% 590062 ± 4% interrupts.CPU45.LOC:Local_timer_interrupts
0.75 ± 57% +1.1e+05% 852.75 ±172% interrupts.CPU45.RES:Rescheduling_interrupts
831.25 +132.2% 1930 ± 92% interrupts.CPU46.CAL:Function_call_interrupts
49293 ± 3% +1095.6% 589326 ± 4% interrupts.CPU46.LOC:Local_timer_interrupts
49281 ± 3% +1098.3% 590561 ± 3% interrupts.CPU47.LOC:Local_timer_interrupts
1.50 ±110% +33666.7% 506.50 ±170% interrupts.CPU47.RES:Rescheduling_interrupts
824.75 ± 3% +67.5% 1381 ± 60% interrupts.CPU48.CAL:Function_call_interrupts
49218 ± 3% +987.0% 534997 ± 24% interrupts.CPU48.LOC:Local_timer_interrupts
3.00 ± 62% +10675.0% 323.25 ±162% interrupts.CPU48.RES:Rescheduling_interrupts
49268 ± 3% +976.0% 530106 ± 24% interrupts.CPU49.LOC:Local_timer_interrupts
1.25 ±103% +9880.0% 124.75 ±150% interrupts.CPU49.RES:Rescheduling_interrupts
49370 ± 3% +986.9% 536578 ± 21% interrupts.CPU5.LOC:Local_timer_interrupts
0.25 ±173% +1.2e+05% 301.25 ± 28% interrupts.CPU5.NMI:Non-maskable_interrupts
0.25 ±173% +1.2e+05% 301.25 ± 28% interrupts.CPU5.PMI:Performance_monitoring_interrupts
12.25 ±114% +5344.9% 667.00 ± 92% interrupts.CPU5.RES:Rescheduling_interrupts
49249 ± 3% +976.2% 530004 ± 24% interrupts.CPU50.LOC:Local_timer_interrupts
1.50 ± 74% +57133.3% 858.50 ±170% interrupts.CPU50.RES:Rescheduling_interrupts
816.00 +121.5% 1807 ± 89% interrupts.CPU51.CAL:Function_call_interrupts
49248 ± 3% +976.5% 530166 ± 24% interrupts.CPU51.LOC:Local_timer_interrupts
1.25 ± 34% +30040.0% 376.75 ±167% interrupts.CPU51.RES:Rescheduling_interrupts
820.25 ± 2% +82.7% 1498 ± 70% interrupts.CPU52.CAL:Function_call_interrupts
49250 ± 3% +976.4% 530138 ± 24% interrupts.CPU52.LOC:Local_timer_interrupts
0.25 ±173% +54600.0% 136.75 ± 29% interrupts.CPU52.NMI:Non-maskable_interrupts
0.25 ±173% +54600.0% 136.75 ± 29% interrupts.CPU52.PMI:Performance_monitoring_interrupts
1.50 ± 57% +12666.7% 191.50 ±160% interrupts.CPU52.RES:Rescheduling_interrupts
49249 ± 3% +976.6% 530214 ± 24% interrupts.CPU53.LOC:Local_timer_interrupts
1.00 ± 70% +44050.0% 441.50 ±167% interrupts.CPU53.RES:Rescheduling_interrupts
815.25 ± 2% +88.4% 1536 ± 74% interrupts.CPU54.CAL:Function_call_interrupts
49268 ± 3% +976.4% 530302 ± 24% interrupts.CPU54.LOC:Local_timer_interrupts
1.75 ± 47% +11771.4% 207.75 ±163% interrupts.CPU54.RES:Rescheduling_interrupts
821.25 +155.8% 2100 ±100% interrupts.CPU55.CAL:Function_call_interrupts
49247 ± 3% +977.2% 530483 ± 24% interrupts.CPU55.LOC:Local_timer_interrupts
1.75 ± 47% +21528.6% 378.50 ±167% interrupts.CPU55.RES:Rescheduling_interrupts
49230 ± 3% +977.6% 530504 ± 24% interrupts.CPU56.LOC:Local_timer_interrupts
1.25 ± 66% +29400.0% 368.75 ±168% interrupts.CPU56.RES:Rescheduling_interrupts
819.50 +180.4% 2298 ±106% interrupts.CPU57.CAL:Function_call_interrupts
49244 ± 3% +976.7% 530203 ± 24% interrupts.CPU57.LOC:Local_timer_interrupts
0.25 ±173% +94600.0% 236.75 ± 70% interrupts.CPU57.NMI:Non-maskable_interrupts
0.25 ±173% +94600.0% 236.75 ± 70% interrupts.CPU57.PMI:Performance_monitoring_interrupts
1.50 ± 74% +32066.7% 482.50 ±169% interrupts.CPU57.RES:Rescheduling_interrupts
49308 ± 3% +975.0% 530051 ± 24% interrupts.CPU58.LOC:Local_timer_interrupts
0.25 ±173% +1e+05% 256.50 ± 79% interrupts.CPU58.NMI:Non-maskable_interrupts
0.25 ±173% +1e+05% 256.50 ± 79% interrupts.CPU58.PMI:Performance_monitoring_interrupts
3.50 ± 84% +12007.1% 423.75 ±167% interrupts.CPU58.RES:Rescheduling_interrupts
817.50 +103.4% 1663 ± 79% interrupts.CPU59.CAL:Function_call_interrupts
49266 ± 3% +975.9% 530043 ± 24% interrupts.CPU59.LOC:Local_timer_interrupts
2.00 ± 35% +14050.0% 283.00 ±158% interrupts.CPU59.RES:Rescheduling_interrupts
49309 ± 3% +988.0% 536501 ± 21% interrupts.CPU6.LOC:Local_timer_interrupts
8.25 ± 95% +9421.2% 785.50 ± 95% interrupts.CPU6.RES:Rescheduling_interrupts
826.75 ± 4% +137.0% 1959 ± 94% interrupts.CPU60.CAL:Function_call_interrupts
49247 ± 3% +977.2% 530470 ± 24% interrupts.CPU60.LOC:Local_timer_interrupts
2.25 ±148% +19777.8% 447.25 ±159% interrupts.CPU60.RES:Rescheduling_interrupts
49247 ± 3% +976.9% 530345 ± 24% interrupts.CPU61.LOC:Local_timer_interrupts
1.50 ± 33% +10083.3% 152.75 ±163% interrupts.CPU61.RES:Rescheduling_interrupts
824.50 ± 3% +107.1% 1707 ± 82% interrupts.CPU62.CAL:Function_call_interrupts
49247 ± 3% +976.6% 530191 ± 24% interrupts.CPU62.LOC:Local_timer_interrupts
0.25 ±173% +77000.0% 192.75 ± 49% interrupts.CPU62.NMI:Non-maskable_interrupts
0.25 ±173% +77000.0% 192.75 ± 49% interrupts.CPU62.PMI:Performance_monitoring_interrupts
1.50 ±100% +17050.0% 257.25 ±162% interrupts.CPU62.RES:Rescheduling_interrupts
819.50 ± 2% +121.9% 1818 ± 78% interrupts.CPU63.CAL:Function_call_interrupts
49245 ± 3% +976.9% 530307 ± 24% interrupts.CPU63.LOC:Local_timer_interrupts
0.25 ±173% +1.3e+05% 335.25 ±158% interrupts.CPU63.RES:Rescheduling_interrupts
811.25 +100.0% 1622 ± 78% interrupts.CPU64.CAL:Function_call_interrupts
49168 ± 3% +979.1% 530566 ± 24% interrupts.CPU64.LOC:Local_timer_interrupts
1.50 ±110% +47833.3% 719.00 ±168% interrupts.CPU64.RES:Rescheduling_interrupts
846.50 ± 3% +56.6% 1326 ± 54% interrupts.CPU65.CAL:Function_call_interrupts
49257 ± 3% +976.8% 530382 ± 24% interrupts.CPU65.LOC:Local_timer_interrupts
811.75 +96.9% 1598 ± 43% interrupts.CPU66.CAL:Function_call_interrupts
49255 ± 3% +976.3% 530149 ± 24% interrupts.CPU66.LOC:Local_timer_interrupts
820.75 ± 3% +77.7% 1458 ± 37% interrupts.CPU67.CAL:Function_call_interrupts
49265 ± 3% +976.1% 530131 ± 24% interrupts.CPU67.LOC:Local_timer_interrupts
3.00 ±122% +10550.0% 319.50 ±165% interrupts.CPU67.RES:Rescheduling_interrupts
805.25 +63.9% 1319 ± 57% interrupts.CPU68.CAL:Function_call_interrupts
49248 ± 3% +976.8% 530330 ± 24% interrupts.CPU68.LOC:Local_timer_interrupts
1.75 ± 84% +24000.0% 421.75 ±159% interrupts.CPU68.RES:Rescheduling_interrupts
830.00 ± 3% +49.3% 1239 ± 47% interrupts.CPU69.CAL:Function_call_interrupts
49270 ± 3% +976.2% 530235 ± 24% interrupts.CPU69.LOC:Local_timer_interrupts
1.00 ± 70% +32800.0% 329.00 ±166% interrupts.CPU69.RES:Rescheduling_interrupts
49299 ± 3% +998.3% 541453 ± 22% interrupts.CPU7.LOC:Local_timer_interrupts
11.75 ± 87% +4563.8% 548.00 ± 95% interrupts.CPU7.RES:Rescheduling_interrupts
836.50 +79.2% 1499 ± 70% interrupts.CPU70.CAL:Function_call_interrupts
49154 ± 3% +979.2% 530495 ± 24% interrupts.CPU70.LOC:Local_timer_interrupts
1.25 ±131% +48500.0% 607.50 ±169% interrupts.CPU70.RES:Rescheduling_interrupts
815.75 ± 2% +51.0% 1232 ± 47% interrupts.CPU71.CAL:Function_call_interrupts
49318 ± 3% +975.3% 530324 ± 24% interrupts.CPU71.LOC:Local_timer_interrupts
1.75 ± 84% +18185.7% 320.00 ±166% interrupts.CPU71.RES:Rescheduling_interrupts
49174 ± 3% +979.5% 530831 ± 23% interrupts.CPU72.LOC:Local_timer_interrupts
49328 ± 3% +976.8% 531165 ± 23% interrupts.CPU73.LOC:Local_timer_interrupts
49291 ± 3% +977.2% 530967 ± 23% interrupts.CPU74.LOC:Local_timer_interrupts
49322 ± 3% +975.3% 530368 ± 24% interrupts.CPU75.LOC:Local_timer_interrupts
144.50 ± 26% -58.0% 60.75 ± 63% interrupts.CPU75.TLB:TLB_shootdowns
49584 ± 2% +969.9% 530478 ± 24% interrupts.CPU76.LOC:Local_timer_interrupts
49412 ± 2% +974.6% 530972 ± 23% interrupts.CPU77.LOC:Local_timer_interrupts
49307 ± 3% +977.0% 531020 ± 23% interrupts.CPU78.LOC:Local_timer_interrupts
49278 ± 3% +975.8% 530161 ± 24% interrupts.CPU79.LOC:Local_timer_interrupts
49364 ± 3% +987.4% 536767 ± 21% interrupts.CPU8.LOC:Local_timer_interrupts
11.00 ±133% +5561.4% 622.75 ± 88% interrupts.CPU8.RES:Rescheduling_interrupts
49281 ± 3% +977.3% 530889 ± 23% interrupts.CPU80.LOC:Local_timer_interrupts
49273 ± 3% +977.7% 531031 ± 23% interrupts.CPU81.LOC:Local_timer_interrupts
157.50 ± 16% -57.9% 66.25 ± 74% interrupts.CPU81.TLB:TLB_shootdowns
49277 ± 3% +977.1% 530767 ± 23% interrupts.CPU82.LOC:Local_timer_interrupts
49260 ± 3% +977.9% 530978 ± 23% interrupts.CPU83.LOC:Local_timer_interrupts
140.50 ± 26% -42.9% 80.25 ± 40% interrupts.CPU83.TLB:TLB_shootdowns
49277 ± 3% +977.5% 530986 ± 23% interrupts.CPU84.LOC:Local_timer_interrupts
49276 ± 3% +977.1% 530739 ± 23% interrupts.CPU85.LOC:Local_timer_interrupts
49275 ± 3% +976.3% 530357 ± 24% interrupts.CPU86.LOC:Local_timer_interrupts
49271 ± 3% +976.2% 530266 ± 24% interrupts.CPU87.LOC:Local_timer_interrupts
49286 ± 3% +976.2% 530422 ± 24% interrupts.CPU88.LOC:Local_timer_interrupts
49277 ± 3% +975.9% 530159 ± 24% interrupts.CPU89.LOC:Local_timer_interrupts
49337 ± 3% +989.1% 537342 ± 21% interrupts.CPU9.LOC:Local_timer_interrupts
20.75 ± 99% +3696.4% 787.75 ± 85% interrupts.CPU9.RES:Rescheduling_interrupts
49269 ± 3% +976.4% 530355 ± 24% interrupts.CPU90.LOC:Local_timer_interrupts
49279 ± 3% +977.8% 531115 ± 23% interrupts.CPU91.LOC:Local_timer_interrupts
0.25 ±173% +74400.0% 186.25 ± 18% interrupts.CPU91.NMI:Non-maskable_interrupts
0.25 ±173% +74400.0% 186.25 ± 18% interrupts.CPU91.PMI:Performance_monitoring_interrupts
148.00 ± 28% -76.9% 34.25 ± 23% interrupts.CPU91.TLB:TLB_shootdowns
49272 ± 3% +977.3% 530826 ± 23% interrupts.CPU92.LOC:Local_timer_interrupts
49273 ± 3% +976.4% 530359 ± 24% interrupts.CPU93.LOC:Local_timer_interrupts
49289 ± 3% +976.2% 530443 ± 24% interrupts.CPU94.LOC:Local_timer_interrupts
49305 ± 3% +976.6% 530812 ± 23% interrupts.CPU95.LOC:Local_timer_interrupts
49303 ± 3% +986.8% 535801 ± 22% interrupts.CPU96.LOC:Local_timer_interrupts
0.25 ±173% +1.1e+05% 275.50 ± 54% interrupts.CPU96.NMI:Non-maskable_interrupts
0.25 ±173% +1.1e+05% 275.50 ± 54% interrupts.CPU96.PMI:Performance_monitoring_interrupts
15.25 ±150% +15845.9% 2431 ±106% interrupts.CPU96.RES:Rescheduling_interrupts
895.25 ± 5% +310.1% 3671 ± 77% interrupts.CPU97.CAL:Function_call_interrupts
49280 ± 3% +987.5% 535931 ± 22% interrupts.CPU97.LOC:Local_timer_interrupts
0.75 ±110% +67700.0% 508.50 ± 81% interrupts.CPU97.NMI:Non-maskable_interrupts
0.75 ±110% +67700.0% 508.50 ± 81% interrupts.CPU97.PMI:Performance_monitoring_interrupts
98.25 ±166% +3216.8% 3258 ± 99% interrupts.CPU97.RES:Rescheduling_interrupts
872.75 ± 4% +323.6% 3697 ± 74% interrupts.CPU98.CAL:Function_call_interrupts
49223 ± 3% +988.5% 535800 ± 22% interrupts.CPU98.LOC:Local_timer_interrupts
0.25 ±173% +2e+05% 495.75 ± 80% interrupts.CPU98.NMI:Non-maskable_interrupts
0.25 ±173% +2e+05% 495.75 ± 80% interrupts.CPU98.PMI:Performance_monitoring_interrupts
7.25 ±126% +50834.5% 3692 ± 97% interrupts.CPU98.RES:Rescheduling_interrupts
859.50 +385.8% 4175 ± 65% interrupts.CPU99.CAL:Function_call_interrupts
49463 ± 3% +991.5% 539879 ± 22% interrupts.CPU99.LOC:Local_timer_interrupts
0.25 ±173% +2.3e+05% 580.50 ± 62% interrupts.CPU99.NMI:Non-maskable_interrupts
0.25 ±173% +2.3e+05% 580.50 ± 62% interrupts.CPU99.PMI:Performance_monitoring_interrupts
9460816 ± 3% +1009.9% 1.05e+08 ± 18% interrupts.LOC:Local_timer_interrupts
0.00 +1.9e+104% 192.00 interrupts.MCP:Machine_check_polls
16.50 ± 15% +3.1e+05% 50541 ± 17% interrupts.NMI:Non-maskable_interrupts
16.75 ± 16% +3e+05% 50541 ± 17% interrupts.PMI:Performance_monitoring_interrupts
2453 ± 10% +7214.2% 179472 ± 23% interrupts.RES:Rescheduling_interrupts
28.86 ± 54% -28.9 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
28.86 ± 54% -28.9 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
50.00 ± 23% -15.4 34.64 ± 13% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
11.82 ± 31% -11.8 0.00 perf-profile.calltrace.cycles-pp.__libc_start_main
11.82 ± 31% -11.8 0.00 perf-profile.calltrace.cycles-pp.main.__libc_start_main
11.82 ± 31% -11.8 0.00 perf-profile.calltrace.cycles-pp.run_builtin.main.__libc_start_main
11.82 ± 31% -11.8 0.00 perf-profile.calltrace.cycles-pp.cmd_record.run_builtin.main.__libc_start_main
11.82 ± 31% -11.8 0.00 perf-profile.calltrace.cycles-pp.perf_mmap__read_head.perf_mmap__push.record__mmap_read_evlist.cmd_record.run_builtin
11.59 ±128% -11.6 0.00 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.59 ±128% -11.6 0.00 perf-profile.calltrace.cycles-pp.proc_reg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.59 ±128% -11.6 0.00 perf-profile.calltrace.cycles-pp.seq_read.proc_reg_read.vfs_read.ksys_read.do_syscall_64
11.59 ±128% -11.6 0.00 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.00 ±100% -10.0 0.00 perf-profile.calltrace.cycles-pp.__prepare_exit_to_usermode.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.00 ±100% -10.0 0.00 perf-profile.calltrace.cycles-pp.do_signal.__prepare_exit_to_usermode.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.00 ±100% -10.0 0.00 perf-profile.calltrace.cycles-pp.get_signal.do_signal.__prepare_exit_to_usermode.do_syscall_64.entry_SYSCALL_64_after_hwframe
10.00 ±100% -10.0 0.00 perf-profile.calltrace.cycles-pp.do_group_exit.get_signal.do_signal.__prepare_exit_to_usermode.do_syscall_64
10.00 ±100% -10.0 0.00 perf-profile.calltrace.cycles-pp.do_exit.do_group_exit.get_signal.do_signal.__prepare_exit_to_usermode
9.54 ± 4% -9.5 0.00 perf-profile.calltrace.cycles-pp.record__mmap_read_evlist.cmd_record.run_builtin.main.__libc_start_main
9.54 ± 4% -9.5 0.00 perf-profile.calltrace.cycles-pp.perf_mmap__push.record__mmap_read_evlist.cmd_record.run_builtin.main
9.54 ± 67% -9.5 0.00 perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
9.54 ±100% -9.5 0.00 perf-profile.calltrace.cycles-pp.step_into.walk_component.link_path_walk.path_openat.do_filp_open
7.50 ±110% -7.5 0.00 perf-profile.calltrace.cycles-pp.mmput.do_exit.do_group_exit.get_signal.do_signal
7.50 ±110% -7.5 0.00 perf-profile.calltrace.cycles-pp.exit_mmap.mmput.do_exit.do_group_exit.get_signal
7.27 ± 57% -7.3 0.00 perf-profile.calltrace.cycles-pp.asm_exc_page_fault.perf_mmap__read_head.perf_mmap__push.record__mmap_read_evlist.cmd_record
7.27 ± 57% -7.3 0.00 perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.perf_mmap__read_head.perf_mmap__push.record__mmap_read_evlist
7.27 ± 57% -7.3 0.00 perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.perf_mmap__read_head.perf_mmap__push
7.27 ± 57% -7.3 0.00 perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.perf_mmap__read_head
7.27 ±113% -7.3 0.00 perf-profile.calltrace.cycles-pp.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.27 ±113% -7.3 0.00 perf-profile.calltrace.cycles-pp.path_openat.do_filp_open.do_sys_openat2.do_sys_open.do_syscall_64
7.27 ±113% -7.3 0.00 perf-profile.calltrace.cycles-pp.link_path_walk.path_openat.do_filp_open.do_sys_openat2.do_sys_open
7.27 ±113% -7.3 0.00 perf-profile.calltrace.cycles-pp.walk_component.link_path_walk.path_openat.do_filp_open.do_sys_openat2
5.00 ±100% -5.0 0.00 perf-profile.calltrace.cycles-pp.tlb_finish_mmu.exit_mmap.mmput.do_exit.do_group_exit
5.00 ±100% -5.0 0.00 perf-profile.calltrace.cycles-pp.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput.do_exit
5.00 ±100% -5.0 0.00 perf-profile.calltrace.cycles-pp.release_pages.tlb_flush_mmu.tlb_finish_mmu.exit_mmap.mmput
4.77 ±100% -4.8 0.00 perf-profile.calltrace.cycles-pp.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault
4.77 ±100% -4.8 0.00 perf-profile.calltrace.cycles-pp.__do_fault.do_fault.__handle_mm_fault.handle_mm_fault.do_user_addr_fault
0.00 +0.6 0.59 ± 12% perf-profile.calltrace.cycles-pp.btrfs_reserve_metadata_bytes.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write
0.00 +0.6 0.61 ± 12% perf-profile.calltrace.cycles-pp.btrfs_delalloc_reserve_metadata.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write
0.00 +0.6 0.65 ± 12% perf-profile.calltrace.cycles-pp.ktime_get.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +0.7 0.67 ± 20% perf-profile.calltrace.cycles-pp.setup_leaf_for_split.btrfs_duplicate_item.btrfs_mark_extent_written.btrfs_finish_ordered_io.btrfs_work_helper
0.00 +0.7 0.68 ± 18% perf-profile.calltrace.cycles-pp.read_extent_buffer.check_leaf.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio
0.00 +0.7 0.68 ± 8% perf-profile.calltrace.cycles-pp.__next_timer_interrupt.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select
0.00 +0.7 0.71 ± 14% perf-profile.calltrace.cycles-pp.perf_mux_hrtimer_handler.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack
0.00 +0.7 0.74 ± 26% perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks.add_pending_csums
0.00 +0.7 0.74 ± 26% perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks
0.00 +0.8 0.83 ± 44% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
0.00 +0.9 0.88 ± 27% perf-profile.calltrace.cycles-pp.btrfs_insert_empty_items.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.btrfs_work_helper
0.00 +0.9 0.89 ± 21% perf-profile.calltrace.cycles-pp.tick_irq_enter.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +1.0 1.04 ± 10% perf-profile.calltrace.cycles-pp.get_next_timer_interrupt.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.00 +1.1 1.06 ± 25% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io
0.00 +1.1 1.06 ± 25% perf-profile.calltrace.cycles-pp.btrfs_lookup_file_extent.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper
0.00 +1.1 1.06 ± 34% perf-profile.calltrace.cycles-pp.btrfs_cow_block.btrfs_search_slot.btrfs_mark_extent_written.btrfs_finish_ordered_io.btrfs_work_helper
0.00 +1.1 1.06 ± 34% perf-profile.calltrace.cycles-pp.__btrfs_cow_block.btrfs_cow_block.btrfs_search_slot.btrfs_mark_extent_written.btrfs_finish_ordered_io
0.00 +1.1 1.08 ± 21% perf-profile.calltrace.cycles-pp.btrfs_duplicate_item.btrfs_mark_extent_written.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
0.00 +1.1 1.08 ± 23% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_lookup_csum.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io
0.00 +1.1 1.09 ± 23% perf-profile.calltrace.cycles-pp.btrfs_lookup_csum.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.btrfs_work_helper
0.00 +1.1 1.13 ± 7% perf-profile.calltrace.cycles-pp.rebalance_domains.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu
0.00 +1.2 1.20 ± 21% perf-profile.calltrace.cycles-pp.run_delalloc_nocow.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages
0.00 +1.2 1.22 ± 18% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +1.3 1.34 ± 20% perf-profile.calltrace.cycles-pp.btrfs_get_64.check_extent_data_item.check_leaf.btree_csum_one_bio.btree_submit_bio_hook
0.00 +1.3 1.34 ± 24% perf-profile.calltrace.cycles-pp.__btrfs_drop_extents.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
0.00 +1.4 1.39 ± 34% perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs_for_head.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space
0.00 +1.4 1.39 ± 24% perf-profile.calltrace.cycles-pp.insert_reserved_file_extent.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
0.00 +1.4 1.40 ± 30% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt
0.00 +1.7 1.70 ± 27% perf-profile.calltrace.cycles-pp.btrfs_search_slot.btrfs_mark_extent_written.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
0.00 +1.7 1.72 ± 23% perf-profile.calltrace.cycles-pp.btrfs_buffered_write.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write
0.00 +1.7 1.72 ± 21% perf-profile.calltrace.cycles-pp.btrfs_run_delalloc_range.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages
0.00 +1.7 1.73 ± 23% perf-profile.calltrace.cycles-pp.new_sync_write.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.00 +1.7 1.73 ± 23% perf-profile.calltrace.cycles-pp.btrfs_file_write_iter.new_sync_write.vfs_write.ksys_write.do_syscall_64
0.00 +1.7 1.74 ± 33% perf-profile.calltrace.cycles-pp.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread
0.00 +1.7 1.74 ± 33% perf-profile.calltrace.cycles-pp.__btrfs_run_delayed_refs.btrfs_run_delayed_refs.flush_space.btrfs_async_reclaim_metadata_space.process_one_work
0.00 +1.8 1.75 ± 23% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
0.00 +1.8 1.75 ± 23% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
0.00 +1.8 1.76 ± 23% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write
0.00 +1.8 1.77 ± 23% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_write
0.00 +1.8 1.79 ± 23% perf-profile.calltrace.cycles-pp.__libc_write
0.00 +1.8 1.84 ± 20% perf-profile.calltrace.cycles-pp.btrfs_get_32.check_leaf.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio
0.00 +1.9 1.87 ± 21% perf-profile.calltrace.cycles-pp.writepage_delalloc.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages
0.00 +1.9 1.90 ± 56% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.00 +2.0 2.01 ± 58% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.00 +2.0 2.03 ± 24% perf-profile.calltrace.cycles-pp.add_pending_csums.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
0.00 +2.0 2.03 ± 24% perf-profile.calltrace.cycles-pp.btrfs_csum_file_blocks.add_pending_csums.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work
0.00 +2.1 2.10 ± 21% perf-profile.calltrace.cycles-pp.__extent_writepage.extent_write_cache_pages.extent_writepages.do_writepages.__writeback_single_inode
0.00 +2.1 2.11 ± 13% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.00 +2.2 2.19 ± 21% perf-profile.calltrace.cycles-pp.extent_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback
0.00 +2.2 2.19 ± 21% perf-profile.calltrace.cycles-pp.extent_write_cache_pages.extent_writepages.do_writepages.__writeback_single_inode.writeback_sb_inodes
0.00 +2.3 2.35 ± 9% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
0.00 +2.4 2.35 ± 9% perf-profile.calltrace.cycles-pp.asm_call_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +2.4 2.38 ± 10% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +2.4 2.40 ± 20% perf-profile.calltrace.cycles-pp.check_extent_data_item.check_leaf.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio
0.00 +2.4 2.45 ± 46% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack
0.00 +2.5 2.46 ± 8% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.00 +2.5 2.48 ± 32% perf-profile.calltrace.cycles-pp.flush_space.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread
0.00 +2.5 2.48 ± 33% perf-profile.calltrace.cycles-pp.btrfs_async_reclaim_metadata_space.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +2.8 2.79 ± 10% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +2.9 2.94 ± 25% perf-profile.calltrace.cycles-pp.btrfs_mark_extent_written.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread
0.00 +3.8 3.80 ± 42% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt
0.00 +6.1 6.10 ± 20% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +6.2 6.25 ± 21% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.00 +6.3 6.30 ± 22% perf-profile.calltrace.cycles-pp.asm_call_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +6.6 6.60 ± 18% perf-profile.calltrace.cycles-pp.check_leaf.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.submit_extent_page
0.00 +6.7 6.75 ± 19% perf-profile.calltrace.cycles-pp.btree_csum_one_bio.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb
0.00 +6.8 6.82 ± 19% perf-profile.calltrace.cycles-pp.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages.__writeback_single_inode
0.00 +6.8 6.84 ± 24% perf-profile.calltrace.cycles-pp.btrfs_finish_ordered_io.btrfs_work_helper.process_one_work.worker_thread.kthread
0.00 +6.9 6.93 ± 19% perf-profile.calltrace.cycles-pp.btree_submit_bio_hook.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages
0.00 +6.9 6.93 ± 19% perf-profile.calltrace.cycles-pp.submit_one_bio.submit_extent_page.write_one_eb.btree_write_cache_pages.do_writepages
0.00 +7.1 7.06 ± 24% perf-profile.calltrace.cycles-pp.btrfs_work_helper.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +7.1 7.10 ± 19% perf-profile.calltrace.cycles-pp.write_one_eb.btree_write_cache_pages.do_writepages.__writeback_single_inode.writeback_sb_inodes
0.00 +7.2 7.21 ± 19% perf-profile.calltrace.cycles-pp.btree_write_cache_pages.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback
0.00 +9.4 9.41 ± 20% perf-profile.calltrace.cycles-pp.do_writepages.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn
0.00 +9.4 9.41 ± 20% perf-profile.calltrace.cycles-pp.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work.worker_thread
0.00 +9.4 9.41 ± 20% perf-profile.calltrace.cycles-pp.__writeback_single_inode.writeback_sb_inodes.wb_writeback.wb_workfn.process_one_work
0.00 +9.4 9.45 ± 20% perf-profile.calltrace.cycles-pp.wb_writeback.wb_workfn.process_one_work.worker_thread.kthread
0.00 +9.5 9.45 ± 20% perf-profile.calltrace.cycles-pp.wb_workfn.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +11.2 11.24 ± 15% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
0.00 +15.9 15.94 ± 43% perf-profile.calltrace.cycles-pp.menu_select.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +19.1 19.14 ± 22% perf-profile.calltrace.cycles-pp.process_one_work.worker_thread.kthread.ret_from_fork
0.00 +19.3 19.29 ± 22% perf-profile.calltrace.cycles-pp.worker_thread.kthread.ret_from_fork
0.00 +19.4 19.36 ± 22% perf-profile.calltrace.cycles-pp.ret_from_fork
0.00 +19.4 19.36 ± 22% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
0.00 +20.9 20.93 ± 18% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
50.00 ± 23% +27.1 77.09 ± 6% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
50.00 ± 23% +27.1 77.12 ± 6% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
50.00 ± 23% +27.1 77.12 ± 6% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
50.00 ± 23% +27.6 77.61 ± 6% perf-profile.calltrace.cycles-pp.secondary_startup_64
35.91 ± 50% -33.8 2.08 ± 23% perf-profile.children.cycles-pp.do_syscall_64
35.91 ± 50% -33.8 2.09 ± 23% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
50.00 ± 23% -15.2 34.85 ± 13% perf-profile.children.cycles-pp.intel_idle
14.09 ± 95% -14.1 0.01 ±173% perf-profile.children.cycles-pp.seq_read
11.82 ± 31% -11.8 0.00 perf-profile.children.cycles-pp.cmd_record
11.82 ± 31% -11.8 0.02 ±173% perf-profile.children.cycles-pp.__libc_start_main
11.82 ± 31% -11.8 0.02 ±173% perf-profile.children.cycles-pp.main
11.82 ± 31% -11.8 0.02 ±173% perf-profile.children.cycles-pp.run_builtin
11.59 ±128% -11.6 0.00 perf-profile.children.cycles-pp.proc_reg_read
10.00 ±100% -10.0 0.00 perf-profile.children.cycles-pp.__prepare_exit_to_usermode
10.00 ±100% -10.0 0.00 perf-profile.children.cycles-pp.do_signal
10.00 ±100% -10.0 0.00 perf-profile.children.cycles-pp.get_signal
10.00 ±100% -10.0 0.00 perf-profile.children.cycles-pp.do_group_exit
10.00 ±100% -10.0 0.00 perf-profile.children.cycles-pp.do_exit
9.54 ± 4% -9.5 0.00 perf-profile.children.cycles-pp.record__mmap_read_evlist
9.54 ± 4% -9.5 0.00 perf-profile.children.cycles-pp.perf_mmap__push
9.54 ± 4% -9.5 0.00 perf-profile.children.cycles-pp.perf_mmap__read_head
7.50 ±110% -7.5 0.01 ±173% perf-profile.children.cycles-pp.mmput
7.50 ±110% -7.5 0.01 ±173% perf-profile.children.cycles-pp.exit_mmap
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.dput
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.do_sys_open
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.do_sys_openat2
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.do_filp_open
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.path_openat
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.link_path_walk
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.walk_component
7.27 ±113% -7.3 0.00 perf-profile.children.cycles-pp.step_into
5.00 ±100% -5.0 0.00 perf-profile.children.cycles-pp.tlb_finish_mmu
5.00 ±100% -5.0 0.00 perf-profile.children.cycles-pp.tlb_flush_mmu
5.00 ±100% -5.0 0.00 perf-profile.children.cycles-pp.release_pages
4.77 ±100% -4.8 0.00 perf-profile.children.cycles-pp.seq_printf
4.77 ±100% -4.8 0.00 perf-profile.children.cycles-pp.seq_vprintf
4.77 ±100% -4.8 0.00 perf-profile.children.cycles-pp.vsnprintf
4.77 ±100% -4.8 0.00 perf-profile.children.cycles-pp.__do_fault
4.77 ±100% -4.8 0.02 ±173% perf-profile.children.cycles-pp.do_fault
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.find_ref_head
0.00 +0.1 0.06 ± 14% perf-profile.children.cycles-pp.memzero_extent_buffer
0.00 +0.1 0.06 ± 16% perf-profile.children.cycles-pp.btrfs_release_extent_buffer_pages
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.btrfs_get_block_group
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.__switch_to_asm
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.check_committed_ref
0.00 +0.1 0.07 ± 31% perf-profile.children.cycles-pp.pagevec_lookup_range_tag
0.00 +0.1 0.07 ± 31% perf-profile.children.cycles-pp.find_get_pages_range_tag
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.btrfs_free_path
0.00 +0.1 0.07 ± 22% perf-profile.children.cycles-pp.btrfs_bio_fits_in_stripe
0.00 +0.1 0.07 ± 30% perf-profile.children.cycles-pp.btrfs_check_node
0.00 +0.1 0.07 ± 38% perf-profile.children.cycles-pp.__slab_free
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.set_next_entity
0.00 +0.1 0.08 ± 21% perf-profile.children.cycles-pp.__switch_to
0.00 +0.1 0.08 ± 32% perf-profile.children.cycles-pp.mark_page_accessed
0.00 +0.1 0.08 ± 40% perf-profile.children.cycles-pp.xas_find_marked
0.00 +0.1 0.08 ± 26% perf-profile.children.cycles-pp.__module_address
0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.dequeue_entity
0.00 +0.1 0.08 ± 19% perf-profile.children.cycles-pp.btrfs_get_chunk_map
0.00 +0.1 0.08 ± 31% perf-profile.children.cycles-pp.kernel_text_address
0.00 +0.1 0.08 ± 27% perf-profile.children.cycles-pp.block_group_cache_tree_search
0.00 +0.1 0.09 ± 28% perf-profile.children.cycles-pp.__blk_mq_try_issue_directly
0.00 +0.1 0.09 ± 14% perf-profile.children.cycles-pp.check_extent_item
0.00 +0.1 0.09 ± 30% perf-profile.children.cycles-pp.___slab_alloc
0.00 +0.1 0.09 ± 29% perf-profile.children.cycles-pp.free_extent_buffer
0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.mark_extent_buffer_accessed
0.00 +0.1 0.09 ± 36% perf-profile.children.cycles-pp.btrfs_inc_extent_ref
0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.select_task_rq_fair
0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.find_next_bit
0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.__kernel_text_address
0.00 +0.1 0.09 ± 29% perf-profile.children.cycles-pp.crc_128
0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.note_gp_changes
0.00 +0.1 0.10 ± 5% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.1 0.10 ± 30% perf-profile.children.cycles-pp.__slab_alloc
0.00 +0.1 0.10 ± 11% perf-profile.children.cycles-pp.btrfs_super_csum_size
0.00 +0.1 0.10 ± 26% perf-profile.children.cycles-pp.push_leaf_left
0.00 +0.1 0.10 ± 39% perf-profile.children.cycles-pp.cpumask_next_and
0.00 +0.1 0.10 ± 29% perf-profile.children.cycles-pp.rcu_nmi_exit
0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.dequeue_task_fair
0.00 +0.1 0.10 ± 32% perf-profile.children.cycles-pp.unwind_get_return_address
0.00 +0.1 0.10 ± 24% perf-profile.children.cycles-pp.btrfs_get_io_geometry
0.00 +0.1 0.10 ± 27% perf-profile.children.cycles-pp.idle_cpu
0.00 +0.1 0.10 ± 39% perf-profile.children.cycles-pp.calc_global_load_tick
0.00 +0.1 0.10 ± 44% perf-profile.children.cycles-pp.memcpy_erms
0.00 +0.1 0.10 ± 35% perf-profile.children.cycles-pp.btrfs_add_delayed_data_ref
0.00 +0.1 0.11 ± 10% perf-profile.children.cycles-pp.call_cpuidle
0.00 +0.1 0.11 ± 35% perf-profile.children.cycles-pp.__percpu_counter_sum
0.00 +0.1 0.11 ± 35% perf-profile.children.cycles-pp.__percpu_counter_compare
0.00 +0.1 0.11 ± 23% perf-profile.children.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.11 ± 28% perf-profile.children.cycles-pp.insert_state
0.00 +0.1 0.11 ± 39% perf-profile.children.cycles-pp.__btrfs_btree_balance_dirty
0.00 +0.1 0.11 ± 20% perf-profile.children.cycles-pp.prepare_pages
0.00 +0.1 0.11 ± 17% perf-profile.children.cycles-pp.rcu_dynticks_eqs_exit
0.00 +0.1 0.11 ± 27% perf-profile.children.cycles-pp.memcpy_extent_buffer
0.00 +0.1 0.12 ± 42% perf-profile.children.cycles-pp.rb_erase
0.00 +0.1 0.12 ± 38% perf-profile.children.cycles-pp.idtentry_exit_cond_rcu
0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.rcu_dynticks_eqs_enter
0.00 +0.1 0.12 ± 20% perf-profile.children.cycles-pp.account_process_tick
0.00 +0.1 0.12 ± 16% perf-profile.children.cycles-pp.btrfs_cross_ref_exist
0.00 +0.1 0.12 ± 15% perf-profile.children.cycles-pp.__test_set_page_writeback
0.00 +0.1 0.12 ± 18% perf-profile.children.cycles-pp.rcu_eqs_exit
0.00 +0.1 0.12 ± 21% perf-profile.children.cycles-pp.___might_sleep
0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.end_extent_writepage
0.00 +0.1 0.12 ± 6% perf-profile.children.cycles-pp.btrfs_writepage_endio_finish_ordered
0.00 +0.1 0.12 ± 29% perf-profile.children.cycles-pp.btrfs_try_tree_write_lock
0.00 +0.1 0.13 ± 27% perf-profile.children.cycles-pp.__clear_extent_bit
0.00 +0.1 0.13 ± 17% perf-profile.children.cycles-pp.end_bio_extent_buffer_writepage
0.00 +0.1 0.13 ± 14% perf-profile.children.cycles-pp.clear_page_dirty_for_io
0.00 +0.1 0.13 ± 31% perf-profile.children.cycles-pp.unpin_extent_range
0.00 +0.1 0.13 ± 29% perf-profile.children.cycles-pp.release_extent_buffer
0.00 +0.1 0.13 ± 21% perf-profile.children.cycles-pp.btrfs_wq_submit_bio
0.00 +0.1 0.13 ± 38% perf-profile.children.cycles-pp.btrfs_find_delalloc_range
0.00 +0.1 0.13 ± 94% perf-profile.children.cycles-pp.timerqueue_add
0.00 +0.1 0.14 ± 25% perf-profile.children.cycles-pp.run_one_async_done
0.00 +0.1 0.14 ± 19% perf-profile.children.cycles-pp.btrfs_submit_bio_hook
0.00 +0.1 0.14 ± 38% perf-profile.children.cycles-pp.unpin_extent_cache
0.00 +0.1 0.14 ± 13% perf-profile.children.cycles-pp.pick_next_task_fair
0.00 +0.1 0.14 ± 91% perf-profile.children.cycles-pp.update_ts_time_stats
0.00 +0.1 0.14 ± 72% perf-profile.children.cycles-pp.rb_next
0.00 +0.1 0.14 ± 35% perf-profile.children.cycles-pp.btrfs_finish_extent_commit
0.00 +0.1 0.14 ± 52% perf-profile.children.cycles-pp.rcu_nmi_enter
0.00 +0.1 0.14 ± 32% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.15 ± 65% perf-profile.children.cycles-pp.nr_iowait_cpu
0.00 +0.1 0.15 ± 31% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.00 +0.1 0.15 ± 51% perf-profile.children.cycles-pp.rb_insert_color
0.00 +0.1 0.15 ± 34% perf-profile.children.cycles-pp.find_lock_delalloc_range
0.00 +0.2 0.15 ± 86% perf-profile.children.cycles-pp.enqueue_hrtimer
0.00 +0.2 0.16 ± 62% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.00 +0.2 0.16 ± 19% perf-profile.children.cycles-pp.btrfs_comp_cpu_keys
0.00 +0.2 0.16 ± 2% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.00 +0.2 0.16 ± 35% perf-profile.children.cycles-pp.btrfs_update_block_group
0.00 +0.2 0.17 ± 25% perf-profile.children.cycles-pp.queued_write_lock_slowpath
0.00 +0.2 0.17 ± 19% perf-profile.children.cycles-pp.finish_wait
0.00 +0.2 0.17 ± 21% perf-profile.children.cycles-pp.test_clear_page_writeback
0.00 +0.2 0.17 ± 36% perf-profile.children.cycles-pp.kmem_cache_free
0.00 +0.2 0.17 ± 26% perf-profile.children.cycles-pp.down_read
0.00 +0.2 0.17 ± 27% perf-profile.children.cycles-pp.__orc_find
0.00 +0.2 0.17 ± 27% perf-profile.children.cycles-pp.__radix_tree_lookup
0.00 +0.2 0.17 ± 59% perf-profile.children.cycles-pp.idtentry_enter_cond_rcu
0.00 +0.2 0.17 ± 21% perf-profile.children.cycles-pp.end_page_writeback
0.00 +0.2 0.17 ± 14% perf-profile.children.cycles-pp.rcu_idle_exit
0.00 +0.2 0.17 ± 22% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.00 +0.2 0.17 ± 45% perf-profile.children.cycles-pp.update_irq_load_avg
0.00 +0.2 0.18 ± 16% perf-profile.children.cycles-pp.run_local_timers
0.00 +0.2 0.18 ± 40% perf-profile.children.cycles-pp.find_get_entry
0.00 +0.2 0.18 ± 21% perf-profile.children.cycles-pp.xas_load
0.00 +0.2 0.18 ± 28% perf-profile.children.cycles-pp.memmove_extent_buffer
0.00 +0.2 0.18 ± 16% perf-profile.children.cycles-pp.end_bio_extent_writepage
0.00 +0.2 0.18 ± 32% perf-profile.children.cycles-pp.__set_page_dirty_nobuffers
0.00 +0.2 0.18 ± 72% perf-profile.children.cycles-pp.timerqueue_del
0.00 +0.2 0.18 ± 18% perf-profile.children.cycles-pp.btrfs_free_tree_block
0.00 +0.2 0.19 ± 21% perf-profile.children.cycles-pp.blk_mq_submit_bio
0.00 +0.2 0.20 ± 27% perf-profile.children.cycles-pp.btrfs_release_path
0.00 +0.2 0.20 ± 32% perf-profile.children.cycles-pp.set_extent_buffer_dirty
0.00 +0.2 0.20 ± 38% perf-profile.children.cycles-pp.run_timer_softirq
0.00 +0.2 0.20 ± 25% perf-profile.children.cycles-pp.orc_find
0.00 +0.2 0.20 ± 21% perf-profile.children.cycles-pp.btrfs_unlock_up_safe
0.00 +0.2 0.20 ± 29% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.00 +0.2 0.20 ± 38% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.21 ± 25% perf-profile.children.cycles-pp.__push_leaf_right
0.00 +0.2 0.21 ± 44% perf-profile.children.cycles-pp.lock_and_cleanup_extent_if_need
0.00 +0.2 0.21 ± 55% perf-profile.children.cycles-pp.io_serial_in
0.00 +0.2 0.21 ± 19% perf-profile.children.cycles-pp.__queue_work
0.00 +0.2 0.21 ± 48% perf-profile.children.cycles-pp.btrfs_get_extent
0.00 +0.2 0.22 ± 25% perf-profile.children.cycles-pp.memmove
0.00 +0.2 0.22 ± 17% perf-profile.children.cycles-pp.queue_work_on
0.00 +0.2 0.22 ± 25% perf-profile.children.cycles-pp.submit_bio_noacct
0.00 +0.2 0.22 ± 22% perf-profile.children.cycles-pp.btrfs_delayed_refs_rsv_release
0.00 +0.2 0.22 ± 15% perf-profile.children.cycles-pp.__extent_writepage_io
0.00 +0.2 0.22 ± 36% perf-profile.children.cycles-pp.run_rebalance_domains
0.00 +0.2 0.23 ± 25% perf-profile.children.cycles-pp.submit_bio
0.00 +0.2 0.23 ± 33% perf-profile.children.cycles-pp.btrfs_mark_buffer_dirty
0.00 +0.2 0.23 ± 16% perf-profile.children.cycles-pp.schedule_idle
0.00 +0.2 0.24 ± 17% perf-profile.children.cycles-pp.add_delayed_ref_head
0.00 +0.2 0.24 ± 21% perf-profile.children.cycles-pp.csum_exist_in_range
0.00 +0.2 0.24 ± 21% perf-profile.children.cycles-pp.btrfs_lookup_csums_range
0.00 +0.2 0.24 ± 79% perf-profile.children.cycles-pp.__remove_hrtimer
0.00 +0.2 0.24 ± 57% perf-profile.children.cycles-pp.update_blocked_averages
0.00 +0.2 0.25 ± 47% perf-profile.children.cycles-pp.serial8250_console_putchar
0.00 +0.2 0.25 ± 5% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.00 +0.2 0.25 ± 48% perf-profile.children.cycles-pp.uart_console_write
0.00 +0.3 0.25 ± 14% perf-profile.children.cycles-pp.kmem_cache_alloc
0.00 +0.3 0.25 ± 45% perf-profile.children.cycles-pp.wait_for_xmitr
0.00 +0.3 0.26 ± 45% perf-profile.children.cycles-pp.serial8250_console_write
0.00 +0.3 0.26 ± 32% perf-profile.children.cycles-pp.set_extent_bit
0.00 +0.3 0.27 ± 14% perf-profile.children.cycles-pp.btrfs_try_granting_tickets
0.00 +0.3 0.27 ± 33% perf-profile.children.cycles-pp.create_io_em
0.00 +0.3 0.27 ± 33% perf-profile.children.cycles-pp.pagecache_get_page
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.sysvec_irq_work
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.__sysvec_irq_work
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.irq_work_run
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.irq_work_single
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.printk
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.vprintk_emit
0.00 +0.3 0.27 ± 44% perf-profile.children.cycles-pp.console_unlock
0.00 +0.3 0.27 ± 36% perf-profile.children.cycles-pp.btrfs_drop_extent_cache
0.00 +0.3 0.28 ± 13% perf-profile.children.cycles-pp.rcu_core
0.00 +0.3 0.28 ± 45% perf-profile.children.cycles-pp.btrfs_dirty_pages
0.00 +0.3 0.29 ± 48% perf-profile.children.cycles-pp.irq_work_run_list
0.00 +0.3 0.29 ± 8% perf-profile.children.cycles-pp.btrfs_inode_rsv_release
0.00 +0.3 0.29 ± 15% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.00 +0.3 0.29 ± 38% perf-profile.children.cycles-pp.alloc_extent_buffer
0.00 +0.3 0.30 ± 40% perf-profile.children.cycles-pp.lookup_inline_extent_backref
0.00 +0.3 0.31 ± 13% perf-profile.children.cycles-pp.btrfs_add_delayed_tree_ref
0.00 +0.3 0.32 ± 23% perf-profile.children.cycles-pp.btrfs_map_bio
0.00 +0.3 0.33 ± 32% perf-profile.children.cycles-pp.lock_extent_bits
0.00 +0.3 0.33 ± 35% perf-profile.children.cycles-pp.generic_bin_search
0.00 +0.3 0.34 ± 26% perf-profile.children.cycles-pp.schedule
0.00 +0.4 0.36 ± 16% perf-profile.children.cycles-pp.btrfs_end_bio
0.00 +0.4 0.37 ± 27% perf-profile.children.cycles-pp.find_extent_buffer
0.00 +0.4 0.38 ± 14% perf-profile.children.cycles-pp.blk_update_request
0.00 +0.4 0.39 ± 34% perf-profile.children.cycles-pp.btrfs_del_items
0.00 +0.4 0.39 ± 13% perf-profile.children.cycles-pp.__lock_text_start
0.00 +0.4 0.39 ± 15% perf-profile.children.cycles-pp.blk_mq_end_request
0.00 +0.4 0.40 ± 44% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.4 0.42 ± 19% perf-profile.children.cycles-pp.update_sd_lb_stats
0.00 +0.4 0.44 ± 21% perf-profile.children.cycles-pp.find_busiest_group
0.00 +0.4 0.44 ± 16% perf-profile.children.cycles-pp.native_sched_clock
0.00 +0.4 0.45 ± 13% perf-profile.children.cycles-pp.unlock_up
0.00 +0.5 0.45 ± 23% perf-profile.children.cycles-pp.btrfs_get_8
0.00 +0.5 0.45 ± 13% perf-profile.children.cycles-pp.nvme_irq
0.00 +0.5 0.46 ± 21% perf-profile.children.cycles-pp.unwind_next_frame
0.00 +0.5 0.46 ± 13% perf-profile.children.cycles-pp.__handle_irq_event_percpu
0.00 +0.5 0.46 ± 8% perf-profile.children.cycles-pp.read_tsc
0.00 +0.5 0.46 ± 15% perf-profile.children.cycles-pp.sched_clock
0.00 +0.5 0.47 ± 13% perf-profile.children.cycles-pp.handle_irq_event_percpu
0.00 +0.5 0.47 ± 83% perf-profile.children.cycles-pp.__filemap_fdatawrite_range
0.00 +0.5 0.48 ± 16% perf-profile.children.cycles-pp.start_kernel
0.00 +0.5 0.48 ± 82% perf-profile.children.cycles-pp.btrfs_write_marked_extents
0.00 +0.5 0.49 ± 13% perf-profile.children.cycles-pp.handle_irq_event
0.00 +0.5 0.49 ± 30% perf-profile.children.cycles-pp.read_block_for_search
0.00 +0.5 0.49 ± 10% perf-profile.children.cycles-pp.lapic_next_deadline
0.00 +0.5 0.49 ± 80% perf-profile.children.cycles-pp.btrfs_write_and_wait_transaction
0.00 +0.5 0.50 ± 14% perf-profile.children.cycles-pp.handle_edge_irq
0.00 +0.5 0.51 ± 11% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.00 +0.5 0.51 ± 14% perf-profile.children.cycles-pp.btrfs_block_rsv_release
0.00 +0.5 0.52 ± 41% perf-profile.children.cycles-pp.__lookup_extent_mapping
0.00 +0.5 0.52 ± 39% perf-profile.children.cycles-pp._raw_spin_trylock
0.00 +0.5 0.52 ± 38% perf-profile.children.cycles-pp.__etree_search
0.00 +0.5 0.53 ± 12% perf-profile.children.cycles-pp.common_interrupt
0.00 +0.5 0.53 ± 20% perf-profile.children.cycles-pp.cow_file_range
0.00 +0.5 0.53 ± 13% perf-profile.children.cycles-pp.asm_common_interrupt
0.00 +0.5 0.55 ± 23% perf-profile.children.cycles-pp.btrfs_set_token_32
0.00 +0.6 0.55 ± 20% perf-profile.children.cycles-pp.__sched_text_start
0.00 +0.6 0.56 ± 98% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.6 0.58 ± 28% perf-profile.children.cycles-pp.sched_clock_cpu
0.00 +0.6 0.59 ± 31% perf-profile.children.cycles-pp.__set_extent_bit
0.00 +0.6 0.59 ± 12% perf-profile.children.cycles-pp.btrfs_reserve_metadata_bytes
0.00 +0.6 0.60 ± 34% perf-profile.children.cycles-pp.btrfs_get_token_32
0.00 +0.6 0.60 ± 25% perf-profile.children.cycles-pp.load_balance
0.00 +0.6 0.61 ± 12% perf-profile.children.cycles-pp.btrfs_delalloc_reserve_metadata
0.00 +0.6 0.63 ± 19% perf-profile.children.cycles-pp.arch_stack_walk
0.00 +0.6 0.64 ± 22% perf-profile.children.cycles-pp.find_free_extent
0.00 +0.6 0.64 ± 20% perf-profile.children.cycles-pp.btrfs_read_lock_root_node
0.00 +0.7 0.66 ± 49% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.00 +0.7 0.67 ± 40% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.00 +0.7 0.67 ± 21% perf-profile.children.cycles-pp.btrfs_reserve_extent
0.00 +0.7 0.68 ± 20% perf-profile.children.cycles-pp.btrfs_tree_read_lock
0.00 +0.7 0.68 ± 18% perf-profile.children.cycles-pp.stack_trace_save_tsk
0.00 +0.7 0.70 ± 30% perf-profile.children.cycles-pp.push_leaf_right
0.00 +0.7 0.72 ± 72% perf-profile.children.cycles-pp.btrfs_commit_transaction
0.00 +0.7 0.74 ± 17% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.7 0.75 ± 9% perf-profile.children.cycles-pp.__next_timer_interrupt
0.00 +0.8 0.77 ± 22% perf-profile.children.cycles-pp.btrfs_lock_root_node
0.00 +0.8 0.78 ± 17% perf-profile.children.cycles-pp.__account_scheduler_latency
0.00 +0.8 0.81 ± 36% perf-profile.children.cycles-pp.__btrfs_free_extent
0.00 +0.8 0.81 ± 21% perf-profile.children.cycles-pp.btrfs_tree_lock
0.00 +0.8 0.81 ± 29% perf-profile.children.cycles-pp.split_leaf
0.00 +0.8 0.85 ± 24% perf-profile.children.cycles-pp.btrfs_alloc_tree_block
0.00 +0.9 0.85 ± 10% perf-profile.children.cycles-pp.irqtime_account_irq
0.00 +0.9 0.85 ± 24% perf-profile.children.cycles-pp.alloc_tree_block_no_bg_flush
0.00 +0.9 0.86 ± 42% perf-profile.children.cycles-pp.scheduler_tick
0.00 +0.9 0.87 ± 18% perf-profile.children.cycles-pp.read_extent_buffer
0.00 +0.9 0.89 ± 20% perf-profile.children.cycles-pp.setup_leaf_for_split
0.00 +0.9 0.90 ± 18% perf-profile.children.cycles-pp.enqueue_entity
0.00 +0.9 0.90 ± 22% perf-profile.children.cycles-pp.tick_irq_enter
0.00 +0.9 0.92 ± 18% perf-profile.children.cycles-pp.enqueue_task_fair
0.00 +0.9 0.93 ± 18% perf-profile.children.cycles-pp.ttwu_do_activate
0.00 +1.0 0.99 ± 21% perf-profile.children.cycles-pp.prepare_to_wait_event
0.00 +1.0 1.02 ± 17% perf-profile.children.cycles-pp.autoremove_wake_function
0.00 +1.0 1.04 ± 16% perf-profile.children.cycles-pp.__wake_up_common
0.00 +1.1 1.05 ± 10% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.00 +1.1 1.09 ± 23% perf-profile.children.cycles-pp.btrfs_lookup_csum
0.00 +1.1 1.09 ± 16% perf-profile.children.cycles-pp.__wake_up_common_lock
0.00 +1.1 1.12 ± 44% perf-profile.children.cycles-pp.copy_extent_buffer_full
0.00 +1.1 1.12 ± 44% perf-profile.children.cycles-pp.copy_page
0.00 +1.2 1.16 ± 25% perf-profile.children.cycles-pp.setup_items_for_insert
0.00 +1.2 1.17 ± 5% perf-profile.children.cycles-pp.rebalance_domains
0.00 +1.2 1.22 ± 17% perf-profile.children.cycles-pp.try_to_wake_up
0.00 +1.2 1.22 ± 21% perf-profile.children.cycles-pp.run_delalloc_nocow
0.00 +1.3 1.25 ± 19% perf-profile.children.cycles-pp.irq_enter_rcu
0.00 +1.3 1.31 ± 23% perf-profile.children.cycles-pp.check_setget_bounds
0.00 +1.3 1.34 ± 26% perf-profile.children.cycles-pp.btrfs_insert_empty_items
0.00 +1.3 1.34 ± 24% perf-profile.children.cycles-pp.__btrfs_drop_extents
0.00 +1.3 1.35 ± 21% perf-profile.children.cycles-pp.btrfs_duplicate_item
0.00 +1.4 1.39 ± 24% perf-profile.children.cycles-pp.insert_reserved_file_extent
0.00 +1.4 1.43 ± 32% perf-profile.children.cycles-pp.btrfs_run_delayed_refs_for_head
0.00 +1.4 1.45 ± 28% perf-profile.children.cycles-pp.clockevents_program_event
0.00 +1.5 1.49 ± 24% perf-profile.children.cycles-pp.btrfs_lookup_file_extent
0.00 +1.6 1.56 ± 21% perf-profile.children.cycles-pp.btrfs_get_64
0.00 +1.7 1.72 ± 23% perf-profile.children.cycles-pp.btrfs_buffered_write
0.00 +1.7 1.73 ± 23% perf-profile.children.cycles-pp.btrfs_file_write_iter
0.00 +1.8 1.75 ± 21% perf-profile.children.cycles-pp.btrfs_run_delalloc_range
0.00 +1.8 1.76 ± 23% perf-profile.children.cycles-pp.new_sync_write
0.00 +1.8 1.78 ± 23% perf-profile.children.cycles-pp.ksys_write
0.00 +1.8 1.78 ± 23% perf-profile.children.cycles-pp.vfs_write
0.00 +1.8 1.79 ± 23% perf-profile.children.cycles-pp.__libc_write
0.00 +1.8 1.80 ± 31% perf-profile.children.cycles-pp.btrfs_run_delayed_refs
0.00 +1.8 1.80 ± 31% perf-profile.children.cycles-pp.__btrfs_run_delayed_refs
0.00 +1.9 1.91 ± 21% perf-profile.children.cycles-pp.writepage_delalloc
0.00 +1.9 1.95 ± 55% perf-profile.children.cycles-pp.update_process_times
0.00 +2.0 1.97 ± 16% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.00 +2.0 2.03 ± 24% perf-profile.children.cycles-pp.add_pending_csums
0.00 +2.0 2.03 ± 24% perf-profile.children.cycles-pp.btrfs_csum_file_blocks
0.00 +2.0 2.04 ± 57% perf-profile.children.cycles-pp.tick_sched_handle
0.00 +2.1 2.14 ± 21% perf-profile.children.cycles-pp.__extent_writepage
0.00 +2.1 2.15 ± 12% perf-profile.children.cycles-pp.tick_nohz_next_event
0.00 +2.2 2.23 ± 21% perf-profile.children.cycles-pp.extent_writepages
0.00 +2.2 2.23 ± 21% perf-profile.children.cycles-pp.extent_write_cache_pages
0.00 +2.5 2.46 ± 11% perf-profile.children.cycles-pp.__softirqentry_text_start
0.00 +2.5 2.48 ± 32% perf-profile.children.cycles-pp.flush_space
0.00 +2.5 2.48 ± 13% perf-profile.children.cycles-pp.do_softirq_own_stack
0.00 +2.5 2.48 ± 33% perf-profile.children.cycles-pp.btrfs_async_reclaim_metadata_space
0.00 +2.5 2.49 ± 8% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.00 +2.5 2.50 ± 45% perf-profile.children.cycles-pp.tick_sched_timer
0.00 +2.5 2.54 ± 31% perf-profile.children.cycles-pp.__btrfs_cow_block
0.00 +2.5 2.55 ± 32% perf-profile.children.cycles-pp.btrfs_cow_block
0.00 +2.6 2.60 ± 20% perf-profile.children.cycles-pp.check_extent_data_item
0.00 +2.6 2.63 ± 28% perf-profile.children.cycles-pp.ktime_get
0.00 +2.6 2.65 ± 19% perf-profile.children.cycles-pp.btrfs_get_32
0.00 +2.9 2.92 ± 12% perf-profile.children.cycles-pp.irq_exit_rcu
0.00 +2.9 2.94 ± 25% perf-profile.children.cycles-pp.btrfs_mark_extent_written
0.00 +3.9 3.89 ± 43% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +5.7 5.72 ± 24% perf-profile.children.cycles-pp.btrfs_search_slot
0.00 +6.3 6.26 ± 21% perf-profile.children.cycles-pp.hrtimer_interrupt
0.00 +6.4 6.41 ± 22% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
0.00 +6.8 6.84 ± 24% perf-profile.children.cycles-pp.btrfs_finish_ordered_io
0.00 +6.9 6.90 ± 19% perf-profile.children.cycles-pp.check_leaf
0.00 +7.0 7.00 ± 19% perf-profile.children.cycles-pp.btree_csum_one_bio
0.00 +7.1 7.06 ± 24% perf-profile.children.cycles-pp.btrfs_work_helper
0.00 +7.2 7.19 ± 19% perf-profile.children.cycles-pp.btree_submit_bio_hook
0.00 +7.3 7.29 ± 19% perf-profile.children.cycles-pp.submit_extent_page
0.00 +7.3 7.33 ± 19% perf-profile.children.cycles-pp.submit_one_bio
0.00 +7.4 7.41 ± 19% perf-profile.children.cycles-pp.write_one_eb
0.00 +7.7 7.68 ± 19% perf-profile.children.cycles-pp.btree_write_cache_pages
0.00 +9.4 9.45 ± 20% perf-profile.children.cycles-pp.__writeback_single_inode
0.00 +9.4 9.45 ± 20% perf-profile.children.cycles-pp.wb_writeback
0.00 +9.4 9.45 ± 20% perf-profile.children.cycles-pp.writeback_sb_inodes
0.00 +9.5 9.45 ± 20% perf-profile.children.cycles-pp.wb_workfn
0.00 +9.6 9.63 ± 20% perf-profile.children.cycles-pp.asm_call_on_stack
0.00 +9.9 9.92 ± 19% perf-profile.children.cycles-pp.do_writepages
0.00 +11.6 11.55 ± 16% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
0.00 +16.1 16.05 ± 43% perf-profile.children.cycles-pp.menu_select
0.00 +16.6 16.56 ± 8% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +19.1 19.14 ± 22% perf-profile.children.cycles-pp.process_one_work
0.00 +19.3 19.29 ± 22% perf-profile.children.cycles-pp.worker_thread
0.00 +19.4 19.36 ± 22% perf-profile.children.cycles-pp.kthread
0.00 +19.4 19.36 ± 22% perf-profile.children.cycles-pp.ret_from_fork
50.00 ± 23% +27.1 77.12 ± 6% perf-profile.children.cycles-pp.start_secondary
50.00 ± 23% +27.6 77.60 ± 6% perf-profile.children.cycles-pp.do_idle
50.00 ± 23% +27.6 77.61 ± 6% perf-profile.children.cycles-pp.secondary_startup_64
50.00 ± 23% +27.6 77.61 ± 6% perf-profile.children.cycles-pp.cpu_startup_entry
50.00 ± 23% -15.2 34.80 ± 13% perf-profile.self.cycles-pp.intel_idle
4.77 ±100% -4.8 0.00 perf-profile.self.cycles-pp.__handle_mm_fault
0.00 +0.1 0.05 perf-profile.self.cycles-pp.find_ref_head
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.memzero_extent_buffer
0.00 +0.1 0.06 ± 28% perf-profile.self.cycles-pp.clockevents_program_event
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.rcu_idle_exit
0.00 +0.1 0.07 ± 26% perf-profile.self.cycles-pp.__switch_to_asm
0.00 +0.1 0.07 ± 33% perf-profile.self.cycles-pp.mark_page_accessed
0.00 +0.1 0.07 ± 31% perf-profile.self.cycles-pp.__btrfs_cow_block
0.00 +0.1 0.07 ± 35% perf-profile.self.cycles-pp.__sysvec_apic_timer_interrupt
0.00 +0.1 0.07 ± 38% perf-profile.self.cycles-pp.__slab_free
0.00 +0.1 0.08 ± 21% perf-profile.self.cycles-pp.__switch_to
0.00 +0.1 0.08 ± 23% perf-profile.self.cycles-pp.__module_address
0.00 +0.1 0.08 ± 32% perf-profile.self.cycles-pp.get_next_timer_interrupt
0.00 +0.1 0.08 ± 40% perf-profile.self.cycles-pp.xas_find_marked
0.00 +0.1 0.08 ± 17% perf-profile.self.cycles-pp.btrfs_super_csum_size
0.00 +0.1 0.08 ± 13% perf-profile.self.cycles-pp.btrfs_search_slot
0.00 +0.1 0.08 ± 15% perf-profile.self.cycles-pp.clear_page_dirty_for_io
0.00 +0.1 0.09 ± 35% perf-profile.self.cycles-pp.crc_128
0.00 +0.1 0.09 ± 34% perf-profile.self.cycles-pp.kmem_cache_free
0.00 +0.1 0.09 ± 8% perf-profile.self.cycles-pp.kmem_cache_alloc
0.00 +0.1 0.09 ± 25% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +0.1 0.10 ± 15% perf-profile.self.cycles-pp.tick_sched_timer
0.00 +0.1 0.10 ± 46% perf-profile.self.cycles-pp.load_balance
0.00 +0.1 0.10 ± 33% perf-profile.self.cycles-pp.idle_cpu
0.00 +0.1 0.10 ± 39% perf-profile.self.cycles-pp.calc_global_load_tick
0.00 +0.1 0.10 ± 44% perf-profile.self.cycles-pp.memcpy_erms
0.00 +0.1 0.11 ± 10% perf-profile.self.cycles-pp.call_cpuidle
0.00 +0.1 0.11 ± 87% perf-profile.self.cycles-pp.sched_clock_cpu
0.00 +0.1 0.11 ± 39% perf-profile.self.cycles-pp.rb_erase
0.00 +0.1 0.11 ± 14% perf-profile.self.cycles-pp.rcu_dynticks_eqs_exit
0.00 +0.1 0.11 ± 27% perf-profile.self.cycles-pp.find_extent_buffer
0.00 +0.1 0.11 ± 21% perf-profile.self.cycles-pp.setup_items_for_insert
0.00 +0.1 0.11 ± 14% perf-profile.self.cycles-pp.rcu_dynticks_eqs_enter
0.00 +0.1 0.11 ± 19% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.12 ± 25% perf-profile.self.cycles-pp.___might_sleep
0.00 +0.1 0.12 ± 20% perf-profile.self.cycles-pp.account_process_tick
0.00 +0.1 0.12 ± 25% perf-profile.self.cycles-pp.down_read
0.00 +0.1 0.12 ± 21% perf-profile.self.cycles-pp.__sched_text_start
0.00 +0.1 0.12 ± 19% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.12 ± 48% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.00 +0.1 0.13 ± 23% perf-profile.self.cycles-pp.rebalance_domains
0.00 +0.1 0.13 ± 78% perf-profile.self.cycles-pp.rb_next
0.00 +0.1 0.13 ± 49% perf-profile.self.cycles-pp.run_timer_softirq
0.00 +0.1 0.14 ± 23% perf-profile.self.cycles-pp.queued_write_lock_slowpath
0.00 +0.1 0.14 ± 26% perf-profile.self.cycles-pp.find_free_extent
0.00 +0.1 0.14 ± 64% perf-profile.self.cycles-pp.nr_iowait_cpu
0.00 +0.1 0.15 ± 51% perf-profile.self.cycles-pp.rb_insert_color
0.00 +0.2 0.15 ± 48% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.2 0.15 ± 17% perf-profile.self.cycles-pp.btrfs_comp_cpu_keys
0.00 +0.2 0.15 ± 26% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.2 0.16 ± 24% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.00 +0.2 0.17 ± 19% perf-profile.self.cycles-pp.run_local_timers
0.00 +0.2 0.17 ± 27% perf-profile.self.cycles-pp.xas_load
0.00 +0.2 0.17 ± 28% perf-profile.self.cycles-pp.__radix_tree_lookup
0.00 +0.2 0.17 ± 27% perf-profile.self.cycles-pp.__orc_find
0.00 +0.2 0.17 ± 43% perf-profile.self.cycles-pp.update_irq_load_avg
0.00 +0.2 0.18 ± 18% perf-profile.self.cycles-pp.add_delayed_ref_head
0.00 +0.2 0.20 ± 9% perf-profile.self.cycles-pp.__softirqentry_text_start
0.00 +0.2 0.20 ± 4% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.2 0.20 ± 29% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.00 +0.2 0.21 ± 17% perf-profile.self.cycles-pp.unwind_next_frame
0.00 +0.2 0.21 ± 55% perf-profile.self.cycles-pp.io_serial_in
0.00 +0.2 0.22 ± 25% perf-profile.self.cycles-pp.memmove
0.00 +0.2 0.25 ± 5% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.00 +0.3 0.27 ± 15% perf-profile.self.cycles-pp.__next_timer_interrupt
0.00 +0.3 0.27 ± 39% perf-profile.self.cycles-pp.generic_bin_search
0.00 +0.3 0.29 ± 8% perf-profile.self.cycles-pp.update_sd_lb_stats
0.00 +0.3 0.30 ± 14% perf-profile.self.cycles-pp.do_idle
0.00 +0.3 0.30 ± 24% perf-profile.self.cycles-pp.btrfs_get_8
0.00 +0.3 0.33 ± 21% perf-profile.self.cycles-pp.check_extent_data_item
0.00 +0.4 0.36 ± 30% perf-profile.self.cycles-pp.tick_nohz_next_event
0.00 +0.4 0.36 ± 12% perf-profile.self.cycles-pp.__lock_text_start
0.00 +0.4 0.37 ± 23% perf-profile.self.cycles-pp.btrfs_set_token_32
0.00 +0.4 0.42 ± 13% perf-profile.self.cycles-pp.native_sched_clock
0.00 +0.4 0.42 ± 16% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.00 +0.4 0.44 ± 7% perf-profile.self.cycles-pp.read_tsc
0.00 +0.5 0.46 ± 34% perf-profile.self.cycles-pp.btrfs_get_token_32
0.00 +0.5 0.47 ±106% perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.00 +0.5 0.49 ± 10% perf-profile.self.cycles-pp.lapic_next_deadline
0.00 +0.5 0.51 ± 41% perf-profile.self.cycles-pp._raw_spin_trylock
0.00 +0.5 0.51 ± 38% perf-profile.self.cycles-pp.__etree_search
0.00 +0.5 0.52 ± 41% perf-profile.self.cycles-pp.__lookup_extent_mapping
0.00 +0.6 0.65 ± 17% perf-profile.self.cycles-pp.irqtime_account_irq
0.00 +0.7 0.65 ± 51% perf-profile.self.cycles-pp.timekeeping_max_deferment
0.00 +0.8 0.84 ± 19% perf-profile.self.cycles-pp.read_extent_buffer
0.00 +1.1 1.12 ± 44% perf-profile.self.cycles-pp.copy_page
0.00 +1.1 1.13 ± 23% perf-profile.self.cycles-pp.check_setget_bounds
0.00 +1.2 1.16 ± 22% perf-profile.self.cycles-pp.check_leaf
0.00 +1.2 1.22 ± 20% perf-profile.self.cycles-pp.btrfs_get_64
0.00 +2.0 1.96 ± 16% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.00 +2.0 2.04 ± 18% perf-profile.self.cycles-pp.btrfs_get_32
0.00 +2.2 2.23 ± 34% perf-profile.self.cycles-pp.ktime_get
0.00 +11.6 11.63 ± 50% perf-profile.self.cycles-pp.cpuidle_enter_state
0.00 +13.3 13.34 ± 51% perf-profile.self.cycles-pp.menu_select
9929 ± 19% +275.1% 37243 ± 8% softirqs.CPU0.RCU
7725 ± 4% +446.9% 42252 ± 4% softirqs.CPU0.SCHED
24234 ± 2% +480.7% 140715 ± 10% softirqs.CPU0.TIMER
7563 ± 7% +376.2% 36020 ± 8% softirqs.CPU1.RCU
5632 ± 3% +592.5% 39000 ± 12% softirqs.CPU1.SCHED
19850 +585.1% 136004 ± 9% softirqs.CPU1.TIMER
7338 ± 5% +385.9% 35657 ± 12% softirqs.CPU10.RCU
4924 ± 10% +664.1% 37626 ± 9% softirqs.CPU10.SCHED
18937 ± 3% +605.7% 133629 ± 10% softirqs.CPU10.TIMER
6745 ± 6% +435.1% 36096 ± 16% softirqs.CPU100.RCU
5306 ± 2% +567.5% 35423 ± 20% softirqs.CPU100.SCHED
18790 ± 4% +586.9% 129065 ± 11% softirqs.CPU100.TIMER
6804 ± 7% +432.2% 36211 ± 16% softirqs.CPU101.RCU
5317 ± 3% +644.8% 39603 ± 2% softirqs.CPU101.SCHED
19083 ± 4% +579.8% 129734 ± 11% softirqs.CPU101.TIMER
7404 ± 11% +349.3% 33265 ± 3% softirqs.CPU102.RCU
5550 ± 7% +580.5% 37773 ± 4% softirqs.CPU102.SCHED
18967 ± 3% +577.1% 128424 ± 10% softirqs.CPU102.TIMER
6864 ± 5% +422.2% 35845 ± 14% softirqs.CPU103.RCU
5330 ± 4% +635.8% 39220 ± 2% softirqs.CPU103.SCHED
18679 ± 5% +594.3% 129694 ± 10% softirqs.CPU103.TIMER
6945 ± 6% +393.1% 34249 ± 6% softirqs.CPU104.RCU
5287 ± 4% +645.7% 39430 softirqs.CPU104.SCHED
18858 ± 2% +586.2% 129410 ± 10% softirqs.CPU104.TIMER
6717 ± 4% +440.1% 36280 ± 15% softirqs.CPU105.RCU
4916 ± 10% +697.7% 39221 softirqs.CPU105.SCHED
18633 ± 2% +600.2% 130475 ± 10% softirqs.CPU105.TIMER
6933 ± 5% +421.7% 36171 ± 18% softirqs.CPU106.RCU
4959 ± 8% +707.5% 40046 ± 4% softirqs.CPU106.SCHED
18385 ± 2% +611.4% 130796 ± 12% softirqs.CPU106.TIMER
6815 ± 4% +424.8% 35766 ± 14% softirqs.CPU107.RCU
5342 ± 2% +639.0% 39480 ± 2% softirqs.CPU107.SCHED
18823 ± 2% +587.4% 129388 ± 11% softirqs.CPU107.TIMER
6677 ± 4% +429.1% 35335 ± 12% softirqs.CPU108.RCU
5081 ± 9% +676.4% 39454 softirqs.CPU108.SCHED
18551 ± 2% +594.5% 128846 ± 10% softirqs.CPU108.TIMER
6563 ± 3% +429.7% 34768 ± 12% softirqs.CPU109.RCU
5297 ± 2% +609.6% 37590 ± 8% softirqs.CPU109.SCHED
18539 ± 2% +604.9% 130674 ± 9% softirqs.CPU109.TIMER
7671 ± 8% +360.1% 35292 ± 11% softirqs.CPU11.RCU
5481 ± 5% +603.4% 38557 ± 5% softirqs.CPU11.SCHED
19914 ± 5% +565.8% 132592 ± 11% softirqs.CPU11.TIMER
6707 ± 4% +426.4% 35310 ± 13% softirqs.CPU110.RCU
4972 ± 11% +703.5% 39953 ± 2% softirqs.CPU110.SCHED
18639 ± 2% +603.4% 131105 ± 10% softirqs.CPU110.TIMER
6526 ± 3% +435.8% 34964 ± 15% softirqs.CPU111.RCU
5261 ± 2% +648.7% 39393 softirqs.CPU111.SCHED
18487 ± 2% +604.9% 130317 ± 10% softirqs.CPU111.TIMER
6375 ± 6% +402.7% 32049 ± 7% softirqs.CPU112.RCU
5288 ± 3% +644.6% 39379 ± 2% softirqs.CPU112.SCHED
18429 ± 3% +596.5% 128361 ± 11% softirqs.CPU112.TIMER
6376 ± 5% +407.6% 32366 ± 7% softirqs.CPU113.RCU
5106 ± 7% +670.7% 39354 softirqs.CPU113.SCHED
18514 ± 2% +598.1% 129257 ± 11% softirqs.CPU113.TIMER
6447 ± 3% +413.3% 33093 ± 11% softirqs.CPU114.RCU
5258 ± 2% +646.2% 39240 ± 2% softirqs.CPU114.SCHED
18546 ± 2% +601.2% 130050 ± 11% softirqs.CPU114.TIMER
6361 ± 4% +418.0% 32950 ± 11% softirqs.CPU115.RCU
5268 ± 2% +644.8% 39237 ± 2% softirqs.CPU115.SCHED
18389 ± 3% +607.5% 130112 ± 11% softirqs.CPU115.TIMER
6377 ± 4% +404.8% 32196 ± 8% softirqs.CPU116.RCU
4865 ± 14% +712.1% 39510 ± 2% softirqs.CPU116.SCHED
18637 ± 3% +600.1% 130485 ± 12% softirqs.CPU116.TIMER
6664 ± 9% +381.7% 32102 ± 8% softirqs.CPU117.RCU
5246 ± 3% +524.5% 32764 ± 32% softirqs.CPU117.SCHED
19461 ± 8% +565.4% 129501 ± 10% softirqs.CPU117.TIMER
6405 ± 4% +410.6% 32705 ± 10% softirqs.CPU118.RCU
5297 ± 2% +650.9% 39781 ± 2% softirqs.CPU118.SCHED
18629 ± 2% +601.0% 130592 ± 11% softirqs.CPU118.TIMER
6370 ± 6% +406.1% 32240 ± 8% softirqs.CPU119.RCU
5270 ± 3% +643.2% 39170 softirqs.CPU119.SCHED
18376 ± 2% +603.0% 129194 ± 11% softirqs.CPU119.TIMER
158.25 ± 15% +2643.0% 4340 ±150% softirqs.CPU12.NET_RX
7430 ± 4% +384.3% 35986 ± 10% softirqs.CPU12.RCU
4872 ± 11% +702.9% 39119 ± 3% softirqs.CPU12.SCHED
19056 ± 2% +603.6% 134089 ± 11% softirqs.CPU12.TIMER
6417 ± 3% +390.5% 31473 ± 5% softirqs.CPU120.RCU
5418 +603.9% 38137 ± 9% softirqs.CPU120.SCHED
19298 ± 3% +563.0% 127952 ± 8% softirqs.CPU120.TIMER
6483 ± 4% +389.2% 31716 ± 5% softirqs.CPU121.RCU
5080 ± 9% +666.6% 38946 ± 4% softirqs.CPU121.SCHED
19017 ± 3% +565.5% 126565 ± 11% softirqs.CPU121.TIMER
6424 ± 3% +398.1% 31998 ± 6% softirqs.CPU122.RCU
5288 ± 4% +644.3% 39362 ± 2% softirqs.CPU122.SCHED
18685 ± 4% +582.5% 127527 ± 11% softirqs.CPU122.TIMER
7462 ± 27% +321.6% 31461 ± 6% softirqs.CPU123.RCU
5454 ± 3% +612.9% 38887 ± 4% softirqs.CPU123.SCHED
20044 ± 10% +529.7% 126218 ± 11% softirqs.CPU123.TIMER
6664 ± 7% +384.0% 32255 ± 6% softirqs.CPU124.RCU
5807 ± 8% +571.2% 38979 ± 5% softirqs.CPU124.SCHED
19465 ± 3% +556.5% 127800 ± 10% softirqs.CPU124.TIMER
6528 ± 3% +385.6% 31705 ± 6% softirqs.CPU125.RCU
5413 ± 2% +616.6% 38791 ± 7% softirqs.CPU125.SCHED
18994 +569.8% 127225 ± 9% softirqs.CPU125.TIMER
6753 ± 3% +370.0% 31740 ± 6% softirqs.CPU126.RCU
5406 +606.8% 38212 ± 8% softirqs.CPU126.SCHED
19088 +559.9% 125967 ± 10% softirqs.CPU126.TIMER
6823 ± 10% +359.2% 31335 ± 5% softirqs.CPU127.RCU
5385 +593.8% 37364 ± 12% softirqs.CPU127.SCHED
18756 +566.3% 124972 ± 9% softirqs.CPU127.TIMER
6561 ± 3% +423.1% 34321 ± 7% softirqs.CPU128.RCU
5362 +595.0% 37267 ± 12% softirqs.CPU128.SCHED
18749 +562.2% 124165 ± 8% softirqs.CPU128.TIMER
6607 ± 3% +420.0% 34358 ± 12% softirqs.CPU129.RCU
5371 ± 2% +609.2% 38092 ± 8% softirqs.CPU129.SCHED
18808 +572.1% 126407 ± 12% softirqs.CPU129.TIMER
7340 ± 4% +378.8% 35147 ± 10% softirqs.CPU13.RCU
5315 ± 2% +640.0% 39332 ± 2% softirqs.CPU13.SCHED
19274 ± 4% +598.9% 134712 ± 10% softirqs.CPU13.TIMER
6551 ± 2% +422.0% 34203 ± 7% softirqs.CPU130.RCU
5058 ± 13% +651.7% 38026 ± 9% softirqs.CPU130.SCHED
18805 +571.1% 126203 ± 9% softirqs.CPU130.TIMER
6971 ± 11% +406.9% 35337 ± 13% softirqs.CPU131.RCU
5407 ± 2% +633.0% 39635 ± 2% softirqs.CPU131.SCHED
19024 +574.8% 128382 ± 10% softirqs.CPU131.TIMER
6523 ± 2% +422.6% 34092 ± 10% softirqs.CPU132.RCU
5393 +531.7% 34068 ± 20% softirqs.CPU132.SCHED
18699 +576.7% 126544 ± 9% softirqs.CPU132.TIMER
6872 ± 7% +407.9% 34906 ± 10% softirqs.CPU133.RCU
5390 +627.2% 39197 ± 3% softirqs.CPU133.SCHED
18833 +573.1% 126762 ± 11% softirqs.CPU133.TIMER
6599 ± 3% +423.6% 34554 ± 9% softirqs.CPU134.RCU
5405 ± 2% +631.6% 39549 softirqs.CPU134.SCHED
18731 +571.7% 125829 ± 11% softirqs.CPU134.TIMER
6543 ± 3% +427.1% 34491 ± 9% softirqs.CPU135.RCU
5466 ± 2% +568.6% 36548 ± 16% softirqs.CPU135.SCHED
18926 ± 2% +565.2% 125886 ± 10% softirqs.CPU135.TIMER
6535 ± 3% +435.1% 34966 ± 10% softirqs.CPU136.RCU
5380 ± 2% +611.0% 38254 ± 8% softirqs.CPU136.SCHED
18901 ± 3% +569.8% 126604 ± 10% softirqs.CPU136.TIMER
6585 ± 3% +426.6% 34680 ± 7% softirqs.CPU137.RCU
5429 ± 2% +594.1% 37684 ± 11% softirqs.CPU137.SCHED
18988 ± 2% +562.2% 125741 ± 9% softirqs.CPU137.TIMER
6567 ± 3% +428.7% 34720 ± 8% softirqs.CPU138.RCU
5415 ± 2% +605.1% 38183 ± 9% softirqs.CPU138.SCHED
18872 ± 2% +572.8% 126980 ± 8% softirqs.CPU138.TIMER
7237 ± 9% +382.5% 34920 ± 8% softirqs.CPU139.RCU
5319 ± 3% +611.6% 37855 ± 9% softirqs.CPU139.SCHED
19559 ± 6% +539.8% 125130 ± 8% softirqs.CPU139.TIMER
7400 ± 4% +380.9% 35586 ± 11% softirqs.CPU14.RCU
5214 +654.4% 39333 ± 2% softirqs.CPU14.SCHED
19159 ± 3% +604.4% 134951 ± 10% softirqs.CPU14.TIMER
6535 ± 3% +431.8% 34757 ± 10% softirqs.CPU140.RCU
5424 ± 2% +606.8% 38340 ± 7% softirqs.CPU140.SCHED
18805 +568.7% 125746 ± 10% softirqs.CPU140.TIMER
6632 +421.9% 34613 ± 9% softirqs.CPU141.RCU
5461 ± 2% +607.2% 38619 ± 6% softirqs.CPU141.SCHED
18835 ± 2% +572.5% 126669 ± 11% softirqs.CPU141.TIMER
6607 ± 3% +418.0% 34228 ± 8% softirqs.CPU142.RCU
5410 +603.0% 38037 ± 9% softirqs.CPU142.SCHED
19045 +565.3% 126713 ± 9% softirqs.CPU142.TIMER
6552 ± 3% +427.9% 34593 ± 10% softirqs.CPU143.RCU
5408 +616.1% 38733 ± 5% softirqs.CPU143.SCHED
18719 ± 2% +571.1% 125618 ± 10% softirqs.CPU143.TIMER
6889 ± 8% +407.1% 34934 ± 8% softirqs.CPU144.RCU
5369 +540.7% 34401 ± 20% softirqs.CPU144.SCHED
18794 ± 2% +582.6% 128291 ± 8% softirqs.CPU144.TIMER
6481 ± 3% +431.9% 34474 ± 7% softirqs.CPU145.RCU
5377 ± 2% +641.0% 39844 softirqs.CPU145.SCHED
18616 ± 2% +578.1% 126234 ± 10% softirqs.CPU145.TIMER
6439 ± 3% +431.8% 34246 ± 7% softirqs.CPU146.RCU
5367 +636.2% 39513 softirqs.CPU146.SCHED
18650 ± 2% +579.4% 126710 ± 10% softirqs.CPU146.TIMER
6489 ± 3% +437.0% 34847 ± 10% softirqs.CPU147.RCU
5353 +644.6% 39859 ± 2% softirqs.CPU147.SCHED
18706 +573.9% 126072 ± 10% softirqs.CPU147.TIMER
6558 ± 3% +430.9% 34813 ± 10% softirqs.CPU148.RCU
5438 +636.0% 40022 softirqs.CPU148.SCHED
18809 ± 2% +579.1% 127744 ± 10% softirqs.CPU148.TIMER
6481 ± 2% +437.3% 34823 ± 10% softirqs.CPU149.RCU
5398 +562.0% 35736 ± 20% softirqs.CPU149.SCHED
18837 +578.6% 127835 ± 9% softirqs.CPU149.TIMER
7192 ± 3% +385.8% 34937 ± 12% softirqs.CPU15.RCU
4933 ± 13% +692.4% 39093 ± 2% softirqs.CPU15.SCHED
19002 ± 2% +605.3% 134017 ± 10% softirqs.CPU15.TIMER
6503 ± 2% +435.7% 34839 ± 9% softirqs.CPU150.RCU
5343 +648.6% 39995 softirqs.CPU150.SCHED
18649 ± 2% +579.3% 126678 ± 10% softirqs.CPU150.TIMER
6838 ± 9% +419.3% 35514 ± 13% softirqs.CPU151.RCU
5313 ± 2% +651.2% 39914 softirqs.CPU151.SCHED
19167 ± 4% +567.0% 127856 ± 10% softirqs.CPU151.TIMER
6664 ± 3% +442.0% 36120 ± 12% softirqs.CPU152.RCU
5370 ± 15% +650.9% 40327 softirqs.CPU152.SCHED
18888 ± 3% +575.6% 127615 ± 10% softirqs.CPU152.TIMER
6779 ± 7% +418.5% 35152 ± 13% softirqs.CPU153.RCU
5505 ± 4% +622.4% 39770 softirqs.CPU153.SCHED
19241 ± 6% +553.3% 125704 ± 10% softirqs.CPU153.TIMER
6446 ± 3% +446.5% 35227 ± 13% softirqs.CPU154.RCU
5350 +644.8% 39848 softirqs.CPU154.SCHED
18631 +576.1% 125962 ± 10% softirqs.CPU154.TIMER
6470 ± 2% +446.0% 35329 ± 13% softirqs.CPU155.RCU
5437 +633.9% 39906 softirqs.CPU155.SCHED
18909 ± 2% +568.7% 126453 ± 9% softirqs.CPU155.TIMER
6486 ± 3% +448.2% 35554 ± 13% softirqs.CPU156.RCU
5395 +642.1% 40035 softirqs.CPU156.SCHED
18659 ± 2% +576.5% 126240 ± 10% softirqs.CPU156.TIMER
6373 ± 3% +447.8% 34918 ± 10% softirqs.CPU157.RCU
5327 +565.4% 35450 ± 20% softirqs.CPU157.SCHED
18452 +585.6% 126513 ± 9% softirqs.CPU157.TIMER
6426 ± 3% +445.7% 35065 ± 9% softirqs.CPU158.RCU
5428 ± 2% +636.3% 39970 softirqs.CPU158.SCHED
18536 +580.7% 126181 ± 10% softirqs.CPU158.TIMER
7106 ± 10% +389.2% 34765 ± 9% softirqs.CPU159.RCU
5371 +646.6% 40107 softirqs.CPU159.SCHED
19996 ± 7% +533.6% 126694 ± 9% softirqs.CPU159.TIMER
7066 ± 2% +357.3% 32318 ± 4% softirqs.CPU16.RCU
5291 ± 3% +552.3% 34517 ± 20% softirqs.CPU16.SCHED
19126 +583.2% 130671 ± 10% softirqs.CPU16.TIMER
6414 ± 4% +424.5% 33643 ± 7% softirqs.CPU160.RCU
5356 +637.7% 39515 softirqs.CPU160.SCHED
18510 +579.2% 125728 ± 10% softirqs.CPU160.TIMER
6753 ± 6% +422.3% 35271 ± 12% softirqs.CPU161.RCU
5530 ± 4% +622.5% 39956 softirqs.CPU161.SCHED
18837 +566.6% 125572 ± 10% softirqs.CPU161.TIMER
6398 ± 4% +451.6% 35291 ± 11% softirqs.CPU162.RCU
5365 ± 2% +645.9% 40019 softirqs.CPU162.SCHED
18641 +579.4% 126643 ± 9% softirqs.CPU162.TIMER
6386 ± 3% +451.9% 35245 ± 11% softirqs.CPU163.RCU
5312 ± 2% +648.6% 39766 softirqs.CPU163.SCHED
18426 +584.7% 126169 ± 10% softirqs.CPU163.TIMER
6368 ± 3% +458.9% 35594 ± 11% softirqs.CPU164.RCU
5369 +644.0% 39951 softirqs.CPU164.SCHED
18559 ± 2% +577.3% 125695 ± 10% softirqs.CPU164.TIMER
6574 ± 5% +434.4% 35133 ± 10% softirqs.CPU165.RCU
5481 ± 5% +629.5% 39986 softirqs.CPU165.SCHED
18637 ± 2% +575.6% 125918 ± 10% softirqs.CPU165.TIMER
6582 ± 2% +426.9% 34681 ± 10% softirqs.CPU166.RCU
5463 +631.9% 39988 softirqs.CPU166.SCHED
18982 ± 2% +568.0% 126810 ± 9% softirqs.CPU166.TIMER
6459 ± 3% +427.7% 34084 ± 10% softirqs.CPU167.RCU
5475 ± 2% +628.5% 39891 ± 2% softirqs.CPU167.SCHED
18716 ± 2% +570.7% 125523 ± 10% softirqs.CPU167.TIMER
6286 ± 2% +437.8% 33808 ± 10% softirqs.CPU168.RCU
5320 +494.8% 31643 ± 26% softirqs.CPU168.SCHED
18449 +596.5% 128501 ± 9% softirqs.CPU168.TIMER
6145 ± 4% +427.7% 32430 ± 6% softirqs.CPU169.RCU
5326 ± 2% +654.2% 40176 softirqs.CPU169.SCHED
18200 ± 3% +600.8% 127549 ± 9% softirqs.CPU169.TIMER
7028 ± 2% +373.9% 33305 ± 5% softirqs.CPU17.RCU
5303 ± 4% +631.0% 38765 softirqs.CPU17.SCHED
18849 +597.6% 131488 ± 11% softirqs.CPU17.TIMER
6537 ± 6% +395.2% 32373 ± 7% softirqs.CPU170.RCU
5383 +609.7% 38202 ± 9% softirqs.CPU170.SCHED
18379 +587.9% 126439 ± 7% softirqs.CPU170.TIMER
6064 ± 4% +450.9% 33409 ± 12% softirqs.CPU171.RCU
5359 +653.0% 40355 softirqs.CPU171.SCHED
18159 ± 2% +606.6% 128309 ± 10% softirqs.CPU171.TIMER
6120 ± 5% +446.2% 33434 ± 12% softirqs.CPU172.RCU
5077 ± 11% +695.6% 40394 softirqs.CPU172.SCHED
18276 ± 2% +600.4% 128011 ± 10% softirqs.CPU172.TIMER
6183 ± 4% +448.1% 33889 ± 12% softirqs.CPU173.RCU
5391 +592.0% 37306 ± 14% softirqs.CPU173.SCHED
18435 ± 2% +601.3% 129282 ± 10% softirqs.CPU173.TIMER
6546 ± 15% +407.8% 33243 ± 12% softirqs.CPU174.RCU
5379 +648.1% 40246 softirqs.CPU174.SCHED
18359 ± 2% +598.5% 128239 ± 10% softirqs.CPU174.TIMER
6245 ± 5% +426.1% 32855 ± 9% softirqs.CPU175.RCU
5040 ± 12% +696.7% 40155 softirqs.CPU175.SCHED
18342 ± 2% +585.9% 125800 ± 9% softirqs.CPU175.TIMER
6294 ± 7% +430.5% 33386 ± 9% softirqs.CPU176.RCU
5377 ± 2% +646.6% 40152 softirqs.CPU176.SCHED
18322 ± 2% +594.7% 127276 ± 10% softirqs.CPU176.TIMER
6226 ± 7% +439.2% 33572 ± 7% softirqs.CPU177.RCU
5373 ± 2% +649.5% 40276 softirqs.CPU177.SCHED
18166 ± 4% +601.1% 127367 ± 10% softirqs.CPU177.TIMER
6550 ± 12% +423.0% 34261 ± 8% softirqs.CPU178.RCU
5384 ± 2% +572.9% 36234 ± 21% softirqs.CPU178.SCHED
18267 ± 2% +604.0% 128610 ± 10% softirqs.CPU178.TIMER
6185 ± 6% +463.1% 34826 ± 13% softirqs.CPU179.RCU
5360 ± 2% +652.0% 40311 softirqs.CPU179.SCHED
18141 ± 3% +600.4% 127053 ± 10% softirqs.CPU179.TIMER
7371 +359.3% 33855 ± 7% softirqs.CPU18.RCU
5200 ± 2% +642.0% 38581 ± 2% softirqs.CPU18.SCHED
19031 +592.7% 131837 ± 11% softirqs.CPU18.TIMER
6486 ± 7% +431.1% 34452 ± 11% softirqs.CPU180.RCU
5294 +660.6% 40270 softirqs.CPU180.SCHED
18554 ± 4% +583.9% 126890 ± 9% softirqs.CPU180.TIMER
6203 ± 6% +467.8% 35224 ± 12% softirqs.CPU181.RCU
5347 ± 2% +647.3% 39959 softirqs.CPU181.SCHED
18030 ± 3% +605.8% 127252 ± 9% softirqs.CPU181.TIMER
6192 ± 6% +460.3% 34699 ± 14% softirqs.CPU182.RCU
5368 ± 2% +648.7% 40196 softirqs.CPU182.SCHED
18378 ± 3% +593.5% 127450 ± 10% softirqs.CPU182.TIMER
6173 ± 6% +464.0% 34817 ± 13% softirqs.CPU183.RCU
5338 ± 2% +652.1% 40144 softirqs.CPU183.SCHED
18127 +599.2% 126746 ± 10% softirqs.CPU183.TIMER
7264 ± 21% +385.9% 35293 ± 14% softirqs.CPU184.RCU
5241 ± 5% +666.4% 40170 softirqs.CPU184.SCHED
19299 ± 7% +558.9% 127161 ± 10% softirqs.CPU184.TIMER
6283 ± 3% +468.2% 35700 ± 14% softirqs.CPU185.RCU
5384 +651.3% 40451 softirqs.CPU185.SCHED
18454 +602.1% 129562 ± 9% softirqs.CPU185.TIMER
6214 ± 6% +453.4% 34389 ± 10% softirqs.CPU186.RCU
5344 ± 2% +650.9% 40128 softirqs.CPU186.SCHED
18212 ± 3% +594.7% 126516 ± 11% softirqs.CPU186.TIMER
6293 ± 3% +468.0% 35747 ± 15% softirqs.CPU187.RCU
5431 +644.0% 40413 softirqs.CPU187.SCHED
18195 ± 3% +598.3% 127060 ± 10% softirqs.CPU187.TIMER
6437 ± 6% +438.7% 34679 ± 15% softirqs.CPU188.RCU
5504 ± 2% +628.9% 40124 softirqs.CPU188.SCHED
18667 ± 4% +578.5% 126653 ± 10% softirqs.CPU188.TIMER
6336 ± 8% +451.9% 34968 ± 13% softirqs.CPU189.RCU
5117 ± 14% +684.3% 40137 softirqs.CPU189.SCHED
18430 ± 5% +587.5% 126708 ± 10% softirqs.CPU189.TIMER
6964 ± 3% +380.5% 33463 ± 5% softirqs.CPU19.RCU
5029 ± 4% +667.7% 38614 softirqs.CPU19.SCHED
18684 ± 3% +604.9% 131704 ± 10% softirqs.CPU19.TIMER
6346 ± 7% +436.3% 34033 ± 7% softirqs.CPU190.RCU
5459 ± 4% +643.2% 40576 softirqs.CPU190.SCHED
18874 ± 4% +596.8% 131509 ± 8% softirqs.CPU190.TIMER
6163 ± 5% +453.2% 34093 ± 8% softirqs.CPU191.RCU
5375 +648.7% 40245 softirqs.CPU191.SCHED
18150 +600.9% 127220 ± 10% softirqs.CPU191.TIMER
7507 ± 7% +385.5% 36444 ± 7% softirqs.CPU2.RCU
5009 ± 12% +682.2% 39187 ± 3% softirqs.CPU2.SCHED
19156 ± 3% +599.4% 133988 ± 10% softirqs.CPU2.TIMER
7041 ± 4% +367.9% 32946 ± 6% softirqs.CPU20.RCU
5121 +663.2% 39085 ± 2% softirqs.CPU20.SCHED
18825 ± 2% +604.8% 132679 ± 10% softirqs.CPU20.TIMER
6890 ± 5% +381.1% 33151 ± 6% softirqs.CPU21.RCU
5120 ± 3% +664.5% 39146 softirqs.CPU21.SCHED
18735 ± 3% +617.9% 134493 ± 10% softirqs.CPU21.TIMER
7314 ± 8% +354.1% 33212 ± 7% softirqs.CPU22.RCU
5151 ± 2% +659.4% 39123 softirqs.CPU22.SCHED
19722 ± 5% +574.1% 132956 ± 9% softirqs.CPU22.TIMER
7556 ± 13% +342.6% 33446 ± 6% softirqs.CPU23.RCU
5106 ± 3% +658.3% 38718 softirqs.CPU23.SCHED
19588 ± 5% +581.4% 133477 ± 10% softirqs.CPU23.TIMER
6818 +381.5% 32828 ± 7% softirqs.CPU24.RCU
5272 ± 2% +681.0% 41175 ± 10% softirqs.CPU24.SCHED
19857 ± 10% +511.9% 121506 ± 16% softirqs.CPU24.TIMER
6943 ± 2% +367.1% 32433 ± 4% softirqs.CPU25.RCU
5259 +673.5% 40679 ± 9% softirqs.CPU25.SCHED
18748 +543.6% 120658 ± 17% softirqs.CPU25.TIMER
6986 ± 3% +363.3% 32369 ± 6% softirqs.CPU26.RCU
3439 ± 32% +1067.5% 40149 ± 13% softirqs.CPU26.SCHED
15431 ± 12% +663.2% 117776 ± 18% softirqs.CPU26.TIMER
6893 ± 3% +372.8% 32594 ± 6% softirqs.CPU27.RCU
4837 ± 16% +777.4% 42444 ± 17% softirqs.CPU27.SCHED
17406 ± 13% +591.6% 120379 ± 16% softirqs.CPU27.TIMER
6818 ± 3% +370.9% 32110 ± 6% softirqs.CPU28.RCU
4980 ± 7% +692.5% 39468 ± 5% softirqs.CPU28.SCHED
18791 +537.9% 119870 ± 16% softirqs.CPU28.TIMER
6883 ± 3% +371.9% 32480 ± 5% softirqs.CPU29.RCU
5198 +653.0% 39145 ± 3% softirqs.CPU29.SCHED
18484 +548.4% 119852 ± 16% softirqs.CPU29.TIMER
7446 ± 5% +383.3% 35992 ± 14% softirqs.CPU3.RCU
4851 ± 9% +707.3% 39166 ± 4% softirqs.CPU3.SCHED
19043 ± 2% +592.4% 131862 ± 12% softirqs.CPU3.TIMER
7467 ± 14% +335.1% 32491 ± 5% softirqs.CPU30.RCU
5471 ± 8% +615.1% 39125 ± 2% softirqs.CPU30.SCHED
19625 ± 9% +515.5% 120800 ± 16% softirqs.CPU30.TIMER
6878 ± 2% +383.4% 33248 ± 6% softirqs.CPU31.RCU
5193 +651.4% 39026 ± 2% softirqs.CPU31.SCHED
18574 +552.9% 121262 ± 18% softirqs.CPU31.TIMER
7160 ± 2% +405.9% 36226 ± 7% softirqs.CPU32.RCU
5187 +649.5% 38874 ± 2% softirqs.CPU32.SCHED
18474 +557.3% 121434 ± 15% softirqs.CPU32.TIMER
7455 ± 6% +349.4% 33503 ± 11% softirqs.CPU33.RCU
5261 +562.3% 34843 ± 23% softirqs.CPU33.SCHED
19872 ± 10% +569.1% 132966 ± 17% softirqs.CPU33.TIMER
7114 ± 2% +388.6% 34758 ± 7% softirqs.CPU34.RCU
5246 +613.5% 37434 ± 3% softirqs.CPU34.SCHED
18812 ± 2% +534.3% 119321 ± 15% softirqs.CPU34.TIMER
7154 ± 2% +388.6% 34957 ± 8% softirqs.CPU35.RCU
5283 +634.7% 38811 ± 2% softirqs.CPU35.SCHED
18712 +540.0% 119754 ± 16% softirqs.CPU35.TIMER
7044 ± 2% +382.8% 34011 ± 12% softirqs.CPU36.RCU
5187 +644.3% 38609 ± 5% softirqs.CPU36.SCHED
18426 +616.8% 132080 ± 17% softirqs.CPU36.TIMER
7089 ± 3% +393.7% 35003 ± 9% softirqs.CPU37.RCU
5205 +625.3% 37755 ± 2% softirqs.CPU37.SCHED
18508 +544.0% 119194 ± 17% softirqs.CPU37.TIMER
7023 ± 2% +398.7% 35023 ± 9% softirqs.CPU38.RCU
5223 +630.5% 38159 softirqs.CPU38.SCHED
18580 +548.7% 120538 ± 15% softirqs.CPU38.TIMER
7070 ± 3% +398.8% 35266 ± 10% softirqs.CPU39.RCU
5129 +642.9% 38104 softirqs.CPU39.SCHED
18485 +547.4% 119677 ± 16% softirqs.CPU39.TIMER
7348 ± 6% +394.6% 36341 ± 13% softirqs.CPU4.RCU
5319 ± 3% +636.0% 39151 ± 3% softirqs.CPU4.SCHED
19085 ± 2% +590.6% 131807 ± 11% softirqs.CPU4.TIMER
7004 ± 2% +408.9% 35644 ± 11% softirqs.CPU40.RCU
5194 +646.1% 38756 ± 2% softirqs.CPU40.SCHED
18435 +554.0% 120559 ± 17% softirqs.CPU40.TIMER
7292 ± 5% +382.1% 35157 ± 8% softirqs.CPU41.RCU
5185 ± 3% +646.8% 38726 softirqs.CPU41.SCHED
19538 ± 6% +512.3% 119632 ± 15% softirqs.CPU41.TIMER
6998 ± 2% +404.5% 35310 ± 9% softirqs.CPU42.RCU
5232 +562.1% 34648 ± 20% softirqs.CPU42.SCHED
18573 ± 2% +544.9% 119768 ± 16% softirqs.CPU42.TIMER
7116 ± 3% +402.2% 35739 ± 9% softirqs.CPU43.RCU
5170 +647.5% 38644 softirqs.CPU43.SCHED
18410 +552.6% 120139 ± 17% softirqs.CPU43.TIMER
7471 ± 11% +368.1% 34978 ± 9% softirqs.CPU44.RCU
5249 +618.2% 37697 ± 3% softirqs.CPU44.SCHED
18597 +538.6% 118761 ± 15% softirqs.CPU44.TIMER
6995 ± 3% +398.0% 34833 ± 8% softirqs.CPU45.RCU
5191 +635.2% 38167 softirqs.CPU45.SCHED
18439 +547.3% 119356 ± 15% softirqs.CPU45.TIMER
7331 ± 11% +373.5% 34718 ± 9% softirqs.CPU46.RCU
5314 ± 3% +619.3% 38226 ± 2% softirqs.CPU46.SCHED
19745 ± 10% +508.5% 120149 ± 14% softirqs.CPU46.TIMER
6900 ± 2% +408.3% 35073 ± 9% softirqs.CPU47.RCU
5149 +562.4% 34113 ± 19% softirqs.CPU47.SCHED
18375 +551.3% 119683 ± 15% softirqs.CPU47.TIMER
7198 ± 3% +407.5% 36527 ± 12% softirqs.CPU48.RCU
5221 +662.4% 39807 softirqs.CPU48.SCHED
18427 +596.8% 128396 ± 13% softirqs.CPU48.TIMER
7248 ± 2% +398.1% 36107 ± 9% softirqs.CPU49.RCU
5321 ± 3% +634.1% 39065 ± 2% softirqs.CPU49.SCHED
18799 ± 4% +572.8% 126478 ± 15% softirqs.CPU49.TIMER
7486 ± 9% +387.1% 36467 ± 13% softirqs.CPU5.RCU
5495 ± 5% +607.0% 38851 ± 3% softirqs.CPU5.SCHED
20673 ± 7% +537.7% 131828 ± 11% softirqs.CPU5.TIMER
7071 ± 2% +419.5% 36731 ± 9% softirqs.CPU50.RCU
5236 +643.2% 38915 softirqs.CPU50.SCHED
18433 ± 2% +583.4% 125966 ± 15% softirqs.CPU50.TIMER
7195 ± 3% +405.2% 36353 ± 10% softirqs.CPU51.RCU
5322 ± 2% +636.1% 39178 ± 2% softirqs.CPU51.SCHED
18960 ± 3% +560.2% 125181 ± 14% softirqs.CPU51.TIMER
6997 ± 2% +421.7% 36501 ± 10% softirqs.CPU52.RCU
5322 +640.4% 39404 ± 2% softirqs.CPU52.SCHED
18851 +573.4% 126948 ± 15% softirqs.CPU52.TIMER
6943 ± 3% +428.5% 36693 ± 10% softirqs.CPU53.RCU
5286 +643.6% 39310 ± 2% softirqs.CPU53.SCHED
18709 +576.0% 126481 ± 15% softirqs.CPU53.TIMER
7009 ± 2% +426.8% 36927 ± 9% softirqs.CPU54.RCU
5189 +648.7% 38854 softirqs.CPU54.SCHED
18335 +590.2% 126541 ± 15% softirqs.CPU54.TIMER
7287 ± 9% +411.8% 37301 ± 12% softirqs.CPU55.RCU
5172 +661.6% 39388 ± 2% softirqs.CPU55.SCHED
19102 ± 7% +564.0% 126831 ± 16% softirqs.CPU55.TIMER
7061 ± 2% +423.2% 36947 ± 10% softirqs.CPU56.RCU
5249 +562.7% 34790 ± 19% softirqs.CPU56.SCHED
18566 ± 2% +583.8% 126964 ± 15% softirqs.CPU56.TIMER
7629 ± 12% +385.0% 37001 ± 10% softirqs.CPU57.RCU
5282 ± 2% +644.6% 39331 ± 2% softirqs.CPU57.SCHED
19675 ± 6% +539.1% 125734 ± 14% softirqs.CPU57.TIMER
7975 ± 21% +365.8% 37150 ± 12% softirqs.CPU58.RCU
5017 ± 10% +686.5% 39466 ± 2% softirqs.CPU58.SCHED
20555 ± 15% +515.3% 126483 ± 15% softirqs.CPU58.TIMER
7401 ± 5% +397.4% 36813 ± 12% softirqs.CPU59.RCU
5555 ± 8% +605.6% 39199 ± 2% softirqs.CPU59.SCHED
18748 +571.3% 125861 ± 15% softirqs.CPU59.TIMER
7303 ± 3% +360.3% 33615 ± 3% softirqs.CPU6.RCU
5233 ± 2% +634.8% 38451 ± 4% softirqs.CPU6.SCHED
19087 ± 2% +594.9% 132637 ± 10% softirqs.CPU6.TIMER
6999 ± 3% +427.1% 36891 ± 11% softirqs.CPU60.RCU
5261 ± 2% +646.8% 39290 ± 2% softirqs.CPU60.SCHED
18444 ± 2% +583.1% 125991 ± 15% softirqs.CPU60.TIMER
6913 ± 3% +422.2% 36101 ± 8% softirqs.CPU61.RCU
5222 ± 2% +648.2% 39072 ± 2% softirqs.CPU61.SCHED
18391 ± 2% +585.6% 126094 ± 15% softirqs.CPU61.TIMER
6922 ± 2% +407.4% 35121 ± 4% softirqs.CPU62.RCU
5193 +647.5% 38824 softirqs.CPU62.SCHED
18255 +591.5% 126235 ± 15% softirqs.CPU62.TIMER
6941 ± 2% +412.8% 35596 ± 5% softirqs.CPU63.RCU
5221 ± 2% +607.7% 36951 ± 11% softirqs.CPU63.SCHED
18317 ± 2% +586.8% 125808 ± 15% softirqs.CPU63.TIMER
6975 ± 4% +397.8% 34722 ± 4% softirqs.CPU64.RCU
5185 +655.1% 39154 ± 2% softirqs.CPU64.SCHED
18105 +591.9% 125278 ± 15% softirqs.CPU64.TIMER
6980 ± 5% +411.2% 35689 ± 11% softirqs.CPU65.RCU
5259 +644.0% 39125 ± 2% softirqs.CPU65.SCHED
18289 +586.4% 125541 ± 15% softirqs.CPU65.TIMER
6963 ± 3% +417.0% 36002 ± 11% softirqs.CPU66.RCU
5241 +646.0% 39105 softirqs.CPU66.SCHED
18198 ± 2% +585.8% 124796 ± 14% softirqs.CPU66.TIMER
6961 ± 3% +415.7% 35897 ± 11% softirqs.CPU67.RCU
5215 +651.5% 39188 ± 2% softirqs.CPU67.SCHED
18260 ± 2% +588.1% 125653 ± 15% softirqs.CPU67.TIMER
7021 ± 5% +410.8% 35861 ± 10% softirqs.CPU68.RCU
5228 +646.3% 39020 ± 2% softirqs.CPU68.SCHED
18242 ± 2% +585.0% 124958 ± 15% softirqs.CPU68.TIMER
6989 ± 4% +408.6% 35549 ± 9% softirqs.CPU69.RCU
5238 ± 2% +642.8% 38909 softirqs.CPU69.SCHED
18308 ± 2% +586.0% 125595 ± 15% softirqs.CPU69.TIMER
7279 ± 3% +387.2% 35462 ± 13% softirqs.CPU7.RCU
4828 ± 9% +710.4% 39130 ± 3% softirqs.CPU7.SCHED
19112 ± 2% +599.6% 133702 ± 10% softirqs.CPU7.TIMER
6870 ± 3% +412.2% 35187 ± 7% softirqs.CPU70.RCU
5262 +643.7% 39141 ± 2% softirqs.CPU70.SCHED
18395 ± 2% +582.2% 125500 ± 14% softirqs.CPU70.TIMER
6886 ± 4% +405.7% 34825 ± 6% softirqs.CPU71.RCU
5249 ± 2% +640.9% 38895 ± 2% softirqs.CPU71.SCHED
18181 +591.2% 125664 ± 15% softirqs.CPU71.TIMER
6828 ± 3% +397.7% 33985 ± 9% softirqs.CPU72.RCU
5204 ± 2% +649.5% 39004 ± 2% softirqs.CPU72.SCHED
18047 ± 3% +561.9% 119452 ± 14% softirqs.CPU72.TIMER
6745 ± 3% +402.2% 33874 ± 8% softirqs.CPU73.RCU
5268 +635.7% 38763 ± 3% softirqs.CPU73.SCHED
18249 ± 2% +550.8% 118765 ± 14% softirqs.CPU73.TIMER
6708 ± 3% +390.6% 32907 ± 4% softirqs.CPU74.RCU
5246 +635.3% 38576 ± 2% softirqs.CPU74.SCHED
18174 ± 2% +543.2% 116900 ± 12% softirqs.CPU74.TIMER
6831 ± 3% +402.3% 34314 ± 10% softirqs.CPU75.RCU
5359 ± 2% +621.6% 38672 ± 2% softirqs.CPU75.SCHED
18384 ± 2% +545.8% 118734 ± 15% softirqs.CPU75.TIMER
6913 ± 6% +398.6% 34466 ± 10% softirqs.CPU76.RCU
4941 ± 12% +681.9% 38637 ± 2% softirqs.CPU76.SCHED
18146 ± 2% +560.3% 119817 ± 15% softirqs.CPU76.TIMER
6707 ± 3% +406.0% 33936 ± 12% softirqs.CPU77.RCU
5487 ± 5% +611.3% 39033 ± 2% softirqs.CPU77.SCHED
18877 ± 6% +538.9% 120609 ± 14% softirqs.CPU77.TIMER
6824 ± 5% +396.7% 33895 ± 11% softirqs.CPU78.RCU
5315 +566.7% 35436 ± 21% softirqs.CPU78.SCHED
19213 ± 7% +589.8% 132542 ± 18% softirqs.CPU78.TIMER
6708 ± 4% +397.5% 33372 ± 6% softirqs.CPU79.RCU
5237 ± 2% +637.1% 38609 ± 2% softirqs.CPU79.SCHED
18173 ± 2% +547.3% 117633 ± 13% softirqs.CPU79.TIMER
7620 ± 6% +352.5% 34482 ± 7% softirqs.CPU8.RCU
5351 ± 5% +558.1% 35220 ± 21% softirqs.CPU8.SCHED
19298 ± 2% +590.4% 133242 ± 10% softirqs.CPU8.TIMER
6646 ± 4% +410.4% 33919 ± 10% softirqs.CPU80.RCU
5213 ± 2% +640.6% 38613 ± 3% softirqs.CPU80.SCHED
18279 ± 3% +553.7% 119493 ± 15% softirqs.CPU80.TIMER
6671 ± 4% +419.3% 34643 ± 9% softirqs.CPU81.RCU
5180 ± 2% +650.2% 38862 ± 2% softirqs.CPU81.SCHED
18178 ± 3% +560.2% 120009 ± 14% softirqs.CPU81.TIMER
6669 ± 4% +418.4% 34571 ± 11% softirqs.CPU82.RCU
5192 +646.3% 38752 ± 3% softirqs.CPU82.SCHED
18039 ± 2% +563.6% 119710 ± 15% softirqs.CPU82.TIMER
6677 ± 5% +419.3% 34671 ± 12% softirqs.CPU83.RCU
4875 ± 11% +689.8% 38503 ± 2% softirqs.CPU83.SCHED
18180 ± 3% +556.8% 119397 ± 15% softirqs.CPU83.TIMER
6670 ± 4% +408.2% 33899 ± 8% softirqs.CPU84.RCU
5149 ± 2% +650.3% 38636 ± 3% softirqs.CPU84.SCHED
18130 ± 2% +553.7% 118527 ± 14% softirqs.CPU84.TIMER
6656 ± 4% +423.3% 34831 ± 12% softirqs.CPU85.RCU
5162 +646.8% 38549 ± 3% softirqs.CPU85.SCHED
18116 ± 2% +556.6% 118947 ± 14% softirqs.CPU85.TIMER
6622 ± 3% +428.3% 34987 ± 14% softirqs.CPU86.RCU
5187 +644.7% 38630 ± 2% softirqs.CPU86.SCHED
18211 ± 2% +557.2% 119680 ± 15% softirqs.CPU86.TIMER
6718 ± 4% +416.6% 34707 ± 12% softirqs.CPU87.RCU
5244 ± 2% +635.9% 38593 ± 3% softirqs.CPU87.SCHED
18225 ± 3% +551.8% 118792 ± 14% softirqs.CPU87.TIMER
6677 ± 3% +429.1% 35330 ± 15% softirqs.CPU88.RCU
5196 +635.7% 38234 softirqs.CPU88.SCHED
18176 +556.6% 119354 ± 15% softirqs.CPU88.TIMER
6743 ± 2% +424.0% 35336 ± 15% softirqs.CPU89.RCU
5204 +638.9% 38455 ± 2% softirqs.CPU89.SCHED
18042 ± 2% +559.7% 119015 ± 15% softirqs.CPU89.TIMER
7417 ± 5% +383.6% 35865 ± 13% softirqs.CPU9.RCU
4984 ± 11% +687.6% 39257 ± 3% softirqs.CPU9.SCHED
19419 ± 2% +593.1% 134592 ± 10% softirqs.CPU9.TIMER
6678 ± 3% +411.1% 34131 ± 9% softirqs.CPU90.RCU
5188 ± 2% +644.6% 38635 ± 2% softirqs.CPU90.SCHED
18061 ± 2% +557.0% 118655 ± 13% softirqs.CPU90.TIMER
6699 +430.3% 35524 ± 15% softirqs.CPU91.RCU
5154 +648.4% 38571 ± 3% softirqs.CPU91.SCHED
18054 +557.9% 118780 ± 15% softirqs.CPU91.TIMER
6545 ± 4% +436.3% 35100 ± 15% softirqs.CPU92.RCU
5183 ± 2% +640.6% 38391 softirqs.CPU92.SCHED
18097 ± 3% +561.2% 119656 ± 15% softirqs.CPU92.TIMER
6649 ± 2% +423.6% 34819 ± 13% softirqs.CPU93.RCU
5210 +642.1% 38671 ± 2% softirqs.CPU93.SCHED
18095 ± 2% +557.9% 119046 ± 14% softirqs.CPU93.TIMER
6759 +392.2% 33267 ± 9% softirqs.CPU94.RCU
5210 +653.1% 39241 ± 2% softirqs.CPU94.SCHED
18143 ± 2% +573.4% 122174 ± 13% softirqs.CPU94.TIMER
6677 ± 2% +414.8% 34374 ± 10% softirqs.CPU95.RCU
5172 ± 2% +418.0% 26794 ± 11% softirqs.CPU95.SCHED
18063 ± 2% +559.7% 119167 ± 15% softirqs.CPU95.TIMER
6785 ± 10% +382.8% 32757 ± 6% softirqs.CPU96.RCU
5193 ± 20% +576.9% 35154 ± 17% softirqs.CPU96.SCHED
18836 ± 6% +602.7% 132354 ± 10% softirqs.CPU96.TIMER
6724 ± 7% +417.1% 34773 ± 10% softirqs.CPU97.RCU
5270 ± 3% +640.4% 39023 softirqs.CPU97.SCHED
18469 ± 4% +597.1% 128754 ± 9% softirqs.CPU97.TIMER
6657 ± 5% +428.6% 35189 ± 13% softirqs.CPU98.RCU
5282 ± 3% +642.8% 39237 softirqs.CPU98.SCHED
18584 ± 3% +594.1% 129004 ± 10% softirqs.CPU98.TIMER
6905 ± 8% +422.5% 36081 ± 16% softirqs.CPU99.RCU
5308 ± 2% +648.2% 39719 ± 2% softirqs.CPU99.SCHED
18905 ± 3% +581.1% 128757 ± 11% softirqs.CPU99.TIMER
697.00 ± 38% +1367.1% 10226 ± 62% softirqs.NET_RX
1309285 ± 3% +407.1% 6639778 ± 9% softirqs.RCU
1012468 +634.4% 7435362 softirqs.SCHED
3593340 +575.0% 24256691 ± 11% softirqs.TIMER
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 1 month
- 1
- 0