[seccomp] 0eebfed295: kernel_selftests.seccomp.make_fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 0eebfed2954f152259cae0ad57b91d3ea92968e8 ("seccomp: test SECCOMP_USER_NOTIF_FLAG_CONTINUE")
https://git.kernel.org/cgit/linux/kernel/git/kees/linux.git for-next/seccomp
in testcase: kernel_selftests
with following parameters:
group: kselftests-02
test-description: The kernel contains a set of "self tests" under the tools/testing/selftests/ directory. These are intended to be small unit tests to exercise individual code paths in the kernel.
test-url: https://www.kernel.org/doc/Documentation/kselftest.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
2019-10-20 11:14:01 make run_tests -C seccomp
make: Entering directory '/usr/src/perf_selftests-x86_64-rhel-7.6-0eebfed2954f152259cae0ad57b91d3ea92968e8/tools/testing/selftests/seccomp'
gcc -Wl,-no-as-needed -Wall seccomp_bpf.c -lpthread -o seccomp_bpf
seccomp_bpf.c: In function ‘user_notification_continue’:
seccomp_bpf.c:3562:15: error: ‘SECCOMP_USER_NOTIF_FLAG_CONTINUE’ undeclared (first use in this function)
resp.flags = SECCOMP_USER_NOTIF_FLAG_CONTINUE;
^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
seccomp_bpf.c:3562:15: note: each undeclared identifier is reported only once for each function it appears in
Makefile:12: recipe for target 'seccomp_bpf' failed
make: *** [seccomp_bpf] Error 1
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-7.6-0eebfed2954f152259cae0ad57b91d3ea92968e8/tools/testing/selftests/seccomp'
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc2-00003-g0eebfed2954f1 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
24480897e7: will-it-scale.per_process_ops 36.4% improvement
by kernel test robot
Greeting,
FYI, we noticed a 36.4% improvement of will-it-scale.per_process_ops due to commit:
commit: 24480897e7718dd8cd6987eb49a74b9ba9ed93fb ("x86/mm: Thread pgprot_t through init_memory_mapping()")
https://github.com/sbates130272/linux-p2pmem.git remap_pages_cache2
in testcase: will-it-scale
on test machine: 288 threads Intel(R) Xeon Phi(TM) CPU 7295 @ 1.50GHz with 80G memory
with following parameters:
nr_task: 100%
mode: process
test: getppid1
cpufreq_governor: performance
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase:
gcc-7/performance/x86_64-rhel-7.6/process/100%/debian-x86_64-2019-05-14.cgz/lkp-knm01/getppid1/will-it-scale
commit:
v5.4-rc2
24480897e7 (" iHUEABYIAB0WIQQeIjHXFZhlkJWE3YwfdExxlD3i+QUCXaYAWgAKCRAfdExxlD3i")
v5.4-rc2 24480897e7718dd8cd6987eb49a
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
4:8 -50% :4 dmesg.WARNING:at#for_ip_interrupt_entry/0x
:8 12% 1:4 dmesg.WARNING:at_ip__fsnotify_parent/0x
%stddev %change %stddev
\ | \
318320 +36.4% 434157 ± 4% will-it-scale.per_process_ops
91676481 +36.4% 1.25e+08 ± 4% will-it-scale.workload
57.60 ± 3% -5.6 51.98 mpstat.cpu.all.sys%
41.10 ± 4% +5.7 46.77 mpstat.cpu.all.usr%
370.83 -100.0% 0.00 uptime.boot
15690 ± 3% -100.0% 0.00 uptime.idle
56.62 ± 2% -9.5% 51.25 ± 2% vmstat.cpu.sy
40.50 ± 4% +13.6% 46.00 vmstat.cpu.us
843108 ± 5% +6.4% 896715 proc-vmstat.numa_hit
843108 ± 5% +6.4% 896715 proc-vmstat.numa_local
935059 ± 4% +6.2% 992768 proc-vmstat.pgalloc_normal
1166 ± 12% -19.5% 939.00 ± 8% slabinfo.dmaengine-unmap-16.active_objs
1166 ± 12% -19.5% 939.00 ± 8% slabinfo.dmaengine-unmap-16.num_objs
474.50 ± 15% +42.3% 675.25 ± 8% slabinfo.kmem_cache.active_objs
474.50 ± 15% +42.3% 675.25 ± 8% slabinfo.kmem_cache.num_objs
555.00 ± 11% +31.7% 731.00 ± 7% slabinfo.kmem_cache_node.active_objs
608.00 ± 10% +28.9% 784.00 ± 6% slabinfo.kmem_cache_node.num_objs
64.50 ± 6% -21.8% 50.45 perf-stat.i.MPKI
4.149e+09 ± 2% +34.4% 5.575e+09 ± 3% perf-stat.i.branch-instructions
3.653e+08 ± 2% +36.2% 4.976e+08 ± 4% perf-stat.i.branch-misses
21.48 -25.2% 16.08 ± 3% perf-stat.i.cpi
3.997e+08 ± 2% +34.1% 5.362e+08 ± 3% perf-stat.i.iTLB-load-misses
2.056e+10 ± 2% +34.3% 2.761e+10 ± 3% perf-stat.i.iTLB-loads
2.058e+10 ± 2% +34.3% 2.765e+10 ± 3% perf-stat.i.instructions
0.05 +33.3% 0.06 ± 3% perf-stat.i.ipc
64.60 ± 6% -21.9% 50.45 perf-stat.overall.MPKI
21.50 -25.2% 16.08 ± 3% perf-stat.overall.cpi
0.05 +33.9% 0.06 ± 3% perf-stat.overall.ipc
4.132e+09 ± 2% +34.4% 5.554e+09 ± 3% perf-stat.ps.branch-instructions
3.639e+08 ± 2% +36.2% 4.957e+08 ± 4% perf-stat.ps.branch-misses
3.982e+08 ± 2% +34.1% 5.342e+08 ± 3% perf-stat.ps.iTLB-load-misses
2.048e+10 ± 2% +34.3% 2.75e+10 ± 3% perf-stat.ps.iTLB-loads
2.05e+10 ± 2% +34.3% 2.754e+10 ± 3% perf-stat.ps.instructions
6.388e+12 +33.7% 8.538e+12 ± 3% perf-stat.total.instructions
7267 ±247% -99.3% 49.75 ± 9% softirqs.CPU10.NET_RX
130728 ± 11% -16.8% 108748 ± 5% softirqs.CPU108.TIMER
132344 ± 10% -14.9% 112617 ± 4% softirqs.CPU115.TIMER
131154 ± 12% -17.1% 108751 ± 5% softirqs.CPU120.TIMER
131815 ± 12% -17.5% 108744 ± 2% softirqs.CPU121.TIMER
126469 ± 12% -14.6% 107953 ± 2% softirqs.CPU129.TIMER
134396 ± 11% -16.6% 112075 ± 4% softirqs.CPU134.TIMER
131395 ± 13% -16.6% 109560 ± 4% softirqs.CPU138.TIMER
128132 ± 13% -16.5% 106998 ± 3% softirqs.CPU141.TIMER
135682 ± 13% -20.3% 108152 ± 3% softirqs.CPU150.TIMER
131463 ± 9% -20.9% 104004 ± 3% softirqs.CPU200.TIMER
128042 ± 11% -16.6% 106766 ± 2% softirqs.CPU222.TIMER
126100 ± 11% -14.1% 108343 ± 5% softirqs.CPU224.TIMER
125564 ± 12% -16.3% 105069 ± 3% softirqs.CPU230.TIMER
130953 ± 12% -18.0% 107418 ± 2% softirqs.CPU234.TIMER
128508 ± 13% -16.5% 107252 ± 5% softirqs.CPU247.TIMER
128403 ± 12% -15.2% 108857 ± 5% softirqs.CPU249.TIMER
129763 ± 11% -14.9% 110485 ± 2% softirqs.CPU259.TIMER
12598 ±250% -100.0% 0.00 interrupts.30:IR-PCI-MSI.2097153-edge.eth0-TxRx-0
819.12 ± 88% -100.0% 0.00 interrupts.31:IR-PCI-MSI.2097154-edge.eth0-TxRx-1
648.12 ±112% -100.0% 0.00 interrupts.32:IR-PCI-MSI.2097155-edge.eth0-TxRx-2
2240 ±207% -100.0% 0.00 interrupts.33:IR-PCI-MSI.2097156-edge.eth0-TxRx-3
2223 ± 19% +29.2% 2872 ± 10% interrupts.CPU0.RES:Rescheduling_interrupts
12598 ±250% -100.0% 0.00 interrupts.CPU10.30:IR-PCI-MSI.2097153-edge.eth0-TxRx-0
4137 ± 32% +36.7% 5657 ± 12% interrupts.CPU100.CAL:Function_call_interrupts
4148 ± 30% +39.6% 5793 ± 13% interrupts.CPU104.CAL:Function_call_interrupts
4182 ± 31% +36.3% 5700 ± 12% interrupts.CPU109.CAL:Function_call_interrupts
819.12 ± 88% -100.0% 0.00 interrupts.CPU11.31:IR-PCI-MSI.2097154-edge.eth0-TxRx-1
4054 ± 33% +40.6% 5700 ± 12% interrupts.CPU111.CAL:Function_call_interrupts
4197 ± 31% +35.2% 5676 ± 12% interrupts.CPU112.CAL:Function_call_interrupts
4109 ± 32% +38.1% 5677 ± 12% interrupts.CPU113.CAL:Function_call_interrupts
4187 ± 32% +35.8% 5687 ± 12% interrupts.CPU114.CAL:Function_call_interrupts
4044 ± 10% +44.0% 5824 ± 24% interrupts.CPU114.NMI:Non-maskable_interrupts
4044 ± 10% +44.0% 5824 ± 24% interrupts.CPU114.PMI:Performance_monitoring_interrupts
4154 ± 31% +37.0% 5690 ± 12% interrupts.CPU115.CAL:Function_call_interrupts
4221 ± 30% +33.5% 5637 ± 12% interrupts.CPU116.CAL:Function_call_interrupts
4239 ± 31% +34.2% 5690 ± 12% interrupts.CPU117.CAL:Function_call_interrupts
4189 ± 31% +35.7% 5683 ± 12% interrupts.CPU118.CAL:Function_call_interrupts
4185 ± 31% +35.9% 5688 ± 12% interrupts.CPU119.CAL:Function_call_interrupts
648.12 ±112% -100.0% 0.00 interrupts.CPU12.32:IR-PCI-MSI.2097155-edge.eth0-TxRx-2
4203 ± 31% +36.9% 5754 ± 11% interrupts.CPU120.CAL:Function_call_interrupts
4225 ± 31% +34.8% 5697 ± 12% interrupts.CPU125.CAL:Function_call_interrupts
4132 ± 33% +36.9% 5655 ± 11% interrupts.CPU127.CAL:Function_call_interrupts
4169 ± 32% +35.4% 5647 ± 11% interrupts.CPU128.CAL:Function_call_interrupts
4074 ± 34% +39.3% 5674 ± 11% interrupts.CPU129.CAL:Function_call_interrupts
2240 ±207% -100.0% 0.00 interrupts.CPU13.33:IR-PCI-MSI.2097156-edge.eth0-TxRx-3
4185 ± 31% +36.2% 5700 ± 11% interrupts.CPU13.CAL:Function_call_interrupts
4171 ± 32% +36.9% 5710 ± 11% interrupts.CPU132.CAL:Function_call_interrupts
4168 ± 32% +37.0% 5712 ± 11% interrupts.CPU133.CAL:Function_call_interrupts
5939 ± 33% -31.7% 4054 ± 13% interrupts.CPU133.NMI:Non-maskable_interrupts
5939 ± 33% -31.7% 4054 ± 13% interrupts.CPU133.PMI:Performance_monitoring_interrupts
4230 ± 31% +34.9% 5708 ± 14% interrupts.CPU143.CAL:Function_call_interrupts
105.25 ±104% +532.1% 665.25 ± 45% interrupts.CPU143.RES:Rescheduling_interrupts
4173 ± 31% +35.8% 5665 ± 11% interrupts.CPU15.CAL:Function_call_interrupts
3878 ± 30% +46.8% 5694 ± 12% interrupts.CPU160.CAL:Function_call_interrupts
4070 ± 31% +39.1% 5662 ± 11% interrupts.CPU176.CAL:Function_call_interrupts
4178 ± 31% +36.6% 5707 ± 11% interrupts.CPU18.CAL:Function_call_interrupts
4170 ± 31% +36.9% 5708 ± 11% interrupts.CPU19.CAL:Function_call_interrupts
4202 ± 31% +36.0% 5715 ± 11% interrupts.CPU20.CAL:Function_call_interrupts
4449 ± 22% +45.6% 6476 ± 14% interrupts.CPU208.NMI:Non-maskable_interrupts
4449 ± 22% +45.6% 6476 ± 14% interrupts.CPU208.PMI:Performance_monitoring_interrupts
4189 ± 31% +36.5% 5718 ± 11% interrupts.CPU21.CAL:Function_call_interrupts
155.38 ± 77% -89.2% 16.75 ±112% interrupts.CPU212.RES:Rescheduling_interrupts
4106 ± 34% +38.4% 5682 ± 12% interrupts.CPU215.CAL:Function_call_interrupts
3978 ± 34% +44.6% 5752 ± 10% interrupts.CPU218.CAL:Function_call_interrupts
7.50 ± 76% +28560.0% 2149 ±147% interrupts.CPU222.RES:Rescheduling_interrupts
4113 ± 34% +39.0% 5717 ± 12% interrupts.CPU227.CAL:Function_call_interrupts
6.12 ± 91% +1712.2% 111.00 ±132% interrupts.CPU244.RES:Rescheduling_interrupts
4102 ± 33% +39.0% 5700 ± 11% interrupts.CPU248.CAL:Function_call_interrupts
15.62 ±102% +1072.8% 183.25 ±135% interrupts.CPU29.RES:Rescheduling_interrupts
4025 ± 34% +41.7% 5703 ± 11% interrupts.CPU32.CAL:Function_call_interrupts
5175 ± 30% +55.7% 8058 ± 15% interrupts.CPU36.NMI:Non-maskable_interrupts
5175 ± 30% +55.7% 8058 ± 15% interrupts.CPU36.PMI:Performance_monitoring_interrupts
40.88 ± 36% +480.4% 237.25 ± 30% interrupts.CPU6.RES:Rescheduling_interrupts
6.62 ± 87% +3952.8% 268.50 ±140% interrupts.CPU78.RES:Rescheduling_interrupts
10.75 ±138% +2395.3% 268.25 ±152% interrupts.CPU79.RES:Rescheduling_interrupts
will-it-scale.per_process_ops
460000 +-+----------------------------------------------------------------+
O O OO O O O O O |
440000 +-+ O O O O O O O |
420000 +-+ O O |
| |
400000 +-+ O O O |
| |
380000 +-+ |
| |
360000 +-+ |
340000 +-+ |
| .+ + .+ |
320000 +-+ +.+. + +.+.+.++.+ + .+.+. .+ .+ + +.+. .+ +.+. .+ |
| + + + + + + + + +.+.+.+ + +.+.|
300000 +-+----------------------------------------------------------------+
will-it-scale.workload
1.35e+08 +-+--------------------------------------------------------------+
1.3e+08 +-+O O O O O |
O O O OO O O O O O |
1.25e+08 +-+ O |
1.2e+08 +-+ O O |
| O O |
1.15e+08 +-+ O |
1.1e+08 +-+ |
1.05e+08 +-+ |
| |
1e+08 +-+ |
9.5e+07 +-++. +. .+ .+. .+.+ |
|.+ +.+. : + + +.+ +.++.+. .++ +.+.++.+.+. .+.++.+.+.+ |
9e+07 +-+ + :+ + ++ +.|
8.5e+07 +-+--------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[ipc/sem.c] 6394de3b86: BUG:kernel_NULL_pointer_dereference,address
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: 6394de3b868537a90dd9128607192b0e97109f6b ("[PATCH 4/5] ipc/sem.c: Document and update memory barriers")
url: https://github.com/0day-ci/linux/commits/Manfred-Spraul/wake_q-Cleanup-Do...
in testcase: ltp
with following parameters:
disk: 1HDD
fs: xfs
test: syscalls_part4
test-description: The LTP testsuite contains a collection of tools for testing the Linux kernel and related features.
test-url: http://linux-test-project.github.io/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------+------------+------------+
| | e14fb72a58 | 6394de3b86 |
+-----------------------------------------------------+------------+------------+
| boot_successes | 12 | 0 |
| boot_failures | 0 | 12 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 9 |
| Oops:#[##] | 0 | 12 |
| RIP:__list_del_entry_valid | 0 | 10 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 12 |
| BUG:unable_to_handle_page_fault_for_address | 0 | 3 |
| RIP:update_queue | 0 | 2 |
| WARNING:at_lib/list_debug.c:#__list_del_entry_valid | 0 | 2 |
| RIP:wake_q_add | 0 | 2 |
+-----------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 482.792516] tst_test.c:1118: INFO: Timeout per run is 0h 05m 00s
[ 482.792520]
[ 482.802139] tst_timer_test.c:345: INFO: CLOCK_MONOTONIC resolution 1ns
[ 482.802143]
[ 482.810179] tst_timer_test.c:357: INFO: prctl(PR_GET_TIMERSLACK) = 50us
[ 482.810183]
[ 482.820803] select_var.h:66: INFO: Testing libc select()
[ 482.820807]
[ 482.830021] tst_timer_test.c:264: INFO: select() sleeping for 1000us 500 iterations, threshold 450.01us
[ 482.830024]
[ 482.847596] tst_timer_test.c:307: INFO: min 1059us, max 7003us, median 1165us, trunc mean 1469.95us (discarded 25)
[ 482.847600]
[ 482.858297] tst_timer_test.c:310: FAIL: select() slept for too long
[ 482.858302]
[ 482.864980]
[ 482.870867] Time: us | Frequency
[ 482.870870]
[ 482.881126] --------------------------------------------------------------------------------
[ 482.881130]
[ 482.895705] 1059 | ********************************************************************
[ 482.895711]
[ 482.903498] 1372 | *+
[ 482.903501]
[ 482.908663] 1685 | +
[ 482.908666]
[ 482.913050] 1998 | *-
[ 482.913053]
[ 482.916768] 2311 | +
[ 482.916771]
[ 482.921066] 2624 | *+
[ 482.921069]
[ 482.925993] 2937 | *+
[ 482.925996]
[ 482.930684] 3250 | *+
[ 482.930687]
[ 482.935946] 3563 | **-
[ 482.935949]
[ 482.941233] 3876 | *-
[ 482.941238]
[ 482.946576] 4189 | *
[ 482.946579]
[ 482.950791] 4502 | +
[ 482.950820]
[ 482.954670] 4815 | *
[ 482.954673]
[ 482.958516] 5128 | +
[ 482.958519]
[ 482.962408] 5441 | .
[ 482.962411]
[ 482.966423] 5754 | +
[ 482.966426]
[ 482.970379] 6067 | .
[ 482.970382]
[ 482.974289] 6380 | .
[ 482.974292]
[ 482.978140] 6693 | +
[ 482.978143]
[ 482.985114] --------------------------------------------------------------------------------
[ 482.985117]
[ 482.992572] 313us | 1 sample = 0.17481 '*', 0.34961 '+', 0.69923 '-', non-zero '.'
[ 482.992576]
[ 482.996417]
[ 483.002115] tst_timer_test.c:264: INFO: select() sleeping for 2000us 500 iterations, threshold 450.01us
[ 483.002118]
[ 483.011234] tst_timer_test.c:307: INFO: min 2031us, max 7845us, median 2148us, trunc mean 2348.76us (discarded 25)
[ 483.011237]
[ 483.018878] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 483.018881]
[ 483.026893] tst_timer_test.c:264: INFO: select() sleeping for 5000us 300 iterations, threshold 450.04us
[ 483.026895]
[ 483.036121] tst_timer_test.c:307: INFO: min 5046us, max 10579us, median 5168us, trunc mean 5493.15us (discarded 15)
[ 483.036124]
[ 483.043537] tst_timer_test.c:310: FAIL: select() slept for too long
[ 483.043540]
[ 483.047267]
[ 483.050003] Time: us | Frequency
[ 483.050006]
[ 483.057332] --------------------------------------------------------------------------------
[ 483.057335]
[ 483.065553] 5046 | ********************************************************************
[ 483.065556]
[ 483.075327] 5338 | ****-
[ 483.075330]
[ 483.081463] 5630 | **+
[ 483.081466]
[ 483.089971] 5922 | ***
[ 483.089974]
[ 483.093897] 6214 | *+
[ 483.093900]
[ 483.099142] 6506 | **
[ 483.099145]
[ 483.103055] 6798 | +
[ 483.103058]
[ 483.107398] 7090 | +
[ 483.107401]
[ 483.111596] 7382 | +
[ 483.111599]
[ 483.115623] 7674 | -
[ 483.115627]
[ 483.119716] 7966 | **
[ 483.119720]
[ 483.123760] 8258 | -
[ 483.123763]
[ 483.127902] 8550 | +
[ 483.127904]
[ 483.131916] 8842 | *
[ 483.131919]
[ 483.136585] 9134 | +
[ 483.136588]
[ 483.142237] 9426 | *+
[ 483.142243]
[ 483.149548] 9718 | +
[ 483.149554]
[ 483.153138] 10010 | +
[ 483.153141]
[ 483.157302] 10302 | +
[ 483.157305]
[ 483.164111] --------------------------------------------------------------------------------
[ 483.164114]
[ 483.171562] 292us | 1 sample = 0.31050 '*', 0.62100 '+', 1.24201 '-', non-zero '.'
[ 483.171565]
[ 483.175390]
[ 483.181145] tst_timer_test.c:264: INFO: select() sleeping for 10000us 100 iterations, threshold 450.33us
[ 483.181149]
[ 483.190439] tst_timer_test.c:307: INFO: min 10053us, max 14724us, median 10197us, trunc mean 10749.59us (discarded 5)
[ 483.190442]
[ 483.197834] tst_timer_test.c:310: FAIL: select() slept for too long
[ 483.197837]
[ 483.201303]
[ 483.203916] Time: us | Frequency
[ 483.203919]
[ 483.211027] --------------------------------------------------------------------------------
[ 483.211030]
[ 483.219870] 10053 | ********************************************************************
[ 483.219873]
[ 483.225281] 10299 | *********+
[ 483.225284]
[ 483.230064] 10545 | **-
[ 483.230068]
[ 483.234029] 10791 | **-
[ 483.234032]
[ 483.237921] 11037 | ***+
[ 483.237924]
[ 483.241894] 11283 | *****+
[ 483.241897]
[ 483.245752] 11529 | ***+
[ 483.245755]
[ 483.249736] 11775 | ***+
[ 483.249739]
[ 483.253790] 12021 | ***+
[ 483.253811]
[ 483.257606] 12267 |
[ 483.257609]
[ 483.261554] 12513 | **-
[ 483.261557]
[ 483.265496] 12759 | **-
[ 483.265499]
[ 483.269462] 13005 | *
[ 483.269465]
[ 483.273456] 13251 | *
[ 483.273459]
[ 483.277520] 13497 | **-
[ 483.277523]
[ 483.281319] 13743 | **-
[ 483.281322]
[ 483.285722] 13989 | *
[ 483.285725]
[ 483.288929] 14235 | *
[ 483.288932]
[ 483.292662] 14481 | **-
[ 483.292665]
[ 483.299588] --------------------------------------------------------------------------------
[ 483.299591]
[ 483.306884] 246us | 1 sample = 1.19298 '*', 2.38596 '+', 4.77193 '-', non-zero '.'
[ 483.306887]
[ 483.312268]
[ 483.317644] tst_timer_test.c:264: INFO: select() sleeping for 25000us 50 iterations, threshold 451.29us
[ 483.317647]
[ 483.326674] tst_timer_test.c:307: INFO: min 25065us, max 31973us, median 25175us, trunc mean 25657.06us (discarded 2)
[ 483.326678]
[ 483.333754] tst_timer_test.c:310: FAIL: select() slept for too long
[ 483.333758]
[ 483.339116]
[ 483.341544] Time: us | Frequency
[ 483.341547]
[ 483.348868] --------------------------------------------------------------------------------
[ 483.348872]
[ 483.356606] 25065 | ********************************************************************
[ 483.356610]
[ 483.365158] 25429 | ***+
[ 483.365161]
[ 483.369295] 25793 | *+
[ 483.369298]
[ 483.373778] 26157 | ***+
[ 483.373781]
[ 483.377857] 26521 | ***+
[ 483.377860]
[ 483.381337] 26885 | ***+
[ 483.381341]
[ 483.385648] 27249 | *+
[ 483.385679]
[ 483.388959] 27613 |
[ 483.388961]
[ 483.393088] 27977 | *+
[ 483.393091]
[ 483.399322] 28341 | *+
[ 483.399328]
[ 483.408035] 28705 |
[ 483.408041]
[ 483.414130] 29069 |
[ 483.414134]
[ 483.417933] 29433 |
[ 483.417936]
[ 483.421615] 29797 |
[ 483.421619]
[ 483.424957] 30161 | *+
[ 483.424960]
[ 483.429455] 30525 | *+
[ 483.429458]
[ 483.435853] 30889 |
[ 483.435859]
[ 483.439883] 31253 |
[ 483.439886]
[ 483.443367] 31617 | *+
[ 483.443370]
[ 483.449449] --------------------------------------------------------------------------------
[ 483.449452]
[ 483.456743] 364us | 1 sample = 1.94286 '*', 3.88571 '+', 7.77143 '-', non-zero '.'
[ 483.456746]
[ 483.462420]
[ 483.470113] tst_timer_test.c:264: INFO: select() sleeping for 100000us 10 iterations, threshold 537.00us
[ 483.470119]
[ 483.481094] tst_timer_test.c:307: INFO: min 100131us, max 103539us, median 100220us, trunc mean 100670.44us (discarded 1)
[ 483.481097]
[ 483.488255] tst_timer_test.c:310: FAIL: select() slept for too long
[ 483.488258]
[ 483.493307]
[ 483.495878] Time: us | Frequency
[ 483.495882]
[ 483.502201] --------------------------------------------------------------------------------
[ 483.502204]
[ 483.509908] 100131 | ********************************************************************
[ 483.509912]
[ 483.516527] 100311 |
[ 483.516530]
[ 483.519777] 100491 |
[ 483.519780]
[ 483.523031] 100671 |
[ 483.523034]
[ 483.526706] 100851 |
[ 483.526710]
[ 483.531098] 101031 | ***********-
[ 483.531101]
[ 483.534626] 101211 |
[ 483.534629]
[ 483.539392] 101391 | ***********-
[ 483.539395]
[ 483.543898] 101571 |
[ 483.543901]
[ 483.548411] 101751 |
[ 483.548415]
[ 483.553914] 101931 |
[ 483.553919]
[ 483.559862] 102111 | ***********-
[ 483.559865]
[ 483.563383] 102291 |
[ 483.563386]
[ 483.567519] 102471 |
[ 483.567522]
[ 483.571286] 102651 |
[ 483.571290]
[ 483.574563] 102831 |
[ 483.574566]
[ 483.578421] 103011 |
[ 483.578427]
[ 483.581578] 103191 |
[ 483.581582]
[ 483.586016] 103371 | ***********-
[ 483.586019]
[ 483.592335] --------------------------------------------------------------------------------
[ 483.592338]
[ 483.599755] 180us | 1 sample = 11.33333 '*', 22.66667 '+', 45.33333 '-', non-zero '.'
[ 483.599759]
[ 483.605208]
[ 483.610713] tst_timer_test.c:264: INFO: select() sleeping for 1000000us 2 iterations, threshold 4400.00us
[ 483.610716]
[ 483.620198] tst_timer_test.c:307: INFO: min 1000207us, max 1002366us, median 1000207us, trunc mean 1000207.00us (discarded 1)
[ 483.620201]
[ 483.627885] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 483.627888]
[ 483.635436] tst_test.c:1118: INFO: Timeout per run is 0h 05m 00s
[ 483.635439]
[ 483.641490] tst_timer_test.c:345: INFO: CLOCK_MONOTONIC resolution 1ns
[ 483.641494]
[ 483.647824] tst_timer_test.c:357: INFO: prctl(PR_GET_TIMERSLACK) = 50us
[ 483.647827]
[ 483.656692] select_var.h:69: INFO: Testing SYS_select syscall
[ 483.656695]
[ 483.672043] tst_timer_test.c:264: INFO: select() sleeping for 1000us 500 iterations, threshold 450.01us
[ 483.672047]
[ 483.681266] tst_timer_test.c:307: INFO: min 1026us, max 9860us, median 1143us, trunc mean 1303.48us (discarded 25)
[ 483.681269]
[ 483.691056] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 483.691060]
[ 483.699289] tst_timer_test.c:264: INFO: select() sleeping for 2000us 500 iterations, threshold 450.01us
[ 483.699292]
[ 483.707203] tst_timer_test.c:285: INFO: Found 2 outliners in [27564,23935] range
[ 483.707206]
[ 483.717665] tst_timer_test.c:307: INFO: min 2030us, max 27564us, median 2149us, trunc mean 2432.32us (discarded 25)
[ 483.717668]
[ 483.725838] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 483.725841]
[ 483.736025] tst_timer_test.c:264: INFO: select() sleeping for 5000us 300 iterations, threshold 450.04us
[ 483.736028]
[ 483.745866] tst_timer_test.c:307: INFO: min 5023us, max 10096us, median 5164us, trunc mean 5361.09us (discarded 15)
[ 483.745869]
[ 483.754268] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 483.754271]
[ 483.764744] tst_timer_test.c:264: INFO: select() sleeping for 10000us 100 iterations, threshold 450.33us
[ 483.764747]
[ 483.774978] tst_timer_test.c:307: INFO: min 10069us, max 14123us, median 10169us, trunc mean 10315.24us (discarded 5)
[ 483.774981]
[ 483.785770] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 483.785773]
[ 483.794917] tst_timer_test.c:264: INFO: select() sleeping for 25000us 50 iterations, threshold 451.29us
[ 483.794920]
[ 484.008296] tst_timer_test.c:307: INFO: min 25065us, max 29510us, median 25233us, trunc mean 25540.21us (discarded 2)
[ 484.008299]
[ 484.016840] tst_timer_test.c:310: FAIL: select() slept for too long
[ 484.016843]
[ 484.024443]
[ 484.028091] Time: us | Frequency
[ 484.028094]
[ 484.040652] --------------------------------------------------------------------------------
[ 484.040657]
[ 484.052910] 25065 | ********************************************************************
[ 484.052913]
[ 484.063459] 25299 | **************
[ 484.063462]
[ 484.068515] 25533 |
[ 484.068519]
[ 484.074365] 25767 | *******
[ 484.074368]
[ 484.079386] 26001 | *********-
[ 484.079389]
[ 484.085273] 26235 | ****+
[ 484.085277]
[ 484.089746] 26469 | **-
[ 484.089749]
[ 484.094720] 26703 |
[ 484.094723]
[ 484.098897] 26937 | **-
[ 484.098901]
[ 484.103199] 27171 |
[ 484.103203]
[ 484.107318] 27405 |
[ 484.107322]
[ 484.113051] 27639 | ****+
[ 484.113054]
[ 484.120068] 27873 |
[ 484.120073]
[ 484.124407] 28107 | **-
[ 484.124411]
[ 484.127982] 28341 |
[ 484.127985]
[ 484.131838] 28575 |
[ 484.131841]
[ 484.136283] 28809 |
[ 484.136287]
[ 484.141330] 29043 |
[ 484.141335]
[ 484.147183] 29277 | **-
[ 484.147186]
[ 484.153769] --------------------------------------------------------------------------------
[ 484.153772]
[ 484.161029] 234us | 1 sample = 2.34483 '*', 4.68966 '+', 9.37931 '-', non-zero '.'
[ 484.161032]
[ 484.166668]
[ 484.172311] tst_timer_test.c:264: INFO: select() sleeping for 100000us 10 iterations, threshold 537.00us
[ 484.172314]
[ 485.015313] tst_timer_test.c:307: INFO: min 100208us, max 100294us, median 100275us, trunc mean 100265.11us (discarded 1)
[ 485.015319]
[ 485.023959] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 485.023963]
[ 485.043016] tst_timer_test.c:264: INFO: select() sleeping for 1000000us 2 iterations, threshold 4400.00us
[ 485.043020]
[ 487.019884] tst_timer_test.c:307: INFO: min 1001184us, max 1001186us, median 1001184us, trunc mean 1001184.00us (discarded 1)
[ 487.019890]
[ 487.035395] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 487.035401]
[ 487.045448] tst_test.c:1118: INFO: Timeout per run is 0h 05m 00s
[ 487.045453]
[ 487.056039] tst_timer_test.c:345: INFO: CLOCK_MONOTONIC resolution 1ns
[ 487.056043]
[ 487.066416] tst_timer_test.c:357: INFO: prctl(PR_GET_TIMERSLACK) = 50us
[ 487.066421]
[ 487.077159] select_var.h:72: INFO: Testing SYS_pselect6 syscall
[ 487.077163]
[ 487.088250] tst_timer_test.c:264: INFO: select() sleeping for 1000us 500 iterations, threshold 450.01us
[ 487.088254]
[ 487.648115] tst_timer_test.c:307: INFO: min 1060us, max 7520us, median 1188us, trunc mean 1187.02us (discarded 25)
[ 487.648121]
[ 487.660865] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 487.660871]
[ 487.681755] tst_timer_test.c:264: INFO: select() sleeping for 2000us 500 iterations, threshold 450.01us
[ 487.681760]
[ 488.765527] tst_timer_test.c:307: INFO: min 2072us, max 5461us, median 2217us, trunc mean 2206.84us (discarded 25)
[ 488.765532]
[ 488.777841] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 488.777844]
[ 488.789015] tst_timer_test.c:264: INFO: select() sleeping for 5000us 300 iterations, threshold 450.04us
[ 488.789018]
[ 490.358620] tst_timer_test.c:307: INFO: min 5090us, max 9929us, median 5230us, trunc mean 5229.22us (discarded 15)
[ 490.358624]
[ 490.370107] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 490.370110]
[ 490.381126] tst_timer_test.c:264: INFO: select() sleeping for 10000us 100 iterations, threshold 450.33us
[ 490.381130]
[ 491.389762] tst_timer_test.c:307: INFO: min 10071us, max 16644us, median 10234us, trunc mean 10230.05us (discarded 5)
[ 491.389768]
[ 491.400810] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 491.400812]
[ 491.412920] tst_timer_test.c:264: INFO: select() sleeping for 25000us 50 iterations, threshold 451.29us
[ 491.412923]
[ 492.654871] tst_timer_test.c:307: INFO: min 25155us, max 28435us, median 25232us, trunc mean 25232.15us (discarded 2)
[ 492.654877]
[ 492.665458] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 492.665461]
[ 492.676978] tst_timer_test.c:264: INFO: select() sleeping for 100000us 10 iterations, threshold 537.00us
[ 492.676981]
[ 493.658209] tst_timer_test.c:307: INFO: min 100273us, max 100291us, median 100288us, trunc mean 100284.78us (discarded 1)
[ 493.658215]
[ 493.669206] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 493.669209]
[ 493.681098] tst_timer_test.c:264: INFO: select() sleeping for 1000000us 2 iterations, threshold 4400.00us
[ 493.681102]
[ 495.654195] LTP: starting semctl01
[ 495.665460] tst_timer_test.c:307: INFO: min 1001178us, max 1001182us, median 1001178us, trunc mean 1001178.00us (discarded 1)
[ 495.665465]
[ 495.678498] tst_timer_test.c:322: PASS: Measured times are within thresholds
[ 495.678501]
[ 495.686271] tst_test.c:1118: INFO: Timeout per run is 0h 05m 00s
[ 495.686275]
[ 495.695265] tst_timer_test.c:345: INFO: CLOCK_MONOTONIC resolution 1ns
[ 495.695269]
[ 495.703086] tst_timer_test.c:357: INFO: prctl(PR_GET_TIMERSLACK) = 50us
[ 495.703089]
[ 495.712458] select_var.h:75: INFO: Testing SYS__newselect syscall
[ 495.712462]
[ 495.725790] tst_timer_test.c:264: INFO: select() sleeping for 1000us 500 iterations, threshold 450.01us
[ 495.725812]
[ 495.737856] select_var.h:52: CONF: syscall(-1) __NR__newselect not supported
[ 495.737860]
[ 495.743433]
[ 495.746020] Summary:
[ 495.746023]
[ 495.749409] BUG: kernel NULL pointer dereference, address: 0000000000000002
[ 495.751192] passed 15
[ 495.751195]
[ 495.754769] #PF: supervisor read access in kernel mode
[ 495.754771] #PF: error_code(0x0000) - not-present page
[ 495.754773] PGD 0 P4D 0
[ 495.754777] Oops: 0000 [#1] SMP PTI
[ 495.754782] CPU: 0 PID: 7442 Comm: semctl01 Not tainted 5.4.0-rc2-00382-g6394de3b86853 #1
[ 495.757491] failed 6
[ 495.757495]
[ 495.759023] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 495.759035] RIP: 0010:__list_del_entry_valid+0x25/0x90
[ 495.759040] Code: c3 0f 1f 40 00 48 8b 07 48 b9 00 01 00 00 00 00 ad de 48 8b 57 08 48 39 c8 74 26 48 b9 22 01 00 00 00 00 ad de 48 39 ca 74 2e <48> 8b 32 48 39 fe 75 3a 48 8b 50 08 48 39 f2 75 48 b8 01 00 00 00
[ 495.762252] skipped 0
[ 495.762255]
[ 495.764857] RSP: 0018:ffffab238045fc28 EFLAGS: 00010203
[ 495.764860] RAX: 0000000000000020 RBX: 0000000000000020 RCX: dead000000000122
[ 495.764861] RDX: 0000000000000002 RSI: ffffab2380a7bd20 RDI: ffffab2380a7bd20
[ 495.764862] RBP: ffff898b5bed7400 R08: ffffab238045fd10 R09: 0000000000000001
[ 495.764863] R10: 0000000000000001 R11: ffffffff85132ae0 R12: ffffab2380a7bd20
[ 495.764864] R13: 0000000000000004 R14: 0000000000000000 R15: ffffab2380a7bd20
[ 495.764866] FS: 00007f013c3f3500(0000) GS:ffff898b7fc00000(0000) knlGS:0000000000000000
[ 495.764868] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 495.764869] CR2: 0000000000000002 CR3: 0000000197550000 CR4: 00000000000006f0
[ 495.764876] Call Trace:
[ 495.767458] warnings 0
[ 495.767461]
[ 495.769346] update_queue+0xac/0x1a0
[ 495.773856] <<<execution_status>>>
[ 495.773859]
[ 495.774808] do_smart_update+0x8b/0x110
[ 495.774813] do_semtimedop+0xc77/0x1270
[ 495.777521] initiation_status="ok"
[ 495.777524]
[ 495.780101] ? reuse_swap_page+0x106/0x350
[ 495.780107] ? ptep_set_access_flags+0x23/0x30
[ 495.780114] ? wp_page_reuse+0x58/0x70
[ 495.780117] ? do_wp_page+0x141/0x3e0
[ 495.780120] ? __handle_mm_fault+0x9ea/0xf70
[ 495.785671] duration=27 termination_type=exited termination_id=1 corefile=no
[ 495.785674]
[ 495.790152] ? handle_mm_fault+0xdd/0x210
[ 495.790159] ? __do_page_fault+0x310/0x520
[ 495.790169] ? do_syscall_64+0x5b/0x1d0
[ 495.793079] cutime=3 cstime=11
[ 495.793084]
[ 495.794012] ? do_semtimedop+0x1270/0x1270
[ 495.794014] do_syscall_64+0x5b/0x1d0
[ 495.794024] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 495.794029] RIP: 0033:0x7f013bf23587
[ 495.797426] <<<test_end>>>
[ 495.797429]
[ 495.800048] Code: 73 01 c3 48 8b 0d 11 e9 2a 00 f7 d8 64 89 01 48 83 c8 ff c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 b8 41 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d e1 e8 2a 00 f7 d8 64 89 01 48
[ 495.800050] RSP: 002b:00007ffdfdaafba8 EFLAGS: 00000202 ORIG_RAX: 0000000000000041
[ 495.800052] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f013bf23587
[ 495.800053] RDX: 0000000000000001 RSI: 00005608192d16f4 RDI: 0000000000000000
[ 495.800054] RBP: 00005608192cff10 R08: 0000000000000000 R09: 00007ffdfdaae9d0
[ 495.800055] R10: 0000000000000853 R11: 0000000000000202 R12: 0000000000000006
[ 495.800056] R13: 00005608190b55d0 R14: 00007f013c3f3498 R15: 00005608192d1574
[ 495.800058] Modules linked in: overlay fuse vfat fat btrfs xor zstd_decompress zstd_compress raid6_pq ext4 mbcache jbd2 loop xfs libcrc32c dm_mod intel_rapl_msr intel_rapl_common crct10dif_pclmul sr_mod crc32_pclmul cdrom crc32c_intel sg ghash_clmulni_intel bochs_drm drm_vram_helper ppdev ttm ata_generic pata_acpi drm_kms_helper snd_pcm aesni_intel syscopyarea sysfillrect snd_timer sysimgblt fb_sys_fops crypto_simd drm snd cryptd glue_helper joydev soundcore pcspkr serio_raw i2c_piix4 ata_piix parport_pc parport floppy ip_tables
[ 495.803953] <<<test_start>>>
[ 495.803955]
[ 495.806468] CR2: 0000000000000002
[ 495.806474] ---[ end trace 84cb6cfa04b40df0 ]---
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc2-00382-g6394de3b86853 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[xfs] eb787bfed8: xfstests.xfs.281.fail
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: eb787bfed810b4839dde386a0d2b8a12715ed588 ("[PATCH] xfs: fix wrong struct type in ioctl definition whih cmd XFS_IOC_GETBMAPAX")
url: https://github.com/0day-ci/linux/commits/yu-kuai/xfs-fix-wrong-struct-typ...
base: https://git.kernel.org/cgit/fs/xfs/xfs-linux.git for-next
in testcase: xfstests
with following parameters:
disk: 4HDD
fs: xfs
test: xfs-group17
test-description: xfstests is a regression test suite for xfs and other files ystems.
test-url: git://git.kernel.org/pub/scm/fs/xfs/xfstests-dev.git
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
2019-10-19 20:53:16 export TEST_DIR=/fs/vda
2019-10-19 20:53:16 export TEST_DEV=/dev/vda
2019-10-19 20:53:16 export FSTYP=xfs
2019-10-19 20:53:16 export SCRATCH_MNT=/fs/scratch
2019-10-19 20:53:16 mkdir /fs/scratch -p
2019-10-19 20:53:16 export SCRATCH_DEV=/dev/vdd
2019-10-19 20:53:16 export SCRATCH_LOGDEV=/dev/vdb
2019-10-19 20:53:16 export SCRATCH_XFS_LIST_METADATA_FIELDS=u3.sfdir3.hdr.parent.i4
2019-10-19 20:53:16 export SCRATCH_XFS_LIST_FUZZ_VERBS=random
2019-10-19 20:53:16 sed "s:^:xfs/:" //lkp/benchmarks/xfstests/tests/xfs-group17 | grep -F -f merged_ignored_files
2019-10-19 20:53:16 sed "s:^:xfs/:" //lkp/benchmarks/xfstests/tests/xfs-group17 | grep -v -F -f merged_ignored_files
2019-10-19 20:53:16 ./check xfs/279 xfs/281 xfs/282 xfs/283 xfs/284 xfs/285 xfs/286 xfs/287 xfs/288 xfs/289 xfs/290 xfs/291
FSTYP -- xfs (debug)
PLATFORM -- Linux/x86_64 vm-snb-7f85e55f15ab 5.4.0-rc2-00008-geb787bfed810b #1 SMP Tue Oct 15 17:39:59 CST 2019
MKFS_OPTIONS -- -f -bsize=4096 /dev/vdd
MOUNT_OPTIONS -- /dev/vdd /fs/scratch
xfs/279 8s
xfs/281 - output mismatch (see /lkp/benchmarks/xfstests/results//xfs/281.out.bad)
--- tests/xfs/281.out 2019-09-06 14:33:46.000000000 +0800
+++ /lkp/benchmarks/xfstests/results//xfs/281.out.bad 2019-10-19 20:53:41.912277447 +0800
@@ -17,6 +17,42 @@
xfsdump: dumping ino map
xfsdump: dumping directories
xfsdump: dumping non-directory files
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/281.out /lkp/benchmarks/xfstests/results//xfs/281.out.bad' to see the entire diff)
xfs/282 _check_dmesg: something found in dmesg (see /lkp/benchmarks/xfstests/results//xfs/282.dmesg)
- output mismatch (see /lkp/benchmarks/xfstests/results//xfs/282.out.bad)
--- tests/xfs/282.out 2019-09-06 14:33:46.000000000 +0800
+++ /lkp/benchmarks/xfstests/results//xfs/282.out.bad 2019-10-19 20:53:57.877277447 +0800
@@ -17,6 +17,42 @@
xfsdump: dumping ino map
xfsdump: dumping directories
xfsdump: dumping non-directory files
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/282.out /lkp/benchmarks/xfstests/results//xfs/282.out.bad' to see the entire diff)
xfs/283 _check_dmesg: something found in dmesg (see /lkp/benchmarks/xfstests/results//xfs/283.dmesg)
- output mismatch (see /lkp/benchmarks/xfstests/results//xfs/283.out.bad)
--- tests/xfs/283.out 2019-09-06 14:33:46.000000000 +0800
+++ /lkp/benchmarks/xfstests/results//xfs/283.out.bad 2019-10-19 20:54:14.209277447 +0800
@@ -17,6 +17,42 @@
xfsdump: dumping ino map
xfsdump: dumping directories
xfsdump: dumping non-directory files
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
+xfsdump: WARNING: getbmapx 1 ino INO mode 0x000081a4 offset 0 failed: Inappropriate ioctl for device
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/283.out /lkp/benchmarks/xfstests/results//xfs/283.out.bad' to see the entire diff)
xfs/284 _check_dmesg: something found in dmesg (see /lkp/benchmarks/xfstests/results//xfs/284.dmesg)
xfs/285 67s
xfs/286 - output mismatch (see /lkp/benchmarks/xfstests/results//xfs/286.out.bad)
--- tests/xfs/286.out 2019-09-06 14:33:46.000000000 +0800
+++ /lkp/benchmarks/xfstests/results//xfs/286.out.bad 2019-10-19 20:56:35.130277447 +0800
@@ -1,4 +1,13 @@
QA output created by 286
Format and populate
Concurrent repair
+Repaired: AG 1 superblock: Repairs successful. (scrub.c line 829)
+Repaired: AG 2 superblock: Repairs successful. (scrub.c line 829)
+Repaired: AG 3 superblock: Repairs successful. (scrub.c line 829)
+Repaired: AG 1 superblock: Repairs successful. (scrub.c line 829)
...
(Run 'diff -u /lkp/benchmarks/xfstests/tests/xfs/286.out /lkp/benchmarks/xfstests/results//xfs/286.out.bad' to see the entire diff)
xfs/287 [not run] 16 bit project IDs not supported on /dev/vdd
xfs/288 3s
xfs/289 1s
xfs/290 2s
xfs/291 87s
Ran: xfs/279 xfs/281 xfs/282 xfs/283 xfs/284 xfs/285 xfs/286 xfs/287 xfs/288 xfs/289 xfs/290 xfs/291
Not run: xfs/287
Failures: xfs/281 xfs/282 xfs/283 xfs/284 xfs/286
Failed 5 of 12 tests
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc2-00008-geb787bfed810b .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[dax] 23c84eb783: fio.write_bw_MBps -61.6% regression
by kernel test robot
Greeting,
FYI, we noticed a -61.6% regression of fio.write_bw_MBps due to commit:
commit: 23c84eb7837514e16d79ed6d849b13745e0ce688 ("dax: Fix missed wakeup with PMD faults")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: fio-basic
on test machine: 72 threads Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz with 256G memory
with following parameters:
disk: 2pmem
fs: ext4
mount_option: dax
runtime: 200s
nr_task: 50%
time_based: tb
rw: write
bs: 2M
ioengine: mmap
test_size: 200G
cpufreq_governor: performance
ucode: 0x43
test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio
In addition to that, the commit also has significant impact on the following tests:
+------------------+---------------------------------------------------------------------------+
| testcase: change | fio-basic: boot-time.boot -5.0% improvement |
| test machine | 96 threads Intel(R) Xeon(R) Platinum 8260L CPU @ 2.40GHz with 128G memory |
| test parameters | bs=128B |
| | cpufreq_governor=performance |
| | fs=ext4 |
| | iodepth=1 |
| | ioengine=libpmem |
| | mode=fsdax |
| | mount_option=dax |
| | nr_dev=2 |
| | nr_task=50% |
| | runtime=200s |
| | rw=randread |
| | test_size=200G |
| | time_based=tb |
| | ucode=0x400001c |
+------------------+---------------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/mount_option/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
2M/gcc-7/performance/2pmem/ext4/mmap/x86_64-rhel-7.6/dax/50%/debian-x86_64-2019-09-23.cgz/200s/write/lkp-hsw-ep4/200G/fio-basic/tb/0x43
commit:
40cdc60ac1 ("device-dax: Add a 'resource' attribute")
23c84eb783 ("dax: Fix missed wakeup with PMD faults")
40cdc60ac16a42eb 23c84eb7837514e16d79ed6d849
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
0:4 34% 1:4 perf-profile.children.cycles-pp.error_entry
0:4 27% 1:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
0.16 ± 39% -0.2 0.00 fio.latency_1000us%
0.01 -0.0 0.00 fio.latency_100ms%
2.96 ± 19% +96.7 99.67 fio.latency_10ms%
0.01 +0.3 0.31 ± 85% fio.latency_20ms%
6.56 ±119% -6.6 0.00 ±173% fio.latency_2ms%
90.07 ± 8% -90.1 0.02 ± 65% fio.latency_4ms%
0.01 ± 32% -0.0 0.00 fio.latency_500us%
0.24 ± 91% -0.2 0.00 fio.latency_750us%
9254 +8.4% 10034 ± 3% fio.time.involuntary_context_switches
27426669 ± 5% +1577.6% 4.601e+08 ± 3% fio.time.minor_page_faults
223.22 ± 3% +2777.2% 6422 fio.time.system_time
7000 -88.4% 815.37 ± 3% fio.time.user_time
22696 ± 2% +8.2% 24558 fio.time.voluntary_context_switches
2337311 ± 7% -61.6% 898367 ± 3% fio.workload
23372 ± 7% -61.6% 8983 ± 3% fio.write_bw_MBps
3129344 ± 9% +172.3% 8519680 ± 5% fio.write_clat_90%_us
3342336 ± 12% +158.8% 8650752 ± 5% fio.write_clat_95%_us
5423104 ± 5% +64.5% 8921088 ± 6% fio.write_clat_99%_us
2598402 ± 8% +204.9% 7923118 ± 3% fio.write_clat_mean_us
11686 ± 7% -61.6% 4491 ± 3% fio.write_iops
25.58 ± 4% -8.9% 23.31 ± 3% turbostat.RAMWatt
1.81 ± 17% +663.8% 13.80 ± 7% iostat.cpu.system
13.24 ± 6% -87.6% 1.64 ± 9% iostat.cpu.user
1.55 +12.3 13.84 ± 7% mpstat.cpu.all.sys%
13.28 ± 6% -11.6 1.64 ± 9% mpstat.cpu.all.usr%
12.75 ± 6% -92.2% 1.00 vmstat.cpu.us
1376693 ± 2% +30.3% 1793986 vmstat.memory.cache
20143 ± 17% -42.1% 11662 ± 19% numa-numastat.node0.other_node
819804 ± 56% +114.3% 1757036 ± 26% numa-numastat.node1.local_node
822287 ± 56% +115.1% 1768778 ± 25% numa-numastat.node1.numa_hit
2484 ±114% +372.7% 11743 ± 19% numa-numastat.node1.other_node
14211 ± 2% +7.8% 15320 ± 3% slabinfo.anon_vma.active_objs
14211 ± 2% +7.8% 15320 ± 3% slabinfo.anon_vma.num_objs
1054 ± 6% +31.2% 1383 ± 3% slabinfo.dquot.active_objs
1054 ± 6% +31.2% 1383 ± 3% slabinfo.dquot.num_objs
48335 +1300.3% 676851 slabinfo.radix_tree_node.active_objs
876.25 +1281.1% 12101 slabinfo.radix_tree_node.active_slabs
49104 +1280.2% 677724 slabinfo.radix_tree_node.num_objs
876.25 +1281.1% 12101 slabinfo.radix_tree_node.num_slabs
43205 ± 13% +416.6% 223216 ± 13% numa-meminfo.node0.KReclaimable
16761 ± 50% +1452.6% 260246 ± 12% numa-meminfo.node0.PageTables
43205 ± 13% +416.6% 223216 ± 13% numa-meminfo.node0.SReclaimable
110769 ± 10% +162.0% 290199 ± 9% numa-meminfo.node0.Slab
45449 ± 13% +395.0% 224981 ± 11% numa-meminfo.node1.KReclaimable
2890524 ± 12% +21.5% 3510888 ± 8% numa-meminfo.node1.MemUsed
15068 ± 59% +1643.0% 262640 ± 11% numa-meminfo.node1.PageTables
45449 ± 13% +395.0% 224981 ± 11% numa-meminfo.node1.SReclaimable
102666 ± 11% +179.0% 286430 ± 7% numa-meminfo.node1.Slab
4134 ± 50% +1467.1% 64786 ± 12% numa-vmstat.node0.nr_page_table_pages
10797 ± 13% +416.9% 55809 ± 13% numa-vmstat.node0.nr_slab_reclaimable
1192200 ± 25% +55.0% 1848501 ± 24% numa-vmstat.node0.numa_hit
1170786 ± 26% +56.8% 1835674 ± 25% numa-vmstat.node0.numa_local
21413 ± 17% -40.1% 12826 ± 20% numa-vmstat.node0.numa_other
3705 ± 59% +1664.2% 65376 ± 11% numa-vmstat.node1.nr_page_table_pages
11359 ± 13% +395.2% 56254 ± 11% numa-vmstat.node1.nr_slab_reclaimable
1120301 ± 26% +70.6% 1911563 ± 22% numa-vmstat.node1.numa_hit
964396 ± 31% +81.1% 1746483 ± 24% numa-vmstat.node1.numa_local
1237 ± 14% -64.3% 441.70 ± 8% sched_debug.cfs_rq:/.exec_clock.min
0.61 ± 9% -13.4% 0.53 ± 5% sched_debug.cfs_rq:/.nr_spread_over.avg
263007 ± 2% -14.6% 224575 ± 9% sched_debug.cfs_rq:/.spread0.max
129.63 ± 6% +28.1% 166.05 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.avg
135782 ± 13% +53.0% 207732 ± 5% sched_debug.cpu.avg_idle.stddev
6.89 ± 28% -70.1% 2.06 ± 4% sched_debug.cpu.clock.stddev
6.89 ± 28% -70.1% 2.06 ± 4% sched_debug.cpu.clock_task.stddev
63.41 ± 5% +41.8% 89.93 ± 10% sched_debug.cpu.sched_goidle.min
5.58 -100.0% 0.00 sched_debug.rt_rq:/.rt_runtime.stddev
977053 ± 6% +10.0% 1074569 ± 7% meminfo.Active
960159 ± 6% +10.1% 1057333 ± 7% meminfo.Active(anon)
1563938 ± 5% +8.5% 1697481 ± 7% meminfo.Committed_AS
88651 +405.8% 448400 meminfo.KReclaimable
6183366 +15.5% 7141630 ± 2% meminfo.Memused
31890 ± 10% +1536.3% 521829 ± 11% meminfo.PageTables
88651 +405.8% 448400 meminfo.SReclaimable
217155 ± 14% +27.2% 276305 ± 10% meminfo.Shmem
213432 +170.3% 576831 meminfo.Slab
11428 ± 6% +54.2% 17619 ± 9% meminfo.max_used_kB
239005 ± 6% +10.5% 264053 ± 7% proc-vmstat.nr_active_anon
1070522 -2.2% 1046455 proc-vmstat.nr_dirty_background_threshold
2143663 -2.2% 2095470 proc-vmstat.nr_dirty_threshold
323153 ± 2% +4.6% 338160 ± 2% proc-vmstat.nr_file_pages
10789746 -2.2% 10548655 proc-vmstat.nr_free_pages
7928 ± 10% +1551.5% 130940 ± 11% proc-vmstat.nr_page_table_pages
54133 ± 14% +27.7% 69115 ± 10% proc-vmstat.nr_shmem
22163 +405.7% 112074 proc-vmstat.nr_slab_reclaimable
239005 ± 6% +10.5% 264053 ± 7% proc-vmstat.nr_zone_active_anon
9727 ± 20% +40.0% 13616 ± 15% proc-vmstat.numa_hint_faults
1824734 ± 4% +90.7% 3478977 ± 2% proc-vmstat.numa_hit
1802105 ± 4% +91.8% 3455569 ± 2% proc-vmstat.numa_local
16717 ± 4% +9.4% 18289 ± 3% proc-vmstat.numa_pages_migrated
21115 ± 30% +66.7% 35207 ± 14% proc-vmstat.pgactivate
2462163 ± 3% +71.2% 4214638 ± 2% proc-vmstat.pgalloc_normal
29317033 ± 4% +1475.5% 4.619e+08 ± 3% proc-vmstat.pgfault
2429361 ± 3% +71.3% 4162407 ± 2% proc-vmstat.pgfree
16717 ± 4% +9.4% 18289 ± 3% proc-vmstat.pgmigrate_success
48830 ± 5% +1739.8% 898367 ± 3% proc-vmstat.thp_fault_fallback
121.28 ± 17% -65.8% 41.51 ± 19% perf-stat.i.MPKI
2.456e+08 ± 16% +601.4% 1.723e+09 ± 28% perf-stat.i.branch-instructions
8210890 ± 26% +32.5% 10879790 ± 11% perf-stat.i.branch-misses
20.87 ± 9% -56.1% 9.15 ± 18% perf-stat.i.cpi
5.80 ± 10% +56.8% 9.10 ± 6% perf-stat.i.cpu-migrations
2176777 ± 20% +252.3% 7669422 ± 28% perf-stat.i.dTLB-load-misses
5.84e+08 ± 21% +237.0% 1.968e+09 ± 27% perf-stat.i.dTLB-loads
0.27 ± 15% +0.9 1.16 ± 8% perf-stat.i.dTLB-store-miss-rate%
2813218 ± 37% +1052.5% 32423092 ± 22% perf-stat.i.dTLB-store-misses
7.056e+08 ± 20% +59.5% 1.125e+09 ± 13% perf-stat.i.dTLB-stores
855886 ± 27% +303.5% 3453236 ± 19% perf-stat.i.iTLB-load-misses
1.174e+09 ± 16% +500.9% 7.055e+09 ± 28% perf-stat.i.instructions
1284 ± 14% +27.0% 1631 ± 9% perf-stat.i.instructions-per-iTLB-miss
0.08 ± 10% +66.7% 0.13 ± 16% perf-stat.i.ipc
39123 ± 10% +1592.5% 662155 ± 11% perf-stat.i.minor-faults
72.94 ± 2% +9.0 81.96 perf-stat.i.node-load-miss-rate%
554017 ± 24% +1240.4% 7426193 ± 21% perf-stat.i.node-load-misses
21822653 ± 34% -61.8% 8340609 ± 21% perf-stat.i.node-loads
29884117 ± 40% -62.6% 11167522 ± 21% perf-stat.i.node-stores
39123 ± 10% +1592.5% 662155 ± 11% perf-stat.i.page-faults
171.16 ± 19% -88.7% 19.36 ± 14% perf-stat.overall.MPKI
3.44 ± 32% -2.8 0.66 ± 17% perf-stat.overall.branch-miss-rate%
31.42 ± 12% -81.9% 5.68 ± 15% perf-stat.overall.cpi
575.80 ± 12% +77.2% 1020 ± 9% perf-stat.overall.cycles-between-cache-misses
0.39 ± 20% +2.4 2.77 ± 10% perf-stat.overall.dTLB-store-miss-rate%
50.44 ± 11% +24.6 75.03 ± 4% perf-stat.overall.iTLB-load-miss-rate%
1416 ± 11% +42.1% 2013 ± 10% perf-stat.overall.instructions-per-iTLB-miss
0.03 ± 11% +458.7% 0.18 ± 15% perf-stat.overall.ipc
2.56 ± 11% +44.5 47.09 ± 3% perf-stat.overall.node-load-miss-rate%
35.55 ± 21% +14.7 50.30 ± 3% perf-stat.overall.node-store-miss-rate%
373429 ± 11% +1347.9% 5406996 ± 21% perf-stat.overall.path-length
2.466e+08 ± 16% +598.1% 1.722e+09 ± 28% perf-stat.ps.branch-instructions
8180698 ± 26% +32.9% 10868841 ± 11% perf-stat.ps.branch-misses
5.86 ± 10% +55.2% 9.10 ± 6% perf-stat.ps.cpu-migrations
2171060 ± 20% +253.0% 7663130 ± 28% perf-stat.ps.dTLB-load-misses
5.88e+08 ± 21% +234.6% 1.967e+09 ± 27% perf-stat.ps.dTLB-loads
2834083 ± 37% +1043.4% 32405891 ± 22% perf-stat.ps.dTLB-store-misses
7.078e+08 ± 20% +58.8% 1.124e+09 ± 13% perf-stat.ps.dTLB-stores
856551 ± 27% +302.8% 3450575 ± 19% perf-stat.ps.iTLB-load-misses
1.179e+09 ± 16% +498.1% 7.051e+09 ± 28% perf-stat.ps.instructions
39462 ± 9% +1576.5% 661605 ± 11% perf-stat.ps.minor-faults
558934 ± 24% +1227.8% 7421551 ± 21% perf-stat.ps.node-load-misses
22060153 ± 34% -62.2% 8335422 ± 21% perf-stat.ps.node-loads
30203853 ± 40% -63.0% 11160678 ± 21% perf-stat.ps.node-stores
39462 ± 9% +1576.5% 661605 ± 11% perf-stat.ps.page-faults
8.746e+11 ± 14% +456.8% 4.87e+12 ± 22% perf-stat.total.instructions
44055 ± 4% -62.0% 16761 ± 9% softirqs.CPU0.RCU
47182 ± 11% -63.7% 17141 ± 11% softirqs.CPU1.RCU
48879 ± 13% -65.9% 16655 ± 10% softirqs.CPU10.RCU
48582 ± 15% -66.5% 16251 ± 9% softirqs.CPU11.RCU
49768 ± 15% -66.4% 16705 ± 17% softirqs.CPU12.RCU
45350 ± 20% -61.7% 17354 ± 14% softirqs.CPU13.RCU
45643 ± 19% -62.6% 17054 ± 11% softirqs.CPU14.RCU
90257 ± 8% -15.3% 76446 ± 16% softirqs.CPU14.SCHED
42541 ± 8% -66.7% 14178 ± 10% softirqs.CPU15.RCU
40700 ± 12% -65.1% 14224 ± 13% softirqs.CPU16.RCU
90664 ± 10% -21.0% 71587 ± 12% softirqs.CPU16.SCHED
40007 ± 11% -63.1% 14762 ± 9% softirqs.CPU17.RCU
90721 ± 9% -15.2% 76913 ± 16% softirqs.CPU17.SCHED
56587 ± 7% -66.3% 19092 ± 7% softirqs.CPU18.RCU
54834 ± 3% -67.6% 17786 ± 11% softirqs.CPU19.RCU
48947 ± 9% -60.7% 19251 ± 16% softirqs.CPU2.RCU
50458 ± 20% -66.9% 16690 ± 9% softirqs.CPU20.RCU
56425 ± 4% -69.0% 17508 ± 14% softirqs.CPU21.RCU
55135 ± 7% -68.7% 17264 ± 11% softirqs.CPU22.RCU
58345 ± 7% -71.2% 16820 ± 10% softirqs.CPU23.RCU
56257 ± 7% -68.6% 17651 ± 9% softirqs.CPU24.RCU
55896 ± 4% -69.0% 17319 ± 12% softirqs.CPU25.RCU
55977 ± 5% -72.8% 15247 ± 18% softirqs.CPU26.RCU
55460 ± 6% -69.7% 16812 ± 10% softirqs.CPU27.RCU
55624 ± 5% -67.8% 17933 ± 24% softirqs.CPU28.RCU
57802 ± 6% -70.1% 17267 ± 9% softirqs.CPU29.RCU
45974 ± 14% -64.0% 16528 ± 7% softirqs.CPU3.RCU
52807 -68.2% 16815 ± 5% softirqs.CPU30.RCU
52603 ± 2% -67.2% 17251 ± 3% softirqs.CPU31.RCU
49441 ± 6% -66.6% 16520 ± 7% softirqs.CPU32.RCU
51960 -68.2% 16524 ± 6% softirqs.CPU33.RCU
52135 ± 2% -68.1% 16612 ± 10% softirqs.CPU34.RCU
39829 ± 12% -57.1% 17068 ± 7% softirqs.CPU35.RCU
57831 ± 5% -64.2% 20680 ± 25% softirqs.CPU36.RCU
58164 ± 10% -68.0% 18608 ± 14% softirqs.CPU37.RCU
50364 ± 17% -67.3% 16457 ± 14% softirqs.CPU38.RCU
55798 ± 7% -70.6% 16430 ± 12% softirqs.CPU39.RCU
45531 ± 14% -61.4% 17557 ± 9% softirqs.CPU4.RCU
53271 ± 4% -68.5% 16801 ± 7% softirqs.CPU40.RCU
53074 ± 19% -68.0% 16995 ± 9% softirqs.CPU41.RCU
57020 ± 8% -72.0% 15938 ± 7% softirqs.CPU42.RCU
57573 ± 9% -70.5% 16997 ± 7% softirqs.CPU43.RCU
54134 ± 11% -70.7% 15861 ± 11% softirqs.CPU44.RCU
53061 ± 7% -70.4% 15697 ± 10% softirqs.CPU45.RCU
49303 ± 15% -65.4% 17070 softirqs.CPU46.RCU
54340 ± 10% -66.8% 18033 ± 7% softirqs.CPU47.RCU
50379 ± 12% -65.7% 17268 ± 9% softirqs.CPU48.RCU
50569 ± 12% -65.1% 17665 ± 3% softirqs.CPU49.RCU
49170 ± 17% -66.5% 16448 ± 10% softirqs.CPU5.RCU
52741 ± 9% -68.0% 16901 softirqs.CPU50.RCU
52519 ± 14% -65.6% 18047 ± 3% softirqs.CPU51.RCU
54948 ± 8% -68.8% 17123 ± 14% softirqs.CPU52.RCU
54210 ± 7% -66.5% 18143 ± 2% softirqs.CPU53.RCU
43736 ± 15% -63.0% 16193 ± 13% softirqs.CPU54.RCU
44488 ± 13% -64.0% 16026 ± 12% softirqs.CPU55.RCU
41085 ± 19% -63.2% 15101 ± 12% softirqs.CPU56.RCU
42371 ± 15% -63.0% 15663 ± 11% softirqs.CPU57.RCU
42237 ± 17% -63.2% 15548 ± 14% softirqs.CPU58.RCU
42957 ± 15% -64.2% 15366 ± 10% softirqs.CPU59.RCU
46957 ± 17% -57.6% 19921 ± 28% softirqs.CPU6.RCU
43793 ± 13% -65.2% 15228 ± 12% softirqs.CPU60.RCU
42612 ± 14% -62.8% 15838 ± 9% softirqs.CPU61.RCU
42578 ± 14% -64.5% 15103 ± 9% softirqs.CPU62.RCU
42461 ± 16% -63.9% 15309 ± 13% softirqs.CPU63.RCU
44047 ± 14% -62.7% 16420 ± 12% softirqs.CPU64.RCU
45361 ± 16% -64.2% 16260 ± 13% softirqs.CPU65.RCU
45455 ± 16% -64.4% 16160 ± 13% softirqs.CPU66.RCU
45070 ± 14% -64.0% 16226 ± 12% softirqs.CPU67.RCU
42204 ± 14% -62.4% 15848 ± 8% softirqs.CPU68.RCU
44889 ± 17% -63.9% 16226 ± 11% softirqs.CPU69.RCU
45813 ± 11% -63.3% 16826 ± 10% softirqs.CPU7.RCU
45145 ± 17% -62.3% 17027 ± 4% softirqs.CPU70.RCU
45264 ± 16% -64.5% 16089 ± 13% softirqs.CPU71.RCU
45030 ± 11% -63.2% 16558 ± 12% softirqs.CPU8.RCU
46406 ± 11% -64.7% 16389 ± 12% softirqs.CPU9.RCU
3549210 ± 3% -66.0% 1205129 ± 8% softirqs.RCU
771.25 ± 19% -55.3% 344.75 ± 8% interrupts.CPU0.RES:Rescheduling_interrupts
51244 ± 34% -80.5% 10009 ±104% interrupts.CPU0.TRM:Thermal_event_interrupts
51247 ± 34% -80.5% 10012 ±104% interrupts.CPU1.TRM:Thermal_event_interrupts
136.00 ± 47% -96.5% 4.75 ± 79% interrupts.CPU10.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU10.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU11.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU12.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU13.TRM:Thermal_event_interrupts
51247 ± 34% -80.5% 10012 ±104% interrupts.CPU14.TRM:Thermal_event_interrupts
463.00 ±138% -94.3% 26.50 ± 71% interrupts.CPU15.RES:Rescheduling_interrupts
51246 ± 34% -80.5% 10012 ±104% interrupts.CPU15.TRM:Thermal_event_interrupts
327.00 ±123% -94.5% 18.00 ±135% interrupts.CPU16.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU16.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU17.TRM:Thermal_event_interrupts
62835 ±100% -100.0% 28.75 ±122% interrupts.CPU18.RES:Rescheduling_interrupts
5511 ±130% -99.2% 45.00 ± 58% interrupts.CPU19.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU2.TRM:Thermal_event_interrupts
6641 ± 7% -13.4% 5754 ± 7% interrupts.CPU20.CAL:Function_call_interrupts
3729 ± 64% -99.2% 30.50 ±154% interrupts.CPU20.NMI:Non-maskable_interrupts
3729 ± 64% -99.2% 30.50 ±154% interrupts.CPU20.PMI:Performance_monitoring_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU3.TRM:Thermal_event_interrupts
15800 ±161% -99.8% 29.25 ± 61% interrupts.CPU32.RES:Rescheduling_interrupts
1885 ±117% +189.4% 5456 ± 45% interrupts.CPU34.NMI:Non-maskable_interrupts
1885 ±117% +189.4% 5456 ± 45% interrupts.CPU34.PMI:Performance_monitoring_interrupts
280.25 ±111% -99.4% 1.75 ± 47% interrupts.CPU36.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU36.TRM:Thermal_event_interrupts
6358 ± 5% -40.5% 3784 ± 50% interrupts.CPU37.CAL:Function_call_interrupts
289.25 ± 87% -93.4% 19.00 ± 97% interrupts.CPU37.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU37.TRM:Thermal_event_interrupts
2175 ±109% +166.6% 5799 ± 37% interrupts.CPU38.NMI:Non-maskable_interrupts
2175 ±109% +166.6% 5799 ± 37% interrupts.CPU38.PMI:Performance_monitoring_interrupts
162.00 ± 44% -61.9% 61.75 ±138% interrupts.CPU38.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10007 ±104% interrupts.CPU38.TRM:Thermal_event_interrupts
108.00 ± 44% -85.4% 15.75 ± 89% interrupts.CPU39.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU39.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU4.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU40.TRM:Thermal_event_interrupts
328.00 ± 88% -96.9% 10.25 ±114% interrupts.CPU41.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU41.TRM:Thermal_event_interrupts
6616 ± 7% -10.7% 5909 ± 12% interrupts.CPU42.CAL:Function_call_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU42.TRM:Thermal_event_interrupts
1385 ±125% +343.9% 6148 ± 28% interrupts.CPU43.NMI:Non-maskable_interrupts
1385 ±125% +343.9% 6148 ± 28% interrupts.CPU43.PMI:Performance_monitoring_interrupts
118.25 ± 41% -81.8% 21.50 ±138% interrupts.CPU43.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU43.TRM:Thermal_event_interrupts
115.50 ± 63% -85.1% 17.25 ± 86% interrupts.CPU44.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU44.TRM:Thermal_event_interrupts
100.25 ± 39% -74.3% 25.75 ±119% interrupts.CPU45.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU45.TRM:Thermal_event_interrupts
51233 ± 34% -80.5% 10012 ±104% interrupts.CPU46.TRM:Thermal_event_interrupts
152.75 ± 72% -94.4% 8.50 ± 90% interrupts.CPU47.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU47.TRM:Thermal_event_interrupts
139.00 ± 58% -86.5% 18.75 ± 93% interrupts.CPU48.RES:Rescheduling_interrupts
51247 ± 34% -80.5% 10012 ±104% interrupts.CPU48.TRM:Thermal_event_interrupts
145.75 ± 58% -81.8% 26.50 ± 77% interrupts.CPU49.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU49.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU5.TRM:Thermal_event_interrupts
151.25 ± 73% -84.0% 24.25 ± 93% interrupts.CPU50.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU50.TRM:Thermal_event_interrupts
51248 ± 34% -80.5% 10011 ±104% interrupts.CPU51.TRM:Thermal_event_interrupts
51239 ± 34% -80.5% 10012 ±104% interrupts.CPU52.TRM:Thermal_event_interrupts
51247 ± 34% -80.5% 10012 ±104% interrupts.CPU53.TRM:Thermal_event_interrupts
2091 ±157% -99.3% 14.75 ±102% interrupts.CPU55.RES:Rescheduling_interrupts
1078 ±125% +201.3% 3249 ± 20% interrupts.CPU56.NMI:Non-maskable_interrupts
1078 ±125% +201.3% 3249 ± 20% interrupts.CPU56.PMI:Performance_monitoring_interrupts
202.75 ± 95% -78.8% 43.00 ± 88% interrupts.CPU57.RES:Rescheduling_interrupts
440.25 ±172% +473.9% 2526 ± 43% interrupts.CPU6.NMI:Non-maskable_interrupts
440.25 ±172% +473.9% 2526 ± 43% interrupts.CPU6.PMI:Performance_monitoring_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU6.TRM:Thermal_event_interrupts
131.50 ± 42% -88.0% 15.75 ± 43% interrupts.CPU61.RES:Rescheduling_interrupts
131.75 ± 72% -78.9% 27.75 ±113% interrupts.CPU62.RES:Rescheduling_interrupts
78.00 ± 44% -51.3% 38.00 ± 34% interrupts.CPU64.RES:Rescheduling_interrupts
245.50 ± 93% -93.3% 16.50 ± 96% interrupts.CPU65.RES:Rescheduling_interrupts
196.25 ±110% -83.6% 32.25 ±105% interrupts.CPU66.RES:Rescheduling_interrupts
299.25 ±126% -93.4% 19.75 ± 91% interrupts.CPU67.RES:Rescheduling_interrupts
4947 ±154% -99.3% 34.25 ±101% interrupts.CPU68.RES:Rescheduling_interrupts
219.00 ±128% -93.7% 13.75 ± 72% interrupts.CPU69.RES:Rescheduling_interrupts
2645 ± 72% -63.2% 972.50 ±173% interrupts.CPU7.NMI:Non-maskable_interrupts
2645 ± 72% -63.2% 972.50 ±173% interrupts.CPU7.PMI:Performance_monitoring_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU7.TRM:Thermal_event_interrupts
6540 ± 6% -12.5% 5722 ± 8% interrupts.CPU70.CAL:Function_call_interrupts
3259 ± 63% -73.6% 859.75 ±156% interrupts.CPU70.NMI:Non-maskable_interrupts
3259 ± 63% -73.6% 859.75 ±156% interrupts.CPU70.PMI:Performance_monitoring_interrupts
271.75 ± 90% -91.3% 23.75 ± 69% interrupts.CPU70.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU8.TRM:Thermal_event_interrupts
5988 ±171% -99.6% 26.00 ± 76% interrupts.CPU9.RES:Rescheduling_interrupts
51248 ± 34% -80.5% 10012 ±104% interrupts.CPU9.TRM:Thermal_event_interrupts
176.00 ± 38% +70.0% 299.25 ± 16% interrupts.IWI:IRQ_work_interrupts
5216285 ± 36% -68.1% 1662283 ±128% interrupts.TRM:Thermal_event_interrupts
68.83 ± 15% -35.3 33.55 ± 17% perf-profile.calltrace.cycles-pp.secondary_startup_64
67.32 ± 14% -34.3 33.02 ± 17% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
65.71 ± 15% -33.3 32.41 ± 17% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
65.71 ± 15% -33.3 32.41 ± 17% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
65.71 ± 15% -33.3 32.41 ± 17% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
65.29 ± 15% -33.0 32.29 ± 17% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
65.26 ± 15% -33.0 32.27 ± 16% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
24.22 ± 38% -23.3 0.88 ± 8% perf-profile.calltrace.cycles-pp.get_io_u
3.13 ± 30% -2.0 1.14 ±101% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
3.13 ± 30% -2.0 1.14 ±101% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
3.13 ± 30% -2.0 1.14 ±101% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
3.10 ± 30% -2.0 1.13 ±101% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
3.10 ± 30% -2.0 1.13 ±101% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.00 +0.6 0.60 ± 5% perf-profile.calltrace.cycles-pp.ext4_es_lookup_extent.ext4_map_blocks.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault
0.00 +0.6 0.60 ± 9% perf-profile.calltrace.cycles-pp._raw_read_lock.find_next_iomem_res.walk_system_ram_range.pat_pagerange_is_ram.lookup_memtype
0.00 +0.7 0.66 ± 9% perf-profile.calltrace.cycles-pp.file_update_time.ext4_dax_huge_fault.__do_fault.__handle_mm_fault.handle_mm_fault
0.00 +0.7 0.68 ± 18% perf-profile.calltrace.cycles-pp.insert_pfn.__vm_insert_mixed.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault
0.00 +0.8 0.83 ± 8% perf-profile.calltrace.cycles-pp.ext4_map_blocks.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault
0.14 ±173% +1.0 1.17 ± 9% perf-profile.calltrace.cycles-pp.prepare_exit_to_usermode.swapgs_restore_regs_and_return_to_usermode
0.16 ±173% +1.4 1.56 ± 9% perf-profile.calltrace.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.00 +2.2 2.21 ± 34% perf-profile.calltrace.cycles-pp._raw_read_lock.jbd2_transaction_committed.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault
0.00 +2.3 2.33 ± 33% perf-profile.calltrace.cycles-pp.ext4_journal_check_start.__ext4_journal_start_sb.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault
0.00 +2.4 2.35 ± 30% perf-profile.calltrace.cycles-pp.ext4_journal_check_start.__ext4_journal_start_sb.ext4_dax_huge_fault.__do_fault.__handle_mm_fault
0.00 +2.4 2.44 ± 33% perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault
0.00 +2.4 2.44 ± 30% perf-profile.calltrace.cycles-pp.__ext4_journal_start_sb.ext4_dax_huge_fault.__do_fault.__handle_mm_fault.handle_mm_fault
0.45 ±117% +2.7 3.15 ± 8% perf-profile.calltrace.cycles-pp.find_next_iomem_res.walk_system_ram_range.pat_pagerange_is_ram.lookup_memtype.track_pfn_insert
0.46 ±116% +2.8 3.25 ± 8% perf-profile.calltrace.cycles-pp.walk_system_ram_range.pat_pagerange_is_ram.lookup_memtype.track_pfn_insert.__vm_insert_mixed
0.46 ±116% +2.8 3.28 ± 8% perf-profile.calltrace.cycles-pp.pat_pagerange_is_ram.lookup_memtype.track_pfn_insert.__vm_insert_mixed.dax_iomap_pte_fault
0.00 +3.2 3.17 ± 29% perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault
0.00 +3.3 3.27 ± 29% perf-profile.calltrace.cycles-pp.__ext4_journal_stop.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault
0.00 +3.6 3.56 ± 22% perf-profile.calltrace.cycles-pp.add_transaction_credits.start_this_handle.jbd2__journal_start.ext4_dax_huge_fault.__do_fault
0.00 +3.7 3.70 ± 26% perf-profile.calltrace.cycles-pp._raw_read_lock.start_this_handle.jbd2__journal_start.ext4_dax_huge_fault.__do_fault
0.00 +5.0 4.99 ± 25% perf-profile.calltrace.cycles-pp.jbd2_journal_stop.__ext4_journal_stop.ext4_dax_huge_fault.__do_fault.__handle_mm_fault
0.00 +5.1 5.11 ± 24% perf-profile.calltrace.cycles-pp.__ext4_journal_stop.ext4_dax_huge_fault.__do_fault.__handle_mm_fault.handle_mm_fault
0.00 +5.5 5.53 ± 33% perf-profile.calltrace.cycles-pp.jbd2_transaction_committed.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault
0.00 +12.7 12.72 ± 29% perf-profile.calltrace.cycles-pp.ext4_iomap_begin.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault.__handle_mm_fault
0.00 +16.4 16.42 ± 26% perf-profile.calltrace.cycles-pp.start_this_handle.jbd2__journal_start.ext4_dax_huge_fault.__do_fault.__handle_mm_fault
0.00 +16.6 16.58 ± 25% perf-profile.calltrace.cycles-pp.jbd2__journal_start.ext4_dax_huge_fault.__do_fault.__handle_mm_fault.handle_mm_fault
0.00 +17.5 17.54 ± 46% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.lookup_memtype.track_pfn_insert.__vm_insert_mixed
0.00 +18.1 18.11 ± 44% perf-profile.calltrace.cycles-pp._raw_spin_lock.lookup_memtype.track_pfn_insert.__vm_insert_mixed.dax_iomap_pte_fault
0.51 ±117% +21.2 21.68 ± 38% perf-profile.calltrace.cycles-pp.lookup_memtype.track_pfn_insert.__vm_insert_mixed.dax_iomap_pte_fault.ext4_dax_huge_fault
0.51 ±117% +21.2 21.70 ± 38% perf-profile.calltrace.cycles-pp.track_pfn_insert.__vm_insert_mixed.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault
0.53 ±117% +21.9 22.41 ± 37% perf-profile.calltrace.cycles-pp.__vm_insert_mixed.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault.__handle_mm_fault
1.46 ± 49% +34.9 36.33 ± 15% perf-profile.calltrace.cycles-pp.dax_iomap_pte_fault.ext4_dax_huge_fault.__do_fault.__handle_mm_fault.handle_mm_fault
3.24 ± 31% +58.7 61.97 ± 8% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
3.33 ± 31% +58.8 62.18 ± 8% perf-profile.calltrace.cycles-pp.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
3.70 ± 29% +58.9 62.65 ± 8% perf-profile.calltrace.cycles-pp.__do_page_fault.do_page_fault.page_fault
3.78 ± 29% +59.0 62.73 ± 8% perf-profile.calltrace.cycles-pp.do_page_fault.page_fault
3.79 ± 29% +59.0 62.75 ± 8% perf-profile.calltrace.cycles-pp.page_fault
1.86 ± 41% +59.7 61.59 ± 8% perf-profile.calltrace.cycles-pp.ext4_dax_huge_fault.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault
1.89 ± 41% +59.8 61.65 ± 8% perf-profile.calltrace.cycles-pp.__do_fault.__handle_mm_fault.handle_mm_fault.__do_page_fault.do_page_fault
68.83 ± 15% -35.3 33.55 ± 17% perf-profile.children.cycles-pp.do_idle
68.83 ± 15% -35.3 33.55 ± 17% perf-profile.children.cycles-pp.secondary_startup_64
68.83 ± 15% -35.3 33.55 ± 17% perf-profile.children.cycles-pp.cpu_startup_entry
68.39 ± 14% -35.0 33.41 ± 17% perf-profile.children.cycles-pp.cpuidle_enter
68.39 ± 14% -35.0 33.41 ± 17% perf-profile.children.cycles-pp.cpuidle_enter_state
67.32 ± 14% -34.3 33.02 ± 17% perf-profile.children.cycles-pp.intel_idle
65.71 ± 15% -33.3 32.41 ± 17% perf-profile.children.cycles-pp.start_secondary
24.27 ± 38% -23.4 0.88 ± 8% perf-profile.children.cycles-pp.get_io_u
3.13 ± 30% -2.0 1.14 ±101% perf-profile.children.cycles-pp.start_kernel
1.07 ± 39% -1.0 0.09 ± 49% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
1.06 ± 39% -1.0 0.09 ± 49% perf-profile.children.cycles-pp.do_syscall_64
1.06 ± 18% -0.8 0.27 ±125% perf-profile.children.cycles-pp.thermal_interrupt
1.03 ± 19% -0.8 0.27 ±124% perf-profile.children.cycles-pp.smp_thermal_interrupt
1.02 ± 19% -0.8 0.27 ±124% perf-profile.children.cycles-pp.intel_thermal_interrupt
0.98 ± 17% -0.7 0.24 ±125% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.95 ± 19% -0.7 0.25 ±125% perf-profile.children.cycles-pp.pkg_thermal_notify
1.02 ± 30% -0.4 0.62 ± 7% perf-profile.children.cycles-pp.apic_timer_interrupt
0.93 ± 33% -0.4 0.56 ± 7% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.40 ± 44% -0.3 0.09 ± 17% perf-profile.children.cycles-pp.dax_wake_entry
0.62 ± 24% -0.2 0.43 ± 8% perf-profile.children.cycles-pp.hrtimer_interrupt
0.27 ± 35% -0.2 0.09 ± 14% perf-profile.children.cycles-pp.menu_select
0.20 ± 20% -0.2 0.03 ±102% perf-profile.children.cycles-pp.io_serial_in
0.44 ± 28% -0.2 0.28 ± 6% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.17 ± 8% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.irq_work_interrupt
0.17 ± 8% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.smp_irq_work_interrupt
0.17 ± 8% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.irq_work_run
0.17 ± 8% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.printk
0.17 ± 8% -0.1 0.04 ± 57% perf-profile.children.cycles-pp.vprintk_emit
0.17 ± 11% -0.1 0.06 ± 60% perf-profile.children.cycles-pp.irq_work_run_list
0.17 ± 9% -0.1 0.06 ± 66% perf-profile.children.cycles-pp.uart_console_write
0.17 ± 11% -0.1 0.06 ± 67% perf-profile.children.cycles-pp.serial8250_console_write
0.17 ± 10% -0.1 0.06 ± 66% perf-profile.children.cycles-pp.wait_for_xmitr
0.17 ± 10% -0.1 0.06 ± 66% perf-profile.children.cycles-pp.serial8250_console_putchar
0.17 ± 11% -0.1 0.06 ± 64% perf-profile.children.cycles-pp.console_unlock
0.06 ± 60% +0.1 0.11 ± 11% perf-profile.children.cycles-pp.kmem_cache_alloc
0.00 +0.1 0.07 ± 23% perf-profile.children.cycles-pp.current_time
0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp._cond_resched
0.00 +0.1 0.07 ± 7% perf-profile.children.cycles-pp.__might_sleep
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.down_read
0.00 +0.1 0.08 ± 14% perf-profile.children.cycles-pp.xas_load
0.03 ±100% +0.1 0.11 ± 19% perf-profile.children.cycles-pp.ext4_data_block_valid
0.00 +0.1 0.09 ± 10% perf-profile.children.cycles-pp.up_read
0.03 ±102% +0.1 0.12 ± 11% perf-profile.children.cycles-pp.__sb_start_write
0.08 ± 19% +0.1 0.17 ± 11% perf-profile.children.cycles-pp.dax_iomap_pfn
0.00 +0.1 0.10 ± 5% perf-profile.children.cycles-pp.sync_regs
0.24 ± 31% +0.1 0.34 ± 5% perf-profile.children.cycles-pp.grab_mapping_entry
0.00 +0.1 0.10 ± 14% perf-profile.children.cycles-pp.___might_sleep
0.04 ± 57% +0.1 0.17 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.00 +0.1 0.14 ± 8% perf-profile.children.cycles-pp.xas_create
0.08 ± 30% +0.1 0.21 ± 8% perf-profile.children.cycles-pp.xas_store
0.03 ±100% +0.2 0.20 ± 15% perf-profile.children.cycles-pp.__check_block_validity
0.02 ±173% +0.2 0.22 ± 8% perf-profile.children.cycles-pp.dax_unlock_entry
0.03 ±102% +0.2 0.24 ± 9% perf-profile.children.cycles-pp.dax_insert_entry
0.01 ±173% +0.2 0.25 ± 14% perf-profile.children.cycles-pp.rbt_memtype_lookup
0.00 +0.3 0.28 ± 13% perf-profile.children.cycles-pp.ext4_meta_trans_blocks
0.07 ± 39% +0.3 0.37 ± 8% perf-profile.children.cycles-pp.next_resource
0.23 ± 21% +0.3 0.57 ± 6% perf-profile.children.cycles-pp.native_irq_return_iret
0.08 ± 12% +0.5 0.60 ± 5% perf-profile.children.cycles-pp.ext4_es_lookup_extent
0.00 +0.6 0.64 ± 20% perf-profile.children.cycles-pp.__get_locked_pte
0.01 ±173% +0.7 0.68 ± 18% perf-profile.children.cycles-pp.insert_pfn
0.13 ± 11% +0.7 0.83 ± 8% perf-profile.children.cycles-pp.ext4_map_blocks
0.40 ± 25% +0.8 1.17 ± 9% perf-profile.children.cycles-pp.prepare_exit_to_usermode
0.48 ± 24% +1.1 1.56 ± 9% perf-profile.children.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.77 ± 57% +2.5 3.23 ± 8% perf-profile.children.cycles-pp.find_next_iomem_res
0.77 ± 57% +2.5 3.26 ± 8% perf-profile.children.cycles-pp.walk_system_ram_range
0.77 ± 57% +2.5 3.29 ± 8% perf-profile.children.cycles-pp.pat_pagerange_is_ram
0.00 +3.6 3.62 ± 22% perf-profile.children.cycles-pp.add_transaction_credits
0.10 ± 15% +4.6 4.73 ± 32% perf-profile.children.cycles-pp.ext4_journal_check_start
0.10 ± 17% +4.8 4.92 ± 31% perf-profile.children.cycles-pp.__ext4_journal_start_sb
0.00 +5.5 5.54 ± 33% perf-profile.children.cycles-pp.jbd2_transaction_committed
0.29 ± 54% +6.3 6.62 ± 26% perf-profile.children.cycles-pp._raw_read_lock
0.18 ± 23% +8.1 8.29 ± 26% perf-profile.children.cycles-pp.jbd2_journal_stop
0.19 ± 21% +8.3 8.50 ± 26% perf-profile.children.cycles-pp.__ext4_journal_stop
0.26 ± 13% +12.5 12.73 ± 29% perf-profile.children.cycles-pp.ext4_iomap_begin
0.18 ± 23% +16.5 16.69 ± 26% perf-profile.children.cycles-pp.start_this_handle
0.26 ± 24% +16.6 16.87 ± 25% perf-profile.children.cycles-pp.jbd2__journal_start
0.93 ± 19% +16.8 17.78 ± 44% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.15 ± 44% +18.6 18.71 ± 44% perf-profile.children.cycles-pp._raw_spin_lock
0.91 ± 51% +20.8 21.70 ± 38% perf-profile.children.cycles-pp.lookup_memtype
0.91 ± 50% +20.8 21.71 ± 38% perf-profile.children.cycles-pp.track_pfn_insert
0.73 ± 65% +21.7 22.41 ± 37% perf-profile.children.cycles-pp.__vm_insert_mixed
1.46 ± 49% +34.9 36.34 ± 15% perf-profile.children.cycles-pp.dax_iomap_pte_fault
3.02 ± 33% +58.6 61.66 ± 8% perf-profile.children.cycles-pp.ext4_dax_huge_fault
3.29 ± 30% +58.7 61.98 ± 8% perf-profile.children.cycles-pp.__handle_mm_fault
3.39 ± 30% +58.8 62.20 ± 8% perf-profile.children.cycles-pp.handle_mm_fault
3.76 ± 28% +58.9 62.65 ± 8% perf-profile.children.cycles-pp.__do_page_fault
3.84 ± 28% +58.9 62.74 ± 8% perf-profile.children.cycles-pp.do_page_fault
3.86 ± 28% +58.9 62.76 ± 8% perf-profile.children.cycles-pp.page_fault
1.89 ± 41% +59.8 61.65 ± 8% perf-profile.children.cycles-pp.__do_fault
67.30 ± 14% -34.3 33.02 ± 17% perf-profile.self.cycles-pp.intel_idle
23.95 ± 38% -23.1 0.87 ± 9% perf-profile.self.cycles-pp.get_io_u
0.39 ± 43% -0.3 0.08 ± 15% perf-profile.self.cycles-pp.dax_wake_entry
0.14 ± 10% -0.1 0.03 ±102% perf-profile.self.cycles-pp.io_serial_in
0.07 ± 26% +0.0 0.11 ± 3% perf-profile.self.cycles-pp.__do_page_fault
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.file_update_time
0.00 +0.1 0.06 ± 9% perf-profile.self.cycles-pp.__might_sleep
0.01 ±173% +0.1 0.08 ± 21% perf-profile.self.cycles-pp.__sb_start_write
0.00 +0.1 0.06 ± 6% perf-profile.self.cycles-pp.__mark_inode_dirty
0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.xas_load
0.01 ±173% +0.1 0.08 ± 10% perf-profile.self.cycles-pp.xas_store
0.00 +0.1 0.07 ± 10% perf-profile.self.cycles-pp.jbd2__journal_start
0.00 +0.1 0.08 ± 12% perf-profile.self.cycles-pp.up_read
0.03 ±100% +0.1 0.11 ± 19% perf-profile.self.cycles-pp.ext4_data_block_valid
0.03 ±100% +0.1 0.11 ± 14% perf-profile.self.cycles-pp.handle_mm_fault
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.__check_block_validity
0.00 +0.1 0.09 ± 5% perf-profile.self.cycles-pp.sync_regs
0.00 +0.1 0.10 ± 19% perf-profile.self.cycles-pp.___might_sleep
0.01 ±173% +0.1 0.12 ± 10% perf-profile.self.cycles-pp.dax_iomap_pte_fault
0.04 ± 57% +0.1 0.17 ± 6% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.00 +0.1 0.13 ± 10% perf-profile.self.cycles-pp.xas_create
0.11 ± 19% +0.1 0.24 ± 2% perf-profile.self.cycles-pp.__handle_mm_fault
0.00 +0.2 0.19 ± 32% perf-profile.self.cycles-pp.__ext4_journal_start_sb
0.03 ±100% +0.2 0.22 ± 11% perf-profile.self.cycles-pp.ext4_dax_huge_fault
0.00 +0.2 0.21 ± 26% perf-profile.self.cycles-pp.__ext4_journal_stop
0.01 ±173% +0.2 0.24 ± 13% perf-profile.self.cycles-pp.rbt_memtype_lookup
0.02 ±173% +0.3 0.28 ± 7% perf-profile.self.cycles-pp.next_resource
0.00 +0.3 0.27 ± 14% perf-profile.self.cycles-pp.ext4_meta_trans_blocks
0.09 ± 25% +0.3 0.39 ± 10% perf-profile.self.cycles-pp.swapgs_restore_regs_and_return_to_usermode
0.23 ± 21% +0.3 0.57 ± 6% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.4 0.37 ± 24% perf-profile.self.cycles-pp.ext4_iomap_begin
0.06 ± 14% +0.5 0.54 ± 5% perf-profile.self.cycles-pp.ext4_es_lookup_extent
0.39 ± 25% +0.8 1.16 ± 9% perf-profile.self.cycles-pp.prepare_exit_to_usermode
0.10 ± 37% +1.0 1.15 ± 17% perf-profile.self.cycles-pp._raw_spin_lock
0.51 ± 46% +1.8 2.32 ± 10% perf-profile.self.cycles-pp.find_next_iomem_res
0.00 +3.3 3.30 ± 32% perf-profile.self.cycles-pp.jbd2_transaction_committed
0.00 +3.6 3.60 ± 22% perf-profile.self.cycles-pp.add_transaction_credits
0.07 ± 17% +4.6 4.63 ± 32% perf-profile.self.cycles-pp.ext4_journal_check_start
0.29 ± 54% +6.3 6.56 ± 26% perf-profile.self.cycles-pp._raw_read_lock
0.10 ± 21% +8.1 8.20 ± 26% perf-profile.self.cycles-pp.jbd2_journal_stop
0.05 ± 64% +9.2 9.23 ± 27% perf-profile.self.cycles-pp.start_this_handle
0.93 ± 19% +16.7 17.66 ± 44% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
fio.write_bw_MBps
35000 +-+-----------------------------------------------------------------+
| |
30000 +-+ +.. |
| .. |
| + + .+ +.. .+.. |
25000 +-+ + + + +..+. + : +. +..+.+.. |
| .. + + + .. + : ..|
20000 +-++ + .+ +.+ +..+. : + |
| +.+. + |
15000 +-+ |
| |
| |
10000 O-+O O O O O O O O O O O O O O O O O O |
| |
5000 +-+-----------------------------------------------------------------+
fio.write_iops
16000 +-+-----------------------------------------------------------------+
| : + |
14000 +-+ : + |
| : + + +.. +.. |
| + + : .. : : .. .+. |
12000 +-+ + : : : +..+ : : + +. +.. +|
| + + : : : .. : : + |
10000 +-++ : : +.+ +.. : + |
| +.+..+ +.+ |
8000 +-+ |
| |
| |
6000 +-+ |
O O O O O O O O O O O O |
4000 +-+O--O----O-----------O----O--O-----------O------------------------+
fio.write_clat_mean_us
9e+06 +-+-----------------------------------------------------------------+
| O O O O |
8e+06 O-+ O O O O O O O O O O O O |
7e+06 +-+ O O |
| |
6e+06 +-+ |
| |
5e+06 +-+ |
| |
4e+06 +-+ |
3e+06 +-+ +.+..+.. +.+.. +..+.+.. |
| .+.. .. .. +..+.. .. .+.. .+..+.+..+..|
2e+06 +-+ + +..+..+ + +. +. |
| |
1e+06 +-+-----------------------------------------------------------------+
fio.write_clat_90__us
1e+07 +-+-----------------------------------------------------------------+
| O O O O |
9e+06 +-+ O O O O O O |
8e+06 O-+ O O O O O O O O |
| |
7e+06 +-+ |
| |
6e+06 +-+ |
| |
5e+06 +-+ + |
4e+06 +-+ +. + : |
| + +..+.. +.+.. +..+ : |
3e+06 +-++.. + .. +..+.. .. : .+.. .+.. .+..+..|
|. + +.. .+ + +. +. + |
2e+06 +-+-----------------------------------------------------------------+
fio.write_clat_95__us
1e+07 +-+-----------------------------------------------------------------+
| O O O O |
9e+06 +-+ O O O O O O O O O |
8e+06 O-+ O O O O O |
| |
7e+06 +-+ |
| |
6e+06 +-+ |
| + |
5e+06 +-+ + : : |
4e+06 +-+ : + +.. : : |
| +.. : +..+.. +.+.. + + : .+..|
3e+06 +-+ : .. +..+.. + : .+.. .+.. .+. |
| + +..+..+ + +. +. + |
2e+06 +-+-----------------------------------------------------------------+
fio.latency_10ms_
100 O-+O--O--O--O--O--O-O--O--O--O--O--O--O--O--O--O--O--O----------------+
90 +-+ |
| |
80 +-+ |
70 +-+ |
| |
60 +-+ |
50 +-+ |
40 +-+ |
| |
30 +-+ |
20 +-+ |
| +.. +.. |
10 +-+ .. .+.. .. .+..|
0 +-+-------------------------------------------------------------------+
fio.workload
3.5e+06 +-+---------------------------------------------------------------+
| |
3e+06 +-+ +.. |
| + |
| + + .+ +.. .+.. |
2.5e+06 +-+ + + + +..+. + : + +..+..+ |
| .. : + + + + : + ..|
2e+06 +-++ : .+ +..+ +.+.. : + |
| +..+. + |
1.5e+06 +-+ |
| |
| |
1e+06 O-+O O O O O O O O O O O O O O O O O O |
| |
500000 +-+---------------------------------------------------------------+
fio.time.user_time
8000 +-+------------------------------------------------------------------+
| |
7000 +-++..+..+..+.+..+..+..+..+..+..+..+.+..+..+..+..+..+..+..+.+..+..+..|
6000 +-+ |
| |
5000 +-+ |
| |
4000 +-+ |
| |
3000 +-+ |
2000 +-+ |
| |
1000 O-+ O O |
| O O O O O O O O O O O O O O O O |
0 +-+------------------------------------------------------------------+
fio.time.system_time
7000 +-+------------------------------------------------------------------+
O O O O O O O O O O O O O O O O O O O |
6000 +-+ |
| |
5000 +-+ |
| |
4000 +-+ |
| |
3000 +-+ |
| |
2000 +-+ |
| |
1000 +-+ |
| |
0 +-+------------------------------------------------------------------+
fio.time.minor_page_faults
5e+08 +-+---------------------------------O----------O------------------+
4.5e+08 O-+ O O O O O O O O O O O O |
| O O O O |
4e+08 +-+ |
3.5e+08 +-+ |
| |
3e+08 +-+ |
2.5e+08 +-+ |
2e+08 +-+ |
| |
1.5e+08 +-+ |
1e+08 +-+ |
| |
5e+07 +-++..+.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+..+.+..+..+..+.+..|
0 +-+---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2sp2: 96 threads Intel(R) Xeon(R) Platinum 8260L CPU @ 2.40GHz with 128G memory
=========================================================================================
bs/compiler/cpufreq_governor/fs/iodepth/ioengine/kconfig/mode/mount_option/nr_dev/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
128B/gcc-7/performance/ext4/1/libpmem/x86_64-rhel-7.6/fsdax/dax/2/50%/debian-x86_64-2019-05-14.cgz/200s/randread/lkp-csl-2sp2/200G/fio-basic/tb/0x400001c
commit:
40cdc60ac1 ("device-dax: Add a 'resource' attribute")
23c84eb783 ("dax: Fix missed wakeup with PMD faults")
40cdc60ac16a42eb 23c84eb7837514e16d79ed6d849
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
1:4 -25% :3 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
1:4 -25% :3 dmesg.WARNING:stack_recursion
1:4 -25% :3 kmsg.Hardware_Error]:DIMM_location:not_present.DMI_handle
1:4 -25% :3 kmsg.Hardware_Error]:Error#,type:recoverable
1:4 -25% :3 kmsg.Hardware_Error]:Hardware_error_from_APEI_Generic_Hardware_Error_Source
1:4 -25% :3 kmsg.Hardware_Error]:error_status
1:4 -25% :3 kmsg.Hardware_Error]:error_type:#,unknown
1:4 -25% :3 kmsg.Hardware_Error]:event_severity:recoverable
1:4 -25% :3 kmsg.Hardware_Error]:node:#card:#module
1:4 -25% :3 kmsg.Hardware_Error]:physical_address
1:4 -25% :3 kmsg.Hardware_Error]:physical_address_mask
1:4 -25% :3 kmsg.Hardware_Error]:section_type:memory_error
1:4 -25% :3 kmsg.Memory_failure:#:recovery_action_for_dax_page:Failed
%stddev %change %stddev
\ | \
0.01 -0.0 0.00 fio.latency_1000us%
0.01 -0.0 0.00 fio.latency_100ms%
0.23 +0.5 0.68 ± 44% fio.latency_10us%
0.12 +2.4 2.54 ± 54% fio.latency_20us%
0.17 +0.4 0.52 ± 40% fio.latency_2us%
644.00 +2359.2% 15837 ± 65% fio.read_clat_99%_us
136.98 +483.3% 798.93 ± 60% fio.read_clat_mean_us
13708 -72.9% 3720 ± 48% fio.read_clat_stddev
271811 +19245.5% 52583088 fio.time.minor_page_faults
196.58 +342.0% 868.90 ± 16% fio.time.system_time
9420 -5.8% 8877 fio.time.user_time
27149 -16.1% 22781 fio.time.voluntary_context_switches
3448 -1.8% 3385 ndctl.time.maximum_resident_set_size
162.00 -11.1% 144.00 ndctl.time.percent_of_cpu_this_job_got
5.773e+08 -28.0% 4.158e+08 ± 35% cpuidle.C6.time
2.85 -0.8 2.02 ± 36% turbostat.C6%
0.20 -0.2 0.02 ± 87% mpstat.cpu.all.soft%
1.43 +3.0 4.42 ± 15% mpstat.cpu.all.sys%
143827 +203.7% 436747 ± 23% numa-numastat.node0.local_node
174846 +161.7% 457502 ± 19% numa-numastat.node0.numa_hit
40.52 -5.0% 38.49 boot-time.boot
25.83 -1.5% 25.44 boot-time.dhcp
3439 -7.1% 3195 boot-time.idle
46.00 -6.5% 43.00 vmstat.cpu.us
1882442 +25.7% 2366566 vmstat.memory.cache
1723 -4.0% 1654 ± 2% vmstat.system.cs
192529 +2.0% 196426 vmstat.system.in
91733 +493.2% 544132 meminfo.KReclaimable
2854102 +30.6% 3726561 meminfo.Memused
9789 +3989.2% 400292 meminfo.PageTables
91733 +493.2% 544132 meminfo.SReclaimable
261954 +173.8% 717201 meminfo.Slab
15548 +24.6% 19376 meminfo.max_used_kB
12428 +1036.9% 141294 ±127% numa-meminfo.node1.Inactive
12424 +1035.7% 141097 ±127% numa-meminfo.node1.Inactive(anon)
35975 +439.8% 194177 ±110% numa-meminfo.node1.KReclaimable
1232 +11028.1% 137098 ±135% numa-meminfo.node1.PageTables
35975 +439.8% 194177 ±110% numa-meminfo.node1.SReclaimable
71264 +9.2% 77846 numa-meminfo.node1.SUnreclaim
172476 +59.0% 274160 ± 31% numa-meminfo.node1.Shmem
107240 +153.7% 272024 ± 78% numa-meminfo.node1.Slab
137.00 -67.2% 45.00 ± 85% numa-vmstat.node0.nr_inactive_file
137.00 -67.2% 45.00 ± 85% numa-vmstat.node0.nr_zone_inactive_file
1.00 +1.8e+07% 176769 ±141% numa-vmstat.node1.nr_dirtied
2973 +1082.6% 35157 ±127% numa-vmstat.node1.nr_inactive_anon
309.00 +10989.3% 34266 ±135% numa-vmstat.node1.nr_page_table_pages
43146 +58.9% 68561 ± 31% numa-vmstat.node1.nr_shmem
8997 +440.5% 48625 ±110% numa-vmstat.node1.nr_slab_reclaimable
17815 +9.2% 19459 numa-vmstat.node1.nr_slab_unreclaimable
1.00 +1.8e+07% 176763 ±141% numa-vmstat.node1.nr_written
2973 +1082.6% 35157 ±127% numa-vmstat.node1.nr_zone_inactive_anon
152151 +4.6% 159190 proc-vmstat.nr_active_anon
6294 -3.6% 6065 proc-vmstat.nr_active_file
451092 +1.7% 458890 proc-vmstat.nr_file_pages
138.00 -31.6% 94.33 ± 2% proc-vmstat.nr_inactive_file
2440 +4007.0% 100212 proc-vmstat.nr_page_table_pages
145339 +5.6% 153452 ± 2% proc-vmstat.nr_shmem
22930 +493.8% 136157 proc-vmstat.nr_slab_reclaimable
152151 +4.6% 159190 proc-vmstat.nr_zone_active_anon
6294 -3.6% 6065 proc-vmstat.nr_zone_active_file
138.00 -31.6% 94.33 ± 2% proc-vmstat.nr_zone_inactive_file
25239 -26.5% 18547 proc-vmstat.numa_hint_faults
10148 -68.5% 3191 ± 4% proc-vmstat.numa_hint_faults_local
770739 +32.1% 1018202 proc-vmstat.numa_hit
739614 +33.5% 987031 proc-vmstat.numa_local
45092 -17.1% 37382 ± 16% proc-vmstat.numa_pages_migrated
844874 +41.6% 1196713 proc-vmstat.pgalloc_normal
836660 +6253.9% 53160425 proc-vmstat.pgfault
740872 +46.6% 1085990 proc-vmstat.pgfree
45092 -17.1% 37382 ± 16% proc-vmstat.pgmigrate_success
48.00 +2.1e+05% 102432 proc-vmstat.thp_fault_fallback
0.90 +0.6 1.48 ± 21% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
0.90 +0.6 1.48 ± 21% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_kernel.secondary_startup_64
0.90 +0.6 1.48 ± 21% perf-profile.calltrace.cycles-pp.start_kernel.secondary_startup_64
0.89 +0.6 1.47 ± 22% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel
0.89 +0.6 1.47 ± 21% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_kernel.secondary_startup_64
1.98 -1.4 0.58 ±119% perf-profile.children.cycles-pp.axmap_next_free
0.00 +0.1 0.07 ± 25% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.11 +0.1 0.19 ± 31% perf-profile.children.cycles-pp.scheduler_tick
0.00 +0.1 0.09 ± 32% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.19 +0.1 0.30 ± 30% perf-profile.children.cycles-pp.update_process_times
0.19 +0.1 0.31 ± 30% perf-profile.children.cycles-pp.tick_sched_handle
0.05 +0.1 0.19 ± 52% perf-profile.children.cycles-pp.irq_exit
0.11 +0.1 0.25 ± 37% perf-profile.children.cycles-pp.clockevents_program_event
0.00 +0.1 0.15 ± 53% perf-profile.children.cycles-pp.__softirqentry_text_start
0.23 +0.2 0.42 ± 31% perf-profile.children.cycles-pp.tick_sched_timer
0.00 +0.2 0.19 ± 92% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.05 +0.2 0.25 ± 78% perf-profile.children.cycles-pp.menu_select
0.29 +0.2 0.50 ± 30% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.08 +0.2 0.30 ± 45% perf-profile.children.cycles-pp.ktime_get
0.46 +0.4 0.88 ± 24% perf-profile.children.cycles-pp.hrtimer_interrupt
0.90 +0.6 1.48 ± 21% perf-profile.children.cycles-pp.start_kernel
0.52 +0.6 1.13 ± 31% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.53 +0.7 1.19 ± 31% perf-profile.children.cycles-pp.apic_timer_interrupt
1.97 -1.4 0.57 ±119% perf-profile.self.cycles-pp.axmap_next_free
0.00 +0.1 0.08 ± 31% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.07 +0.2 0.27 ± 46% perf-profile.self.cycles-pp.ktime_get
1595 +25.0% 1994 ± 14% slabinfo.UNIX.active_objs
1595 +25.0% 1994 ± 14% slabinfo.UNIX.num_objs
168.00 -66.7% 56.00 slabinfo.btrfs_extent_map.active_objs
168.00 -66.7% 56.00 slabinfo.btrfs_extent_map.num_objs
216.00 -44.4% 120.00 ± 14% slabinfo.btrfs_path.active_objs
216.00 -44.4% 120.00 ± 14% slabinfo.btrfs_path.num_objs
10235 +9.9% 11250 ± 4% slabinfo.kmalloc-96.active_objs
420.00 +56.7% 658.00 ± 21% slabinfo.kmem_cache.active_objs
420.00 +56.7% 658.00 ± 21% slabinfo.kmem_cache.num_objs
725.00 +53.5% 1113 ± 21% slabinfo.kmem_cache_node.active_objs
768.00 +50.0% 1152 ± 20% slabinfo.kmem_cache_node.num_objs
588.00 +26.2% 742.00 ± 5% slabinfo.mnt_cache.active_objs
588.00 +26.2% 742.00 ± 5% slabinfo.mnt_cache.num_objs
372.00 -33.3% 248.00 ± 20% slabinfo.numa_policy.active_objs
372.00 -33.3% 248.00 ± 20% slabinfo.numa_policy.num_objs
34276 +2309.9% 826003 slabinfo.radix_tree_node.active_objs
613.00 +2306.9% 14754 slabinfo.radix_tree_node.active_slabs
34348 +2305.6% 826283 slabinfo.radix_tree_node.num_objs
613.00 +2306.9% 14754 slabinfo.radix_tree_node.num_slabs
647.00 -21.4% 508.33 slabinfo.skbuff_ext_cache.active_objs
761.00 -25.8% 565.00 ± 9% slabinfo.skbuff_ext_cache.num_objs
260.00 +47.6% 383.67 ± 13% slabinfo.skbuff_fclone_cache.active_objs
260.00 +47.6% 383.67 ± 13% slabinfo.skbuff_fclone_cache.num_objs
3103 +19.7% 3713 ± 13% slabinfo.sock_inode_cache.active_objs
3103 +19.7% 3713 ± 13% slabinfo.sock_inode_cache.num_objs
2015 +16.7% 2351 ± 10% slabinfo.task_group.active_objs
2015 +16.7% 2351 ± 10% slabinfo.task_group.num_objs
10871 +15.3% 12537 ± 7% slabinfo.vmap_area.active_objs
10897 +15.1% 12547 ± 7% slabinfo.vmap_area.num_objs
306.00 -50.0% 153.00 ± 27% slabinfo.xfrm_dst_cache.active_objs
306.00 -50.0% 153.00 ± 27% slabinfo.xfrm_dst_cache.num_objs
2.10 +30.9% 2.75 ± 2% perf-stat.i.MPKI
1667 -3.8% 1603 ± 2% perf-stat.i.context-switches
27.21 -46.7% 14.50 ± 53% perf-stat.i.cpu-migrations
0.12 +0.1 0.20 ± 2% perf-stat.i.dTLB-load-miss-rate%
0.00 +0.0 0.02 ± 17% perf-stat.i.dTLB-store-miss-rate%
54955 +834.8% 513715 ± 5% perf-stat.i.dTLB-store-misses
27.37 +4.4 31.74 ± 7% perf-stat.i.iTLB-load-miss-rate%
1702300 +57.8% 2685706 ± 8% perf-stat.i.iTLB-load-misses
2688 +8874.4% 241268 perf-stat.i.minor-faults
3.28 +24.7 27.94 ± 3% perf-stat.i.node-load-miss-rate%
187966 +4476.0% 8601404 ± 73% perf-stat.i.node-load-misses
81.25 -3.7 77.54 ± 2% perf-stat.i.node-store-miss-rate%
59369 +964.1% 631752 ± 3% perf-stat.i.node-store-misses
14987 +269.7% 55401 ± 12% perf-stat.i.node-stores
2688 +8875.0% 241285 perf-stat.i.page-faults
1.85 +45.0% 2.69 perf-stat.overall.MPKI
0.12 +0.1 0.18 ± 23% perf-stat.overall.branch-miss-rate%
0.13 +0.1 0.21 ± 3% perf-stat.overall.dTLB-load-miss-rate%
0.00 +0.0 0.02 ± 46% perf-stat.overall.dTLB-store-miss-rate%
27.25 +9.2 36.44 ± 6% perf-stat.overall.iTLB-load-miss-rate%
33626 -59.6% 13600 ± 65% perf-stat.overall.instructions-per-iTLB-miss
0.88 +26.7 27.61 ± 3% perf-stat.overall.node-load-miss-rate%
79.84 +12.0 91.87 perf-stat.overall.node-store-miss-rate%
2059 +13.8% 2343 ± 6% perf-stat.overall.path-length
1658 -4.0% 1592 ± 2% perf-stat.ps.context-switches
27.07 -46.7% 14.43 ± 53% perf-stat.ps.cpu-migrations
54587 +828.6% 506869 ± 5% perf-stat.ps.dTLB-store-misses
1693240 +57.2% 2661964 ± 8% perf-stat.ps.iTLB-load-misses
2675 +8794.5% 237936 perf-stat.ps.minor-faults
187014 +4466.7% 8540397 ± 73% perf-stat.ps.node-load-misses
59071 +954.4% 622854 ± 3% perf-stat.ps.node-store-misses
14913 +268.6% 54979 ± 12% perf-stat.ps.node-stores
2675 +8795.1% 237953 perf-stat.ps.page-faults
102.00 -100.0% 0.00 interrupts.349:PCI-MSI.288768-edge.ahci[0000:00:11.5]
165.00 +136.8% 390.67 ± 39% interrupts.70:PCI-MSI.70258694-edge.eth2-TxRx-5
104.00 +25.6% 130.67 ± 11% interrupts.71:PCI-MSI.70258695-edge.eth2-TxRx-6
2445 -54.7% 1106 ± 21% interrupts.CPU0.RES:Rescheduling_interrupts
161.00 +6865.4% 11214 ±113% interrupts.CPU1.RES:Rescheduling_interrupts
302.00 -89.0% 33.33 ± 62% interrupts.CPU11.TLB:TLB_shootdowns
102.00 -100.0% 0.00 interrupts.CPU17.349:PCI-MSI.288768-edge.ahci[0000:00:11.5]
203855 -95.0% 10261 ±136% interrupts.CPU2.RES:Rescheduling_interrupts
6063 -97.9% 127.00 ±121% interrupts.CPU3.RES:Rescheduling_interrupts
34.00 +1193.1% 439.67 ± 58% interrupts.CPU31.TLB:TLB_shootdowns
2221 +12.7% 2503 ± 7% interrupts.CPU34.CAL:Function_call_interrupts
28.00 +1463.1% 437.67 ± 58% interrupts.CPU35.TLB:TLB_shootdowns
14.00 +3040.5% 439.67 ± 60% interrupts.CPU36.TLB:TLB_shootdowns
8.00 +5387.5% 439.00 ± 58% interrupts.CPU37.TLB:TLB_shootdowns
32.00 +1314.6% 452.67 ± 57% interrupts.CPU39.TLB:TLB_shootdowns
4.00 +9491.7% 383.67 ±133% interrupts.CPU40.RES:Rescheduling_interrupts
8.00 +5425.0% 442.00 ± 55% interrupts.CPU40.TLB:TLB_shootdowns
33.00 +1187.9% 425.00 ± 61% interrupts.CPU42.TLB:TLB_shootdowns
13.00 +3294.9% 441.33 ± 61% interrupts.CPU43.TLB:TLB_shootdowns
4.00 +11241.7% 453.67 ± 55% interrupts.CPU45.TLB:TLB_shootdowns
29.00 +732.2% 241.33 ±111% interrupts.CPU47.TLB:TLB_shootdowns
3347 -99.8% 7.00 ±101% interrupts.CPU53.RES:Rescheduling_interrupts
34.00 +278.4% 128.67 ± 90% interrupts.CPU66.TLB:TLB_shootdowns
2444 +16.7% 2851 ± 10% interrupts.CPU69.CAL:Function_call_interrupts
902.00 +196.6% 2675 ± 4% interrupts.CPU73.CAL:Function_call_interrupts
165.00 +136.8% 390.67 ± 39% interrupts.CPU76.70:PCI-MSI.70258694-edge.eth2-TxRx-5
104.00 +25.6% 130.67 ± 11% interrupts.CPU77.71:PCI-MSI.70258695-edge.eth2-TxRx-6
159.00 -75.7% 38.67 ± 77% interrupts.CPU77.TLB:TLB_shootdowns
13.00 +1069.2% 152.00 ± 93% interrupts.CPU82.TLB:TLB_shootdowns
406.00 -91.6% 34.00 ±111% interrupts.CPU84.RES:Rescheduling_interrupts
8701 -27.5% 6311 ± 27% interrupts.CPU87.NMI:Non-maskable_interrupts
8701 -27.5% 6311 ± 27% interrupts.CPU87.PMI:Performance_monitoring_interrupts
35.00 +175.2% 96.33 ± 18% interrupts.CPU94.TLB:TLB_shootdowns
218391 -74.9% 54875 ± 49% interrupts.RES:Rescheduling_interrupts
4882 +131.5% 11302 ± 22% interrupts.TLB:TLB_shootdowns
66.91 -100.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.avg
6423 -100.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.max
652.16 -100.0% 0.00 ± 3% sched_debug.cfs_rq:/.MIN_vruntime.stddev
55837 +15.8% 64652 ± 2% sched_debug.cfs_rq:/.exec_clock.avg
704.76 -75.9% 169.91 ± 43% sched_debug.cfs_rq:/.exec_clock.min
508473 +16.6% 592912 ± 4% sched_debug.cfs_rq:/.load.avg
507.39 +17.0% 593.51 ± 3% sched_debug.cfs_rq:/.load_avg.avg
66.91 -100.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.avg
6423 -100.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.max
652.16 -100.0% 0.00 ± 3% sched_debug.cfs_rq:/.max_vruntime.stddev
23657 -23.5% 18098 ± 19% sched_debug.cfs_rq:/.min_vruntime.min
0.52 +16.8% 0.61 ± 3% sched_debug.cfs_rq:/.nr_running.avg
0.14 -97.2% 0.00 ±141% sched_debug.cfs_rq:/.nr_spread_over.avg
2.25 -88.9% 0.25 ±141% sched_debug.cfs_rq:/.nr_spread_over.max
0.47 -93.2% 0.03 ±141% sched_debug.cfs_rq:/.nr_spread_over.stddev
493.76 +16.6% 575.63 ± 4% sched_debug.cfs_rq:/.runnable_load_avg.avg
508431 +16.6% 592847 ± 4% sched_debug.cfs_rq:/.runnable_weight.avg
-4735 +574.4% -31934 sched_debug.cfs_rq:/.spread0.min
571.86 +16.0% 663.09 ± 2% sched_debug.cfs_rq:/.util_avg.avg
870.00 -41.2% 511.50 sched_debug.cfs_rq:/.util_est_enqueued.max
203.82 -21.5% 160.02 sched_debug.cfs_rq:/.util_est_enqueued.stddev
16015309 -94.7% 850358 sched_debug.cpu.avg_idle.avg
87047806 -98.8% 1021851 ± 3% sched_debug.cpu.avg_idle.max
76953 -45.3% 42066 ± 45% sched_debug.cpu.avg_idle.min
16507466 -98.7% 211475 ± 6% sched_debug.cpu.avg_idle.stddev
5298421 -90.6% 500000 sched_debug.cpu.max_idle_balance_cost.avg
14677282 -96.6% 500000 sched_debug.cpu.max_idle_balance_cost.max
3245193 -100.0% 0.00 sched_debug.cpu.max_idle_balance_cost.stddev
1714934 +19.6% 2050299 sched_debug.cpu.nr_load_updates.max
161991 +19.2% 193066 sched_debug.cpu.nr_load_updates.stddev
0.01 +55.6% 0.01 ± 10% sched_debug.cpu.nr_uninterruptible.avg
76.50 -10.5% 68.50 ± 4% sched_debug.cpu.sched_count.min
5702 -18.9% 4624 ± 18% sched_debug.cpu.sched_count.stddev
3.75 +120.0% 8.25 ± 7% sched_debug.cpu.sched_goidle.min
2853 -19.5% 2297 ± 18% sched_debug.cpu.sched_goidle.stddev
2047 -27.1% 1493 ± 11% sched_debug.cpu.ttwu_count.stddev
375.59 -10.0% 338.00 ± 2% sched_debug.cpu.ttwu_local.avg
1582 -22.5% 1227 ± 20% sched_debug.cpu.ttwu_local.stddev
0.06 -100.0% 0.00 sched_debug.rt_rq:/.rt_time.avg
5.48 -100.0% 0.00 sched_debug.rt_rq:/.rt_time.max
0.56 -100.0% 0.00 sched_debug.rt_rq:/.rt_time.stddev
5717 +378.1% 27333 ± 52% softirqs.CPU1.SCHED
3743 +442.4% 20300 ± 55% softirqs.CPU10.SCHED
4362 +423.1% 22815 ± 57% softirqs.CPU13.SCHED
75628 +37.5% 104002 ± 13% softirqs.CPU13.TIMER
32742 -38.4% 20170 ± 54% softirqs.CPU14.SCHED
101974 -17.7% 83966 ± 14% softirqs.CPU14.TIMER
118827 -79.7% 24125 ± 58% softirqs.CPU2.SCHED
3816 +424.2% 20004 ± 50% softirqs.CPU22.SCHED
5141 +454.7% 28516 ±106% softirqs.CPU24.SCHED
88797 +16.4% 103367 ± 10% softirqs.CPU24.TIMER
3859 +253.0% 13620 ± 78% softirqs.CPU25.SCHED
75033 +11.9% 83976 ± 2% softirqs.CPU25.TIMER
54332 -13.7% 46876 ± 8% softirqs.CPU26.RCU
75701 +11.5% 84403 softirqs.CPU26.TIMER
56074 -16.6% 46760 ± 8% softirqs.CPU28.RCU
54473 -13.3% 47249 ± 8% softirqs.CPU29.RCU
75145 +11.9% 84056 softirqs.CPU29.TIMER
396697 -78.5% 85352 ± 11% softirqs.CPU3.TIMER
54396 -13.8% 46904 ± 8% softirqs.CPU31.RCU
3981 +243.9% 13689 ± 76% softirqs.CPU31.SCHED
74166 +12.4% 83331 ± 2% softirqs.CPU31.TIMER
4085 +268.8% 15066 ± 59% softirqs.CPU32.SCHED
71541 +19.5% 85502 ± 3% softirqs.CPU32.TIMER
3704 +236.4% 12458 ± 84% softirqs.CPU36.SCHED
72133 +31.5% 94841 ± 13% softirqs.CPU36.TIMER
3864 +214.6% 12155 ± 87% softirqs.CPU38.SCHED
3681 +242.4% 12603 ± 82% softirqs.CPU40.SCHED
73540 +27.2% 93570 ± 15% softirqs.CPU40.TIMER
3850 +221.7% 12384 ± 84% softirqs.CPU41.SCHED
71418 +14.0% 81439 softirqs.CPU41.TIMER
27325 -54.9% 12322 ± 85% softirqs.CPU42.SCHED
71599 +14.1% 81690 ± 2% softirqs.CPU43.TIMER
43146 +23.0% 53051 ± 10% softirqs.CPU44.RCU
27047 -53.7% 12521 ± 80% softirqs.CPU45.SCHED
5194 +177.7% 14424 ± 69% softirqs.CPU46.SCHED
73602 +15.5% 84977 softirqs.CPU46.TIMER
30007 +18.4% 35534 ± 7% softirqs.CPU47.SCHED
92763 +26.5% 117385 ± 9% softirqs.CPU47.TIMER
95514 -13.0% 83067 softirqs.CPU49.TIMER
3598 +235.9% 12084 ± 94% softirqs.CPU50.SCHED
75948 +10.7% 84080 softirqs.CPU50.TIMER
52806 -11.7% 46652 ± 10% softirqs.CPU51.RCU
1677858 -94.8% 87918 ± 7% softirqs.CPU51.TIMER
75905 +14.2% 86687 ± 3% softirqs.CPU52.TIMER
18597 +165.5% 49378 ± 12% softirqs.CPU53.RCU
29446 -57.5% 12500 ± 94% softirqs.CPU53.SCHED
3847 +361.6% 17759 ± 56% softirqs.CPU55.SCHED
71400 +936.0% 739692 ±124% softirqs.CPU55.TIMER
4055 +209.3% 12541 ± 89% softirqs.CPU56.SCHED
74122 +13.1% 83797 ± 3% softirqs.CPU56.TIMER
3799 +239.6% 12902 ± 86% softirqs.CPU59.SCHED
73830 +17.6% 86816 ± 5% softirqs.CPU59.TIMER
3789 +591.6% 26204 ± 64% softirqs.CPU6.SCHED
74036 +18.5% 87699 ± 4% softirqs.CPU62.TIMER
3617 +232.4% 12023 ± 94% softirqs.CPU63.SCHED
73615 +11.0% 81705 softirqs.CPU63.TIMER
3638 +230.5% 12024 ± 94% softirqs.CPU64.SCHED
70890 +17.7% 83403 ± 3% softirqs.CPU64.TIMER
73302 +14.6% 83983 softirqs.CPU65.TIMER
71888 +15.5% 83048 softirqs.CPU66.TIMER
73388 +14.0% 83666 softirqs.CPU67.TIMER
72650 +16.0% 84271 softirqs.CPU68.TIMER
73528 +14.3% 84039 softirqs.CPU69.TIMER
43111 +10.7% 47716 ± 3% softirqs.CPU7.RCU
76154 +14.7% 87336 ± 5% softirqs.CPU71.TIMER
95281 -13.2% 82745 ± 12% softirqs.CPU73.TIMER
4453 +372.3% 21032 ± 49% softirqs.CPU78.SCHED
71517 +13.7% 81342 ± 3% softirqs.CPU78.TIMER
51125 -10.7% 45668 softirqs.CPU79.RCU
53450 -11.9% 47089 ± 3% softirqs.CPU83.RCU
3545 +468.8% 20164 ± 57% softirqs.CPU83.SCHED
3576 +461.9% 20092 ± 57% softirqs.CPU85.SCHED
3878 +428.1% 20478 ± 53% softirqs.CPU9.SCHED
109714 -25.7% 81558 ± 9% softirqs.CPU9.TIMER
3651 +605.4% 25755 ± 12% softirqs.CPU90.SCHED
70706 +19.3% 84361 ± 2% softirqs.CPU90.TIMER
3731 +431.3% 19821 ± 57% softirqs.CPU92.SCHED
3657 +453.0% 20224 ± 55% softirqs.CPU93.SCHED
13076 +60.5% 20987 ± 14% softirqs.NET_RX
1605010 +9.1% 1750317 softirqs.SCHED
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 3 months
- 4
- 3
[mm, meminit] f22f67b2a6: BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/mutex.c
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: f22f67b2a64e67dff83120990d851a182165ab62 ("mm, meminit: Recalculate pcpu batch and high limits after init completes")
https://git.kernel.org/cgit/linux/kernel/git/mel/linux.git mm-percpubatch-v1r1
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------------------------+------------+------------+
| | 6009807d7e | f22f67b2a6 |
+-----------------------------------------------------------------------------+------------+------------+
| boot_successes | 4 | 0 |
| boot_failures | 0 | 6 |
| BUG:sleeping_function_called_from_invalid_context_at_kernel/locking/mutex.c | 0 | 6 |
+-----------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 0.804226] BUG: sleeping function called from invalid context at kernel/locking/mutex.c:281
[ 0.804226] in_atomic(): 1, irqs_disabled(): 1, non_block: 0, pid: 19, name: pgdatinit0
[ 0.804226] CPU: 1 PID: 19 Comm: pgdatinit0 Not tainted 5.4.0-rc3-00002-gf22f67b2a64e6 #1
[ 0.804226] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 0.804226] Call Trace:
[ 0.804226] dump_stack+0x5c/0x7b
[ 0.804226] ___might_sleep+0x102/0x120
[ 0.804226] mutex_lock+0x1c/0x40
[ 0.804226] zone_pcp_update+0x10/0x25
[ 0.804226] deferred_init_memmap+0x143/0x1b3
[ 0.804226] ? alloc_large_system_hash+0x26a/0x26a
[ 0.804226] kthread+0x11e/0x140
[ 0.804226] ? kthread_park+0x90/0x90
[ 0.804226] ret_from_fork+0x35/0x40
[ 0.854236] node 0 initialised, 1181418 pages in 51ms
[ 0.856230] devtmpfs: initialized
[ 0.857340] x86/mm: Memory block size: 128MB
[ 0.860709] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 0.861240] futex hash table entries: 512 (order: 3, 32768 bytes, linear)
[ 0.862961] pinctrl core: initialized pinctrl subsystem
[ 0.863369] PM: RTC time: 10:35:35, date: 2019-10-19
[ 0.864431] NET: Registered protocol family 16
[ 0.865481] audit: initializing netlink subsys (disabled)
[ 0.866267] audit: type=2000 audit(1571452535.659:1): state=initialized audit_enabled=0 res=1
[ 0.869236] cpuidle: using governor menu
[ 0.870532] ACPI: bus type PCI registered
[ 0.871233] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.872400] PCI: Using configuration type 1 for base access
[ 0.875571] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[ 0.879331] ACPI: Added _OSI(Module Device)
[ 0.880238] ACPI: Added _OSI(Processor Device)
[ 0.881261] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.882231] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.883255] ACPI: Added _OSI(Linux-Dell-Video)
[ 0.884262] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[ 0.885235] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[ 0.886977] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 0.888479] ACPI: Interpreter enabled
[ 0.889246] ACPI: (supports S0 S3 S4 S5)
[ 0.890230] ACPI: Using IOAPIC for interrupt routing
[ 0.891248] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.892363] ACPI: Enabled 3 GPEs in block 00 to 0F
[ 0.896012] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 0.896237] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI HPX-Type3]
[ 0.897242] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[ 0.898544] acpiphp: Slot [3] registered
[ 0.899264] acpiphp: Slot [4] registered
[ 0.900260] acpiphp: Slot [5] registered
[ 0.901260] acpiphp: Slot [6] registered
[ 0.902259] acpiphp: Slot [7] registered
[ 0.903258] acpiphp: Slot [8] registered
[ 0.904258] acpiphp: Slot [9] registered
[ 0.905260] acpiphp: Slot [10] registered
[ 0.906260] acpiphp: Slot [11] registered
[ 0.907261] acpiphp: Slot [12] registered
[ 0.908256] acpiphp: Slot [13] registered
[ 0.909256] acpiphp: Slot [14] registered
[ 0.910255] acpiphp: Slot [15] registered
[ 0.911259] acpiphp: Slot [16] registered
[ 0.912256] acpiphp: Slot [17] registered
[ 0.913256] acpiphp: Slot [18] registered
[ 0.914256] acpiphp: Slot [19] registered
[ 0.915256] acpiphp: Slot [20] registered
[ 0.916256] acpiphp: Slot [21] registered
[ 0.917259] acpiphp: Slot [22] registered
[ 0.918256] acpiphp: Slot [23] registered
[ 0.919256] acpiphp: Slot [24] registered
[ 0.920256] acpiphp: Slot [25] registered
[ 0.921256] acpiphp: Slot [26] registered
[ 0.922255] acpiphp: Slot [27] registered
[ 0.923259] acpiphp: Slot [28] registered
[ 0.924256] acpiphp: Slot [29] registered
[ 0.925255] acpiphp: Slot [30] registered
[ 0.926256] acpiphp: Slot [31] registered
[ 0.927248] PCI host bridge to bus 0000:00
[ 0.928232] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 0.929232] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 0.930231] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 0.931231] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[ 0.932231] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 0.933287] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000
[ 0.934885] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100
[ 0.936113] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180
[ 0.947233] pci 0000:00:01.1: reg 0x20: [io 0xc200-0xc20f]
[ 0.953252] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7]
[ 0.954232] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6]
[ 0.955231] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177]
[ 0.956231] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376]
[ 0.957504] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000
[ 0.958895] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI
[ 0.959244] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB
[ 0.960580] pci 0000:00:02.0: [1234:1111] type 00 class 0x030000
[ 0.963233] pci 0000:00:02.0: reg 0x10: [mem 0xfd000000-0xfdffffff pref]
[ 0.969233] pci 0000:00:02.0: reg 0x18: [mem 0xfebf0000-0xfebf0fff]
[ 0.979235] pci 0000:00:02.0: reg 0x30: [mem 0xfebe0000-0xfebeffff pref]
[ 0.980566] pci 0000:00:03.0: [8086:100e] type 00 class 0x020000
[ 0.983232] pci 0000:00:03.0: reg 0x10: [mem 0xfebc0000-0xfebdffff]
[ 0.986233] pci 0000:00:03.0: reg 0x14: [io 0xc000-0xc03f]
[ 0.999234] pci 0000:00:03.0: reg 0x30: [mem 0xfeb80000-0xfebbffff pref]
[ 1.000650] pci 0000:00:04.0: [1af4:1001] type 00 class 0x010000
[ 1.003233] pci 0000:00:04.0: reg 0x10: [io 0xc040-0xc07f]
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc3-00002-gf22f67b2a64e6 .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
1 year, 3 months
- 1
- 0
[rcu] 7107a600da: stress-ng.membarrier.ops_per_sec -39.5% regression
by kernel test robot
Greeting,
FYI, we noticed a -39.5% regression of stress-ng.membarrier.ops_per_sec due to commit:
commit: 7107a600da14eddd4ce878215236bc91f11af6f6 ("rcu: Confine ->core_needs_qs accesses to the corresponding CPU")
git://internal_merge_and_test_tree devel-catchup-201910052325
in testcase: stress-ng
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
with following parameters:
nr_threads: 100%
disk: 1HDD
testtime: 30s
class: cpu-cache
cpufreq_governor: performance
ucode: 0x500002b
In addition to that, the commit also has significant impact on the following tests:
+------------------+----------------------------------------------------------------------+
| testcase: change | stress-ng: stress-ng.membarrier.ops_per_sec -43.0% regression |
| test machine | 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory |
| test parameters | class=memory |
| | cpufreq_governor=performance |
| | disk=1HDD |
| | nr_threads=100% |
| | testtime=1s |
| | ucode=0x500002b |
+------------------+----------------------------------------------------------------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode:
cpu-cache/gcc-7/performance/1HDD/x86_64-rhel-7.6/100%/debian-x86_64-2019-09-23.cgz/lkp-csl-2sp5/stress-ng/30s/0x500002b
commit:
34ad1fdab6 ("rcu: Reset CPU hints when reporting a quiescent state")
7107a600da ("rcu: Confine ->core_needs_qs accesses to the corresponding CPU")
34ad1fdab65714d5 7107a600da14eddd4ce87821523
---------------- ---------------------------
%stddev %change %stddev
\ | \
230809 -39.5% 139693 ± 6% stress-ng.membarrier.ops
7689 -39.5% 4651 ± 6% stress-ng.membarrier.ops_per_sec
323279 ± 2% +12.0% 362149 stress-ng.time.involuntary_context_switches
1216361 -37.5% 759869 ± 5% stress-ng.time.voluntary_context_switches
4634 -24.2% 3514 ± 3% vmstat.system.cs
8580 ± 11% +17.4% 10071 ± 2% numa-meminfo.node0.KernelStack
49411 ± 34% -54.1% 22680 ± 37% numa-meminfo.node1.Inactive
49331 ± 34% -54.1% 22636 ± 38% numa-meminfo.node1.Inactive(anon)
7969 ± 12% -19.1% 6448 ± 4% numa-meminfo.node1.KernelStack
58460 ± 29% -50.4% 29003 ± 33% numa-meminfo.node1.Mapped
92701 ± 21% -41.3% 54402 ± 38% numa-meminfo.node1.Shmem
120174 ± 9% -12.2% 105531 ± 2% numa-meminfo.node1.Slab
31.02 +1.2 32.20 perf-stat.i.cache-miss-rate%
4630 -24.4% 3501 ± 3% perf-stat.i.context-switches
1086 ± 2% -32.7% 730.70 ± 7% perf-stat.i.cpu-migrations
254882 ± 3% -48.1% 132212 ± 6% perf-stat.i.cycles-between-cache-misses
44.64 +1.8 46.45 perf-stat.i.node-load-miss-rate%
4620 -24.4% 3494 ± 3% perf-stat.ps.context-switches
1083 ± 2% -32.7% 729.07 ± 7% perf-stat.ps.cpu-migrations
8580 ± 11% +17.3% 10068 ± 2% numa-vmstat.node0.nr_kernel_stack
12263 ± 35% -53.5% 5703 ± 38% numa-vmstat.node1.nr_inactive_anon
7968 ± 12% -19.1% 6450 ± 4% numa-vmstat.node1.nr_kernel_stack
14573 ± 30% -49.7% 7325 ± 32% numa-vmstat.node1.nr_mapped
23007 ± 21% -40.7% 13648 ± 38% numa-vmstat.node1.nr_shmem
12263 ± 35% -53.5% 5703 ± 38% numa-vmstat.node1.nr_zone_inactive_anon
1390343 ± 10% -14.2% 1192270 ± 6% numa-vmstat.node1.numa_hit
1225877 ± 11% -16.4% 1024767 ± 7% numa-vmstat.node1.numa_local
198.00 ± 73% -99.6% 0.75 ±173% interrupts.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
3516 ± 13% -28.4% 2517 ± 15% interrupts.CPU0.RES:Rescheduling_interrupts
1977 ± 10% -38.5% 1215 ± 34% interrupts.CPU24.RES:Rescheduling_interrupts
1926 ± 21% -59.1% 788.25 ± 36% interrupts.CPU27.RES:Rescheduling_interrupts
1151 ± 21% -46.0% 621.50 ± 12% interrupts.CPU28.RES:Rescheduling_interrupts
1486 ± 32% -48.9% 758.75 ± 53% interrupts.CPU33.RES:Rescheduling_interrupts
1425 ± 33% -44.6% 789.25 ± 24% interrupts.CPU46.RES:Rescheduling_interrupts
533.75 ± 36% -45.4% 291.25 ± 47% interrupts.CPU50.RES:Rescheduling_interrupts
197.75 ± 73% -99.6% 0.75 ±173% interrupts.CPU60.96:PCI-MSI.31981629-edge.i40e-eth0-TxRx-60
1037 ± 64% -70.9% 301.75 ± 11% interrupts.CPU91.RES:Rescheduling_interrupts
6.76 ± 5% -32.1% 4.59 ± 57% sched_debug.cfs_rq:/.removed.util_avg.stddev
17255 -22.5% 13375 ± 3% sched_debug.cpu.nr_switches.avg
12766 ± 2% -40.9% 7541 ± 5% sched_debug.cpu.nr_switches.min
3448 ± 3% +36.0% 4690 ± 10% sched_debug.cpu.nr_switches.stddev
85.44 ± 18% -43.2% 48.54 ± 35% sched_debug.cpu.nr_uninterruptible.max
-103.62 -47.5% -54.38 sched_debug.cpu.nr_uninterruptible.min
33.80 ± 9% -45.0% 18.59 ± 25% sched_debug.cpu.nr_uninterruptible.stddev
15878 -24.5% 11982 ± 3% sched_debug.cpu.sched_count.avg
11811 ± 3% -44.1% 6601 ± 7% sched_debug.cpu.sched_count.min
3102 ± 7% +38.4% 4294 ± 10% sched_debug.cpu.sched_count.stddev
5701 -33.4% 3794 ± 5% sched_debug.cpu.sched_goidle.avg
9142 ± 8% -18.3% 7467 ± 9% sched_debug.cpu.sched_goidle.max
4968 ± 3% -49.9% 2490 ± 4% sched_debug.cpu.sched_goidle.min
7894 -27.7% 5707 ± 4% sched_debug.cpu.ttwu_count.avg
6192 ± 3% -46.8% 3296 ± 6% sched_debug.cpu.ttwu_count.min
1265 ± 6% +50.1% 1900 ± 13% sched_debug.cpu.ttwu_count.stddev
3824 -27.4% 2778 sched_debug.cpu.ttwu_local.avg
6809 ± 7% +45.6% 9915 ± 16% sched_debug.cpu.ttwu_local.max
2899 ± 3% -47.5% 1522 ± 7% sched_debug.cpu.ttwu_local.min
810.59 ± 10% +61.7% 1310 ± 8% sched_debug.cpu.ttwu_local.stddev
78183 ± 7% +249.8% 273468 softirqs.CPU0.RCU
81229 ± 8% +237.2% 273879 softirqs.CPU1.RCU
78077 ± 8% +250.5% 273673 softirqs.CPU10.RCU
78355 ± 10% +248.3% 272879 softirqs.CPU11.RCU
80158 ± 9% +240.4% 272860 softirqs.CPU12.RCU
78833 ± 9% +248.5% 274758 softirqs.CPU13.RCU
78585 ± 9% +247.8% 273312 softirqs.CPU14.RCU
78082 ± 9% +249.2% 272687 softirqs.CPU15.RCU
84061 ± 8% +225.4% 273533 softirqs.CPU16.RCU
85251 ± 7% +220.8% 273502 softirqs.CPU17.RCU
84822 ± 7% +221.4% 272647 softirqs.CPU18.RCU
83560 ± 7% +227.3% 273464 softirqs.CPU19.RCU
78701 ± 9% +250.2% 275611 ± 2% softirqs.CPU2.RCU
83998 ± 7% +225.4% 273338 softirqs.CPU20.RCU
84282 ± 7% +223.5% 272643 softirqs.CPU21.RCU
83925 ± 6% +225.8% 273427 softirqs.CPU22.RCU
80245 ± 11% +241.0% 273605 softirqs.CPU23.RCU
84033 ± 13% +226.4% 274274 softirqs.CPU24.RCU
83270 ± 13% +227.8% 272973 softirqs.CPU25.RCU
83397 ± 12% +226.5% 272314 softirqs.CPU26.RCU
83541 ± 13% +225.6% 271982 softirqs.CPU27.RCU
79102 ± 4% +244.0% 272143 softirqs.CPU28.RCU
83996 ± 11% +224.8% 272792 softirqs.CPU29.RCU
78142 ± 8% +250.6% 273979 softirqs.CPU3.RCU
83899 ± 11% +224.7% 272390 softirqs.CPU30.RCU
82887 ± 12% +228.2% 272066 softirqs.CPU31.RCU
77805 ± 10% +248.5% 271185 softirqs.CPU32.RCU
78744 ± 9% +244.9% 271578 softirqs.CPU33.RCU
78746 ± 8% +244.4% 271181 softirqs.CPU34.RCU
79025 ± 10% +243.2% 271176 softirqs.CPU35.RCU
78555 ± 9% +245.6% 271492 softirqs.CPU36.RCU
78751 ± 8% +245.4% 272006 softirqs.CPU37.RCU
77675 ± 10% +249.2% 271243 softirqs.CPU38.RCU
78380 ± 9% +246.4% 271495 softirqs.CPU39.RCU
79138 ± 9% +245.8% 273668 softirqs.CPU4.RCU
79583 ± 9% +241.1% 271432 softirqs.CPU40.RCU
79925 ± 8% +239.0% 270925 softirqs.CPU41.RCU
78338 ± 9% +246.7% 271596 softirqs.CPU42.RCU
78471 ± 9% +245.6% 271184 softirqs.CPU43.RCU
80560 ± 8% +236.8% 271352 softirqs.CPU44.RCU
78466 ± 9% +246.0% 271508 softirqs.CPU45.RCU
78649 ± 8% +245.6% 271811 softirqs.CPU46.RCU
78319 ± 8% +246.6% 271456 softirqs.CPU47.RCU
76961 ± 10% +254.1% 272533 softirqs.CPU48.RCU
77701 ± 11% +251.0% 272742 softirqs.CPU49.RCU
79300 ± 8% +245.4% 273869 softirqs.CPU5.RCU
78580 ± 10% +245.3% 271351 softirqs.CPU50.RCU
78776 ± 9% +245.9% 272453 softirqs.CPU51.RCU
78344 ± 9% +245.9% 271018 softirqs.CPU52.RCU
78563 ± 8% +246.3% 272025 softirqs.CPU53.RCU
78706 ± 10% +244.2% 270900 softirqs.CPU54.RCU
10441 ± 3% -10.8% 9313 ± 3% softirqs.CPU54.SCHED
76757 ± 11% +253.8% 271565 softirqs.CPU55.RCU
77533 ± 10% +252.0% 272889 softirqs.CPU56.RCU
78777 ± 9% +244.3% 271203 softirqs.CPU57.RCU
77431 ± 11% +251.0% 271751 softirqs.CPU58.RCU
78572 ± 10% +245.1% 271172 softirqs.CPU59.RCU
79361 ± 9% +245.3% 274041 softirqs.CPU6.RCU
79309 ± 10% +243.5% 272453 softirqs.CPU60.RCU
78459 ± 11% +245.9% 271360 softirqs.CPU61.RCU
77757 ± 11% +249.2% 271525 softirqs.CPU62.RCU
77137 ± 11% +252.7% 272099 softirqs.CPU63.RCU
82747 ± 7% +228.7% 271994 softirqs.CPU64.RCU
83393 ± 7% +227.3% 272977 softirqs.CPU65.RCU
83950 ± 7% +223.9% 271942 softirqs.CPU66.RCU
81732 ± 7% +233.1% 272280 softirqs.CPU67.RCU
82718 ± 6% +229.1% 272254 softirqs.CPU68.RCU
11781 ± 2% -7.9% 10847 ± 5% softirqs.CPU68.SCHED
82048 ± 6% +231.5% 272013 softirqs.CPU69.RCU
77811 ± 9% +251.3% 273373 softirqs.CPU7.RCU
82424 ± 7% +229.8% 271837 softirqs.CPU70.RCU
82559 ± 6% +229.5% 272044 softirqs.CPU71.RCU
82525 ± 11% +229.7% 272061 softirqs.CPU72.RCU
81132 ± 11% +234.1% 271091 softirqs.CPU73.RCU
82062 ± 10% +230.5% 271251 softirqs.CPU74.RCU
11814 ± 3% -8.0% 10869 ± 7% softirqs.CPU74.SCHED
81975 ± 11% +230.7% 271134 softirqs.CPU75.RCU
82290 ± 13% +229.3% 270980 softirqs.CPU76.RCU
81639 ± 9% +231.6% 270707 softirqs.CPU77.RCU
82362 ± 10% +229.1% 271014 softirqs.CPU78.RCU
82286 ± 11% +229.5% 271121 softirqs.CPU79.RCU
77238 ± 6% +253.9% 273319 softirqs.CPU8.RCU
78161 ± 8% +245.8% 270251 softirqs.CPU80.RCU
78415 ± 8% +244.8% 270339 softirqs.CPU81.RCU
78715 ± 7% +243.6% 270486 softirqs.CPU82.RCU
79407 ± 9% +241.2% 270903 softirqs.CPU83.RCU
78316 ± 8% +245.5% 270590 softirqs.CPU84.RCU
77992 ± 7% +247.3% 270849 softirqs.CPU85.RCU
78245 ± 8% +245.9% 270648 softirqs.CPU86.RCU
78566 ± 8% +244.1% 270322 softirqs.CPU87.RCU
79684 ± 8% +239.5% 270503 softirqs.CPU88.RCU
79683 ± 7% +240.3% 271174 softirqs.CPU89.RCU
76956 ± 11% +254.5% 272812 softirqs.CPU9.RCU
77994 ± 7% +247.1% 270746 softirqs.CPU90.RCU
78138 ± 8% +246.4% 270640 softirqs.CPU91.RCU
77882 ± 9% +247.6% 270721 softirqs.CPU92.RCU
78306 ± 8% +245.6% 270661 softirqs.CPU93.RCU
78605 ± 8% +245.0% 271214 softirqs.CPU94.RCU
77877 ± 8% +248.1% 271054 softirqs.CPU95.RCU
7675659 ± 9% +240.2% 26114802 softirqs.RCU
76.11 -18.0 58.08 ± 3% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
51.97 ± 2% -9.7 42.24 ± 2% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
38.52 ± 3% -6.3 32.24 ± 3% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
33.27 ± 4% -4.7 28.59 perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
20.80 ± 2% -4.6 16.25 ± 5% perf-profile.calltrace.cycles-pp.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
32.67 ± 4% -4.4 28.29 ± 2% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
9.32 ± 14% -4.2 5.14 ± 7% perf-profile.calltrace.cycles-pp.ktime_get_update_offsets_now.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
9.75 ± 9% -3.6 6.20 ± 8% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
16.80 ± 4% -3.4 13.38 ± 5% perf-profile.calltrace.cycles-pp.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle.tick_sched_timer
6.74 ± 13% -3.0 3.71 ± 15% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
3.72 ± 12% -1.2 2.48 ± 23% perf-profile.calltrace.cycles-pp.ktime_get.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
3.12 ± 12% -1.1 2.00 ± 7% perf-profile.calltrace.cycles-pp.__remove_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
3.80 ± 6% -1.0 2.80 ± 12% perf-profile.calltrace.cycles-pp.update_curr.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle
5.87 ± 5% -1.0 4.90 ± 4% perf-profile.calltrace.cycles-pp.update_load_avg.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle
1.15 ± 23% -0.9 0.27 ±100% perf-profile.calltrace.cycles-pp.__libc_start_main
1.18 ± 5% -0.8 0.42 ±100% perf-profile.calltrace.cycles-pp.irq_work_run_list.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
2.30 ± 14% -0.6 1.74 ± 9% perf-profile.calltrace.cycles-pp.timerqueue_del.__remove_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt
0.90 ± 11% -0.5 0.40 ±100% perf-profile.calltrace.cycles-pp.console_unlock.wake_up_klogd_work_func.irq_work_run_list.update_process_times.tick_sched_handle
0.90 ± 11% -0.5 0.40 ±100% perf-profile.calltrace.cycles-pp.wake_up_klogd_work_func.irq_work_run_list.update_process_times.tick_sched_handle.tick_sched_timer
1.14 ± 10% -0.5 0.67 ± 16% perf-profile.calltrace.cycles-pp.interrupt_entry
0.92 ± 20% -0.5 0.46 ± 58% perf-profile.calltrace.cycles-pp.ret_from_fork
0.92 ± 20% -0.5 0.46 ± 58% perf-profile.calltrace.cycles-pp.kthread.ret_from_fork
2.72 ± 5% -0.5 2.26 ± 8% perf-profile.calltrace.cycles-pp.lapic_next_deadline.clockevents_program_event.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.87 ± 27% -0.4 0.44 ± 58% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.70 ± 14% -0.4 0.27 ±100% perf-profile.calltrace.cycles-pp.__GI___libc_read.__libc_start_main
0.74 ± 10% -0.4 0.32 ±100% perf-profile.calltrace.cycles-pp.serial8250_console_write.console_unlock.wake_up_klogd_work_func.irq_work_run_list.update_process_times
1.35 ± 20% -0.4 0.95 ± 20% perf-profile.calltrace.cycles-pp.enqueue_hrtimer.__hrtimer_run_queues.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
0.71 ± 11% -0.4 0.31 ±101% perf-profile.calltrace.cycles-pp.uart_console_write.serial8250_console_write.console_unlock.wake_up_klogd_work_func.irq_work_run_list
1.46 ± 9% -0.4 1.08 ± 6% perf-profile.calltrace.cycles-pp.run_timer_softirq.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
0.69 ± 10% -0.4 0.31 ±100% perf-profile.calltrace.cycles-pp.serial8250_console_putchar.uart_console_write.serial8250_console_write.console_unlock.wake_up_klogd_work_func
2.15 ± 8% -0.4 1.79 ± 4% perf-profile.calltrace.cycles-pp.__update_load_avg_se.update_load_avg.task_tick_fair.scheduler_tick.update_process_times
0.85 ± 9% -0.4 0.50 ± 59% perf-profile.calltrace.cycles-pp.read_tsc.ktime_get_update_offsets_now.hrtimer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
1.60 ± 9% -0.4 1.25 ± 8% perf-profile.calltrace.cycles-pp.update_cfs_group.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle
1.15 ± 9% -0.2 0.98 ± 3% perf-profile.calltrace.cycles-pp.reweight_entity.task_tick_fair.scheduler_tick.update_process_times.tick_sched_handle
1.08 ± 28% +1.9 3.02 ± 6% perf-profile.calltrace.cycles-pp.note_gp_changes.rcu_core.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt
86.90 +2.2 89.14 perf-profile.calltrace.cycles-pp.apic_timer_interrupt
2.53 ± 7% +2.3 4.79 ± 9% perf-profile.calltrace.cycles-pp.rcu_sched_clock_irq.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues
85.44 +2.3 87.70 perf-profile.calltrace.cycles-pp.smp_apic_timer_interrupt.apic_timer_interrupt
0.00 +15.8 15.82 ± 12% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.rcu_core.__softirqentry_text_start.irq_exit
0.21 ±173% +19.4 19.66 ± 11% perf-profile.calltrace.cycles-pp._raw_spin_lock_irqsave.rcu_core.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt
5.70 ± 11% +21.0 26.73 ± 8% perf-profile.calltrace.cycles-pp.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
4.58 ± 17% +21.2 25.75 ± 9% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
1.93 ± 27% +21.7 23.62 ± 9% perf-profile.calltrace.cycles-pp.rcu_core.__softirqentry_text_start.irq_exit.smp_apic_timer_interrupt.apic_timer_interrupt
76.50 -18.4 58.14 ± 3% perf-profile.children.cycles-pp.hrtimer_interrupt
52.07 ± 2% -9.8 42.29 ± 2% perf-profile.children.cycles-pp.__hrtimer_run_queues
38.59 ± 3% -6.3 32.28 ± 3% perf-profile.children.cycles-pp.tick_sched_timer
33.30 ± 4% -4.7 28.59 perf-profile.children.cycles-pp.tick_sched_handle
20.87 ± 2% -4.6 16.26 ± 5% perf-profile.children.cycles-pp.scheduler_tick
11.09 ± 7% -4.4 6.65 ± 14% perf-profile.children.cycles-pp.ktime_get
32.71 ± 4% -4.4 28.31 ± 2% perf-profile.children.cycles-pp.update_process_times
9.37 ± 14% -4.2 5.16 ± 8% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
9.78 ± 9% -3.6 6.21 ± 8% perf-profile.children.cycles-pp.clockevents_program_event
16.86 ± 4% -3.4 13.42 ± 5% perf-profile.children.cycles-pp.task_tick_fair
3.16 ± 8% -1.2 1.95 ± 11% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
3.15 ± 8% -1.2 1.95 ± 11% perf-profile.children.cycles-pp.do_syscall_64
3.15 ± 11% -1.1 2.02 ± 6% perf-profile.children.cycles-pp.__remove_hrtimer
3.99 ± 6% -1.1 2.87 ± 12% perf-profile.children.cycles-pp.update_curr
5.91 ± 5% -1.0 4.95 ± 4% perf-profile.children.cycles-pp.update_load_avg
2.36 ± 9% -0.9 1.43 ± 24% perf-profile.children.cycles-pp.irq_work_run_list
2.08 ± 12% -0.7 1.36 ± 27% perf-profile.children.cycles-pp.console_unlock
1.15 ± 23% -0.7 0.49 ± 9% perf-profile.children.cycles-pp.__libc_start_main
1.79 ± 13% -0.6 1.19 ± 26% perf-profile.children.cycles-pp.serial8250_console_write
1.73 ± 12% -0.6 1.15 ± 26% perf-profile.children.cycles-pp.uart_console_write
2.23 ± 12% -0.6 1.66 ± 14% perf-profile.children.cycles-pp.interrupt_entry
2.35 ± 13% -0.6 1.78 ± 8% perf-profile.children.cycles-pp.timerqueue_del
1.70 ± 15% -0.6 1.15 ± 27% perf-profile.children.cycles-pp.wait_for_xmitr
1.65 ± 14% -0.5 1.10 ± 27% perf-profile.children.cycles-pp.serial8250_console_putchar
0.90 ± 11% -0.5 0.40 ±100% perf-profile.children.cycles-pp.wake_up_klogd_work_func
1.82 ± 10% -0.5 1.34 ± 12% perf-profile.children.cycles-pp.read_tsc
0.51 ± 46% -0.5 0.03 ±102% perf-profile.children.cycles-pp.new_sync_write
0.52 ± 46% -0.5 0.04 ± 60% perf-profile.children.cycles-pp.ksys_write
0.52 ± 46% -0.5 0.04 ± 60% perf-profile.children.cycles-pp.vfs_write
2.75 ± 5% -0.5 2.28 ± 9% perf-profile.children.cycles-pp.lapic_next_deadline
1.24 ± 15% -0.4 0.83 ± 29% perf-profile.children.cycles-pp.io_serial_in
1.49 ± 9% -0.4 1.08 ± 5% perf-profile.children.cycles-pp.run_timer_softirq
2.18 ± 8% -0.4 1.81 ± 4% perf-profile.children.cycles-pp.__update_load_avg_se
1.65 ± 7% -0.4 1.29 ± 7% perf-profile.children.cycles-pp.update_cfs_group
0.93 ± 19% -0.4 0.58 ± 11% perf-profile.children.cycles-pp.ret_from_fork
0.92 ± 20% -0.3 0.58 ± 11% perf-profile.children.cycles-pp.kthread
1.17 ± 10% -0.3 0.85 ± 16% perf-profile.children.cycles-pp.update_rq_clock
0.74 ± 21% -0.3 0.47 ± 10% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.96 ± 15% -0.3 0.69 ± 10% perf-profile.children.cycles-pp.vfs_read
0.66 ± 35% -0.2 0.42 ± 14% perf-profile.children.cycles-pp.worker_thread
0.62 ± 28% -0.2 0.38 ± 10% perf-profile.children.cycles-pp.execve
0.62 ± 28% -0.2 0.38 ± 10% perf-profile.children.cycles-pp.__x64_sys_execve
0.62 ± 28% -0.2 0.38 ± 10% perf-profile.children.cycles-pp.__do_execve_file
0.68 ± 18% -0.2 0.46 ± 24% perf-profile.children.cycles-pp.rb_erase
0.70 ± 14% -0.2 0.49 ± 9% perf-profile.children.cycles-pp.__GI___libc_read
0.43 ± 43% -0.2 0.22 ± 12% perf-profile.children.cycles-pp.load_elf_binary
0.50 ± 45% -0.2 0.29 ± 3% perf-profile.children.cycles-pp.drm_fb_helper_dirty_work
0.43 ± 43% -0.2 0.23 ± 14% perf-profile.children.cycles-pp.search_binary_handler
0.99 ± 6% -0.2 0.81 ± 16% perf-profile.children.cycles-pp.cpuacct_charge
1.18 ± 8% -0.2 1.01 ± 2% perf-profile.children.cycles-pp.reweight_entity
0.39 ± 4% -0.1 0.24 ± 20% perf-profile.children.cycles-pp.run_posix_cpu_timers
0.56 ± 13% -0.1 0.42 ± 24% perf-profile.children.cycles-pp.ksoftirqd_running
0.29 ± 8% -0.1 0.17 ± 37% perf-profile.children.cycles-pp.vt_console_print
0.28 ± 10% -0.1 0.17 ± 34% perf-profile.children.cycles-pp.fbcon_putcs
0.27 ± 15% -0.1 0.16 ± 18% perf-profile.children.cycles-pp.task_work_run
0.28 ± 10% -0.1 0.17 ± 37% perf-profile.children.cycles-pp.lf
0.28 ± 10% -0.1 0.17 ± 37% perf-profile.children.cycles-pp.con_scroll
0.28 ± 10% -0.1 0.17 ± 37% perf-profile.children.cycles-pp.fbcon_scroll
0.28 ± 10% -0.1 0.17 ± 37% perf-profile.children.cycles-pp.fbcon_redraw
0.27 ± 11% -0.1 0.17 ± 34% perf-profile.children.cycles-pp.bit_putcs
0.24 ± 11% -0.1 0.15 ± 41% perf-profile.children.cycles-pp.sys_imageblit
0.24 ± 11% -0.1 0.15 ± 41% perf-profile.children.cycles-pp.drm_fb_helper_sys_imageblit
0.34 ± 15% -0.1 0.25 ± 8% perf-profile.children.cycles-pp.__accumulate_pelt_segments
0.15 ± 14% -0.1 0.08 ± 20% perf-profile.children.cycles-pp.rebalance_domains
0.11 ± 27% -0.1 0.04 ±110% perf-profile.children.cycles-pp.load_balance
0.10 ± 26% -0.1 0.03 ±102% perf-profile.children.cycles-pp.pipe_write
0.11 ± 23% -0.1 0.05 ± 60% perf-profile.children.cycles-pp.write
0.18 ± 15% +0.1 0.28 ± 14% perf-profile.children.cycles-pp.raise_softirq
0.35 ± 15% +0.2 0.58 ± 8% perf-profile.children.cycles-pp.sched_clock_cpu
1.09 ± 27% +1.9 3.03 ± 6% perf-profile.children.cycles-pp.note_gp_changes
87.00 +2.2 89.19 perf-profile.children.cycles-pp.apic_timer_interrupt
2.57 ± 8% +2.2 4.79 ± 9% perf-profile.children.cycles-pp.rcu_sched_clock_irq
85.49 +2.2 87.74 perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.32 ± 23% +15.5 15.84 ± 12% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
1.55 ± 10% +18.8 20.33 ± 11% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
5.74 ± 11% +21.0 26.76 ± 8% perf-profile.children.cycles-pp.irq_exit
4.58 ± 17% +21.2 25.75 ± 9% perf-profile.children.cycles-pp.__softirqentry_text_start
1.94 ± 28% +21.7 23.65 ± 9% perf-profile.children.cycles-pp.rcu_core
10.11 ± 9% -4.2 5.89 ± 17% perf-profile.self.cycles-pp.ktime_get
8.24 ± 16% -3.7 4.54 ± 7% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
2.62 ± 14% -0.9 1.72 ± 13% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
2.39 ± 7% -0.9 1.52 ± 11% perf-profile.self.cycles-pp.update_curr
2.21 ± 8% -0.6 1.65 ± 8% perf-profile.self.cycles-pp.update_load_avg
0.81 ± 19% -0.6 0.25 ± 48% perf-profile.self.cycles-pp.__remove_hrtimer
2.21 ± 12% -0.6 1.65 ± 13% perf-profile.self.cycles-pp.interrupt_entry
2.09 ± 10% -0.5 1.55 ± 10% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.81 ± 19% -0.5 0.27 ± 38% perf-profile.self.cycles-pp.update_rq_clock
1.15 ± 20% -0.5 0.67 ± 14% perf-profile.self.cycles-pp.scheduler_tick
1.78 ± 10% -0.5 1.31 ± 12% perf-profile.self.cycles-pp.read_tsc
0.95 ± 19% -0.5 0.50 ± 15% perf-profile.self.cycles-pp.timerqueue_del
1.23 ± 14% -0.4 0.83 ± 29% perf-profile.self.cycles-pp.io_serial_in
0.44 ± 13% -0.4 0.07 ± 26% perf-profile.self.cycles-pp.update_process_times
1.63 ± 7% -0.4 1.28 ± 7% perf-profile.self.cycles-pp.update_cfs_group
1.10 ± 17% -0.3 0.76 ± 9% perf-profile.self.cycles-pp.run_timer_softirq
1.97 ± 7% -0.3 1.67 ± 6% perf-profile.self.cycles-pp.__update_load_avg_se
0.28 ± 23% -0.2 0.06 ± 58% perf-profile.self.cycles-pp.irq_work_run_list
0.69 ± 22% -0.2 0.47 ± 10% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.66 ± 20% -0.2 0.45 ± 23% perf-profile.self.cycles-pp.rb_erase
0.24 ± 16% -0.2 0.07 ±102% perf-profile.self.cycles-pp.enqueue_hrtimer
0.97 ± 6% -0.2 0.81 ± 15% perf-profile.self.cycles-pp.cpuacct_charge
0.56 ± 12% -0.1 0.42 ± 21% perf-profile.self.cycles-pp.ksoftirqd_running
0.38 ± 3% -0.1 0.24 ± 20% perf-profile.self.cycles-pp.run_posix_cpu_timers
0.77 ± 11% -0.1 0.63 ± 4% perf-profile.self.cycles-pp.reweight_entity
0.33 ± 16% -0.1 0.24 ± 6% perf-profile.self.cycles-pp.__accumulate_pelt_segments
0.24 ± 11% -0.1 0.15 ± 41% perf-profile.self.cycles-pp.sys_imageblit
0.10 ± 21% -0.0 0.06 ± 58% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.04 ±110% +0.1 0.12 ± 24% perf-profile.self.cycles-pp.native_apic_mem_write
0.18 ± 15% +0.1 0.28 ± 14% perf-profile.self.cycles-pp.raise_softirq
0.02 ±173% +0.2 0.24 ± 10% perf-profile.self.cycles-pp.sched_clock_cpu
0.14 ± 45% +0.6 0.79 ± 10% perf-profile.self.cycles-pp.rcu_core
0.74 ± 25% +2.1 2.80 ± 10% perf-profile.self.cycles-pp.note_gp_changes
2.11 ± 9% +2.2 4.32 ± 9% perf-profile.self.cycles-pp.rcu_sched_clock_irq
1.19 ± 17% +3.3 4.48 ± 7% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.32 ± 25% +15.5 15.84 ± 12% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
stress-ng.membarrier.ops_per_sec
9000 +-+------------------------------------------------------------------+
| |
8000 +-++++++++++++++++++++++++ +++++++++ ++++++++++++++++ ++++++ ++++++++|
7000 +-+ + + + + + + |
| O |
6000 +-+ OOOO OO O |
5000 OO+O OO O OO O |
| OO OO O O O O O O OOOO |
4000 +-+ O |
3000 +-+ |
| |
2000 +-+ |
1000 +-+ |
| |
0 +-+---------------------O--------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2sp5: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 192G memory
=========================================================================================
class/compiler/cpufreq_governor/disk/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode:
memory/gcc-7/performance/1HDD/x86_64-rhel-7.6/100%/debian-x86_64-2019-09-23.cgz/lkp-csl-2sp5/stress-ng/1s/0x500002b
commit:
34ad1fdab6 ("rcu: Reset CPU hints when reporting a quiescent state")
7107a600da ("rcu: Confine ->core_needs_qs accesses to the corresponding CPU")
34ad1fdab65714d5 7107a600da14eddd4ce87821523
---------------- ---------------------------
%stddev %change %stddev
\ | \
7634 -42.2% 4416 stress-ng.membarrier.ops
7490 -43.0% 4271 stress-ng.membarrier.ops_per_sec
2215264 ± 5% -16.4% 1853013 ± 6% stress-ng.mincore.ops
2216149 ± 5% -16.3% 1854089 ± 6% stress-ng.mincore.ops_per_sec
7830 -2.2% 7658 stress-ng.time.percent_of_cpu_this_job_got
1513096 ± 19% -21.2% 1192529 ± 3% stress-ng.vm-rw.ops
1513147 ± 19% -21.2% 1192692 ± 3% stress-ng.vm-rw.ops_per_sec
1084 ± 17% -26.3% 800.00 ± 17% numa-vmstat.node0.nr_isolated_anon
4911 ± 12% -17.5% 4054 ± 11% sched_debug.cfs_rq:/.min_vruntime.min
3568008 ± 86% -58.3% 1489424 ± 9% cpuidle.POLL.time
221956 ± 12% -31.9% 151074 ± 20% cpuidle.POLL.usage
15043599 ± 8% -16.6% 12540958 ± 13% perf-stat.i.dTLB-load-misses
14748032 ± 8% -16.4% 12325330 ± 14% perf-stat.ps.dTLB-load-misses
2.646e+08 ± 6% -15.5% 2.236e+08 ± 7% proc-vmstat.numa_hit
2.645e+08 ± 6% -15.5% 2.235e+08 ± 7% proc-vmstat.numa_local
3.454e+08 ± 4% -8.7% 3.154e+08 ± 3% proc-vmstat.pgalloc_normal
3.452e+08 ± 4% -8.7% 3.153e+08 ± 3% proc-vmstat.pgfree
1536 ± 5% +12.5% 1728 ± 3% slabinfo.avc_xperms_data.active_objs
1536 ± 5% +12.5% 1728 ± 3% slabinfo.avc_xperms_data.num_objs
2923 ± 6% -32.0% 1987 ± 14% slabinfo.numa_policy.active_objs
2923 ± 6% -32.0% 1987 ± 14% slabinfo.numa_policy.num_objs
3808 ± 3% +12.0% 4264 ± 5% slabinfo.skbuff_head_cache.active_objs
3896 ± 4% +10.9% 4320 ± 5% slabinfo.skbuff_head_cache.num_objs
905.75 ± 13% +81.2% 1641 ± 37% interrupts.CPU0.TLB:TLB_shootdowns
2986 ± 11% -25.2% 2234 ± 17% interrupts.CPU1.RES:Rescheduling_interrupts
2177 ± 10% -28.3% 1560 ± 29% interrupts.CPU14.RES:Rescheduling_interrupts
1939 ± 17% +31.8% 2557 ± 7% interrupts.CPU2.CAL:Function_call_interrupts
2537 ± 15% -25.7% 1885 ± 18% interrupts.CPU2.RES:Rescheduling_interrupts
2006 ± 18% +38.2% 2772 ± 7% interrupts.CPU24.CAL:Function_call_interrupts
2013 ± 17% +36.7% 2752 ± 7% interrupts.CPU25.CAL:Function_call_interrupts
2012 ± 19% +35.2% 2720 ± 6% interrupts.CPU27.CAL:Function_call_interrupts
2015 ± 17% +40.7% 2835 ± 6% interrupts.CPU29.CAL:Function_call_interrupts
2020 ± 18% +36.1% 2750 ± 7% interrupts.CPU31.CAL:Function_call_interrupts
2018 ± 18% +34.6% 2717 ± 10% interrupts.CPU32.CAL:Function_call_interrupts
1986 ± 16% +38.5% 2751 ± 5% interrupts.CPU34.CAL:Function_call_interrupts
921.00 ± 16% +118.7% 2014 ± 36% interrupts.CPU40.TLB:TLB_shootdowns
2388 ± 16% -36.7% 1511 ± 29% interrupts.CPU57.RES:Rescheduling_interrupts
2221 ± 11% -30.8% 1537 ± 31% interrupts.CPU58.RES:Rescheduling_interrupts
2076 ± 8% -23.2% 1593 ± 25% interrupts.CPU65.RES:Rescheduling_interrupts
2279 ± 8% -30.1% 1592 ± 33% interrupts.CPU66.RES:Rescheduling_interrupts
2363 ± 13% -37.6% 1474 ± 31% interrupts.CPU67.RES:Rescheduling_interrupts
2224 ± 9% -29.9% 1560 ± 23% interrupts.CPU68.RES:Rescheduling_interrupts
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.ioctl.perf_evsel__enable.evsel__enable
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.ioctl.perf_evsel__enable.evsel__enable.evlist__enable
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.smp_call_function_single.event_function_call.perf_event_for_each_child._perf_ioctl.perf_ioctl
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.ioctl.perf_evsel__enable
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.ksys_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe.ioctl
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl.do_syscall_64.entry_SYSCALL_64_after_hwframe
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp._perf_ioctl.perf_ioctl.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.event_function_call.perf_event_for_each_child._perf_ioctl.perf_ioctl.do_vfs_ioctl
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.perf_ioctl.do_vfs_ioctl.ksys_ioctl.__x64_sys_ioctl.do_syscall_64
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.perf_event_for_each_child._perf_ioctl.perf_ioctl.do_vfs_ioctl.ksys_ioctl
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.__libc_start_main
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.main.__libc_start_main
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.run_builtin.main.__libc_start_main
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.cmd_record.run_builtin.main.__libc_start_main
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.evlist__enable.cmd_record.run_builtin.main.__libc_start_main
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.evsel__enable.evlist__enable.cmd_record.run_builtin.main
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.perf_evsel__enable.evsel__enable.evlist__enable.cmd_record.run_builtin
13.49 ±130% -13.5 0.00 perf-profile.calltrace.cycles-pp.ioctl.perf_evsel__enable.evsel__enable.evlist__enable.cmd_record
7.29 ±102% -6.5 0.83 ±173% perf-profile.calltrace.cycles-pp.seq_read.proc_reg_read.vfs_read.ksys_read.do_syscall_64
7.29 ±102% -6.5 0.83 ±173% perf-profile.calltrace.cycles-pp.proc_reg_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
7.29 ±102% -4.8 2.50 ±173% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.read
7.29 ±102% -4.8 2.50 ±173% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
7.29 ±102% -4.8 2.50 ±173% perf-profile.calltrace.cycles-pp.read
7.29 ±102% -4.8 2.50 ±173% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
7.29 ±102% -4.8 2.50 ±173% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.read
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.__x64_sys_ioctl
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.ksys_ioctl
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.do_vfs_ioctl
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp._perf_ioctl
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.perf_ioctl
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.perf_event_for_each_child
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.__libc_start_main
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.main
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.run_builtin
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.cmd_record
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.evlist__enable
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.evsel__enable
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.perf_evsel__enable
13.49 ±130% -13.5 0.00 perf-profile.children.cycles-pp.ioctl
13.49 ±130% -12.4 1.14 ±173% perf-profile.children.cycles-pp.smp_call_function_single
13.49 ±130% -12.4 1.14 ±173% perf-profile.children.cycles-pp.event_function_call
7.29 ±102% -6.5 0.83 ±173% perf-profile.children.cycles-pp.proc_reg_read
7.29 ±102% -5.6 1.67 ±173% perf-profile.children.cycles-pp.seq_read
7.29 ±102% -4.8 2.50 ±173% perf-profile.children.cycles-pp.read
7.29 ±102% -4.8 2.50 ±173% perf-profile.children.cycles-pp.ksys_read
7.29 ±102% -4.8 2.50 ±173% perf-profile.children.cycles-pp.vfs_read
13.49 ±130% -12.4 1.14 ±173% perf-profile.self.cycles-pp.smp_call_function_single
8066 ± 7% +218.8% 25716 ± 9% softirqs.CPU0.RCU
11592 ± 15% +132.9% 26995 ± 10% softirqs.CPU1.RCU
9171 ± 22% +166.2% 24416 ± 6% softirqs.CPU10.RCU
8067 ± 6% +203.3% 24471 ± 8% softirqs.CPU11.RCU
9353 ± 21% +156.3% 23976 ± 8% softirqs.CPU12.RCU
7774 ± 5% +201.1% 23412 ± 4% softirqs.CPU13.RCU
7834 ± 4% +206.6% 24021 ± 5% softirqs.CPU14.RCU
7690 ± 5% +234.9% 25757 ± 6% softirqs.CPU15.RCU
7920 ± 6% +199.4% 23718 ± 6% softirqs.CPU16.RCU
7985 ± 6% +206.5% 24473 ± 9% softirqs.CPU17.RCU
8015 ± 4% +204.3% 24388 ± 7% softirqs.CPU18.RCU
7968 ± 7% +197.2% 23681 ± 5% softirqs.CPU19.RCU
8651 ± 19% +179.1% 24143 ± 4% softirqs.CPU2.RCU
9196 ± 6% +153.6% 23317 ± 8% softirqs.CPU20.RCU
26459 ± 9% -10.9% 23579 ± 2% softirqs.CPU20.TIMER
8237 ± 6% +188.6% 23771 ± 7% softirqs.CPU21.RCU
8368 ± 4% +196.0% 24770 ± 7% softirqs.CPU22.RCU
7808 ± 3% +207.9% 24039 ± 10% softirqs.CPU23.RCU
9264 ± 14% +181.0% 26034 ± 9% softirqs.CPU24.RCU
7582 ± 7% +205.7% 23177 ± 6% softirqs.CPU25.RCU
7748 ± 5% +196.3% 22954 ± 5% softirqs.CPU26.RCU
7779 ± 8% +192.6% 22760 ± 4% softirqs.CPU27.RCU
8042 ± 8% +191.1% 23408 ± 6% softirqs.CPU28.RCU
7679 ± 6% +194.7% 22628 ± 6% softirqs.CPU29.RCU
7996 ± 6% +218.0% 25430 ± 10% softirqs.CPU3.RCU
7834 ± 6% +195.2% 23125 ± 6% softirqs.CPU30.RCU
7723 ± 7% +203.4% 23428 ± 3% softirqs.CPU31.RCU
7646 ± 8% +197.6% 22752 ± 7% softirqs.CPU32.RCU
7853 ± 7% +182.0% 22143 ± 5% softirqs.CPU33.RCU
8125 ± 10% +177.6% 22553 ± 4% softirqs.CPU34.RCU
7996 ± 12% +183.3% 22652 ± 7% softirqs.CPU35.RCU
8032 ± 10% +187.2% 23072 ± 7% softirqs.CPU36.RCU
7778 ± 9% +194.7% 22921 ± 4% softirqs.CPU37.RCU
7922 ± 7% +191.0% 23052 ± 7% softirqs.CPU38.RCU
7992 ± 11% +203.7% 24272 ± 13% softirqs.CPU39.RCU
7928 ± 4% +209.3% 24520 ± 6% softirqs.CPU4.RCU
7703 ± 6% +197.7% 22929 ± 7% softirqs.CPU40.RCU
7842 ± 4% +184.7% 22324 ± 4% softirqs.CPU41.RCU
7581 ± 5% +200.8% 22803 ± 5% softirqs.CPU42.RCU
7766 ± 7% +186.6% 22260 ± 6% softirqs.CPU43.RCU
7793 ± 4% +184.9% 22200 ± 4% softirqs.CPU44.RCU
7754 ± 2% +198.4% 23138 ± 7% softirqs.CPU45.RCU
7645 ± 7% +192.7% 22378 ± 6% softirqs.CPU46.RCU
7785 ± 7% +191.9% 22726 ± 5% softirqs.CPU47.RCU
7983 ± 10% +203.5% 24229 ± 8% softirqs.CPU48.RCU
7639 ± 7% +211.8% 23821 ± 4% softirqs.CPU49.RCU
8105 ± 5% +196.7% 24049 ± 6% softirqs.CPU5.RCU
7733 ± 11% +207.0% 23743 ± 4% softirqs.CPU50.RCU
8394 ± 16% +183.4% 23790 ± 5% softirqs.CPU51.RCU
7391 ± 4% +220.6% 23696 ± 7% softirqs.CPU52.RCU
7431 ± 5% +213.6% 23303 ± 6% softirqs.CPU53.RCU
7821 ± 6% +197.1% 23239 ± 5% softirqs.CPU54.RCU
7527 ± 4% +211.3% 23431 ± 5% softirqs.CPU55.RCU
7608 ± 5% +205.6% 23246 ± 7% softirqs.CPU56.RCU
7823 ± 5% +196.6% 23204 ± 5% softirqs.CPU57.RCU
7969 ± 3% +193.1% 23355 ± 7% softirqs.CPU58.RCU
7833 ± 7% +193.3% 22975 ± 6% softirqs.CPU59.RCU
8180 ± 3% +193.0% 23971 ± 6% softirqs.CPU6.RCU
7548 ± 5% +205.8% 23082 ± 2% softirqs.CPU60.RCU
10533 ± 29% +128.7% 24087 ± 4% softirqs.CPU61.RCU
7411 ± 6% +220.1% 23721 ± 4% softirqs.CPU62.RCU
7584 ± 8% +222.8% 24484 ± 5% softirqs.CPU63.RCU
7737 ± 3% +208.4% 23861 ± 10% softirqs.CPU64.RCU
7783 ± 8% +191.0% 22649 ± 5% softirqs.CPU65.RCU
9354 ± 27% +152.3% 23601 ± 5% softirqs.CPU66.RCU
8000 ± 12% +193.7% 23500 ± 5% softirqs.CPU67.RCU
7704 ± 7% +198.2% 22974 ± 7% softirqs.CPU68.RCU
7583 ± 5% +212.3% 23679 ± 6% softirqs.CPU69.RCU
8046 ± 5% +200.2% 24155 ± 3% softirqs.CPU7.RCU
8813 ± 18% +165.9% 23434 ± 5% softirqs.CPU70.RCU
7801 ± 6% +196.7% 23144 ± 5% softirqs.CPU71.RCU
7807 ± 5% +189.2% 22582 ± 4% softirqs.CPU72.RCU
7345 ± 6% +205.4% 22432 ± 5% softirqs.CPU73.RCU
7314 ± 6% +207.4% 22484 ± 5% softirqs.CPU74.RCU
7500 ± 4% +203.8% 22789 ± 5% softirqs.CPU75.RCU
8305 ± 18% +167.4% 22207 ± 7% softirqs.CPU76.RCU
7455 ± 6% +200.0% 22364 ± 6% softirqs.CPU77.RCU
7489 ± 7% +197.8% 22301 ± 5% softirqs.CPU78.RCU
7594 ± 8% +198.9% 22698 ± 6% softirqs.CPU79.RCU
7730 ± 4% +200.6% 23238 ± 5% softirqs.CPU8.RCU
7449 ± 7% +193.3% 21853 ± 8% softirqs.CPU80.RCU
7439 ± 7% +196.8% 22078 ± 7% softirqs.CPU81.RCU
7599 ± 6% +186.5% 21771 ± 6% softirqs.CPU82.RCU
7663 ± 8% +192.0% 22378 ± 2% softirqs.CPU83.RCU
7532 ± 8% +198.0% 22446 ± 7% softirqs.CPU84.RCU
7418 ± 7% +200.7% 22306 ± 7% softirqs.CPU85.RCU
7355 ± 8% +202.7% 22266 ± 6% softirqs.CPU86.RCU
7634 ± 8% +191.7% 22270 ± 8% softirqs.CPU87.RCU
7546 ± 6% +196.9% 22403 ± 3% softirqs.CPU88.RCU
8254 ± 10% +174.3% 22638 ± 9% softirqs.CPU89.RCU
7830 +200.1% 23499 ± 6% softirqs.CPU9.RCU
7617 ± 11% +196.1% 22556 ± 7% softirqs.CPU90.RCU
7958 ± 12% +178.2% 22142 ± 5% softirqs.CPU91.RCU
7378 ± 7% +194.3% 21712 ± 4% softirqs.CPU92.RCU
7533 ± 4% +201.2% 22687 ± 6% softirqs.CPU93.RCU
7482 ± 6% +191.3% 21794 ± 5% softirqs.CPU94.RCU
7658 ± 10% +189.3% 22157 ± 5% softirqs.CPU95.RCU
761762 ± 4% +193.4% 2235237 ± 5% softirqs.RCU
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 3 months
- 1
- 0
[blackhole_netdev] [confidence: ] b0818f80c8: WARNING:at_fs/proc/generic.c:#remove_proc_entry
by kernel test robot
FYI, we noticed the following commit (built with gcc-7):
commit: b0818f80c8c1bc215bba276bd61c216014fab23b ("blackhole_netdev: fix syzkaller reported issue")
https://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git master
in testcase: boot
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-------------------------------------------------------+------------+------------+
| | 9cb0aec9ad | b0818f80c8 |
+-------------------------------------------------------+------------+------------+
| boot_successes | 28 | 0 |
| boot_failures | 0 | 36 |
| WARNING:at_fs/proc/generic.c:#remove_proc_entry | 0 | 36 |
| RIP:remove_proc_entry | 0 | 36 |
| RIP:queued_spin_lock_slowpath | 0 | 21 |
| Kernel_panic-not_syncing:softlockup:hung_tasks | 0 | 21 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 9 |
| Oops:#[##] | 0 | 11 |
| RIP:fib6_walk_continue | 0 | 6 |
| Kernel_panic-not_syncing:Fatal_exception_in_interrupt | 0 | 11 |
| WARNING:at_net/ipv6/ip6_fib.c:#fib6_walk_continue | 0 | 4 |
| RIP:neigh_flush_dev | 0 | 5 |
| BUG:unable_to_handle_page_fault_for_address | 0 | 1 |
| RIP:_raw_spin_lock_bh | 0 | 1 |
+-------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <lkp(a)intel.com>
[ 4.870076] WARNING: CPU: 0 PID: 1 at fs/proc/generic.c:684 remove_proc_entry+0x171/0x180
[ 4.871043] Modules linked in:
[ 4.871043] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.4.0-rc1-00362-gb0818f80c8c1b #1
[ 4.871043] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.10.2-1 04/01/2014
[ 4.871043] RIP: 0010:remove_proc_entry+0x171/0x180
[ 4.871043] Code: 00 48 c7 c6 c0 7a 05 ac 48 c7 c7 f8 84 33 ac 48 0f 45 c2 48 8b 55 78 4c 8b 80 a0 00 00 00 48 8b 92 a0 00 00 00 e8 af 3d d4 ff <0f> 0b eb 88 e8 86 40 d4 ff 66 0f 1f 44 00 00 66 66 66 66 90 41 57
[ 4.871043] RSP: 0000:ffffb13780013d90 EFLAGS: 00010282
[ 4.871043] RAX: 0000000000000000 RBX: ffff9c3131ce82c0 RCX: ffffffffac651f68
[ 4.871043] RDX: 0000000000000001 RSI: 0000000000000086 RDI: 0000000000000246
[ 4.871043] RBP: ffff9c3131ce8240 R08: 00000000000001f5 R09: 0000000000000065
[ 4.871043] R10: ffffb1378006bd88 R11: ffffb13780013c30 R12: ffff9c316a705240
[ 4.871043] R13: ffffffffac721908 R14: ffffffffac7218e0 R15: 0000000000000000
[ 4.871043] FS: 0000000000000000(0000) GS:ffff9c317fc00000(0000) knlGS:0000000000000000
[ 4.871043] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 4.871043] CR2: 0000000000000000 CR3: 00000000a260a000 CR4: 00000000000406f0
[ 4.871043] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 4.871043] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 4.871043] Call Trace:
[ 4.871043] ipv6_proc_exit_net+0x2f/0x50
[ 4.871043] ops_exit_list+0x36/0x70
[ 4.871043] unregister_pernet_operations+0xf1/0x150
[ 4.871043] ? af_unix_init+0x4e/0x4e
[ 4.871043] ? set_debug_rodata+0x11/0x11
[ 4.871043] unregister_pernet_subsys+0x1d/0x30
[ 4.871043] inet6_init+0x2eb/0x388
[ 4.871043] do_one_initcall+0x46/0x214
[ 4.871043] kernel_init_freeable+0x1b6/0x273
[ 4.871043] ? rest_init+0xd0/0xd0
[ 4.871043] kernel_init+0xa/0x110
[ 4.871043] ret_from_fork+0x35/0x40
[ 4.871043] ---[ end trace 727e474a6092601b ]---
To reproduce:
# build kernel
cd linux
cp config-5.4.0-rc1-00362-gb0818f80c8c1b .config
make HOSTCC=gcc-7 CC=gcc-7 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
lkp
1 year, 3 months
- 1
- 0
[netns] a1c2f32297: netperf.Throughput_total_tps -6.8% regression
by kernel test robot
Greeting,
FYI, we noticed a -6.8% regression of netperf.Throughput_total_tps due to commit:
commit: a1c2f3229734a4bb8d5ac008c0a67e025aa11547 ("netns: provide pure entropy for net_hash_mix()")
https://git.kernel.org/cgit/linux/kernel/git/stable/linux-stable-rc.git linux-4.19.y
in testcase: netperf
on test machine: 72 threads Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz with 192G memory
with following parameters:
ip: ipv4
runtime: 300s
nr_threads: 16
cluster: cs-localhost
test: TCP_CRR
ucode: 0x200005e
cpufreq_governor: performance
test-description: Netperf is a benchmark that can be use to measure various aspect of networking performance.
test-url: http://www.netperf.org/netperf/
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
cluster/compiler/cpufreq_governor/ip/kconfig/nr_threads/rootfs/runtime/tbox_group/test/testcase/ucode:
cs-localhost/gcc-7/performance/ipv4/x86_64-rhel-7.6/16/debian-x86_64-2019-05-14.cgz/300s/lkp-skl-2sp8/TCP_CRR/netperf/0x200005e
commit:
53a1906859 ("net/mlx5: Decrease default mr cache size")
a1c2f32297 ("netns: provide pure entropy for net_hash_mix()")
53a1906859a2ec1d a1c2f3229734a4bb8d5ac008c0a
---------------- ---------------------------
%stddev %change %stddev
\ | \
383553 -6.8% 357607 netperf.Throughput_total_tps
23972 -6.8% 22350 netperf.Throughput_tps
187.31 -4.8% 178.23 ± 2% netperf.time.user_time
2.14e+08 -2.8% 2.079e+08 netperf.time.voluntary_context_switches
1.151e+08 -6.8% 1.073e+08 netperf.workload
10.25 ± 14% +130.1% 23.58 ± 44% sched_debug.cpu.nr_uninterruptible.max
3096 ± 3% +7.5% 3328 ± 3% slabinfo.skbuff_head_cache.num_objs
2190042 -3.1% 2121214 vmstat.system.cs
938.50 -1.3% 926.75 turbostat.Avg_MHz
227.32 -1.4% 224.24 turbostat.PkgWatt
3815 ± 2% -23.8% 2908 ± 19% numa-vmstat.node0.nr_mapped
952.25 ± 18% -46.2% 512.00 ± 65% numa-vmstat.node0.nr_page_table_pages
29319 ± 6% -11.6% 25922 ± 6% numa-vmstat.node0.nr_slab_unreclaimable
22998 ± 7% +15.4% 26540 ± 5% numa-vmstat.node1.nr_slab_unreclaimable
916351 ± 2% -5.3% 867925 proc-vmstat.numa_hit
902376 ± 2% -5.4% 853924 proc-vmstat.numa_local
1081259 ± 2% -8.7% 987046 proc-vmstat.pgalloc_normal
1033827 ± 2% -9.2% 939065 proc-vmstat.pgfree
3811 ± 18% -46.2% 2049 ± 65% numa-meminfo.node0.PageTables
117240 ± 6% -11.6% 103687 ± 6% numa-meminfo.node0.SUnreclaim
3560 ± 94% +165.8% 9464 ± 46% numa-meminfo.node1.Inactive
91959 ± 7% +15.5% 106185 ± 5% numa-meminfo.node1.SUnreclaim
119645 ± 7% +12.7% 134828 numa-meminfo.node1.Slab
13769 ± 13% -22.8% 10626 ± 8% interrupts.CPU16.RES:Rescheduling_interrupts
3283 ± 20% +39.7% 4587 ± 6% interrupts.CPU17.NMI:Non-maskable_interrupts
3283 ± 20% +39.7% 4587 ± 6% interrupts.CPU17.PMI:Performance_monitoring_interrupts
12476 ± 19% -33.5% 8299 ± 15% interrupts.CPU21.RES:Rescheduling_interrupts
11281 ± 17% -31.8% 7693 ± 19% interrupts.CPU23.RES:Rescheduling_interrupts
13641 ± 26% -32.2% 9249 ± 11% interrupts.CPU25.RES:Rescheduling_interrupts
13562 ± 15% -36.5% 8614 ± 14% interrupts.CPU27.RES:Rescheduling_interrupts
14943 ± 9% -35.0% 9715 ± 17% interrupts.CPU28.RES:Rescheduling_interrupts
14401 ± 34% -38.2% 8899 ± 7% interrupts.CPU29.RES:Rescheduling_interrupts
12246 ± 7% -21.3% 9639 ± 19% interrupts.CPU30.RES:Rescheduling_interrupts
4276 ± 13% -20.6% 3396 ± 6% interrupts.CPU31.NMI:Non-maskable_interrupts
4276 ± 13% -20.6% 3396 ± 6% interrupts.CPU31.PMI:Performance_monitoring_interrupts
9075 ± 5% -13.1% 7888 ± 6% interrupts.CPU54.RES:Rescheduling_interrupts
9972 ± 4% -25.4% 7437 ± 7% interrupts.CPU56.RES:Rescheduling_interrupts
10420 ± 16% -29.4% 7352 ± 5% interrupts.CPU60.RES:Rescheduling_interrupts
8746 ± 9% -26.5% 6425 ± 10% interrupts.CPU65.RES:Rescheduling_interrupts
2907 ± 21% +31.1% 3811 ± 12% interrupts.CPU7.NMI:Non-maskable_interrupts
2907 ± 21% +31.1% 3811 ± 12% interrupts.CPU7.PMI:Performance_monitoring_interrupts
12019 ± 21% -30.8% 8316 ± 4% interrupts.CPU7.RES:Rescheduling_interrupts
3868 ± 13% -23.0% 2979 ± 16% interrupts.CPU71.NMI:Non-maskable_interrupts
3868 ± 13% -23.0% 2979 ± 16% interrupts.CPU71.PMI:Performance_monitoring_interrupts
714982 ± 3% -15.2% 606456 ± 6% interrupts.RES:Rescheduling_interrupts
13.23 ± 2% +9.0% 14.41 ± 2% perf-stat.i.MPKI
9.046e+09 -5.9% 8.509e+09 perf-stat.i.branch-instructions
1.79e+08 -5.9% 1.686e+08 perf-stat.i.branch-misses
9.93 +1.1 11.07 perf-stat.i.cache-miss-rate%
59768309 +11.6% 66676203 perf-stat.i.cache-misses
2211549 -3.1% 2143696 perf-stat.i.context-switches
1.52 +6.1% 1.61 perf-stat.i.cpi
6.847e+10 -1.1% 6.769e+10 perf-stat.i.cpu-cycles
1191 -12.3% 1044 perf-stat.i.cycles-between-cache-misses
1.385e+10 -5.7% 1.306e+10 perf-stat.i.dTLB-loads
8.517e+09 -6.2% 7.993e+09 perf-stat.i.dTLB-stores
4.58e+10 -6.0% 4.306e+10 perf-stat.i.instructions
0.67 -5.0% 0.63 perf-stat.i.ipc
83.57 +0.9 84.46 perf-stat.i.node-load-miss-rate%
10748394 ± 2% +16.0% 12468342 perf-stat.i.node-load-misses
2096584 +8.7% 2278100 perf-stat.i.node-loads
3773801 -12.4% 3304144 perf-stat.i.node-store-misses
137586 -7.0% 127931 perf-stat.i.node-stores
13.14 +5.8% 13.90 perf-stat.overall.MPKI
9.94 +1.2 11.14 perf-stat.overall.cache-miss-rate%
1.50 +5.1% 1.57 perf-stat.overall.cpi
1145 -11.4% 1015 perf-stat.overall.cycles-between-cache-misses
0.67 -4.9% 0.64 perf-stat.overall.ipc
83.67 +0.9 84.55 perf-stat.overall.node-load-miss-rate%
9.015e+09 -5.9% 8.48e+09 perf-stat.ps.branch-instructions
1.784e+08 -5.9% 1.68e+08 perf-stat.ps.branch-misses
59564982 +11.6% 66447308 perf-stat.ps.cache-misses
2204029 -3.1% 2136334 perf-stat.ps.context-switches
6.824e+10 -1.1% 6.746e+10 perf-stat.ps.cpu-cycles
1.38e+10 -5.7% 1.301e+10 perf-stat.ps.dTLB-loads
8.488e+09 -6.2% 7.965e+09 perf-stat.ps.dTLB-stores
4.564e+10 -6.0% 4.292e+10 perf-stat.ps.instructions
10711810 ± 2% +16.0% 12425503 perf-stat.ps.node-load-misses
2089456 +8.7% 2270284 perf-stat.ps.node-loads
3760951 -12.4% 3292790 perf-stat.ps.node-store-misses
137129 -7.0% 127503 perf-stat.ps.node-stores
1.398e+13 -6.0% 1.313e+13 perf-stat.total.instructions
520103 ± 4% -8.2% 477326 ± 3% softirqs.CPU11.RCU
573068 ± 4% -5.9% 539001 ± 2% softirqs.CPU17.RCU
4172477 ± 9% -12.0% 3671557 ± 4% softirqs.CPU18.NET_RX
4595149 ± 10% -18.1% 3765198 ± 5% softirqs.CPU21.NET_RX
450233 ± 7% -15.8% 379294 ± 3% softirqs.CPU21.RCU
4732458 ± 5% -14.3% 4057529 ± 6% softirqs.CPU22.NET_RX
461175 ± 3% -13.4% 399343 ± 4% softirqs.CPU22.RCU
461405 ± 5% -10.1% 414957 ± 2% softirqs.CPU23.RCU
4993020 ± 7% -15.9% 4197412 ± 4% softirqs.CPU24.NET_RX
484711 ± 6% -14.7% 413336 ± 5% softirqs.CPU24.RCU
5218819 -14.1% 4485058 softirqs.CPU25.NET_RX
498524 -11.8% 439800 softirqs.CPU25.RCU
5394088 ± 2% -15.1% 4577733 ± 5% softirqs.CPU26.NET_RX
512595 ± 2% -12.7% 447608 ± 3% softirqs.CPU26.RCU
5446419 ± 3% -10.6% 4869450 ± 4% softirqs.CPU27.NET_RX
514690 ± 3% -8.7% 469711 ± 4% softirqs.CPU27.RCU
5854223 ± 5% -15.8% 4928666 ± 4% softirqs.CPU28.NET_RX
552782 ± 5% -14.1% 474876 ± 4% softirqs.CPU28.RCU
5912684 ± 5% -13.1% 5141013 softirqs.CPU29.NET_RX
555005 ± 4% -11.3% 492248 softirqs.CPU29.RCU
6106124 ± 2% -17.3% 5047198 softirqs.CPU30.NET_RX
566983 -15.7% 478062 softirqs.CPU30.RCU
5986120 ± 4% -12.2% 5255013 ± 5% softirqs.CPU31.NET_RX
542065 ± 4% -9.8% 488749 ± 3% softirqs.CPU31.RCU
6121749 ± 2% -12.0% 5389364 ± 5% softirqs.CPU32.NET_RX
568918 ± 2% -11.3% 504879 ± 4% softirqs.CPU32.RCU
6327720 ± 3% -13.0% 5507161 ± 3% softirqs.CPU33.NET_RX
584398 ± 2% -12.4% 511695 ± 2% softirqs.CPU33.RCU
6420732 ± 2% -12.4% 5624846 ± 3% softirqs.CPU34.NET_RX
590962 -11.0% 525974 ± 3% softirqs.CPU34.RCU
6197761 ± 3% -14.1% 5324666 ± 5% softirqs.CPU54.NET_RX
6016379 ± 3% -11.9% 5301773 ± 3% softirqs.CPU55.NET_RX
5892535 ± 3% -12.1% 5178162 ± 3% softirqs.CPU56.NET_RX
548218 ± 2% -10.8% 489082 ± 2% softirqs.CPU56.RCU
5443586 ± 3% -10.4% 4876838 ± 5% softirqs.CPU58.NET_RX
511125 ± 3% -8.5% 467853 ± 4% softirqs.CPU58.RCU
5370678 ± 3% -15.8% 4520204 ± 5% softirqs.CPU59.NET_RX
510799 ± 3% -14.1% 438741 ± 3% softirqs.CPU59.RCU
4593396 ± 5% -14.4% 3930378 ± 5% softirqs.CPU63.NET_RX
441677 ± 4% -13.2% 383569 ± 3% softirqs.CPU63.RCU
389349 ± 3% -11.2% 345885 ± 6% softirqs.CPU67.RCU
3853265 ± 6% -13.7% 3325496 ± 4% softirqs.CPU68.NET_RX
381832 ± 5% -12.0% 336190 ± 2% softirqs.CPU68.RCU
3664749 ± 9% -15.7% 3091134 ± 7% softirqs.CPU70.NET_RX
41.71 ± 7% -5.2 36.51 ± 3% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
40.47 ± 7% -5.2 35.30 ± 3% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.do_idle.cpu_startup_entry.start_secondary
46.51 ± 6% -5.1 41.45 ± 3% perf-profile.calltrace.cycles-pp.secondary_startup_64
45.71 ± 6% -5.0 40.76 ± 3% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
45.67 ± 6% -4.9 40.73 ± 3% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
45.71 ± 6% -4.9 40.77 ± 3% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
2.37 ± 5% -0.2 2.21 ± 4% perf-profile.calltrace.cycles-pp.inet_accept.__sys_accept4.__x64_sys_accept.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.59 ± 3% +0.0 0.63 ± 3% perf-profile.calltrace.cycles-pp.tcp_v4_send_synack.tcp_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv
1.13 ± 4% +0.1 1.20 ± 3% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_rcv_established.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
0.56 ± 7% +0.1 0.66 ± 3% perf-profile.calltrace.cycles-pp.sel_netport_sid.selinux_socket_bind.security_socket_bind.__sys_bind.__x64_sys_bind
0.71 ± 6% +0.1 0.81 ± 3% perf-profile.calltrace.cycles-pp.inet_create.__sock_create.__sys_socket.__x64_sys_socket.do_syscall_64
0.62 ± 6% +0.1 0.74 perf-profile.calltrace.cycles-pp.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_rcv.ip_local_deliver_finish
0.74 ± 4% +0.1 0.87 ± 3% perf-profile.calltrace.cycles-pp.selinux_socket_bind.security_socket_bind.__sys_bind.__x64_sys_bind.do_syscall_64
1.24 ± 5% +0.1 1.37 ± 2% perf-profile.calltrace.cycles-pp.dput.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
0.66 ± 6% +0.1 0.79 perf-profile.calltrace.cycles-pp.__inet_bind.__sys_bind.__x64_sys_bind.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.14 ± 5% +0.1 1.27 ± 2% perf-profile.calltrace.cycles-pp.__dentry_kill.dentry_kill.dput.__fput.task_work_run
1.16 ± 6% +0.1 1.29 ± 3% perf-profile.calltrace.cycles-pp.__sock_create.__sys_socket.__x64_sys_socket.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.75 ± 4% +0.1 0.88 ± 2% perf-profile.calltrace.cycles-pp.security_socket_bind.__sys_bind.__x64_sys_bind.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.17 ± 5% +0.1 1.30 ± 2% perf-profile.calltrace.cycles-pp.dentry_kill.dput.__fput.task_work_run.exit_to_usermode_loop
0.60 ± 5% +0.1 0.74 perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_child_process.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
1.99 ± 5% +0.2 2.15 ± 2% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
1.94 ± 5% +0.2 2.09 ± 2% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
2.68 ± 5% +0.2 2.89 ± 4% perf-profile.calltrace.cycles-pp.sk_wait_data.tcp_recvmsg.inet_recvmsg.__sys_recvfrom.__x64_sys_recvfrom
1.97 ± 6% +0.2 2.19 ± 2% perf-profile.calltrace.cycles-pp.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv
1.14 ± 7% +0.2 1.36 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.tcp_close.inet_release.__sock_release
0.41 ± 58% +0.2 0.63 ± 2% perf-profile.calltrace.cycles-pp.inet_csk_get_port.__inet_bind.__sys_bind.__x64_sys_bind.do_syscall_64
1.17 ± 7% +0.2 1.39 perf-profile.calltrace.cycles-pp.__release_sock.tcp_close.inet_release.__sock_release.sock_close
2.01 ± 6% +0.2 2.24 ± 2% perf-profile.calltrace.cycles-pp.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
1.13 ± 7% +0.2 1.36 perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.tcp_close.inet_release
1.50 ± 4% +0.3 1.76 perf-profile.calltrace.cycles-pp.__sys_bind.__x64_sys_bind.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.51 ± 4% +0.3 1.78 perf-profile.calltrace.cycles-pp.__x64_sys_bind.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.80 ± 5% +0.4 2.16 ± 3% perf-profile.calltrace.cycles-pp.tcp_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
1.32 ± 5% +0.4 1.69 perf-profile.calltrace.cycles-pp.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
1.56 ± 6% +0.4 1.96 perf-profile.calltrace.cycles-pp.tcp_check_req.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv
0.13 ±173% +0.4 0.53 ± 3% perf-profile.calltrace.cycles-pp.tcp_done.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv
0.13 ±173% +0.4 0.57 perf-profile.calltrace.cycles-pp.sk_clone_lock.inet_csk_clone_lock.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req
0.14 ±173% +0.5 0.60 perf-profile.calltrace.cycles-pp.inet_csk_clone_lock.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_rcv
0.00 +0.6 0.55 ± 3% perf-profile.calltrace.cycles-pp.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv
0.00 +0.6 0.56 perf-profile.calltrace.cycles-pp.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.release_sock
4.67 ± 5% +0.6 5.26 ± 2% perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
5.85 ± 6% +0.6 6.44 ± 2% perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg
5.72 ± 5% +0.6 6.34 ± 2% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked
7.59 ± 5% +0.7 8.25 ± 2% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg
7.60 ± 5% +0.7 8.26 ± 2% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto
4.17 ± 5% +0.7 4.84 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_state_process
4.30 ± 5% +0.7 4.99 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_state_process.tcp_v4_do_rcv
4.42 ± 5% +0.7 5.13 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock
8.67 ± 5% +0.7 9.38 ± 2% perf-profile.calltrace.cycles-pp.tcp_sendmsg_locked.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto
4.54 ± 5% +0.7 5.26 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.release_sock
5.07 ± 5% +0.8 5.88 perf-profile.calltrace.cycles-pp.tcp_rcv_state_process.tcp_v4_do_rcv.__release_sock.release_sock.__inet_stream_connect
10.06 ± 5% +0.8 10.87 ± 2% perf-profile.calltrace.cycles-pp.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
9.95 ± 5% +0.8 10.77 ± 2% perf-profile.calltrace.cycles-pp.tcp_sendmsg.sock_sendmsg.__sys_sendto.__x64_sys_sendto.do_syscall_64
3.29 ± 5% +0.8 4.11 perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect.tcp_v4_connect
10.17 ± 5% +0.8 11.01 ± 2% perf-profile.calltrace.cycles-pp.__sys_sendto.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.27 ± 5% +0.8 4.11 perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect
10.20 ± 5% +0.8 11.04 ± 2% perf-profile.calltrace.cycles-pp.__x64_sys_sendto.do_syscall_64.entry_SYSCALL_64_after_hwframe
3.96 ± 5% +0.8 4.81 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect
9.47 ± 5% +0.9 10.35 ± 2% perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv
3.75 ± 5% +0.9 4.62 perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect
7.14 ± 6% +0.9 8.04 perf-profile.calltrace.cycles-pp.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_close.inet_release
4.73 ± 5% +0.9 5.62 ± 2% perf-profile.calltrace.cycles-pp.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.__sys_connect
6.90 ± 6% +0.9 7.80 ± 2% perf-profile.calltrace.cycles-pp.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_close
5.78 ± 5% +0.9 6.70 perf-profile.calltrace.cycles-pp.release_sock.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect
5.75 ± 5% +0.9 6.68 perf-profile.calltrace.cycles-pp.__release_sock.release_sock.__inet_stream_connect.inet_stream_connect.__sys_connect
5.71 ± 5% +0.9 6.65 perf-profile.calltrace.cycles-pp.tcp_v4_do_rcv.__release_sock.release_sock.__inet_stream_connect.inet_stream_connect
8.14 ± 5% +0.9 9.08 ± 2% perf-profile.calltrace.cycles-pp.__tcp_push_pending_frames.tcp_close.inet_release.__sock_release.sock_close
8.13 ± 5% +0.9 9.07 ± 2% perf-profile.calltrace.cycles-pp.tcp_write_xmit.__tcp_push_pending_frames.tcp_close.inet_release.__sock_release
5.77 ± 6% +1.2 6.93 ± 2% perf-profile.calltrace.cycles-pp.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect
10.81 ± 6% +1.2 11.98 ± 2% perf-profile.calltrace.cycles-pp.tcp_close.inet_release.__sock_release.sock_close.__fput
11.14 ± 6% +1.3 12.44 ± 2% perf-profile.calltrace.cycles-pp.inet_release.__sock_release.sock_close.__fput.task_work_run
11.25 ± 6% +1.3 12.58 ± 2% perf-profile.calltrace.cycles-pp.__sock_release.sock_close.__fput.task_work_run.exit_to_usermode_loop
11.27 ± 6% +1.3 12.60 ± 2% perf-profile.calltrace.cycles-pp.sock_close.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64
12.97 ± 6% +1.5 14.44 ± 2% perf-profile.calltrace.cycles-pp.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.42 ± 5% +1.5 13.89 ± 2% perf-profile.calltrace.cycles-pp.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
12.88 ± 6% +1.5 14.36 ± 2% perf-profile.calltrace.cycles-pp.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.72 ± 6% +1.5 14.20 ± 2% perf-profile.calltrace.cycles-pp.__fput.task_work_run.exit_to_usermode_loop.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.21 ± 5% +1.5 13.71 ± 2% perf-profile.calltrace.cycles-pp.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb.tcp_write_xmit
0.00 +1.8 1.83 ± 15% perf-profile.calltrace.cycles-pp.__inet_lookup_established.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv
11.75 ± 5% +2.1 13.82 perf-profile.calltrace.cycles-pp.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
11.69 ± 5% +2.1 13.76 perf-profile.calltrace.cycles-pp.__inet_stream_connect.inet_stream_connect.__sys_connect.__x64_sys_connect.do_syscall_64
12.07 ± 5% +2.1 14.17 perf-profile.calltrace.cycles-pp.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
12.06 ± 5% +2.1 14.15 perf-profile.calltrace.cycles-pp.__sys_connect.__x64_sys_connect.do_syscall_64.entry_SYSCALL_64_after_hwframe
16.59 ± 5% +2.9 19.51 perf-profile.calltrace.cycles-pp.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core
17.05 ± 5% +2.9 19.99 perf-profile.calltrace.cycles-pp.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action
16.87 ± 5% +2.9 19.81 perf-profile.calltrace.cycles-pp.ip_local_deliver_finish.ip_local_deliver.ip_rcv.__netif_receive_skb_one_core.process_backlog
17.69 ± 5% +3.0 20.64 perf-profile.calltrace.cycles-pp.ip_rcv.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start
18.36 ± 5% +3.0 21.32 perf-profile.calltrace.cycles-pp.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq
17.98 ± 5% +3.0 20.95 perf-profile.calltrace.cycles-pp.__netif_receive_skb_one_core.process_backlog.net_rx_action.__softirqentry_text_start.do_softirq_own_stack
18.60 ± 5% +3.0 21.57 perf-profile.calltrace.cycles-pp.net_rx_action.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip
18.99 ± 5% +3.0 21.97 perf-profile.calltrace.cycles-pp.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit
18.90 ± 5% +3.0 21.88 perf-profile.calltrace.cycles-pp.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_output
18.88 ± 5% +3.0 21.87 perf-profile.calltrace.cycles-pp.__softirqentry_text_start.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
18.98 ± 5% +3.0 21.97 perf-profile.calltrace.cycles-pp.__local_bh_enable_ip.ip_finish_output2.ip_output.__ip_queue_xmit.__tcp_transmit_skb
48.95 ± 5% +4.9 53.87 ± 2% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
49.11 ± 5% +4.9 54.04 ± 2% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
42.52 ± 7% -5.3 37.19 ± 3% perf-profile.children.cycles-pp.cpuidle_enter_state
41.20 ± 7% -5.3 35.92 ± 3% perf-profile.children.cycles-pp.intel_idle
46.51 ± 6% -5.1 41.45 ± 3% perf-profile.children.cycles-pp.secondary_startup_64
46.51 ± 6% -5.1 41.45 ± 3% perf-profile.children.cycles-pp.cpu_startup_entry
46.50 ± 6% -5.1 41.44 ± 3% perf-profile.children.cycles-pp.do_idle
45.71 ± 6% -4.9 40.77 ± 3% perf-profile.children.cycles-pp.start_secondary
2.37 ± 5% -0.2 2.21 ± 4% perf-profile.children.cycles-pp.inet_accept
0.20 ± 8% -0.0 0.17 ± 8% perf-profile.children.cycles-pp.fib_table_lookup
0.07 -0.0 0.04 ± 58% perf-profile.children.cycles-pp.netlbl_req_setattr
0.09 -0.0 0.08 ± 6% perf-profile.children.cycles-pp.selinux_netlbl_inet_conn_request
0.05 +0.0 0.06 perf-profile.children.cycles-pp.__close_fd
0.07 ± 5% +0.0 0.09 ± 5% perf-profile.children.cycles-pp.fsnotify_destroy_marks
0.07 ± 6% +0.0 0.08 perf-profile.children.cycles-pp.iput
0.06 +0.0 0.07 ± 5% perf-profile.children.cycles-pp.skb_entail
0.05 ± 8% +0.0 0.07 ± 10% perf-profile.children.cycles-pp.selinux_skb_peerlbl_sid
0.15 ± 5% +0.0 0.17 ± 2% perf-profile.children.cycles-pp.sock_put
0.14 ± 5% +0.0 0.16 ± 4% perf-profile.children.cycles-pp.security_inode_alloc
0.07 ± 5% +0.0 0.09 ± 4% perf-profile.children.cycles-pp._raw_spin_lock_irq
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.children.cycles-pp.tcp_push
0.13 ± 5% +0.0 0.15 ± 4% perf-profile.children.cycles-pp.selinux_inode_alloc_security
0.07 ± 5% +0.0 0.10 ± 5% perf-profile.children.cycles-pp.tcp_mtup_init
0.04 ± 57% +0.0 0.06 perf-profile.children.cycles-pp.selinux_netlbl_sock_rcv_skb
0.10 ± 10% +0.0 0.13 ± 3% perf-profile.children.cycles-pp.tcp_rack_update_reo_wnd
0.07 ± 14% +0.0 0.10 ± 7% perf-profile.children.cycles-pp.inet_sock_destruct
0.31 ± 4% +0.0 0.34 ± 2% perf-profile.children.cycles-pp.__ip_local_out
0.33 ± 4% +0.0 0.36 perf-profile.children.cycles-pp.ip_local_out
0.13 ± 3% +0.0 0.16 ± 2% perf-profile.children.cycles-pp.tcp_openreq_init_rwin
0.03 ±100% +0.0 0.06 perf-profile.children.cycles-pp.up_write
0.17 ± 2% +0.0 0.21 ± 2% perf-profile.children.cycles-pp.tcp_schedule_loss_probe
0.01 ±173% +0.0 0.06 ± 7% perf-profile.children.cycles-pp.inode_wait_for_writeback
0.59 ± 3% +0.0 0.64 ± 2% perf-profile.children.cycles-pp.tcp_v4_send_synack
0.20 ± 7% +0.0 0.24 ± 6% perf-profile.children.cycles-pp.__fget_light
0.14 ± 6% +0.0 0.18 ± 4% perf-profile.children.cycles-pp.tcp_parse_options
0.00 +0.1 0.05 perf-profile.children.cycles-pp.clear_inode
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.deactivate_task
0.28 ± 5% +0.1 0.33 ± 7% perf-profile.children.cycles-pp.sockfd_lookup_light
0.17 ± 11% +0.1 0.23 ± 5% perf-profile.children.cycles-pp.evict
0.35 ± 5% +0.1 0.41 ± 3% perf-profile.children.cycles-pp.tcp_update_pacing_rate
0.13 ± 6% +0.1 0.20 ± 5% perf-profile.children.cycles-pp.inet_twsk_kill
0.15 ± 4% +0.1 0.21 ± 3% perf-profile.children.cycles-pp.inet_twsk_deschedule_put
0.40 ± 8% +0.1 0.46 ± 6% perf-profile.children.cycles-pp.tcp_v4_destroy_sock
0.28 ± 5% +0.1 0.36 ± 4% perf-profile.children.cycles-pp.__tcp_get_metrics
0.73 ± 6% +0.1 0.80 ± 2% perf-profile.children.cycles-pp.tcp_done
0.31 ± 9% +0.1 0.39 ± 2% perf-profile.children.cycles-pp.inet_csk_route_req
0.11 ± 9% +0.1 0.20 ± 5% perf-profile.children.cycles-pp.__inet_lookup_listener
0.77 ± 8% +0.1 0.86 ± 5% perf-profile.children.cycles-pp.inet_csk_destroy_sock
0.47 ± 4% +0.1 0.57 perf-profile.children.cycles-pp.sk_clone_lock
0.34 ± 5% +0.1 0.43 ± 2% perf-profile.children.cycles-pp.sk_alloc
0.54 ± 6% +0.1 0.64 ± 2% perf-profile.children.cycles-pp.dst_release
0.35 ± 6% +0.1 0.45 ± 3% perf-profile.children.cycles-pp.__inet_hash_connect
0.68 ± 4% +0.1 0.78 ± 3% perf-profile.children.cycles-pp.sel_netport_sid
0.49 ± 5% +0.1 0.60 perf-profile.children.cycles-pp.inet_csk_clone_lock
0.53 ± 7% +0.1 0.63 ± 2% perf-profile.children.cycles-pp.inet_csk_get_port
0.71 ± 6% +0.1 0.81 ± 3% perf-profile.children.cycles-pp.inet_create
0.17 ± 7% +0.1 0.29 ± 6% perf-profile.children.cycles-pp.__inet_inherit_port
0.62 ± 6% +0.1 0.74 perf-profile.children.cycles-pp.tcp_create_openreq_child
0.15 ± 7% +0.1 0.27 ± 8% perf-profile.children.cycles-pp.inet_ehash_insert
0.74 ± 4% +0.1 0.87 ± 3% perf-profile.children.cycles-pp.selinux_socket_bind
1.14 ± 5% +0.1 1.27 ± 2% perf-profile.children.cycles-pp.__dentry_kill
0.75 ± 4% +0.1 0.88 ± 2% perf-profile.children.cycles-pp.security_socket_bind
1.16 ± 6% +0.1 1.29 ± 3% perf-profile.children.cycles-pp.__sock_create
0.20 ± 7% +0.1 0.33 ± 6% perf-profile.children.cycles-pp.inet_csk_reqsk_queue_hash_add
0.66 ± 6% +0.1 0.80 ± 2% perf-profile.children.cycles-pp.__inet_bind
1.24 ± 5% +0.1 1.37 perf-profile.children.cycles-pp.dput
1.17 ± 5% +0.1 1.30 ± 2% perf-profile.children.cycles-pp.dentry_kill
0.28 ± 6% +0.1 0.41 ± 2% perf-profile.children.cycles-pp.inet_csk_route_child_sock
0.41 ± 5% +0.1 0.55 ± 3% perf-profile.children.cycles-pp.tcp_time_wait
0.23 ± 11% +0.2 0.39 ± 3% perf-profile.children.cycles-pp.inet_put_port
0.41 ± 3% +0.2 0.56 perf-profile.children.cycles-pp.tcp_finish_connect
2.69 ± 5% +0.2 2.89 ± 4% perf-profile.children.cycles-pp.sk_wait_data
0.27 ± 4% +0.2 0.48 perf-profile.children.cycles-pp.tcp_update_metrics
0.20 ± 4% +0.2 0.42 ± 2% perf-profile.children.cycles-pp.tcp_init_metrics
0.42 ± 8% +0.2 0.65 perf-profile.children.cycles-pp.__sk_destruct
1.50 ± 4% +0.3 1.76 perf-profile.children.cycles-pp.__sys_bind
1.51 ± 4% +0.3 1.78 perf-profile.children.cycles-pp.__x64_sys_bind
0.68 ± 4% +0.3 0.97 perf-profile.children.cycles-pp.tcp_init_transfer
4.46 ± 4% +0.3 4.76 ± 3% perf-profile.children.cycles-pp.__schedule
3.00 ± 6% +0.3 3.33 ± 2% perf-profile.children.cycles-pp.tcp_fin
0.91 ± 8% +0.3 1.25 ± 3% perf-profile.children.cycles-pp.ip_route_output_key_hash
0.88 ± 8% +0.3 1.23 ± 3% perf-profile.children.cycles-pp.ip_route_output_key_hash_rcu
0.61 ± 8% +0.3 0.96 ± 2% perf-profile.children.cycles-pp.ip_route_output_flow
1.81 ± 5% +0.4 2.16 ± 3% perf-profile.children.cycles-pp.tcp_conn_request
0.04 ± 58% +0.4 0.41 perf-profile.children.cycles-pp.__ip_dev_find
1.32 ± 5% +0.4 1.70 perf-profile.children.cycles-pp.tcp_v4_syn_recv_sock
0.01 ±173% +0.4 0.40 perf-profile.children.cycles-pp.inet_lookup_ifaddr_rcu
1.56 ± 6% +0.4 1.96 perf-profile.children.cycles-pp.tcp_check_req
0.32 ± 4% +0.4 0.74 ± 2% perf-profile.children.cycles-pp.tcp_get_metrics
8.68 ± 5% +0.7 9.40 ± 2% perf-profile.children.cycles-pp.tcp_sendmsg_locked
10.06 ± 5% +0.8 10.87 ± 2% perf-profile.children.cycles-pp.sock_sendmsg
9.96 ± 5% +0.8 10.77 ± 2% perf-profile.children.cycles-pp.tcp_sendmsg
10.20 ± 5% +0.8 11.04 ± 2% perf-profile.children.cycles-pp.__x64_sys_sendto
10.17 ± 5% +0.8 11.01 ± 2% perf-profile.children.cycles-pp.__sys_sendto
4.73 ± 6% +0.9 5.62 ± 2% perf-profile.children.cycles-pp.tcp_connect
7.94 ± 5% +0.9 8.88 perf-profile.children.cycles-pp.release_sock
5.78 ± 6% +1.2 6.93 ± 2% perf-profile.children.cycles-pp.tcp_v4_connect
10.82 ± 6% +1.2 11.99 ± 2% perf-profile.children.cycles-pp.tcp_close
8.58 ± 5% +1.2 9.75 perf-profile.children.cycles-pp.__release_sock
1.02 ± 7% +1.2 2.26 perf-profile.children.cycles-pp.__inet_lookup_established
11.14 ± 6% +1.3 12.45 ± 2% perf-profile.children.cycles-pp.inet_release
11.25 ± 6% +1.3 12.58 ± 2% perf-profile.children.cycles-pp.__sock_release
11.28 ± 6% +1.3 12.61 ± 2% perf-profile.children.cycles-pp.sock_close
0.11 ± 13% +1.4 1.47 ± 2% perf-profile.children.cycles-pp.inet_ehashfn
12.97 ± 6% +1.5 14.44 ± 2% perf-profile.children.cycles-pp.exit_to_usermode_loop
12.88 ± 6% +1.5 14.36 ± 2% perf-profile.children.cycles-pp.task_work_run
12.73 ± 6% +1.5 14.20 ± 2% perf-profile.children.cycles-pp.__fput
15.74 ± 5% +1.6 17.33 ± 2% perf-profile.children.cycles-pp.tcp_write_xmit
15.75 ± 5% +1.6 17.34 ± 2% perf-profile.children.cycles-pp.__tcp_push_pending_frames
11.51 ± 5% +1.8 13.26 perf-profile.children.cycles-pp.tcp_rcv_state_process
17.92 ± 5% +2.1 19.98 ± 2% perf-profile.children.cycles-pp.tcp_v4_do_rcv
11.69 ± 5% +2.1 13.76 perf-profile.children.cycles-pp.__inet_stream_connect
11.75 ± 5% +2.1 13.82 perf-profile.children.cycles-pp.inet_stream_connect
12.07 ± 5% +2.1 14.17 perf-profile.children.cycles-pp.__x64_sys_connect
12.06 ± 5% +2.1 14.15 perf-profile.children.cycles-pp.__sys_connect
16.83 ± 5% +2.9 19.74 perf-profile.children.cycles-pp.tcp_v4_rcv
17.28 ± 5% +2.9 20.21 perf-profile.children.cycles-pp.ip_local_deliver
17.09 ± 5% +2.9 20.02 perf-profile.children.cycles-pp.ip_local_deliver_finish
17.92 ± 5% +2.9 20.86 perf-profile.children.cycles-pp.ip_rcv
18.62 ± 5% +2.9 21.56 perf-profile.children.cycles-pp.process_backlog
18.22 ± 5% +3.0 21.18 perf-profile.children.cycles-pp.__netif_receive_skb_one_core
18.86 ± 5% +3.0 21.82 perf-profile.children.cycles-pp.net_rx_action
19.42 ± 5% +3.0 22.38 perf-profile.children.cycles-pp.__local_bh_enable_ip
19.26 ± 5% +3.0 22.22 perf-profile.children.cycles-pp.do_softirq
19.16 ± 5% +3.0 22.12 perf-profile.children.cycles-pp.do_softirq_own_stack
19.76 ± 5% +3.0 22.75 perf-profile.children.cycles-pp.__softirqentry_text_start
20.74 ± 5% +3.0 23.75 perf-profile.children.cycles-pp.ip_finish_output2
21.59 ± 5% +3.0 24.61 perf-profile.children.cycles-pp.ip_output
23.61 ± 5% +3.1 26.71 perf-profile.children.cycles-pp.__tcp_transmit_skb
22.49 ± 5% +3.1 25.62 perf-profile.children.cycles-pp.__ip_queue_xmit
49.00 ± 5% +4.9 53.94 ± 2% perf-profile.children.cycles-pp.do_syscall_64
49.16 ± 5% +4.9 54.10 ± 2% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
41.20 ± 7% -5.3 35.92 ± 3% perf-profile.self.cycles-pp.intel_idle
0.20 ± 8% -0.0 0.17 ± 7% perf-profile.self.cycles-pp.fib_table_lookup
0.15 ± 5% -0.0 0.13 ± 5% perf-profile.self.cycles-pp.inet_csk_accept
0.11 ± 4% -0.0 0.09 perf-profile.self.cycles-pp.tcp_v4_do_rcv
0.11 ± 4% +0.0 0.12 ± 3% perf-profile.self.cycles-pp.tcp_update_metrics
0.05 +0.0 0.07 ± 7% perf-profile.self.cycles-pp.skb_entail
0.11 ± 6% +0.0 0.13 ± 3% perf-profile.self.cycles-pp.__inet_check_established
0.07 ± 10% +0.0 0.09 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.21 ± 6% +0.0 0.23 ± 4% perf-profile.self.cycles-pp.kmem_cache_free
0.14 ± 5% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.sock_put
0.07 ± 6% +0.0 0.09 ± 4% perf-profile.self.cycles-pp.tcp_mtup_init
0.12 ± 8% +0.0 0.15 ± 2% perf-profile.self.cycles-pp.ip_finish_output
0.08 ± 8% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.tcp_push
0.13 ± 8% +0.0 0.16 ± 2% perf-profile.self.cycles-pp.tcp_connect
0.07 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__inet_bind
0.05 ± 9% +0.0 0.08 ± 8% perf-profile.self.cycles-pp.tcp_openreq_init_rwin
0.17 ± 6% +0.0 0.20 ± 7% perf-profile.self.cycles-pp.enqueue_to_backlog
0.14 +0.0 0.17 ± 2% perf-profile.self.cycles-pp.tcp_schedule_loss_probe
0.16 ± 8% +0.0 0.19 ± 3% perf-profile.self.cycles-pp.tcp_init_buffer_space
0.20 ± 7% +0.0 0.23 ± 3% perf-profile.self.cycles-pp.__fget_light
0.11 ± 3% +0.0 0.15 ± 2% perf-profile.self.cycles-pp.tcp_close
0.27 ± 4% +0.0 0.32 ± 3% perf-profile.self.cycles-pp.__ip_queue_xmit
0.04 ± 57% +0.0 0.08 ± 5% perf-profile.self.cycles-pp.inet_twsk_kill
0.00 +0.1 0.05 perf-profile.self.cycles-pp.selinux_ipv4_output
0.13 ± 6% +0.1 0.18 ± 4% perf-profile.self.cycles-pp.tcp_parse_options
0.34 ± 5% +0.1 0.40 ± 4% perf-profile.self.cycles-pp.tcp_update_pacing_rate
0.28 ± 5% +0.1 0.35 ± 4% perf-profile.self.cycles-pp.__tcp_get_metrics
0.09 ± 9% +0.1 0.16 ± 4% perf-profile.self.cycles-pp.__inet_hash_connect
0.51 ± 2% +0.1 0.58 ± 2% perf-profile.self.cycles-pp.sel_netport_sid
0.11 ± 9% +0.1 0.20 ± 5% perf-profile.self.cycles-pp.__inet_lookup_listener
0.16 ± 11% +0.1 0.25 ± 4% perf-profile.self.cycles-pp.sk_alloc
0.17 ± 7% +0.1 0.26 ± 3% perf-profile.self.cycles-pp.sk_clone_lock
0.54 ± 7% +0.1 0.63 ± 2% perf-profile.self.cycles-pp.dst_release
0.00 +0.1 0.11 ± 6% perf-profile.self.cycles-pp.__inet_inherit_port
0.00 +0.1 0.13 ± 3% perf-profile.self.cycles-pp.inet_csk_get_port
0.17 ± 8% +0.1 0.32 perf-profile.self.cycles-pp.__sk_destruct
0.00 +0.2 0.16 perf-profile.self.cycles-pp.inet_put_port
0.00 +0.4 0.38 ± 3% perf-profile.self.cycles-pp.tcp_get_metrics
0.01 ±173% +0.4 0.40 perf-profile.self.cycles-pp.inet_lookup_ifaddr_rcu
0.11 ± 15% +1.3 1.46 ± 2% perf-profile.self.cycles-pp.inet_ehashfn
netperf.Throughput_tps
24500 +-+-----------------------------------------------------------------+
| .+.. + |
24000 +-++..+..+..+.. .+.. .+..+..+. .+.. .. |
| +...+. +. +. + |
23500 +-+ |
| |
23000 +-+ |
| O |
22500 +-+ O O O O |
O O O O O O O O O
22000 +-+ O |
| |
21500 +-+ O O O O |
| O O O O |
21000 +-+-----------------------------------------------------------------+
netperf.Throughput_total_tps
390000 +-+----------------------------------------------------------------+
385000 +-+ .+.. .+.. ..+. .+.. .+ |
|..+. +..+..+.. .+..+. +. +. +. |
380000 +-+ +. |
375000 +-+ |
370000 +-+ |
365000 +-+ |
| O |
360000 +-+O O O O O O O O O
355000 O-+ O O O |
350000 +-+ O |
345000 +-+ |
| O O O O O O |
340000 +-+ O O |
335000 +-+----------------------------------------------------------------+
netperf.workload
1.18e+08 +-+--------------------------------------------------------------+
| .+.. + |
1.16e+08 +-++..+..+..+.. .+.. .+..+..+ .+.. .. |
1.14e+08 +-+ +..+. +. +. + |
| |
1.12e+08 +-+ |
1.1e+08 +-+ |
| O |
1.08e+08 +-+ O O O O O O O
1.06e+08 O-+O O O O O |
| O |
1.04e+08 +-+ O |
1.02e+08 +-+ O O O O O |
| O O |
1e+08 +-+--------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 3 months
- 1
- 0
[sched/fair] 8c308346c4: hackbench.throughput -13.0% regression
by kernel test robot
Greeting,
FYI, we noticed a -13.0% regression of hackbench.throughput due to commit:
commit: 8c308346c4a77bb9aade6acf5299d036b61cc129 ("sched/fair: rework load_balance")
https://git.linaro.org/people/vincent.guittot/kernel.git sched/pelt
in testcase: hackbench
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:
nr_threads: 1600%
mode: threads
ipc: pipe
ucode: 0x5000021
cpufreq_governor: performance
test-description: Hackbench is both a benchmark and a stress test for the Linux kernel scheduler.
test-url: https://github.com/linux-test-project/ltp/blob/master/testcases/kernel/sc...
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/ipc/kconfig/mode/nr_threads/rootfs/tbox_group/testcase/ucode:
gcc-7/performance/pipe/x86_64-rhel-7.6/threads/1600%/debian-x86_64-2019-05-14.cgz/lkp-csl-2sp7/hackbench/0x5000021
commit:
0a1e496375 ("sched/fair: remove meaningless imbalance calculation")
8c308346c4 ("sched/fair: rework load_balance")
0a1e4963754eb1a8 8c308346c4a77bb9aade6acf529
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 75% 3:4 dmesg.WARNING:at#for_ip_swapgs_restore_regs_and_return_to_usermode/0x
%stddev %change %stddev
\ | \
531250 -13.0% 462210 ± 2% hackbench.throughput
1.589e+09 +34.3% 2.135e+09 ± 3% hackbench.time.involuntary_context_switches
4792498 -13.2% 4161353 ± 2% hackbench.time.minor_page_faults
8854 +1.0% 8940 hackbench.time.percent_of_cpu_this_job_got
48834 +1.1% 49369 hackbench.time.system_time
5512 -8.0% 5072 hackbench.time.user_time
2.474e+09 +25.9% 3.115e+09 ± 2% hackbench.time.voluntary_context_switches
3.11e+09 -13.0% 2.707e+09 ± 2% hackbench.workload
18932 ± 2% -27.2% 13773 ± 5% meminfo.max_used_kB
7.64 -0.8 6.82 mpstat.cpu.all.idle%
13761 ± 16% -19.8% 11040 ± 17% numa-meminfo.node0.Mapped
608.50 ± 6% -11.1% 541.00 ± 7% slabinfo.taskstats.active_objs
608.50 ± 6% -11.1% 541.00 ± 7% slabinfo.taskstats.num_objs
1.463e+08 ± 5% -37.7% 91153014 ± 3% cpuidle.C1.time
9.555e+08 ± 84% -91.8% 78370837 ± 49% cpuidle.C6.time
1958440 ± 90% -95.4% 90017 ± 51% cpuidle.C6.usage
82.00 +2.1% 83.75 vmstat.cpu.sy
6642135 +29.6% 8606013 ± 2% vmstat.system.cs
614163 +18.0% 724552 vmstat.system.in
2358 +1.5% 2394 turbostat.Avg_MHz
0.25 ± 5% -0.1 0.15 ± 2% turbostat.C1%
1954422 ± 90% -95.7% 84126 ± 54% turbostat.C6
1.62 ± 85% -1.5 0.12 ± 56% turbostat.C6%
8.04 -10.1% 7.22 turbostat.CPU%c1
3.917e+08 ± 2% +14.4% 4.483e+08 ± 2% turbostat.IRQ
100503 ± 3% +8.4% 108921 ± 4% softirqs.CPU10.RCU
109213 ± 2% +8.3% 118232 ± 5% softirqs.CPU16.RCU
108215 ± 2% +8.0% 116908 ± 5% softirqs.CPU17.RCU
109156 ± 2% +8.2% 118096 ± 5% softirqs.CPU18.RCU
107984 ± 2% +8.3% 116951 ± 5% softirqs.CPU22.RCU
109149 ± 2% +10.1% 120123 ± 6% softirqs.CPU64.RCU
108877 ± 2% +9.7% 119469 ± 6% softirqs.CPU65.RCU
108333 ± 2% +9.9% 119037 ± 6% softirqs.CPU66.RCU
107578 ± 2% +10.3% 118628 ± 5% softirqs.CPU67.RCU
108126 ± 2% +10.5% 119476 ± 6% softirqs.CPU70.RCU
109336 ± 3% +10.1% 120359 ± 6% softirqs.CPU71.RCU
103355 ± 4% +7.2% 110811 ± 5% softirqs.CPU73.RCU
100551 ± 9% +11.2% 111796 ± 6% softirqs.CPU77.RCU
93480 ± 5% +13.7% 106257 ± 6% softirqs.CPU90.RCU
178829 +2.1% 182598 proc-vmstat.nr_anon_pages
5052 +4.7% 5291 proc-vmstat.nr_inactive_anon
665304 +7.8% 717409 proc-vmstat.nr_kernel_stack
6420 -2.8% 6240 proc-vmstat.nr_mapped
25392 +1.2% 25708 proc-vmstat.nr_slab_reclaimable
236906 +5.8% 250552 proc-vmstat.nr_slab_unreclaimable
5052 +4.7% 5291 proc-vmstat.nr_zone_inactive_anon
1221098 -13.5% 1055957 ± 2% proc-vmstat.numa_hint_faults
1129059 -9.9% 1017325 proc-vmstat.numa_hint_faults_local
6.649e+08 -16.1% 5.577e+08 ± 2% proc-vmstat.numa_hit
6.649e+08 -16.1% 5.577e+08 ± 2% proc-vmstat.numa_local
93826 ± 17% -49.2% 47700 ± 22% proc-vmstat.numa_pages_migrated
1257498 ± 3% -12.2% 1103845 ± 3% proc-vmstat.numa_pte_updates
6.705e+08 -16.1% 5.625e+08 ± 2% proc-vmstat.pgalloc_normal
5575960 -6.0% 5242799 proc-vmstat.pgfault
6.704e+08 -16.1% 5.625e+08 ± 2% proc-vmstat.pgfree
93826 ± 17% -49.2% 47700 ± 22% proc-vmstat.pgmigrate_success
49737887 ± 2% +49.7% 74436372 ± 3% sched_debug.cfs_rq:/.min_vruntime.avg
81890729 ± 9% +64.8% 1.349e+08 ± 5% sched_debug.cfs_rq:/.min_vruntime.max
26833761 ± 21% +96.6% 52743610 ± 10% sched_debug.cfs_rq:/.min_vruntime.stddev
102.10 +10.3% 112.58 sched_debug.cfs_rq:/.removed.load_avg.max
26864023 ± 21% +96.6% 52803964 ± 10% sched_debug.cfs_rq:/.spread0.stddev
210.46 ± 6% +24.1% 261.22 ± 3% sched_debug.cfs_rq:/.util_avg.stddev
758.15 ± 12% +98.0% 1501 ± 10% sched_debug.cfs_rq:/.util_est_enqueued.avg
2470 ± 13% +71.7% 4241 ± 17% sched_debug.cfs_rq:/.util_est_enqueued.max
13.93 ± 8% +58.4% 22.06 ± 17% sched_debug.cfs_rq:/.util_est_enqueued.min
627.20 ± 13% +112.2% 1331 ± 20% sched_debug.cfs_rq:/.util_est_enqueued.stddev
458.09 ± 23% +92.3% 880.87 ± 20% sched_debug.cpu.clock.stddev
458.09 ± 23% +92.3% 880.87 ± 20% sched_debug.cpu.clock_task.stddev
0.00 ± 22% +90.4% 0.00 ± 19% sched_debug.cpu.next_balance.stddev
36.08 ± 18% +122.1% 80.14 ± 10% sched_debug.cpu.nr_running.avg
124.47 ± 17% +79.5% 223.44 ± 15% sched_debug.cpu.nr_running.max
35.17 ± 19% +123.1% 78.46 ± 17% sched_debug.cpu.nr_running.stddev
20815422 +23.8% 25764935 sched_debug.cpu.nr_switches.avg
39754924 ± 6% +24.7% 49584242 ± 2% sched_debug.cpu.nr_switches.max
13928170 ± 13% +31.3% 18290479 ± 5% sched_debug.cpu.nr_switches.stddev
29.09 ± 29% +149.9% 72.68 ± 11% sched_debug.cpu.nr_uninterruptible.avg
4.019e+10 -5.0% 3.816e+10 perf-stat.i.branch-instructions
0.82 +0.0 0.84 perf-stat.i.branch-miss-rate%
12.04 ± 2% -1.6 10.46 perf-stat.i.cache-miss-rate%
1.056e+09 ± 2% +8.9% 1.15e+09 perf-stat.i.cache-references
7745194 +14.3% 8850851 ± 2% perf-stat.i.context-switches
101054 -3.9% 97080 perf-stat.i.cpu-clock
333887 ± 13% +64.1% 548028 ± 9% perf-stat.i.cpu-migrations
0.01 ± 34% -0.0 0.01 ± 5% perf-stat.i.dTLB-load-miss-rate%
6.1e+10 -5.3% 5.775e+10 perf-stat.i.dTLB-loads
0.01 ± 30% -0.0 0.01 ± 10% perf-stat.i.dTLB-store-miss-rate%
154247 ± 12% -22.3% 119847 ± 3% perf-stat.i.dTLB-store-misses
3.581e+10 -5.5% 3.383e+10 perf-stat.i.dTLB-stores
96.60 +1.3 97.93 perf-stat.i.iTLB-load-miss-rate%
2.248e+08 -2.6% 2.188e+08 perf-stat.i.iTLB-load-misses
1124574 ± 22% -24.0% 854220 ± 14% perf-stat.i.iTLB-loads
2.042e+11 -5.2% 1.936e+11 perf-stat.i.instructions
915.54 -2.7% 890.64 perf-stat.i.instructions-per-iTLB-miss
12235 ± 11% -26.9% 8946 ± 3% perf-stat.i.minor-faults
68.92 +5.6 74.48 perf-stat.i.node-load-miss-rate%
30975325 ± 6% +19.6% 37036083 ± 5% perf-stat.i.node-load-misses
48.84 +4.4 53.24 ± 2% perf-stat.i.node-store-miss-rate%
6626829 -5.2% 6284222 ± 2% perf-stat.i.node-stores
12247 ± 11% -26.9% 8952 ± 3% perf-stat.i.page-faults
99919 -3.0% 96911 perf-stat.i.task-clock
4.40 +30.8% 5.76 ± 2% perf-stat.overall.MPKI
0.72 +0.1 0.78 perf-stat.overall.branch-miss-rate%
11.59 -1.9 9.67 perf-stat.overall.cache-miss-rate%
1.11 +7.0% 1.19 perf-stat.overall.cpi
921.45 -3.6% 888.07 perf-stat.overall.instructions-per-iTLB-miss
0.90 -6.5% 0.84 perf-stat.overall.ipc
73.24 +5.9 79.13 perf-stat.overall.node-load-miss-rate%
53.96 +5.1 59.02 ± 2% perf-stat.overall.node-store-miss-rate%
40113 +8.4% 43466 perf-stat.overall.path-length
3.99e+10 -4.8% 3.799e+10 perf-stat.ps.branch-instructions
2.861e+08 +4.0% 2.975e+08 perf-stat.ps.branch-misses
1.036e+08 +3.6% 1.073e+08 perf-stat.ps.cache-misses
8.938e+08 +24.2% 1.11e+09 perf-stat.ps.cache-references
6618392 +30.3% 8621164 ± 2% perf-stat.ps.context-switches
2.252e+11 +1.6% 2.288e+11 perf-stat.ps.cpu-cycles
260843 ± 10% +98.3% 517195 ± 9% perf-stat.ps.cpu-migrations
6.096e+10 -5.6% 5.756e+10 perf-stat.ps.dTLB-loads
3.588e+10 -6.0% 3.372e+10 perf-stat.ps.dTLB-stores
2.031e+11 -5.1% 1.928e+11 perf-stat.ps.instructions
9021 -5.5% 8528 perf-stat.ps.minor-faults
25750568 ± 3% +38.2% 35583113 ± 5% perf-stat.ps.node-load-misses
8053878 ± 3% +13.6% 9150588 ± 4% perf-stat.ps.node-store-misses
6869081 -7.6% 6346912 ± 2% perf-stat.ps.node-stores
9021 -5.5% 8528 perf-stat.ps.page-faults
1.248e+14 -5.7% 1.176e+14 perf-stat.total.instructions
91.66 -60.7 30.98 ± 43% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe
90.26 -59.5 30.78 ± 43% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe
48.41 ± 2% -30.3 18.09 ± 41% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
44.92 ± 3% -27.5 17.41 ± 40% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
36.18 ± 3% -25.9 10.29 ± 46% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
33.04 ± 2% -23.3 9.74 ± 45% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
22.06 ± 2% -0.8 21.23 ± 3% perf-profile.calltrace.cycles-pp.new_sync_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.03 ± 13% -0.7 0.31 ±101% perf-profile.calltrace.cycles-pp.cpumask_next_wrap.select_idle_sibling.select_task_rq_fair.try_to_wake_up.autoremove_wake_function
2.95 ± 13% -0.7 2.26 ± 7% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_read.ksys_read.do_syscall_64
2.79 ± 12% -0.6 2.20 ± 7% perf-profile.calltrace.cycles-pp.selinux_file_permission.security_file_permission.vfs_write.ksys_write.do_syscall_64
2.51 ± 11% -0.5 1.99 ± 9% perf-profile.calltrace.cycles-pp.copyin.copy_page_from_iter.pipe_write.new_sync_write.vfs_write
2.92 ± 10% -0.5 2.40 ± 8% perf-profile.calltrace.cycles-pp.copyout.copy_page_to_iter.pipe_read.new_sync_read.vfs_read
1.03 ± 27% -0.5 0.53 ± 67% perf-profile.calltrace.cycles-pp.switch_fpu_return.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.80 ± 14% -0.5 1.29 ± 21% perf-profile.calltrace.cycles-pp.fsnotify.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.69 ± 11% -0.5 1.20 ± 21% perf-profile.calltrace.cycles-pp.mutex_lock.pipe_read.new_sync_read.vfs_read.ksys_read
2.59 ± 11% -0.5 2.14 ± 6% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyout.copy_page_to_iter.pipe_read.new_sync_read
2.18 ± 12% -0.5 1.73 ± 7% perf-profile.calltrace.cycles-pp.copy_user_enhanced_fast_string.copyin.copy_page_from_iter.pipe_write.new_sync_write
1.77 ± 11% -0.4 1.34 ± 7% perf-profile.calltrace.cycles-pp.touch_atime.pipe_read.new_sync_read.vfs_read.ksys_read
2.19 ± 13% -0.4 1.77 ± 9% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_write.ksys_write.do_syscall_64
0.92 ± 25% -0.4 0.50 ± 66% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_wait.pipe_read
2.23 ± 12% -0.4 1.82 ± 8% perf-profile.calltrace.cycles-pp.file_has_perm.security_file_permission.vfs_read.ksys_read.do_syscall_64
1.32 ± 13% -0.4 0.90 ± 21% perf-profile.calltrace.cycles-pp.atime_needs_update.touch_atime.pipe_read.new_sync_read.vfs_read
0.71 ± 8% -0.4 0.30 ±100% perf-profile.calltrace.cycles-pp.current_time.atime_needs_update.touch_atime.pipe_read.new_sync_read
1.00 ± 11% -0.4 0.60 ± 58% perf-profile.calltrace.cycles-pp.__might_fault.copy_page_to_iter.pipe_read.new_sync_read.vfs_read
1.26 ± 16% -0.4 0.86 ± 18% perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_read.ksys_read
1.43 ± 7% -0.4 1.05 ± 11% perf-profile.calltrace.cycles-pp.file_update_time.pipe_write.new_sync_write.vfs_write.ksys_write
1.18 ± 14% -0.4 0.80 ± 19% perf-profile.calltrace.cycles-pp.__inode_security_revalidate.selinux_file_permission.security_file_permission.vfs_write.ksys_write
0.85 ± 13% -0.4 0.47 ± 58% perf-profile.calltrace.cycles-pp.__might_fault.copy_page_from_iter.pipe_write.new_sync_write.vfs_write
0.74 ± 14% -0.3 0.42 ± 58% perf-profile.calltrace.cycles-pp.__fsnotify_parent.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
1.67 ± 10% -0.3 1.36 ± 9% perf-profile.calltrace.cycles-pp.__fget_light.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.96 ± 3% -0.3 0.64 ± 12% perf-profile.calltrace.cycles-pp.__lock_text_start.__wake_up_common_lock.pipe_write.new_sync_write.vfs_write
0.74 ± 14% -0.3 0.45 ± 58% perf-profile.calltrace.cycles-pp.__fsnotify_parent.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.69 ± 13% -0.3 0.40 ± 57% perf-profile.calltrace.cycles-pp.__fsnotify_parent.security_file_permission.vfs_read.ksys_read.do_syscall_64
0.00 +0.6 0.59 ± 12% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
0.00 +0.9 0.85 ± 10% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
0.00 +0.9 0.86 ± 11% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +1.1 1.06 ± 21% perf-profile.calltrace.cycles-pp.__pthread_disable_asynccancel.start_thread
0.00 +1.1 1.06 ± 21% perf-profile.calltrace.cycles-pp.__pthread_enable_asynccancel.start_thread
0.00 +1.3 1.26 ± 12% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +1.3 1.26 ± 12% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64
0.00 +1.3 1.26 ± 12% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64
0.00 +1.3 1.27 ± 11% perf-profile.calltrace.cycles-pp.secondary_startup_64
0.00 +1.3 1.27 ± 26% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read
0.00 +1.8 1.79 ± 22% perf-profile.calltrace.cycles-pp.__fdget_pos.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write
0.00 +2.4 2.41 ± 21% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.__GI___libc_read.start_thread
0.00 +2.5 2.45 ± 20% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64.__GI___libc_write.start_thread
0.00 +20.7 20.73 ± 21% perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read
0.00 +23.0 22.98 ± 22% perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread
0.00 +24.1 24.11 ± 21% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread
0.00 +24.6 24.59 ± 21% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_read.start_thread
0.00 +25.7 25.69 ± 22% perf-profile.calltrace.cycles-pp.vfs_write.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write
0.00 +28.4 28.43 ± 21% perf-profile.calltrace.cycles-pp.__GI___libc_read.start_thread
0.00 +28.5 28.55 ± 22% perf-profile.calltrace.cycles-pp.ksys_write.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread
0.00 +30.2 30.21 ± 22% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread
0.00 +30.7 30.68 ± 22% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__GI___libc_write.start_thread
0.00 +34.5 34.46 ± 22% perf-profile.calltrace.cycles-pp.__GI___libc_write.start_thread
0.00 +65.3 65.33 ± 22% perf-profile.calltrace.cycles-pp.start_thread
91.74 -4.7 87.05 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
90.40 -4.5 85.94 perf-profile.children.cycles-pp.do_syscall_64
36.24 ± 3% -2.9 33.33 perf-profile.children.cycles-pp.ksys_read
33.20 ± 2% -2.6 30.59 perf-profile.children.cycles-pp.vfs_read
48.48 ± 2% -1.7 46.74 ± 2% perf-profile.children.cycles-pp.ksys_write
22.11 ± 2% -0.8 21.27 ± 2% perf-profile.children.cycles-pp.new_sync_read
3.86 ± 13% -0.8 3.09 ± 8% perf-profile.children.cycles-pp.___might_sleep
1.10 ± 13% -0.3 0.84 ± 10% perf-profile.children.cycles-pp.cpumask_next_wrap
1.49 ± 7% -0.2 1.26 ± 8% perf-profile.children.cycles-pp.file_update_time
0.51 ± 22% -0.2 0.34 ± 6% perf-profile.children.cycles-pp.__enqueue_entity
0.76 ± 13% -0.2 0.59 ± 8% perf-profile.children.cycles-pp.rcu_all_qs
0.43 ± 13% -0.1 0.29 ± 4% perf-profile.children.cycles-pp.__mutex_unlock_slowpath
0.48 ± 10% -0.1 0.39 ± 13% perf-profile.children.cycles-pp.timespec64_trunc
0.23 ± 14% -0.1 0.16 ± 6% perf-profile.children.cycles-pp.wake_up_q
0.12 ± 15% -0.0 0.08 ± 5% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.09 ± 17% -0.0 0.06 ± 7% perf-profile.children.cycles-pp.wake_q_add
0.11 ± 4% +0.0 0.14 ± 3% perf-profile.children.cycles-pp.task_tick_fair
0.07 ± 12% +0.0 0.09 ± 11% perf-profile.children.cycles-pp.__mark_inode_dirty
0.10 ± 8% +0.0 0.12 ± 11% perf-profile.children.cycles-pp.generic_update_time
0.07 ± 5% +0.0 0.10 ± 7% perf-profile.children.cycles-pp.__softirqentry_text_start
0.14 ± 3% +0.0 0.18 ± 2% perf-profile.children.cycles-pp.scheduler_tick
0.72 ± 2% +0.0 0.77 ± 2% perf-profile.children.cycles-pp.smp_apic_timer_interrupt
0.08 ± 8% +0.1 0.13 ± 9% perf-profile.children.cycles-pp.irq_exit
0.00 +0.1 0.05 ± 9% perf-profile.children.cycles-pp.llist_add_batch
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.mutex_spin_on_owner
0.77 ± 2% +0.1 0.84 perf-profile.children.cycles-pp.apic_timer_interrupt
0.00 +0.1 0.07 ± 33% perf-profile.children.cycles-pp.remove_entity_load_avg
0.00 +0.1 0.07 ± 24% perf-profile.children.cycles-pp.handle_mm_fault
0.00 +0.1 0.07 ± 24% perf-profile.children.cycles-pp.__handle_mm_fault
0.02 ±173% +0.1 0.10 ± 22% perf-profile.children.cycles-pp.update_cfs_rq_h_load
0.00 +0.1 0.08 ± 8% perf-profile.children.cycles-pp.menu_select
0.00 +0.1 0.08 ± 13% perf-profile.children.cycles-pp.poll_idle
0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.do_page_fault
0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.__do_page_fault
0.00 +0.1 0.09 ± 12% perf-profile.children.cycles-pp.copy_process
0.00 +0.1 0.09 ± 19% perf-profile.children.cycles-pp.page_fault
0.19 ± 11% +0.1 0.29 ± 8% perf-profile.children.cycles-pp.__mutex_lock
0.00 +0.1 0.12 ± 15% perf-profile.children.cycles-pp.__x64_sys_clone
0.00 +0.1 0.12 ± 15% perf-profile.children.cycles-pp._do_fork
0.00 +0.1 0.14 ± 17% perf-profile.children.cycles-pp.__clone
0.02 ±173% +0.2 0.19 ± 29% perf-profile.children.cycles-pp.migrate_task_rq_fair
0.00 +0.2 0.19 ± 21% perf-profile.children.cycles-pp.schedule_idle
0.02 ±173% +0.3 0.37 ± 23% perf-profile.children.cycles-pp.set_task_cpu
0.38 ± 45% +0.4 0.75 ± 21% perf-profile.children.cycles-pp.finish_task_switch
2.46 ± 7% +0.4 2.89 ± 5% perf-profile.children.cycles-pp.mutex_unlock
0.00 +0.5 0.47 ± 5% perf-profile.children.cycles-pp.remove_wait_queue
0.00 +0.5 0.48 ± 5% perf-profile.children.cycles-pp.poll_freewait
0.00 +0.5 0.53 ± 5% perf-profile.children.cycles-pp.__x64_sys_poll
0.00 +0.5 0.53 ± 5% perf-profile.children.cycles-pp.do_sys_poll
0.00 +0.5 0.54 ± 6% perf-profile.children.cycles-pp.poll
0.00 +0.6 0.59 ± 12% perf-profile.children.cycles-pp.intel_idle
0.20 ± 66% +0.6 0.82 ± 22% perf-profile.children.cycles-pp.scheduler_ipi
0.18 ± 68% +0.6 0.81 ± 22% perf-profile.children.cycles-pp.sched_ttwu_pending
0.33 ± 52% +0.7 0.99 ± 22% perf-profile.children.cycles-pp.reschedule_interrupt
0.00 +0.9 0.87 ± 10% perf-profile.children.cycles-pp.cpuidle_enter
0.00 +0.9 0.87 ± 10% perf-profile.children.cycles-pp.cpuidle_enter_state
0.60 ± 33% +1.0 1.65 ± 18% perf-profile.children.cycles-pp.update_cfs_group
0.00 +1.1 1.06 ± 21% perf-profile.children.cycles-pp.__pthread_disable_asynccancel
0.00 +1.1 1.06 ± 21% perf-profile.children.cycles-pp.__pthread_enable_asynccancel
1.60 ± 5% +1.1 2.70 ± 6% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
2.29 ± 13% +1.2 3.52 ± 14% perf-profile.children.cycles-pp.entry_SYSCALL_64
0.00 +1.3 1.26 ± 12% perf-profile.children.cycles-pp.start_secondary
0.00 +1.3 1.27 ± 11% perf-profile.children.cycles-pp.do_idle
0.00 +1.3 1.27 ± 11% perf-profile.children.cycles-pp.secondary_startup_64
0.00 +1.3 1.27 ± 11% perf-profile.children.cycles-pp.cpu_startup_entry
1.08 ± 49% +1.7 2.74 ± 18% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.00 +28.4 28.44 ± 21% perf-profile.children.cycles-pp.__GI___libc_read
0.00 +34.5 34.52 ± 22% perf-profile.children.cycles-pp.__GI___libc_write
0.00 +65.3 65.33 ± 22% perf-profile.children.cycles-pp.start_thread
3.73 ± 13% -0.8 2.98 ± 8% perf-profile.self.cycles-pp.___might_sleep
1.31 ± 7% -0.2 1.10 ± 10% perf-profile.self.cycles-pp.new_sync_read
0.51 ± 22% -0.2 0.33 ± 5% perf-profile.self.cycles-pp.__enqueue_entity
0.84 ± 16% -0.2 0.67 ± 3% perf-profile.self.cycles-pp.__inode_security_revalidate
1.11 ± 2% -0.2 0.94 ± 2% perf-profile.self.cycles-pp.__lock_text_start
0.78 ± 19% -0.2 0.62 perf-profile.self.cycles-pp.__fget_light
0.57 ± 13% -0.1 0.42 ± 9% perf-profile.self.cycles-pp.rcu_all_qs
0.63 ± 13% -0.1 0.48 ± 10% perf-profile.self.cycles-pp.cpumask_next_wrap
0.71 ± 6% -0.1 0.59 ± 4% perf-profile.self.cycles-pp.file_update_time
0.44 ± 10% -0.1 0.34 ± 13% perf-profile.self.cycles-pp.timespec64_trunc
0.41 ± 13% -0.1 0.32 ± 4% perf-profile.self.cycles-pp.rw_verify_area
0.11 ± 13% -0.0 0.08 ± 11% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.07 ± 15% -0.0 0.04 ± 58% perf-profile.self.cycles-pp.__mutex_unlock_slowpath
0.08 ± 16% -0.0 0.06 ± 9% perf-profile.self.cycles-pp.wake_q_add
0.09 ± 11% +0.0 0.11 ± 7% perf-profile.self.cycles-pp.__mutex_lock
0.07 ± 17% +0.0 0.09 ± 11% perf-profile.self.cycles-pp.__mark_inode_dirty
1.41 +0.0 1.45 perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.38 ± 4% +0.1 0.43 ± 3% perf-profile.self.cycles-pp.__wake_up_common
0.00 +0.1 0.05 ± 9% perf-profile.self.cycles-pp.llist_add_batch
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.mutex_spin_on_owner
0.00 +0.1 0.07 ± 25% perf-profile.self.cycles-pp.sched_ttwu_pending
0.10 ± 33% +0.1 0.17 ± 23% perf-profile.self.cycles-pp.cpus_share_cache
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.scheduler_ipi
0.02 ±173% +0.1 0.10 ± 22% perf-profile.self.cycles-pp.update_cfs_rq_h_load
0.00 +0.1 0.08 ± 8% perf-profile.self.cycles-pp.poll_idle
0.00 +0.1 0.12 ± 29% perf-profile.self.cycles-pp.migrate_task_rq_fair
0.00 +0.2 0.17 ± 18% perf-profile.self.cycles-pp.set_task_cpu
0.41 ± 35% +0.3 0.69 ± 23% perf-profile.self.cycles-pp.update_load_avg
2.39 ± 8% +0.4 2.81 ± 5% perf-profile.self.cycles-pp.mutex_unlock
0.00 +0.6 0.59 ± 12% perf-profile.self.cycles-pp.intel_idle
0.00 +1.0 0.98 ± 21% perf-profile.self.cycles-pp.__pthread_enable_asynccancel
0.00 +1.0 1.02 ± 20% perf-profile.self.cycles-pp.__pthread_disable_asynccancel
0.59 ± 32% +1.0 1.64 ± 18% perf-profile.self.cycles-pp.update_cfs_group
0.00 +1.3 1.26 ± 21% perf-profile.self.cycles-pp.__GI___libc_read
0.00 +1.3 1.26 ± 20% perf-profile.self.cycles-pp.__GI___libc_write
1.08 ± 49% +1.7 2.73 ± 18% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
43.75 ± 93% -93.7% 2.75 ±118% interrupts.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
9711676 ± 6% -63.1% 3586200 ± 12% interrupts.CAL:Function_call_interrupts
103912 ± 13% -63.9% 37488 ± 15% interrupts.CPU0.CAL:Function_call_interrupts
147171 ± 10% -67.9% 47272 ± 13% interrupts.CPU0.TLB:TLB_shootdowns
43.50 ± 94% -94.3% 2.50 ±131% interrupts.CPU1.37:PCI-MSI.31981570-edge.i40e-eth0-TxRx-1
103484 ± 9% -63.9% 37338 ± 5% interrupts.CPU1.CAL:Function_call_interrupts
154135 ± 9% -69.8% 46478 ± 6% interrupts.CPU1.TLB:TLB_shootdowns
102735 ± 11% -63.2% 37828 ± 12% interrupts.CPU10.CAL:Function_call_interrupts
6986 ± 4% -25.0% 5240 ± 25% interrupts.CPU10.NMI:Non-maskable_interrupts
6986 ± 4% -25.0% 5240 ± 25% interrupts.CPU10.PMI:Performance_monitoring_interrupts
155066 ± 12% -69.4% 47373 ± 10% interrupts.CPU10.TLB:TLB_shootdowns
102752 ± 12% -62.6% 38404 ± 6% interrupts.CPU11.CAL:Function_call_interrupts
7001 ± 5% -25.7% 5202 ± 24% interrupts.CPU11.NMI:Non-maskable_interrupts
7001 ± 5% -25.7% 5202 ± 24% interrupts.CPU11.PMI:Performance_monitoring_interrupts
154514 ± 14% -59.1% 63221 ± 37% interrupts.CPU11.TLB:TLB_shootdowns
104450 ± 12% -64.9% 36688 ± 9% interrupts.CPU12.CAL:Function_call_interrupts
148100 ± 9% -54.0% 68108 ± 44% interrupts.CPU12.TLB:TLB_shootdowns
102102 ± 9% -63.7% 37046 ± 11% interrupts.CPU13.CAL:Function_call_interrupts
150792 ± 13% -60.9% 58891 ± 24% interrupts.CPU13.TLB:TLB_shootdowns
102842 ± 9% -63.0% 38062 ± 9% interrupts.CPU14.CAL:Function_call_interrupts
7000 ± 5% -36.3% 4456 ± 34% interrupts.CPU14.NMI:Non-maskable_interrupts
7000 ± 5% -36.3% 4456 ± 34% interrupts.CPU14.PMI:Performance_monitoring_interrupts
151636 ± 11% -68.9% 47106 ± 9% interrupts.CPU14.TLB:TLB_shootdowns
104728 ± 12% -64.3% 37362 ± 9% interrupts.CPU15.CAL:Function_call_interrupts
6971 ± 5% -35.7% 4485 ± 34% interrupts.CPU15.NMI:Non-maskable_interrupts
6971 ± 5% -35.7% 4485 ± 34% interrupts.CPU15.PMI:Performance_monitoring_interrupts
153685 ± 13% -65.8% 52587 ± 10% interrupts.CPU15.TLB:TLB_shootdowns
102792 ± 12% -63.0% 38080 ± 11% interrupts.CPU16.CAL:Function_call_interrupts
6991 ± 5% -36.1% 4470 ± 33% interrupts.CPU16.NMI:Non-maskable_interrupts
6991 ± 5% -36.1% 4470 ± 33% interrupts.CPU16.PMI:Performance_monitoring_interrupts
149633 ± 8% -68.2% 47560 ± 11% interrupts.CPU16.TLB:TLB_shootdowns
101750 ± 10% -61.7% 38984 ± 8% interrupts.CPU17.CAL:Function_call_interrupts
6988 ± 5% -46.7% 3724 ± 35% interrupts.CPU17.NMI:Non-maskable_interrupts
6988 ± 5% -46.7% 3724 ± 35% interrupts.CPU17.PMI:Performance_monitoring_interrupts
153154 ± 13% -65.2% 53296 ± 12% interrupts.CPU17.TLB:TLB_shootdowns
103077 ± 11% -61.4% 39808 ± 15% interrupts.CPU18.CAL:Function_call_interrupts
148653 ± 9% -56.3% 64977 ± 24% interrupts.CPU18.TLB:TLB_shootdowns
100994 ± 11% -61.3% 39125 ± 11% interrupts.CPU19.CAL:Function_call_interrupts
146856 ± 9% -52.8% 69306 ± 57% interrupts.CPU19.TLB:TLB_shootdowns
103013 ± 12% -64.0% 37112 ± 9% interrupts.CPU2.CAL:Function_call_interrupts
167869 ± 25% -69.5% 51225 ± 21% interrupts.CPU2.TLB:TLB_shootdowns
102186 ± 10% -63.0% 37835 ± 7% interrupts.CPU20.CAL:Function_call_interrupts
7000 ± 5% -34.7% 4569 ± 31% interrupts.CPU20.NMI:Non-maskable_interrupts
7000 ± 5% -34.7% 4569 ± 31% interrupts.CPU20.PMI:Performance_monitoring_interrupts
145888 ± 7% -56.9% 62933 ± 46% interrupts.CPU20.TLB:TLB_shootdowns
104649 ± 13% -63.5% 38188 ± 9% interrupts.CPU21.CAL:Function_call_interrupts
6988 ± 5% -36.2% 4458 ± 33% interrupts.CPU21.NMI:Non-maskable_interrupts
6988 ± 5% -36.2% 4458 ± 33% interrupts.CPU21.PMI:Performance_monitoring_interrupts
151192 ± 11% -65.0% 52856 ± 22% interrupts.CPU21.TLB:TLB_shootdowns
104919 ± 10% -63.4% 38431 ± 14% interrupts.CPU22.CAL:Function_call_interrupts
6062 ± 23% -38.6% 3719 ± 35% interrupts.CPU22.NMI:Non-maskable_interrupts
6062 ± 23% -38.6% 3719 ± 35% interrupts.CPU22.PMI:Performance_monitoring_interrupts
149618 ± 9% -63.6% 54502 ± 24% interrupts.CPU22.TLB:TLB_shootdowns
103989 ± 11% -63.5% 37951 ± 14% interrupts.CPU23.CAL:Function_call_interrupts
147535 ± 8% -67.1% 48509 ± 11% interrupts.CPU23.TLB:TLB_shootdowns
98820 ± 8% -62.6% 36934 ± 23% interrupts.CPU24.CAL:Function_call_interrupts
144808 ± 5% -67.5% 47074 ± 20% interrupts.CPU24.TLB:TLB_shootdowns
100156 ± 9% -64.4% 35704 ± 22% interrupts.CPU25.CAL:Function_call_interrupts
145841 ± 6% -64.9% 51216 ± 31% interrupts.CPU25.TLB:TLB_shootdowns
99083 ± 9% -63.7% 35943 ± 21% interrupts.CPU26.CAL:Function_call_interrupts
144363 ± 5% -67.9% 46289 ± 19% interrupts.CPU26.TLB:TLB_shootdowns
99164 ± 12% -62.0% 37703 ± 16% interrupts.CPU27.CAL:Function_call_interrupts
144070 ± 7% -63.2% 53030 ± 31% interrupts.CPU27.TLB:TLB_shootdowns
97278 ± 11% -63.4% 35629 ± 23% interrupts.CPU28.CAL:Function_call_interrupts
146970 ± 10% -64.4% 52386 ± 30% interrupts.CPU28.TLB:TLB_shootdowns
100232 ± 13% -64.4% 35721 ± 21% interrupts.CPU29.CAL:Function_call_interrupts
144866 ± 9% -64.5% 51381 ± 31% interrupts.CPU29.TLB:TLB_shootdowns
103001 ± 12% -63.5% 37639 ± 7% interrupts.CPU3.CAL:Function_call_interrupts
154085 ± 11% -69.6% 46820 ± 7% interrupts.CPU3.TLB:TLB_shootdowns
100083 ± 10% -63.9% 36161 ± 24% interrupts.CPU30.CAL:Function_call_interrupts
5339 ± 33% -28.5% 3815 ± 34% interrupts.CPU30.NMI:Non-maskable_interrupts
5339 ± 33% -28.5% 3815 ± 34% interrupts.CPU30.PMI:Performance_monitoring_interrupts
147571 ± 6% -68.8% 46002 ± 22% interrupts.CPU30.TLB:TLB_shootdowns
98413 ± 9% -62.7% 36719 ± 23% interrupts.CPU31.CAL:Function_call_interrupts
143127 ± 4% -67.0% 47182 ± 20% interrupts.CPU31.TLB:TLB_shootdowns
96640 ± 7% -61.2% 37485 ± 22% interrupts.CPU32.CAL:Function_call_interrupts
145357 ± 6% -53.6% 67468 ± 62% interrupts.CPU32.TLB:TLB_shootdowns
102211 ± 11% -64.2% 36609 ± 22% interrupts.CPU33.CAL:Function_call_interrupts
150089 ± 6% -62.1% 56889 ± 42% interrupts.CPU33.TLB:TLB_shootdowns
97039 ± 7% -62.0% 36867 ± 24% interrupts.CPU34.CAL:Function_call_interrupts
157390 ± 12% -60.4% 62338 ± 44% interrupts.CPU34.TLB:TLB_shootdowns
97168 ± 13% -59.9% 38966 ± 19% interrupts.CPU35.CAL:Function_call_interrupts
145250 ± 8% -66.7% 48405 ± 17% interrupts.CPU35.TLB:TLB_shootdowns
101136 ± 13% -63.7% 36684 ± 21% interrupts.CPU36.CAL:Function_call_interrupts
145728 ± 6% -67.1% 47932 ± 17% interrupts.CPU36.TLB:TLB_shootdowns
101347 ± 11% -63.6% 36850 ± 25% interrupts.CPU37.CAL:Function_call_interrupts
147688 ± 6% -65.1% 51507 ± 32% interrupts.CPU37.TLB:TLB_shootdowns
100185 ± 12% -63.1% 37012 ± 21% interrupts.CPU38.CAL:Function_call_interrupts
146320 ± 7% -63.9% 52751 ± 32% interrupts.CPU38.TLB:TLB_shootdowns
99241 ± 11% -62.8% 36929 ± 26% interrupts.CPU39.CAL:Function_call_interrupts
146252 ± 6% -68.2% 46480 ± 23% interrupts.CPU39.TLB:TLB_shootdowns
105900 ± 11% -64.1% 38054 ± 11% interrupts.CPU4.CAL:Function_call_interrupts
154366 ± 12% -69.5% 47013 ± 12% interrupts.CPU4.TLB:TLB_shootdowns
97729 ± 13% -61.2% 37951 ± 19% interrupts.CPU40.CAL:Function_call_interrupts
145188 ± 5% -67.9% 46639 ± 20% interrupts.CPU40.TLB:TLB_shootdowns
98169 ± 10% -60.5% 38803 ± 25% interrupts.CPU41.CAL:Function_call_interrupts
144299 ± 6% -66.9% 47781 ± 24% interrupts.CPU41.TLB:TLB_shootdowns
97586 ± 13% -61.6% 37437 ± 21% interrupts.CPU42.CAL:Function_call_interrupts
143316 ± 7% -66.9% 47440 ± 18% interrupts.CPU42.TLB:TLB_shootdowns
98835 ± 9% -61.4% 38148 ± 23% interrupts.CPU43.CAL:Function_call_interrupts
144106 ± 5% -67.0% 47564 ± 20% interrupts.CPU43.TLB:TLB_shootdowns
100397 ± 13% -63.0% 37169 ± 23% interrupts.CPU44.CAL:Function_call_interrupts
144097 ± 7% -67.5% 46788 ± 20% interrupts.CPU44.TLB:TLB_shootdowns
99684 ± 11% -63.4% 36480 ± 21% interrupts.CPU45.CAL:Function_call_interrupts
145496 ± 4% -61.6% 55877 ± 45% interrupts.CPU45.TLB:TLB_shootdowns
100802 ± 11% -63.6% 36711 ± 20% interrupts.CPU46.CAL:Function_call_interrupts
7143 -21.7% 5590 ± 26% interrupts.CPU46.NMI:Non-maskable_interrupts
7143 -21.7% 5590 ± 26% interrupts.CPU46.PMI:Performance_monitoring_interrupts
144657 ± 5% -57.1% 62130 ± 53% interrupts.CPU46.TLB:TLB_shootdowns
100828 ± 13% -63.1% 37184 ± 23% interrupts.CPU47.CAL:Function_call_interrupts
145739 ± 7% -57.0% 62607 ± 56% interrupts.CPU47.TLB:TLB_shootdowns
103945 ± 11% -63.0% 38413 ± 10% interrupts.CPU48.CAL:Function_call_interrupts
148960 ± 9% -67.5% 48437 ± 7% interrupts.CPU48.TLB:TLB_shootdowns
102730 ± 9% -63.5% 37511 ± 7% interrupts.CPU49.CAL:Function_call_interrupts
6981 ± 5% -24.8% 5253 ± 25% interrupts.CPU49.NMI:Non-maskable_interrupts
6981 ± 5% -24.8% 5253 ± 25% interrupts.CPU49.PMI:Performance_monitoring_interrupts
148981 ± 6% -65.1% 51927 ± 17% interrupts.CPU49.TLB:TLB_shootdowns
101079 ± 11% -64.3% 36103 ± 11% interrupts.CPU5.CAL:Function_call_interrupts
149986 ± 11% -68.7% 46962 ± 9% interrupts.CPU5.TLB:TLB_shootdowns
103044 ± 12% -63.8% 37342 ± 12% interrupts.CPU50.CAL:Function_call_interrupts
7004 ± 5% -36.2% 4467 ± 33% interrupts.CPU50.NMI:Non-maskable_interrupts
7004 ± 5% -36.2% 4467 ± 33% interrupts.CPU50.PMI:Performance_monitoring_interrupts
153766 ± 11% -69.0% 47709 ± 9% interrupts.CPU50.TLB:TLB_shootdowns
101571 ± 10% -63.1% 37490 ± 7% interrupts.CPU51.CAL:Function_call_interrupts
162215 ± 21% -71.4% 46432 ± 7% interrupts.CPU51.TLB:TLB_shootdowns
103870 ± 11% -65.0% 36382 ± 7% interrupts.CPU52.CAL:Function_call_interrupts
6952 ± 5% -35.9% 4457 ± 34% interrupts.CPU52.NMI:Non-maskable_interrupts
6952 ± 5% -35.9% 4457 ± 34% interrupts.CPU52.PMI:Performance_monitoring_interrupts
147626 ± 8% -68.8% 46020 ± 6% interrupts.CPU52.TLB:TLB_shootdowns
103274 ± 10% -65.2% 35960 ± 8% interrupts.CPU53.CAL:Function_call_interrupts
146906 ± 8% -67.5% 47735 ± 10% interrupts.CPU53.TLB:TLB_shootdowns
101308 ± 12% -64.3% 36176 ± 7% interrupts.CPU54.CAL:Function_call_interrupts
179065 ± 21% -74.3% 46105 ± 7% interrupts.CPU54.TLB:TLB_shootdowns
103289 ± 9% -64.1% 37035 ± 9% interrupts.CPU55.CAL:Function_call_interrupts
159321 ± 17% -71.1% 45972 ± 9% interrupts.CPU55.TLB:TLB_shootdowns
103033 ± 11% -64.3% 36817 ± 7% interrupts.CPU56.CAL:Function_call_interrupts
156964 ± 15% -70.1% 46867 ± 9% interrupts.CPU56.TLB:TLB_shootdowns
103414 ± 14% -64.5% 36684 ± 7% interrupts.CPU57.CAL:Function_call_interrupts
6996 ± 4% -25.6% 5204 ± 24% interrupts.CPU57.NMI:Non-maskable_interrupts
6996 ± 4% -25.6% 5204 ± 24% interrupts.CPU57.PMI:Performance_monitoring_interrupts
157703 ± 16% -70.9% 45905 ± 8% interrupts.CPU57.TLB:TLB_shootdowns
103160 ± 12% -64.2% 36904 ± 8% interrupts.CPU58.CAL:Function_call_interrupts
162357 ± 19% -71.7% 45869 ± 8% interrupts.CPU58.TLB:TLB_shootdowns
100857 ± 13% -62.1% 38273 ± 7% interrupts.CPU59.CAL:Function_call_interrupts
161380 ± 18% -61.0% 62999 ± 23% interrupts.CPU59.TLB:TLB_shootdowns
102700 ± 8% -63.7% 37302 ± 11% interrupts.CPU6.CAL:Function_call_interrupts
169343 ± 19% -69.2% 52208 ± 23% interrupts.CPU6.TLB:TLB_shootdowns
102601 ± 10% -62.3% 38654 ± 9% interrupts.CPU60.CAL:Function_call_interrupts
6992 ± 5% -24.9% 5249 ± 23% interrupts.CPU60.NMI:Non-maskable_interrupts
6992 ± 5% -24.9% 5249 ± 23% interrupts.CPU60.PMI:Performance_monitoring_interrupts
148121 ± 8% -57.0% 63681 ± 23% interrupts.CPU60.TLB:TLB_shootdowns
101914 ± 10% -63.4% 37340 ± 8% interrupts.CPU61.CAL:Function_call_interrupts
152904 ± 13% -68.0% 48879 ± 8% interrupts.CPU61.TLB:TLB_shootdowns
103883 ± 9% -63.3% 38089 ± 9% interrupts.CPU62.CAL:Function_call_interrupts
6982 ± 5% -36.2% 4453 ± 33% interrupts.CPU62.NMI:Non-maskable_interrupts
6982 ± 5% -36.2% 4453 ± 33% interrupts.CPU62.PMI:Performance_monitoring_interrupts
153828 ± 12% -66.3% 51842 ± 10% interrupts.CPU62.TLB:TLB_shootdowns
101506 ± 11% -63.7% 36806 ± 3% interrupts.CPU63.CAL:Function_call_interrupts
151709 ± 13% -68.2% 48206 ± 8% interrupts.CPU63.TLB:TLB_shootdowns
103548 ± 12% -63.3% 37969 ± 9% interrupts.CPU64.CAL:Function_call_interrupts
153885 ± 13% -58.9% 63194 ± 39% interrupts.CPU64.TLB:TLB_shootdowns
100194 ± 8% -63.1% 36987 ± 11% interrupts.CPU65.CAL:Function_call_interrupts
153526 ± 13% -69.4% 46937 ± 10% interrupts.CPU65.TLB:TLB_shootdowns
103910 ± 11% -63.5% 37957 ± 13% interrupts.CPU66.CAL:Function_call_interrupts
148570 ± 7% -54.4% 67798 ± 40% interrupts.CPU66.TLB:TLB_shootdowns
100601 ± 12% -62.5% 37773 ± 13% interrupts.CPU67.CAL:Function_call_interrupts
147439 ± 10% -64.0% 53008 ± 24% interrupts.CPU67.TLB:TLB_shootdowns
100085 ± 11% -64.2% 35839 ± 11% interrupts.CPU68.CAL:Function_call_interrupts
152113 ± 12% -55.4% 67812 ± 58% interrupts.CPU68.TLB:TLB_shootdowns
102487 ± 11% -62.3% 38667 ± 10% interrupts.CPU69.CAL:Function_call_interrupts
149061 ± 7% -64.2% 53351 ± 21% interrupts.CPU69.TLB:TLB_shootdowns
104258 ± 9% -63.4% 38158 ± 9% interrupts.CPU7.CAL:Function_call_interrupts
163043 ± 12% -71.0% 47332 ± 9% interrupts.CPU7.TLB:TLB_shootdowns
104050 ± 11% -63.0% 38527 ± 15% interrupts.CPU70.CAL:Function_call_interrupts
149089 ± 9% -67.6% 48304 ± 13% interrupts.CPU70.TLB:TLB_shootdowns
106423 ± 10% -64.5% 37796 ± 17% interrupts.CPU71.CAL:Function_call_interrupts
149765 ± 8% -64.7% 52798 ± 26% interrupts.CPU71.TLB:TLB_shootdowns
99366 ± 11% -62.7% 37053 ± 22% interrupts.CPU72.CAL:Function_call_interrupts
144324 ± 6% -64.0% 51947 ± 34% interrupts.CPU72.TLB:TLB_shootdowns
102219 ± 11% -62.7% 38156 ± 24% interrupts.CPU73.CAL:Function_call_interrupts
145573 ± 6% -67.6% 47161 ± 23% interrupts.CPU73.TLB:TLB_shootdowns
98245 ± 9% -63.3% 36070 ± 23% interrupts.CPU74.CAL:Function_call_interrupts
145583 ± 6% -65.4% 50413 ± 14% interrupts.CPU74.TLB:TLB_shootdowns
95493 ± 11% -61.3% 36974 ± 23% interrupts.CPU75.CAL:Function_call_interrupts
143821 ± 6% -60.7% 56587 ± 46% interrupts.CPU75.TLB:TLB_shootdowns
99858 ± 10% -63.8% 36156 ± 22% interrupts.CPU76.CAL:Function_call_interrupts
148751 ± 10% -65.8% 50934 ± 31% interrupts.CPU76.TLB:TLB_shootdowns
100240 ± 9% -62.3% 37796 ± 23% interrupts.CPU77.CAL:Function_call_interrupts
146732 ± 7% -68.0% 47008 ± 21% interrupts.CPU77.TLB:TLB_shootdowns
99854 ± 10% -64.0% 35906 ± 21% interrupts.CPU78.CAL:Function_call_interrupts
145329 ± 6% -68.3% 46095 ± 18% interrupts.CPU78.TLB:TLB_shootdowns
100766 ± 10% -64.1% 36130 ± 21% interrupts.CPU79.CAL:Function_call_interrupts
147658 ± 8% -64.8% 51994 ± 30% interrupts.CPU79.TLB:TLB_shootdowns
100685 ± 9% -64.1% 36164 ± 9% interrupts.CPU8.CAL:Function_call_interrupts
161465 ± 17% -71.7% 45703 ± 10% interrupts.CPU8.TLB:TLB_shootdowns
97182 ± 9% -62.5% 36486 ± 18% interrupts.CPU80.CAL:Function_call_interrupts
146698 ± 8% -61.1% 57137 ± 42% interrupts.CPU80.TLB:TLB_shootdowns
97396 ± 10% -61.2% 37762 ± 24% interrupts.CPU81.CAL:Function_call_interrupts
145590 ± 6% -57.1% 62486 ± 44% interrupts.CPU81.TLB:TLB_shootdowns
100223 ± 11% -62.6% 37434 ± 25% interrupts.CPU82.CAL:Function_call_interrupts
147710 ± 9% -64.9% 51814 ± 32% interrupts.CPU82.TLB:TLB_shootdowns
97800 ± 13% -61.1% 38050 ± 25% interrupts.CPU83.CAL:Function_call_interrupts
144846 ± 8% -67.4% 47153 ± 23% interrupts.CPU83.TLB:TLB_shootdowns
99769 ± 11% -61.0% 38895 ± 19% interrupts.CPU84.CAL:Function_call_interrupts
146415 ± 5% -60.6% 57705 ± 41% interrupts.CPU84.TLB:TLB_shootdowns
97909 ± 9% -61.5% 37690 ± 26% interrupts.CPU85.CAL:Function_call_interrupts
145030 ± 5% -67.8% 46766 ± 21% interrupts.CPU85.TLB:TLB_shootdowns
98562 ± 9% -61.7% 37769 ± 21% interrupts.CPU86.CAL:Function_call_interrupts
7131 -13.8% 6149 interrupts.CPU86.NMI:Non-maskable_interrupts
7131 -13.8% 6149 interrupts.CPU86.PMI:Performance_monitoring_interrupts
145328 ± 6% -67.7% 46983 ± 21% interrupts.CPU86.TLB:TLB_shootdowns
98596 ± 11% -61.8% 37687 ± 24% interrupts.CPU87.CAL:Function_call_interrupts
142575 ± 6% -60.2% 56674 ± 44% interrupts.CPU87.TLB:TLB_shootdowns
101052 ± 12% -62.6% 37768 ± 25% interrupts.CPU88.CAL:Function_call_interrupts
146589 ± 7% -64.5% 52076 ± 35% interrupts.CPU88.TLB:TLB_shootdowns
99216 ± 11% -60.9% 38833 ± 27% interrupts.CPU89.CAL:Function_call_interrupts
143748 ± 7% -63.4% 52567 ± 35% interrupts.CPU89.TLB:TLB_shootdowns
103631 ± 10% -64.7% 36605 ± 6% interrupts.CPU9.CAL:Function_call_interrupts
167989 ± 21% -71.9% 47249 ± 10% interrupts.CPU9.TLB:TLB_shootdowns
99567 ± 13% -63.1% 36738 ± 24% interrupts.CPU90.CAL:Function_call_interrupts
7136 -14.0% 6135 interrupts.CPU90.NMI:Non-maskable_interrupts
7136 -14.0% 6135 interrupts.CPU90.PMI:Performance_monitoring_interrupts
145470 ± 6% -68.8% 45331 ± 21% interrupts.CPU90.TLB:TLB_shootdowns
103568 ± 12% -64.2% 37040 ± 25% interrupts.CPU91.CAL:Function_call_interrupts
147157 ± 6% -68.6% 46280 ± 20% interrupts.CPU91.TLB:TLB_shootdowns
98725 ± 13% -62.8% 36685 ± 23% interrupts.CPU92.CAL:Function_call_interrupts
142904 ± 7% -68.1% 45596 ± 20% interrupts.CPU92.TLB:TLB_shootdowns
99359 ± 12% -61.5% 38255 ± 22% interrupts.CPU93.CAL:Function_call_interrupts
142676 ± 6% -62.7% 53181 ± 29% interrupts.CPU93.TLB:TLB_shootdowns
101238 ± 13% -63.1% 37325 ± 22% interrupts.CPU94.CAL:Function_call_interrupts
144665 ± 7% -57.0% 62147 ± 40% interrupts.CPU94.TLB:TLB_shootdowns
102885 ± 12% -64.5% 36562 ± 26% interrupts.CPU95.CAL:Function_call_interrupts
146647 ± 5% -61.5% 56512 ± 45% interrupts.CPU95.TLB:TLB_shootdowns
2.485e+08 ± 2% +29.4% 3.215e+08 ± 3% interrupts.RES:Rescheduling_interrupts
14385468 ± 4% -65.2% 5005018 ± 12% interrupts.TLB:TLB_shootdowns
hackbench.throughput
550000 +-+----------------------------------------------------------------+
|.+.. .+..+. .+.. + .+.+..+.+..+.+.+ |
| + +.+..+.+..+.+ + + |
500000 +-+ |
| O O O
| O O O |
450000 +-+ O O |
| O |
400000 +-+ O O |
| O O O O O O O O O |
O |
350000 +-+ O O |
| |
| O O O O |
300000 +-+-------O-----------------------O--------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 3 months
- 1
- 0