[lru] b955362805: WARNING:at_include/linux/vmstat.h:#si_mem_available
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: b955362805a1e47c5a659acf7187c6d2cf226e66 ("lru: cacheline 64 bytes for each of lru lists")
https://github.com/alexshi/linux.git nextlru
in testcase: boot
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------+---------------+------------+
| | next-20201210 | b955362805 |
+-----------------------------------------------------+---------------+------------+
| boot_successes | 8 | 0 |
| boot_failures | 0 | 30 |
| WARNING:at_include/linux/vmstat.h:#si_mem_available | 0 | 30 |
| EIP:si_mem_available | 0 | 30 |
| BUG:kernel_NULL_pointer_dereference,address | 0 | 30 |
| Oops:#[##] | 0 | 30 |
| EIP:__list_add_valid | 0 | 30 |
| Kernel_panic-not_syncing:Fatal_exception | 0 | 30 |
+-----------------------------------------------------+---------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 0.232823] WARNING: CPU: 0 PID: 0 at include/linux/vmstat.h:209 si_mem_available+0x33/0xc0
[ 0.234161] Modules linked in:
[ 0.234570] CPU: 0 PID: 0 Comm: swapper Not tainted 5.10.0-rc7-next-20201210-00001-gb955362805a1 #1
[ 0.235723] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 0.236783] EIP: si_mem_available+0x33/0xc0
[ 0.237322] Code: e5 56 53 83 ec 38 eb 17 8d b4 26 00 00 00 00 8b 01 89 44 95 bc 83 fa 0e 74 1d 83 c1 04 89 d0 8d 50 01 83 e8 05 83 f8 01 77 e5 <0f> 0b 8b 01 89 44 95 bc eb e6 8d 76 00 e8 fb 1a fd ff 31 db 85 c0
[ 0.239712] EAX: 00000000 EBX: 83477100 ECX: 841f8914 EDX: 00000006
[ 0.240505] ESI: 83467f38 EDI: 00000002 EBP: 83467f08 ESP: 83467ec8
[ 0.241302] DS: 007b ES: 007b FS: 0000 GS: 00e0 SS: 0068 EFLAGS: 00210097
[ 0.242169] CR0: 80050033 CR2: ffdec000 CR3: 03b14000 CR4: 00040690
[ 0.242960] Call Trace:
[ 0.243271] ? __alloc_pages_nodemask+0x134/0x2c0
[ 0.243869] ? __alloc_pages_nodemask+0x15c/0x2c0
[ 0.244467] __rb_allocate_pages+0x24/0x1c0
[ 0.245074] rb_allocate_cpu_buffer+0x19c/0x240
[ 0.245646] __ring_buffer_alloc+0xcc/0x160
[ 0.246233] tracer_alloc_buffers+0xb7/0x2ba
[ 0.246915] early_trace_init+0x53/0x5c
[ 0.247537] start_kernel+0x1e1/0x417
[ 0.248023] ? early_idt_handler_common+0x50/0x50
[ 0.248619] i386_start_kernel+0x42/0x44
[ 0.249116] startup_32_smp+0x15f/0x170
[ 0.249621] irq event stamp: 0
[ 0.250028] hardirqs last enabled at (0): [<00000000>] 0x0
[ 0.250732] hardirqs last disabled at (0): [<00000000>] 0x0
[ 0.251440] softirqs last enabled at (0): [<00000000>] 0x0
[ 0.252156] softirqs last disabled at (0): [<00000000>] 0x0
[ 0.252883] random: get_random_bytes called from init_oops_id+0x3a/0x40 with crng_init=0
[ 0.252893] ---[ end trace 4bc0c53f48cce3f8 ]---
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc7-next-20201210-00001-gb955362805a1 .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[entry] a358d5636c: unixbench.score -1.9% regression
by kernel test robot
Greeting,
FYI, we noticed a -1.9% regression of unixbench.score due to commit:
commit: a358d5636cfcb8b278c766ac261ad99143215041 ("[PATCH] entry: split lockdep and syscall work functions")
url: https://github.com/0day-ci/linux/commits/Sven-Schnelle/entry-split-lockde...
base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git 09162bc32c880a791c6c0668ce0745cf7958f576
in testcase: will-it-scale
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:
nr_task: 16
mode: process
test: futex3
cpufreq_governor: performance
ucode: 0x5003003
test-description: Will It Scale takes a testcase and runs it from 1 through to n parallel copies to see if the testcase will scale. It builds both a process and threads based test in order to see any differences between the two.
test-url: https://github.com/antonblanchard/will-it-scale
In addition to that, the commit also has significant impact on the following tests:
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_task/rootfs/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/process/16/debian-10.4-x86_64-20200603.cgz/lkp-csl-2ap2/futex3/will-it-scale/0x5003003
commit:
v5.10-rc4
a358d5636c ("entry: split lockdep and syscall work functions")
v5.10-rc4 a358d5636cfcb8b278c766ac261
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:7 129% 9:9 stderr.Events_disabled
:7 129% 9:9 stderr.Events_enabled
:7 129% 9:9 stderr.[perf_record:Captured_and_wrote#MB/tmp/lkp/perf-sched.data(#samples)]
:7 129% 9:9 stderr.[perf_record:Woken_up#times_to_write_data]
:7 129% 9:9 stderr.has_stderr
%stddev %change %stddev
\ | \
5516 ± 4% -10.3% 4947 ± 4% boot-time.idle
291515 ± 68% -41.2% 171377 ± 4% cpuidle.POLL.time
22225 ± 62% +280.3% 84528 ± 6% numa-numastat.node1.other_node
4076 ±101% -100.0% 0.00 softirqs.CPU14.NET_RX
10586 +14.2% 12085 slabinfo.kmalloc-2k.active_objs
10704 ± 2% +14.5% 12252 slabinfo.kmalloc-2k.num_objs
4098 ± 15% +203.3% 12431 ± 5% numa-vmstat.node3.nr_active_anon
76843 ± 6% +15.0% 88374 ± 5% numa-vmstat.node3.nr_file_pages
4679 ± 23% +183.0% 13240 ± 6% numa-vmstat.node3.nr_shmem
4098 ± 15% +203.3% 12431 ± 5% numa-vmstat.node3.nr_zone_active_anon
16418 ± 15% +202.6% 49674 ± 5% numa-meminfo.node3.Active
16418 ± 15% +202.6% 49674 ± 5% numa-meminfo.node3.Active(anon)
307349 ± 6% +15.0% 353508 ± 5% numa-meminfo.node3.FilePages
697704 ± 20% +32.9% 927015 ± 13% numa-meminfo.node3.MemUsed
18690 ± 23% +183.4% 52973 ± 6% numa-meminfo.node3.Shmem
19935 ± 8% +169.7% 53758 ± 3% meminfo.Active
19935 ± 8% +169.7% 53758 ± 3% meminfo.Active(anon)
470080 +9.8% 516343 meminfo.Committed_AS
2798824 +15.1% 3220140 meminfo.Memused
31425 ± 5% +109.3% 65771 ± 3% meminfo.Shmem
11733 +27.0% 14898 meminfo.max_used_kB
4977 ± 8% +169.7% 13426 ± 3% proc-vmstat.nr_active_anon
67216 +4.0% 69896 proc-vmstat.nr_anon_pages
293542 +5.6% 310056 proc-vmstat.nr_file_pages
69999 +3.9% 72758 proc-vmstat.nr_inactive_anon
7851 ± 5% +109.3% 16436 ± 3% proc-vmstat.nr_shmem
69914 +2.5% 71683 proc-vmstat.nr_slab_unreclaimable
285726 +2.8% 293640 proc-vmstat.nr_unevictable
4977 ± 8% +169.7% 13426 ± 3% proc-vmstat.nr_zone_active_anon
69999 +3.9% 72758 proc-vmstat.nr_zone_inactive_anon
285726 +2.8% 293640 proc-vmstat.nr_zone_unevictable
989357 +25.2% 1238643 proc-vmstat.numa_hit
896081 +9.2% 978823 proc-vmstat.numa_local
93275 +178.6% 259820 proc-vmstat.numa_other
5379 ± 15% +229.0% 17697 ± 4% proc-vmstat.pgactivate
1060503 +24.6% 1321886 proc-vmstat.pgalloc_normal
1160918 +2.7% 1192221 proc-vmstat.pgfault
1177873 +20.8% 1422376 proc-vmstat.pgfree
9.075e+09 ± 36% +25.9% 1.142e+10 perf-stat.i.branch-instructions
5471478 ± 11% -20.5% 4349395 ± 6% perf-stat.i.cache-misses
1.22 ± 55% -36.0% 0.78 perf-stat.i.cpi
198.19 +1.8% 201.74 perf-stat.i.cpu-migrations
10702 ± 12% +24.4% 13314 ± 5% perf-stat.i.cycles-between-cache-misses
1.488e+10 ± 36% +24.5% 1.853e+10 perf-stat.i.dTLB-loads
1.124e+10 ± 36% +25.2% 1.408e+10 perf-stat.i.dTLB-stores
1.03 ± 36% +25.3% 1.29 perf-stat.i.ipc
0.73 ± 12% +95.6% 1.44 ± 12% perf-stat.i.major-faults
183.61 ± 36% +25.0% 229.60 perf-stat.i.metric.M/sec
3733 +2.4% 3822 perf-stat.i.minor-faults
3734 +2.4% 3823 perf-stat.i.page-faults
1.22 ± 55% -36.2% 0.78 perf-stat.overall.cpi
10582 ± 11% +23.5% 13066 ± 6% perf-stat.overall.cycles-between-cache-misses
1.03 ± 36% +25.3% 1.29 perf-stat.overall.ipc
9.044e+09 ± 36% +25.9% 1.138e+10 perf-stat.ps.branch-instructions
5452944 ± 11% -20.5% 4334998 ± 6% perf-stat.ps.cache-misses
197.71 +1.7% 201.11 perf-stat.ps.cpu-migrations
1.483e+10 ± 36% +24.5% 1.847e+10 perf-stat.ps.dTLB-loads
1.12e+10 ± 36% +25.2% 1.403e+10 perf-stat.ps.dTLB-stores
0.73 ± 12% +95.9% 1.43 ± 12% perf-stat.ps.major-faults
3720 +2.4% 3809 perf-stat.ps.minor-faults
3721 +2.4% 3810 perf-stat.ps.page-faults
21770 ± 23% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.avg
110841 ± 11% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.max
18.36 ± 18% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.min
33023 ± 14% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.stddev
0.03 ± 78% -100.0% 0.00 sched_debug.cfs_rq:/.nr_spread_over.avg
1.34 ± 28% -100.0% 0.00 sched_debug.cfs_rq:/.nr_spread_over.max
0.17 ± 49% -100.0% 0.00 sched_debug.cfs_rq:/.nr_spread_over.stddev
1670 ± 11% -100.0% 0.00 sched_debug.cpu.sched_count.avg
67230 ± 12% -100.0% 0.00 sched_debug.cpu.sched_count.max
512.85 ± 9% -100.0% 0.00 sched_debug.cpu.sched_count.min
5175 ± 10% -100.0% 0.00 sched_debug.cpu.sched_count.stddev
755.90 ± 11% -100.0% 0.00 sched_debug.cpu.sched_goidle.avg
33544 ± 12% -100.0% 0.00 sched_debug.cpu.sched_goidle.max
70.86 ± 29% -100.0% 0.00 sched_debug.cpu.sched_goidle.min
2591 ± 10% -100.0% 0.00 sched_debug.cpu.sched_goidle.stddev
734.02 ± 12% -100.0% 0.00 sched_debug.cpu.ttwu_count.avg
33982 ± 13% -100.0% 0.00 sched_debug.cpu.ttwu_count.max
181.24 ± 9% -100.0% 0.00 sched_debug.cpu.ttwu_count.min
2616 ± 10% -100.0% 0.00 sched_debug.cpu.ttwu_count.stddev
308.36 ± 15% -100.0% 0.00 sched_debug.cpu.ttwu_local.avg
3731 ±105% -100.0% 0.00 sched_debug.cpu.ttwu_local.max
176.38 ± 10% -100.0% 0.00 sched_debug.cpu.ttwu_local.min
371.08 ± 77% -100.0% 0.00 sched_debug.cpu.ttwu_local.stddev
0.00 +0.6 0.62 ± 7% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.syscall
0.00 +0.1 0.06 ± 18% perf-profile.children.cycles-pp.unwind_next_frame
0.00 +0.1 0.09 ± 13% perf-profile.children.cycles-pp.perf_callchain_kernel
0.00 +0.1 0.10 ± 13% perf-profile.children.cycles-pp.get_perf_callchain
0.00 +0.1 0.10 ± 13% perf-profile.children.cycles-pp.perf_callchain
0.00 +0.1 0.11 ± 12% perf-profile.children.cycles-pp.perf_prepare_sample
0.00 +0.1 0.11 ± 23% perf-profile.children.cycles-pp.process_simple
0.00 +0.1 0.11 ± 25% perf-profile.children.cycles-pp.perf_session__process_events
0.00 +0.1 0.11 ± 25% perf-profile.children.cycles-pp.record__finish_output
0.21 ± 39% +0.1 0.33 ± 8% perf-profile.children.cycles-pp.syscall@plt
0.00 +0.1 0.12 ± 13% perf-profile.children.cycles-pp.perf_trace_sched_stat_runtime
0.00 +0.1 0.12 ± 12% perf-profile.children.cycles-pp.perf_event_output_forward
0.00 +0.1 0.13 ± 12% perf-profile.children.cycles-pp.perf_swevent_overflow
0.00 +0.1 0.13 ± 12% perf-profile.children.cycles-pp.__perf_event_overflow
0.00 +0.1 0.13 ± 14% perf-profile.children.cycles-pp.update_curr
0.00 +0.1 0.13 ± 12% perf-profile.children.cycles-pp.perf_tp_event
0.00 +0.1 0.14 ± 24% perf-profile.children.cycles-pp.cmd_sched
0.00 +0.1 0.14 ± 24% perf-profile.children.cycles-pp.cmd_record
0.21 ± 27% +0.1 0.36 ± 17% perf-profile.children.cycles-pp.scheduler_tick
0.00 +0.1 0.15 ± 12% perf-profile.children.cycles-pp.task_tick_fair
0.00 +0.2 0.16 ± 21% perf-profile.children.cycles-pp.__libc_start_main
0.00 +0.2 0.16 ± 21% perf-profile.children.cycles-pp.main
0.00 +0.2 0.16 ± 21% perf-profile.children.cycles-pp.run_builtin
0.00 +0.6 0.62 ± 7% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
12.66 ±140% -11.4 1.22 ± 8% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
0.00 +0.6 0.62 ± 7% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
8798 ±204% -100.0% 0.00 interrupts.161:PCI-MSI.524289-edge.eth0-TxRx-0
2564 ±100% -100.0% 0.00 interrupts.162:PCI-MSI.524290-edge.eth0-TxRx-1
10781 ±172% -100.0% 0.00 interrupts.163:PCI-MSI.524291-edge.eth0-TxRx-2
7838 ±101% -100.0% 0.00 interrupts.164:PCI-MSI.524292-edge.eth0-TxRx-3
34.71 ± 31% +448.9% 190.56 ± 68% interrupts.CPU10.RES:Rescheduling_interrupts
8798 ±204% -100.0% 0.00 interrupts.CPU11.161:PCI-MSI.524289-edge.eth0-TxRx-0
2156 ± 21% -28.4% 1544 ± 20% interrupts.CPU115.CAL:Function_call_interrupts
2090 ± 17% -25.8% 1551 ± 20% interrupts.CPU116.CAL:Function_call_interrupts
2564 ±100% -100.0% 0.00 interrupts.CPU12.162:PCI-MSI.524290-edge.eth0-TxRx-1
2330 ± 40% -31.8% 1588 ± 18% interrupts.CPU123.CAL:Function_call_interrupts
2014 ± 4% -21.2% 1587 ± 19% interrupts.CPU124.CAL:Function_call_interrupts
2689 ± 42% -40.8% 1593 ± 16% interrupts.CPU125.CAL:Function_call_interrupts
2214 ± 27% -29.9% 1552 ± 19% interrupts.CPU126.CAL:Function_call_interrupts
10781 ±172% -100.0% 0.00 interrupts.CPU13.163:PCI-MSI.524291-edge.eth0-TxRx-2
7838 ±101% -100.0% 0.00 interrupts.CPU14.164:PCI-MSI.524292-edge.eth0-TxRx-3
1962 ± 9% -16.7% 1634 ± 13% interrupts.CPU144.CAL:Function_call_interrupts
1913 ± 5% -17.8% 1572 ± 19% interrupts.CPU146.CAL:Function_call_interrupts
1877 ± 3% -17.7% 1545 ± 20% interrupts.CPU151.CAL:Function_call_interrupts
2622 ± 69% -40.6% 1558 ± 20% interrupts.CPU165.CAL:Function_call_interrupts
118.43 ± 29% +332.2% 511.89 ± 24% interrupts.CPU191.NMI:Non-maskable_interrupts
118.43 ± 29% +332.2% 511.89 ± 24% interrupts.CPU191.PMI:Performance_monitoring_interrupts
2625 ± 70% -40.7% 1556 ± 19% interrupts.CPU41.CAL:Function_call_interrupts
1903 ± 4% -18.8% 1544 ± 20% interrupts.CPU45.CAL:Function_call_interrupts
1955 ± 6% -17.9% 1606 ± 20% interrupts.CPU49.CAL:Function_call_interrupts
2521 ± 40% -38.1% 1560 ± 20% interrupts.CPU75.CAL:Function_call_interrupts
147.43 ± 9% +121.8% 327.00 ± 22% interrupts.CPU95.NMI:Non-maskable_interrupts
147.43 ± 9% +121.8% 327.00 ± 22% interrupts.CPU95.PMI:Performance_monitoring_interrupts
6669 ± 35% -39.2% 4053 ± 17% interrupts.RES:Rescheduling_interrupts
will-it-scale.per_process_ops
1.04e+07 +---------------------------------------------------------------+
| +..+ +.. |
1.035e+07 |..+..+.+.. .. + .. |
| + + +..+.. |
| + +.. +.. +..|
1.03e+07 |-+ + .. .+.. .. +.. .. |
| + +. +.+ +.+ |
1.025e+07 |-+ |
| O O O O O |
1.02e+07 |-+ O O O O O O O O O O O |
| O O O O O |
| |
1.015e+07 |-+ |
| O |
1.01e+07 +---------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
***************************************************************************************************
lkp-csl-2sp4: 96 threads Intel(R) Xeon(R) CPU @ 2.30GHz with 128G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_task/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/1/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2sp4/syscall/unixbench/0x4003003
commit:
v5.10-rc4
a358d5636c ("entry: split lockdep and syscall work functions")
v5.10-rc4 a358d5636cfcb8b278c766ac261
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:9 44% 4:4 stderr.Events_disabled
:9 44% 4:4 stderr.Events_enabled
:9 44% 4:4 stderr.[perf_record:Captured_and_wrote#MB/tmp/lkp/perf-sched.data(#samples)]
:9 44% 4:4 stderr.[perf_record:Woken_up#times_to_write_data]
:9 44% 4:4 stderr.has_stderr
1:9 -10% 0:4 perf-profile.children.cycles-pp.error_entry
1:9 -9% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
1506 -1.9% 1478 unixbench.score
54357 -7.7% 50172 unixbench.time.minor_page_faults
92.23 +1.7% 93.76 unixbench.time.user_time
8.815e+08 -1.8% 8.654e+08 unixbench.workload
21.47 +3.1% 22.13 boot-time.boot
32298 ± 41% -37.1% 20310 ± 7% softirqs.CPU62.RCU
6703 ± 3% +11.1% 7448 slabinfo.kmalloc-2k.active_objs
6757 ± 3% +12.0% 7567 slabinfo.kmalloc-2k.num_objs
837.78 ± 11% +27.9% 1071 ± 5% slabinfo.mnt_cache.active_objs
837.78 ± 11% +27.9% 1071 ± 5% slabinfo.mnt_cache.num_objs
3003 ± 52% +196.2% 8895 ± 7% numa-meminfo.node1.Active
2964 ± 53% +198.2% 8839 ± 7% numa-meminfo.node1.Active(anon)
450792 ± 6% +11.8% 503916 ± 9% numa-meminfo.node1.FilePages
8176 ± 40% +87.8% 15358 ± 20% numa-meminfo.node1.Shmem
442607 ± 6% +10.4% 488571 ± 9% numa-meminfo.node1.Unevictable
6811 ± 3% +75.3% 11943 ± 5% meminfo.Active
6545 ± 4% +71.0% 11193 ± 5% meminfo.Active(anon)
265.89 ±107% +181.6% 748.75 ± 74% meminfo.Active(file)
2086104 +12.7% 2350606 meminfo.Memused
16185 +28.7% 20830 ± 3% meminfo.Shmem
5936 ± 2% +21.3% 7199 ± 2% meminfo.max_used_kB
740.67 ± 53% +198.6% 2211 ± 8% numa-vmstat.node1.nr_active_anon
112698 ± 6% +11.8% 125979 ± 9% numa-vmstat.node1.nr_file_pages
2044 ± 40% +87.9% 3840 ± 20% numa-vmstat.node1.nr_shmem
110651 ± 6% +10.4% 122142 ± 9% numa-vmstat.node1.nr_unevictable
740.67 ± 53% +198.6% 2211 ± 8% numa-vmstat.node1.nr_zone_active_anon
110651 ± 6% +10.4% 122142 ± 9% numa-vmstat.node1.nr_zone_unevictable
1770566 ± 9% -26.4% 1303772 ± 23% perf-stat.i.cache-misses
4073 ± 6% +32.6% 5402 ± 13% perf-stat.i.cycles-between-cache-misses
6.456e+08 +1.3% 6.541e+08 perf-stat.i.dTLB-stores
0.48 ± 9% +11.1% 0.53 ± 8% perf-stat.i.ipc
2903 +1.1% 2936 perf-stat.i.minor-faults
2903 +1.1% 2936 perf-stat.i.page-faults
3677 +25.2% 4604 ± 9% perf-stat.overall.cycles-between-cache-misses
1766768 ± 9% -26.4% 1301105 ± 23% perf-stat.ps.cache-misses
6.438e+08 +1.3% 6.524e+08 perf-stat.ps.dTLB-stores
2896 +1.1% 2929 perf-stat.ps.minor-faults
2897 +1.1% 2929 perf-stat.ps.page-faults
0.55 ± 38% +0.4 0.96 ± 13% perf-profile.calltrace.cycles-pp.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
1.13 ± 12% +0.6 1.74 ± 14% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe
0.14 ± 13% +0.0 0.18 ± 8% perf-profile.children.cycles-pp.call_cpuidle
0.12 ± 22% +0.1 0.18 ± 24% perf-profile.children.cycles-pp.do_user_addr_fault
0.14 ± 19% +0.1 0.20 ± 18% perf-profile.children.cycles-pp.asm_exc_page_fault
0.13 ± 22% +0.1 0.18 ± 20% perf-profile.children.cycles-pp.exc_page_fault
0.11 ± 26% +0.1 0.16 ± 22% perf-profile.children.cycles-pp.__handle_mm_fault
0.11 ± 23% +0.1 0.17 ± 22% perf-profile.children.cycles-pp.handle_mm_fault
0.77 ± 11% +0.5 1.24 ± 13% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.00 +0.6 0.60 ± 20% perf-profile.children.cycles-pp.syscall_exit_to_user_mode_prepare
1.70 ± 8% +0.8 2.51 ± 15% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
0.14 ± 15% +0.0 0.18 ± 8% perf-profile.self.cycles-pp.call_cpuidle
0.06 ± 59% +0.0 0.10 ± 27% perf-profile.self.cycles-pp.trigger_load_balance
0.63 ± 12% +0.5 1.12 ± 15% perf-profile.self.cycles-pp.exit_to_user_mode_prepare
0.00 +0.5 0.53 ± 17% perf-profile.self.cycles-pp.syscall_exit_to_user_mode_prepare
1635 ± 4% +71.0% 2795 ± 5% proc-vmstat.nr_active_anon
65.89 ±108% +183.8% 187.00 ± 74% proc-vmstat.nr_active_file
58918 +5.3% 62014 proc-vmstat.nr_anon_pages
239429 +3.9% 248685 proc-vmstat.nr_file_pages
61168 +5.0% 64234 proc-vmstat.nr_inactive_anon
8304 +2.2% 8483 proc-vmstat.nr_mapped
4045 +28.7% 5208 ± 3% proc-vmstat.nr_shmem
235310 +3.4% 243282 proc-vmstat.nr_unevictable
1635 ± 4% +71.0% 2795 ± 5% proc-vmstat.nr_zone_active_anon
65.89 ±108% +183.8% 187.00 ± 74% proc-vmstat.nr_zone_active_file
61168 +5.0% 64234 proc-vmstat.nr_zone_inactive_anon
235310 +3.4% 243282 proc-vmstat.nr_zone_unevictable
937318 +14.1% 1069639 proc-vmstat.numa_hit
906134 +8.1% 979942 proc-vmstat.numa_local
31184 +187.6% 89696 ± 5% proc-vmstat.numa_other
999.44 ± 15% +282.9% 3827 ± 3% proc-vmstat.pgactivate
996499 +13.8% 1134186 proc-vmstat.pgalloc_normal
1174226 +1.3% 1189681 proc-vmstat.pgfault
1031237 +12.2% 1157491 proc-vmstat.pgfree
625.89 ±222% -87.5% 78.25 ± 30% interrupts.CPU11.NMI:Non-maskable_interrupts
625.89 ±222% -87.5% 78.25 ± 30% interrupts.CPU11.PMI:Performance_monitoring_interrupts
24.89 ±102% +152.1% 62.75 ± 61% interrupts.CPU12.RES:Rescheduling_interrupts
337.44 ± 44% +195.5% 997.00 ± 82% interrupts.CPU36.CAL:Function_call_interrupts
363.89 ± 33% +67.4% 609.25 ± 19% interrupts.CPU38.CAL:Function_call_interrupts
408.78 ± 56% +5575.0% 23198 ±166% interrupts.CPU4.CAL:Function_call_interrupts
347.89 ± 47% +106.7% 719.25 ± 44% interrupts.CPU42.CAL:Function_call_interrupts
347.89 ± 47% +56.9% 545.75 ± 3% interrupts.CPU45.CAL:Function_call_interrupts
652.78 ±216% -87.8% 79.75 ± 42% interrupts.CPU53.NMI:Non-maskable_interrupts
652.78 ±216% -87.8% 79.75 ± 42% interrupts.CPU53.PMI:Performance_monitoring_interrupts
288.11 ±145% -67.2% 94.50 ± 27% interrupts.CPU54.NMI:Non-maskable_interrupts
288.11 ±145% -67.2% 94.50 ± 27% interrupts.CPU54.PMI:Performance_monitoring_interrupts
128.44 ± 18% -49.4% 65.00 ± 33% interrupts.CPU55.NMI:Non-maskable_interrupts
128.44 ± 18% -49.4% 65.00 ± 33% interrupts.CPU55.PMI:Performance_monitoring_interrupts
142.33 ± 14% -36.2% 90.75 ± 27% interrupts.CPU56.NMI:Non-maskable_interrupts
142.33 ± 14% -36.2% 90.75 ± 27% interrupts.CPU56.PMI:Performance_monitoring_interrupts
141.78 ± 15% -44.8% 78.25 ± 23% interrupts.CPU58.NMI:Non-maskable_interrupts
141.78 ± 15% -44.8% 78.25 ± 23% interrupts.CPU58.PMI:Performance_monitoring_interrupts
351.22 ± 47% +221.2% 1128 ± 85% interrupts.CPU81.CAL:Function_call_interrupts
363.22 ± 47% +500.0% 2179 ± 76% interrupts.CPU90.CAL:Function_call_interrupts
3295 ± 9% -35.4% 2128 ± 10% interrupts.RES:Rescheduling_interrupts
1796 ± 23% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.avg
35813 ± 23% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.max
11.90 ± 29% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.min
6114 ± 21% -100.0% 0.00 sched_debug.cfs_rq:/.exec_clock.stddev
0.04 ± 7% +11.2% 0.05 ± 9% sched_debug.cpu.nr_running.avg
2585 ± 16% -100.0% 0.00 sched_debug.cpu.sched_count.avg
56814 ± 16% -100.0% 0.00 sched_debug.cpu.sched_count.max
602.46 ± 8% -100.0% 0.00 sched_debug.cpu.sched_count.min
6511 ± 23% -100.0% 0.00 sched_debug.cpu.sched_count.stddev
1213 ± 16% -100.0% 0.00 sched_debug.cpu.sched_goidle.avg
28314 ± 16% -100.0% 0.00 sched_debug.cpu.sched_goidle.max
216.95 ± 8% -100.0% 0.00 sched_debug.cpu.sched_goidle.min
3257 ± 23% -100.0% 0.00 sched_debug.cpu.sched_goidle.stddev
1155 ± 17% -100.0% 0.00 sched_debug.cpu.ttwu_count.avg
26529 ± 21% -100.0% 0.00 sched_debug.cpu.ttwu_count.max
212.36 ± 8% -100.0% 0.00 sched_debug.cpu.ttwu_count.min
3187 ± 26% -100.0% 0.00 sched_debug.cpu.ttwu_count.stddev
535.27 ± 28% -100.0% 0.00 sched_debug.cpu.ttwu_local.avg
11898 ± 98% -100.0% 0.00 sched_debug.cpu.ttwu_local.max
210.09 ± 8% -100.0% 0.00 sched_debug.cpu.ttwu_local.min
1252 ± 91% -100.0% 0.00 sched_debug.cpu.ttwu_local.stddev
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[mtd] 19b2ce184b: WARNING:at_drivers/mtd/nand/raw/nand_base.c:#nand_scan_with_ids
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with clang-12):
commit: 19b2ce184b9f404d6620adf667a9019e6abcae51 ("mtd: nand: ecc-hamming: Stop using raw NAND structures")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: trinity
version: trinity-x86_64-af355e9-1_2019-12-03
with following parameters:
runtime: 300s
test-description: Trinity is a linux system call fuzz tester.
test-url: http://codemonkey.org.uk/projects/trinity/
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------------+------------+------------+
| | 90ccf0a019 | 19b2ce184b |
+-----------------------------------------------------------------+------------+------------+
| WARNING:at_drivers/mtd/nand/raw/nand_base.c:#nand_scan_with_ids | 0 | 16 |
| RIP:nand_scan_with_ids | 0 | 16 |
+-----------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
[ 24.075484] WARNING: CPU: 0 PID: 1 at drivers/mtd/nand/raw/nand_base.c:5856 nand_scan_with_ids+0x13c1/0x1850
[ 24.076283] Modules linked in:
[ 24.076542] CPU: 0 PID: 1 Comm: swapper/0 Not tainted 5.10.0-rc6-00016-g19b2ce184b9f #1
[ 24.077185] RIP: 0010:nand_scan_with_ids+0x13c1/0x1850
[ 24.077613] Code: 9e 98 82 31 c0 e8 8f c6 92 ff 90 0f 0b 90 90 41 bc ea ff ff ff e9 30 04 00 00 90 48 c7 c7 c5 14 a9 82 31 c0 e8 70 c6 92 ff 90 <0f> 0b 90 90 41 bc ea ff ff ff e9 11 04 00 00 48 89 df e8 38 d1 fd
[ 24.079123] RSP: 0000:ffff888100117c30 EFLAGS: 00010246
[ 24.079558] RAX: 30a3860978805c00 RBX: ffff8881493d8000 RCX: ffffffff82c51b00
[ 24.080129] RDX: c0000000ffff7fff RSI: ffffffff811996f4 RDI: ffffffff8119a021
[ 24.080703] RBP: ffff888100117ca8 R08: 0000000000000000 R09: ffffffff82d11cc0
[ 24.081292] R10: 00000000ffff7fff R11: 0000000000000000 R12: 00000000fffffff4
[ 24.081864] R13: ffffffff830d4898 R14: 0000000000000001 R15: 0000000000000001
[ 24.082455] FS: 0000000000000000(0000) GS:ffff888237c00000(0000) knlGS:0000000000000000
[ 24.083101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 24.083571] CR2: 0000000000000000 CR3: 0000000002c22000 CR4: 00000000000406f0
[ 24.084144] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 24.084720] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 24.085299] Call Trace:
[ 24.085508] ? inftl_partscan+0x2d4/0x2d4
[ 24.085837] ns_init_module+0x48f/0x8b8
[ 24.086157] ? inftl_partscan+0x2d4/0x2d4
[ 24.086495] ? inftl_partscan+0x2d4/0x2d4
[ 24.086823] do_one_initcall+0x113/0x230
[ 24.087147] ? rcu_read_lock_sched_held+0x44/0xa0
[ 24.087538] do_initcall_level+0x95/0xab
[ 24.087862] ? kernel_init+0x9/0x180
[ 24.088156] do_initcalls+0x49/0x75
[ 24.088452] do_basic_setup+0x1f/0x21
[ 24.088753] kernel_init_freeable+0x15d/0x1b3
[ 24.089109] ? rest_init+0x1f0/0x1f0
[ 24.089411] kernel_init+0x9/0x180
[ 24.089693] ret_from_fork+0x22/0x30
[ 24.089987] irq event stamp: 7045039
[ 24.090300] hardirqs last enabled at (7045049): [<ffffffff8119a021>] console_unlock+0x6f1/0x790
[ 24.091000] hardirqs last disabled at (7045056): [<ffffffff81199abb>] console_unlock+0x18b/0x790
[ 24.091708] softirqs last enabled at (7044862): [<ffffffff82000ea2>] asm_call_irq_on_stack+0x12/0x20
[ 24.092450] softirqs last disabled at (7044853): [<ffffffff82000ea2>] asm_call_irq_on_stack+0x12/0x20
[ 24.093197] ---[ end trace b33334ce9dfe4ae9 ]---
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc6-00016-g19b2ce184b9f .config
make HOSTCC=clang-12 CC=clang-12 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> job-script # job-script is attached in this email
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[locking/rwsem] 2f06f70292: vm-scalability.throughput 385.1% improvement
by kernel test robot
Greeting,
FYI, we noticed a 385.1% improvement of vm-scalability.throughput due to commit:
commit: 2f06f702925b512a95b95dca3855549c047eef58 ("locking/rwsem: Prevent potential lock starvation")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: vm-scalability
on test machine: 192 threads Intel(R) Xeon(R) Platinum 9242 CPU @ 2.30GHz with 192G memory
with following parameters:
runtime: 300s
test: small-allocs-mt
cpufreq_governor: performance
ucode: 0x5003003
test-description: The motivation behind this suite is to exercise functions and regions of the mm/ of the Linux kernel which are of interest to us.
test-url: https://git.kernel.org/cgit/linux/kernel/git/wfg/vm-scalability.git/
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase/ucode:
gcc-9/performance/x86_64-rhel-8.3/debian-10.4-x86_64-20200603.cgz/300s/lkp-csl-2ap4/small-allocs-mt/vm-scalability/0x5003003
commit:
c8fe8b0564 ("locking/rwsem: Pass the current atomic count to rwsem_down_read_slowpath()")
2f06f70292 ("locking/rwsem: Prevent potential lock starvation")
c8fe8b0564388f41 2f06f702925b512a95b95dca385
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 2% 0:4 perf-profile.children.cycles-pp.error_return
0:4 29% 1:4 perf-profile.children.cycles-pp.error_entry
:4 9% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
1270 ± 2% +386.1% 6173 ± 3% vm-scalability.median
595.12 ± 2% -584.4 10.74 ± 13% vm-scalability.stddev%
244318 ± 2% +385.1% 1185224 ± 3% vm-scalability.throughput
302.47 +2.5% 309.88 vm-scalability.time.elapsed_time
302.47 +2.5% 309.88 vm-scalability.time.elapsed_time.max
2794 ± 13% -29.5% 1969 ± 9% vm-scalability.time.involuntary_context_switches
16325540 ± 2% +384.9% 79166643 ± 3% vm-scalability.time.minor_page_faults
1684 ± 6% -52.0% 809.50 ± 25% vm-scalability.time.percent_of_cpu_this_job_got
5064 ± 6% -55.5% 2255 ± 28% vm-scalability.time.system_time
32.75 ± 2% +676.6% 254.36 vm-scalability.time.user_time
6129899 ± 2% +1215.7% 80652041 ± 3% vm-scalability.time.voluntary_context_switches
73432051 ± 2% +385.1% 3.562e+08 ± 3% vm-scalability.workload
33.55 -5.7% 31.64 ± 2% boot-time.boot
5565 -6.5% 5201 ± 2% boot-time.idle
81877350 ± 54% +124.7% 1.84e+08 ± 4% cpuidle.C1E.usage
1274888 ± 9% -67.6% 413373 ± 3% cpuidle.POLL.usage
0.88 ± 10% +0.5 1.39 ± 2% mpstat.cpu.all.irq%
0.08 ± 6% +0.0 0.10 ± 2% mpstat.cpu.all.soft%
8.76 ± 6% -3.6 5.11 ± 28% mpstat.cpu.all.sys%
0.10 ± 2% +0.5 0.63 mpstat.cpu.all.usr%
89.75 +3.1% 92.50 vmstat.cpu.id
1395256 +24.4% 1735292 vmstat.memory.cache
16.50 ± 3% -63.6% 6.00 ± 26% vmstat.procs.r
42739 ± 2% +1111.5% 517804 ± 3% vmstat.system.cs
378250 ± 3% +3.5% 391503 vmstat.system.in
160095 ± 8% +177.0% 443432 ± 3% meminfo.Active
159053 ± 8% +178.1% 442402 ± 3% meminfo.Active(anon)
1273383 +26.7% 1613270 meminfo.Cached
2228592 +12.1% 2497201 meminfo.Committed_AS
47452 ± 6% +163.3% 124931 ± 6% meminfo.Mapped
3706975 +33.2% 4939236 meminfo.Memused
71067 ± 3% +351.2% 320667 ± 5% meminfo.PageTables
459065 +148.7% 1141724 ± 3% meminfo.SUnreclaim
274717 ± 5% +123.7% 614603 ± 3% meminfo.Shmem
580430 +117.5% 1262588 ± 2% meminfo.Slab
14533 +37.8% 20021 meminfo.max_used_kB
1819 ± 12% -21.3% 1433 ± 4% slabinfo.dmaengine-unmap-16.active_objs
1819 ± 12% -21.3% 1433 ± 4% slabinfo.dmaengine-unmap-16.num_objs
46889 ± 2% +171.1% 127126 ± 4% slabinfo.kmalloc-512.active_objs
734.75 ± 2% +171.0% 1991 ± 4% slabinfo.kmalloc-512.active_slabs
47056 ± 2% +170.8% 127447 ± 4% slabinfo.kmalloc-512.num_objs
734.75 ± 2% +171.0% 1991 ± 4% slabinfo.kmalloc-512.num_slabs
9979 ± 6% -12.1% 8772 ± 9% slabinfo.task_delay_info.active_objs
9979 ± 6% -12.1% 8772 ± 9% slabinfo.task_delay_info.num_objs
836132 ± 4% +388.6% 4085102 ± 5% slabinfo.vm_area_struct.active_objs
20903 ± 4% +388.6% 102128 ± 5% slabinfo.vm_area_struct.active_slabs
836145 ± 4% +388.6% 4085150 ± 5% slabinfo.vm_area_struct.num_objs
20903 ± 4% +388.6% 102128 ± 5% slabinfo.vm_area_struct.num_slabs
3474 ± 18% +77.7% 6175 ± 10% numa-vmstat.node0.nr_mapped
4736 ± 14% +344.6% 21057 ± 18% numa-vmstat.node0.nr_page_table_pages
34864 ± 13% +125.8% 78729 ± 18% numa-vmstat.node0.nr_slab_unreclaimable
2655 ± 26% +148.6% 6600 ± 26% numa-vmstat.node1.nr_mapped
4416 ± 7% +373.4% 20907 ± 22% numa-vmstat.node1.nr_page_table_pages
25938 ± 8% +177.8% 72059 ± 15% numa-vmstat.node1.nr_slab_unreclaimable
64427 +31.5% 84738 ± 9% numa-vmstat.node2.nr_file_pages
2418 ± 7% +172.1% 6580 ± 9% numa-vmstat.node2.nr_mapped
3939 ± 13% +452.4% 21761 ± 16% numa-vmstat.node2.nr_page_table_pages
3903 ± 12% +487.2% 22923 ± 28% numa-vmstat.node2.nr_shmem
24946 ± 12% +199.3% 74658 ± 11% numa-vmstat.node2.nr_slab_unreclaimable
411481 ± 12% +36.8% 562990 ± 32% numa-vmstat.node2.numa_local
3592 ± 6% +243.4% 12337 ± 18% numa-vmstat.node3.nr_mapped
4683 ± 16% +253.9% 16575 ± 37% numa-vmstat.node3.nr_page_table_pages
46224 ± 25% +69.0% 78102 ± 27% numa-vmstat.node3.nr_shmem
39780 ± 8% +177.3% 110320 ± 3% proc-vmstat.nr_active_anon
76433 -6.7% 71321 proc-vmstat.nr_anon_pages
318685 +26.6% 403466 proc-vmstat.nr_file_pages
105287 +8.6% 114392 proc-vmstat.nr_inactive_anon
12065 ± 6% +162.7% 31701 ± 6% proc-vmstat.nr_mapped
17734 ± 4% +353.2% 80374 ± 5% proc-vmstat.nr_page_table_pages
68756 ± 5% +123.3% 153537 ± 3% proc-vmstat.nr_shmem
114763 +148.7% 285464 ± 3% proc-vmstat.nr_slab_unreclaimable
39780 ± 8% +177.3% 110320 ± 3% proc-vmstat.nr_zone_active_anon
105287 +8.6% 114392 proc-vmstat.nr_zone_inactive_anon
19756 ± 20% +434.5% 105589 ± 6% proc-vmstat.numa_hint_faults
8425 ± 79% +440.0% 45500 ± 7% proc-vmstat.numa_hint_faults_local
1462760 +33.6% 1953667 proc-vmstat.numa_hit
1202814 +40.8% 1693663 proc-vmstat.numa_local
196698 ± 3% +98.2% 389913 proc-vmstat.numa_pte_updates
94418 ± 5% +160.2% 245708 ± 4% proc-vmstat.pgactivate
1605226 +41.5% 2271576 proc-vmstat.pgalloc_normal
17615093 ± 2% +358.0% 80681973 ± 3% proc-vmstat.pgfault
1601028 +28.4% 2055930 ± 2% proc-vmstat.pgfree
13661 ± 17% +81.6% 24806 ± 11% numa-meminfo.node0.Mapped
945549 ± 11% +29.8% 1227000 ± 14% numa-meminfo.node0.MemUsed
18929 ± 15% +345.6% 84353 ± 18% numa-meminfo.node0.PageTables
139433 ± 13% +125.9% 315020 ± 18% numa-meminfo.node0.SUnreclaim
181496 ± 18% +92.8% 349907 ± 19% numa-meminfo.node0.Slab
10633 ± 25% +149.7% 26547 ± 27% numa-meminfo.node1.Mapped
855893 ± 15% +43.2% 1225970 ± 13% numa-meminfo.node1.MemUsed
17645 ± 7% +374.6% 83749 ± 23% numa-meminfo.node1.PageTables
103731 ± 8% +178.0% 288333 ± 15% numa-meminfo.node1.SUnreclaim
132718 ± 14% +142.4% 321698 ± 14% numa-meminfo.node1.Slab
257732 +31.5% 338901 ± 9% numa-meminfo.node2.FilePages
9545 ± 6% +177.8% 26522 ± 9% numa-meminfo.node2.Mapped
822556 ± 5% +42.3% 1170402 ± 8% numa-meminfo.node2.MemUsed
15737 ± 13% +453.8% 87154 ± 16% numa-meminfo.node2.PageTables
99753 ± 12% +199.5% 298733 ± 11% numa-meminfo.node2.SUnreclaim
15639 ± 12% +486.0% 91645 ± 28% numa-meminfo.node2.Shmem
117075 ± 11% +176.9% 324165 ± 8% numa-meminfo.node2.Slab
13738 ± 8% +260.9% 49579 ± 18% numa-meminfo.node3.Mapped
18716 ± 16% +254.4% 66331 ± 37% numa-meminfo.node3.PageTables
184851 ± 25% +68.8% 312075 ± 27% numa-meminfo.node3.Shmem
5400 ± 23% +48.3% 8006 ± 4% sched_debug.cfs_rq:/.load.avg
120624 ± 44% +119.5% 264763 ± 37% sched_debug.cfs_rq:/.load.max
20671 ± 18% +87.1% 38682 ± 16% sched_debug.cfs_rq:/.load.stddev
11.26 ±101% -67.6% 3.65 ± 14% sched_debug.cfs_rq:/.load_avg.avg
254570 ± 11% -73.2% 68331 ± 22% sched_debug.cfs_rq:/.min_vruntime.avg
328095 ± 8% -64.6% 116031 ± 21% sched_debug.cfs_rq:/.min_vruntime.max
174260 ± 13% -72.6% 47761 ± 29% sched_debug.cfs_rq:/.min_vruntime.min
30101 ± 26% -67.4% 9801 ± 56% sched_debug.cfs_rq:/.min_vruntime.stddev
0.07 ± 20% -29.9% 0.05 ± 24% sched_debug.cfs_rq:/.nr_running.avg
77.55 ± 9% -45.8% 42.01 ± 15% sched_debug.cfs_rq:/.runnable_avg.avg
777.60 ± 4% -9.9% 700.54 ± 2% sched_debug.cfs_rq:/.runnable_avg.max
151.29 -49.9% 75.85 ± 5% sched_debug.cfs_rq:/.runnable_avg.stddev
60350 ± 10% -98.3% 1050 ±909% sched_debug.cfs_rq:/.spread0.avg
133886 ± 6% -63.6% 48756 ± 9% sched_debug.cfs_rq:/.spread0.max
30097 ± 26% -67.4% 9801 ± 56% sched_debug.cfs_rq:/.spread0.stddev
77.51 ± 9% -45.9% 41.96 ± 15% sched_debug.cfs_rq:/.util_avg.avg
777.55 ± 4% -10.1% 699.00 ± 2% sched_debug.cfs_rq:/.util_avg.max
151.24 -49.9% 75.77 ± 5% sched_debug.cfs_rq:/.util_avg.stddev
10.02 ± 22% -67.8% 3.22 ± 24% sched_debug.cfs_rq:/.util_est_enqueued.avg
532.40 ± 11% -49.6% 268.58 ± 9% sched_debug.cfs_rq:/.util_est_enqueued.max
57.42 ± 12% -60.3% 22.78 ± 7% sched_debug.cfs_rq:/.util_est_enqueued.stddev
887243 -24.1% 673329 ± 2% sched_debug.cpu.avg_idle.avg
17254 ± 67% +542.7% 110888 ± 24% sched_debug.cpu.avg_idle.min
198232 ± 7% -19.9% 158800 ± 14% sched_debug.cpu.avg_idle.stddev
0.00 ± 15% -25.4% 0.00 ± 10% sched_debug.cpu.next_balance.stddev
0.07 ± 16% -29.0% 0.05 ± 23% sched_debug.cpu.nr_running.avg
28419 ± 4% +1326.2% 405307 ± 11% sched_debug.cpu.nr_switches.avg
44802 ± 8% +1006.0% 495514 ± 19% sched_debug.cpu.nr_switches.max
19592 ± 4% +1273.1% 269028 ± 31% sched_debug.cpu.nr_switches.min
4396 ± 34% +1593.2% 74447 ± 92% sched_debug.cpu.nr_switches.stddev
0.01 ± 9% -26.1% 0.01 ± 5% perf-sched.sch_delay.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
0.01 ± 11% +33.3% 0.01 ± 15% perf-sched.sch_delay.avg.ms.do_nanosleep.hrtimer_nanosleep.__x64_sys_nanosleep.do_syscall_64
0.01 ± 20% +40.9% 0.01 ± 10% perf-sched.sch_delay.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
0.01 ± 11% -100.0% 0.00 perf-sched.sch_delay.avg.ms.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
0.01 +70.0% 0.01 ± 10% perf-sched.sch_delay.avg.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
0.01 ± 9% +25.7% 0.01 ± 6% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.ep_poll.do_epoll_wait.__x64_sys_epoll_wait
0.00 ± 47% -100.0% 0.00 perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
0.01 +20.0% 0.01 perf-sched.sch_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork
0.01 ± 20% -30.2% 0.01 ± 4% perf-sched.sch_delay.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
0.01 ± 16% +61.3% 0.01 ± 3% perf-sched.sch_delay.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
7.06 ± 61% -100.0% 0.00 perf-sched.sch_delay.max.ms.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
4.15 ± 57% +64.7% 6.83 ± 14% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
12.99 ± 9% -69.4% 3.97 ± 4% perf-sched.total_wait_and_delay.average.ms
446342 ± 9% +230.9% 1476918 ± 4% perf-sched.total_wait_and_delay.count.ms
12.98 ± 9% -69.5% 3.96 ± 4% perf-sched.total_wait_time.average.ms
55.23 ± 55% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
4.98 ± 11% -100.0% 0.00 perf-sched.wait_and_delay.avg.ms.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
2.32 ± 10% -41.2% 1.36 ± 4% perf-sched.wait_and_delay.avg.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
226.67 ± 48% -82.8% 39.00 ± 4% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
9.75 ± 15% -100.0% 0.00 perf-sched.wait_and_delay.count.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
328127 ± 11% -100.0% 0.00 perf-sched.wait_and_delay.count.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
105951 ± 8% +73.4% 183678 ± 4% perf-sched.wait_and_delay.count.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
93.00 ± 40% +345.2% 414.00 ± 4% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
232.31 ± 24% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
306.39 ± 10% -100.0% 0.00 perf-sched.wait_and_delay.max.ms.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
301.07 ± 8% -97.7% 6.83 ± 14% perf-sched.wait_and_delay.max.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
1.36 ± 7% -13.1% 1.18 ± 3% perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
1.37 ± 7% -13.3% 1.19 ± 3% perf-sched.wait_time.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
0.95 ± 20% +49.4% 1.43 ± 13% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_exc_page_fault.[unknown]
0.82 ± 30% +43.6% 1.17 ± 10% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
55.22 ± 55% -95.8% 2.32 ± 48% perf-sched.wait_time.avg.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
4.98 ± 11% -100.0% 0.00 perf-sched.wait_time.avg.ms.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
2.31 ± 10% -41.4% 1.35 ± 4% perf-sched.wait_time.avg.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
226.67 ± 48% -82.8% 39.00 ± 4% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.poll_schedule_timeout.constprop.0.do_sys_poll
5.20 ± 31% -57.5% 2.21 ± 20% perf-sched.wait_time.avg.ms.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg.__sys_recvfrom
6.68 ± 9% +90.5% 12.72 ± 21% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_kthread.kthread.ret_from_fork
2.72 ± 7% -13.1% 2.36 ± 3% perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
2.74 ± 7% -13.3% 2.38 ± 3% perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read
1.24 ± 10% +74.7% 2.16 ± 15% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt.[unknown]
232.29 ± 24% -94.6% 12.46 ±133% perf-sched.wait_time.max.ms.exit_to_user_mode_prepare.syscall_exit_to_user_mode.entry_SYSCALL_64_after_hwframe.[unknown]
306.38 ± 10% -100.0% 0.00 perf-sched.wait_time.max.ms.rwsem_down_read_slowpath.isra.0.do_user_addr_fault.exc_page_fault
301.05 ± 8% -98.8% 3.60 ± 9% perf-sched.wait_time.max.ms.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
5.20 ± 31% -57.5% 2.21 ± 20% perf-sched.wait_time.max.ms.schedule_timeout.__skb_wait_for_more_packets.unix_dgram_recvmsg.__sys_recvfrom
2.15 ± 38% +245.0% 7.41 ± 6% perf-stat.i.MPKI
3.902e+09 ± 4% -40.5% 2.322e+09 ± 4% perf-stat.i.branch-instructions
0.30 ± 26% +0.4 0.73 ± 4% perf-stat.i.branch-miss-rate%
11088155 ± 18% +59.1% 17646179 perf-stat.i.branch-misses
27.79 ± 23% +10.4 38.24 ± 3% perf-stat.i.cache-miss-rate%
8670461 ± 5% +178.2% 24123210 ± 8% perf-stat.i.cache-misses
34209769 ± 28% +89.4% 64777142 ± 8% perf-stat.i.cache-references
43061 ± 2% +1116.5% 523820 ± 3% perf-stat.i.context-switches
3.55 -25.1% 2.66 ± 14% perf-stat.i.cpi
6.388e+10 ± 6% -63.5% 2.331e+10 ± 18% perf-stat.i.cpu-cycles
7612 -87.0% 990.85 ± 20% perf-stat.i.cycles-between-cache-misses
0.02 ± 74% +0.1 0.08 ± 8% perf-stat.i.dTLB-load-miss-rate%
630696 ± 62% +231.7% 2091983 ± 7% perf-stat.i.dTLB-load-misses
4.643e+09 ± 5% -46.6% 2.477e+09 ± 4% perf-stat.i.dTLB-loads
107074 ± 44% +203.1% 324513 ± 3% perf-stat.i.dTLB-store-misses
4.165e+08 +96.0% 8.162e+08 ± 2% perf-stat.i.dTLB-stores
4198252 ± 7% +73.2% 7269429 ± 4% perf-stat.i.iTLB-load-misses
3667116 ± 5% +85.4% 6797954 ± 2% perf-stat.i.iTLB-loads
1.795e+10 ± 5% -50.7% 8.845e+09 ± 4% perf-stat.i.instructions
4328 ± 2% -72.0% 1213 ± 6% perf-stat.i.instructions-per-iTLB-miss
0.28 +38.5% 0.39 ± 13% perf-stat.i.ipc
0.33 ± 6% -63.5% 0.12 ± 18% perf-stat.i.metric.GHz
2.01 ± 2% -84.7% 0.31 ± 11% perf-stat.i.metric.K/sec
46.88 ± 4% -36.7% 29.70 ± 4% perf-stat.i.metric.M/sec
58055 ± 2% +349.0% 260670 ± 3% perf-stat.i.minor-faults
92.97 +2.4 95.41 perf-stat.i.node-load-miss-rate%
2120153 ± 3% +365.6% 9871040 ± 3% perf-stat.i.node-load-misses
189417 ± 4% +172.6% 516379 ± 7% perf-stat.i.node-loads
753850 +382.9% 3640602 ± 4% perf-stat.i.node-store-misses
33427 ± 17% +129.1% 76567 ± 13% perf-stat.i.node-stores
58057 ± 2% +349.0% 260672 ± 3% perf-stat.i.page-faults
1.94 ± 35% +277.2% 7.33 ± 6% perf-stat.overall.MPKI
0.29 ± 24% +0.5 0.76 ± 4% perf-stat.overall.branch-miss-rate%
27.25 ± 24% +10.0 37.22 ± 3% perf-stat.overall.cache-miss-rate%
3.56 -26.3% 2.62 ± 14% perf-stat.overall.cpi
7359 -86.7% 976.00 ± 21% perf-stat.overall.cycles-between-cache-misses
0.01 ± 69% +0.1 0.08 ± 8% perf-stat.overall.dTLB-load-miss-rate%
4284 ± 2% -71.5% 1219 ± 6% perf-stat.overall.instructions-per-iTLB-miss
0.28 +38.5% 0.39 ± 14% perf-stat.overall.ipc
91.79 +3.2 95.02 perf-stat.overall.node-load-miss-rate%
95.75 +2.2 97.94 perf-stat.overall.node-store-miss-rate%
74055 ± 5% -89.6% 7694 ± 3% perf-stat.overall.path-length
3.889e+09 ± 4% -40.6% 2.31e+09 ± 4% perf-stat.ps.branch-instructions
11075294 ± 18% +58.6% 17562399 perf-stat.ps.branch-misses
8644500 ± 5% +177.7% 24004988 ± 8% perf-stat.ps.cache-misses
34116591 ± 28% +89.0% 64488065 ± 8% perf-stat.ps.cache-references
42910 ± 2% +1112.9% 520450 ± 3% perf-stat.ps.context-switches
6.365e+10 ± 6% -63.5% 2.321e+10 ± 18% perf-stat.ps.cpu-cycles
629001 ± 62% +230.6% 2079558 ± 7% perf-stat.ps.dTLB-load-misses
4.627e+09 ± 5% -46.7% 2.465e+09 ± 4% perf-stat.ps.dTLB-loads
106777 ± 44% +202.1% 322591 ± 3% perf-stat.ps.dTLB-store-misses
4.153e+08 +95.7% 8.126e+08 ± 2% perf-stat.ps.dTLB-stores
4183842 ± 7% +72.9% 7234466 ± 4% perf-stat.ps.iTLB-load-misses
3654597 ± 5% +85.1% 6764775 ± 2% perf-stat.ps.iTLB-loads
1.789e+10 ± 5% -50.8% 8.802e+09 ± 4% perf-stat.ps.instructions
57856 ± 2% +347.7% 259003 ± 3% perf-stat.ps.minor-faults
2114573 ± 3% +364.4% 9820829 ± 3% perf-stat.ps.node-load-misses
189140 ± 4% +172.7% 515878 ± 7% perf-stat.ps.node-loads
751475 +381.4% 3617788 ± 4% perf-stat.ps.node-store-misses
33331 ± 17% +128.7% 76237 ± 13% perf-stat.ps.node-stores
57857 ± 2% +347.7% 259004 ± 3% perf-stat.ps.page-faults
5.435e+12 ± 5% -49.6% 2.741e+12 ± 4% perf-stat.total.instructions
58.22 -58.2 0.00 perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
54.47 -54.5 0.00 perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
59.24 -40.5 18.71 ± 30% perf-profile.calltrace.cycles-pp.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
59.57 -38.3 21.23 ± 26% perf-profile.calltrace.cycles-pp.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
59.57 -38.3 21.26 ± 26% perf-profile.calltrace.cycles-pp.exc_page_fault.asm_exc_page_fault.do_access
59.61 -37.5 22.12 ± 23% perf-profile.calltrace.cycles-pp.asm_exc_page_fault.do_access
59.72 -36.4 23.29 ± 22% perf-profile.calltrace.cycles-pp.do_access
3.78 ± 10% -2.2 1.54 ± 13% perf-profile.calltrace.cycles-pp.osq_lock.rwsem_optimistic_spin.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff
3.92 ± 10% -2.1 1.86 ± 12% perf-profile.calltrace.cycles-pp.rwsem_optimistic_spin.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
0.68 ± 8% +0.4 1.04 ± 16% perf-profile.calltrace.cycles-pp.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.13 ±173% +0.6 0.69 ± 14% perf-profile.calltrace.cycles-pp.timekeeping_max_deferment.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle
0.29 ±100% +0.6 0.86 ± 15% perf-profile.calltrace.cycles-pp.__softirqentry_text_start.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt
0.29 ±100% +0.6 0.87 ± 15% perf-profile.calltrace.cycles-pp.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
0.29 ±100% +0.6 0.87 ± 16% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.do_softirq_own_stack.irq_exit_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.69 ± 8% +0.6 1.26 ± 12% perf-profile.calltrace.cycles-pp.tick_nohz_next_event.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry
0.00 +0.6 0.62 ± 7% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault
0.00 +0.6 0.63 ± 18% perf-profile.calltrace.cycles-pp.ttwu_queue_wakelist.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff
0.00 +0.6 0.64 ± 18% perf-profile.calltrace.cycles-pp.mmap_region.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
0.00 +0.7 0.65 ± 19% perf-profile.calltrace.cycles-pp.rwsem_mark_wake.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
0.00 +0.7 0.68 ± 14% perf-profile.calltrace.cycles-pp.update_cfs_rq_h_load.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake
0.00 +0.7 0.69 ± 16% perf-profile.calltrace.cycles-pp.dequeue_entity.dequeue_task_fair.__schedule.schedule.rwsem_down_read_slowpath
0.00 +0.7 0.70 ± 16% perf-profile.calltrace.cycles-pp.irq_enter_rcu.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.65 ± 20% +0.7 1.36 ± 14% perf-profile.calltrace.cycles-pp.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.7 0.73 ± 12% perf-profile.calltrace.cycles-pp.enqueue_entity.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_from_idle
0.00 +0.8 0.76 ± 14% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault
0.75 ± 7% +0.8 1.55 ± 14% perf-profile.calltrace.cycles-pp.tick_nohz_get_sleep_length.menu_select.do_idle.cpu_startup_entry.start_secondary
0.62 ± 13% +0.8 1.43 ± 19% perf-profile.calltrace.cycles-pp.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.17 ±173% +0.8 1.00 ± 14% perf-profile.calltrace.cycles-pp.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
0.18 ±173% +0.9 1.04 ± 14% perf-profile.calltrace.cycles-pp.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt
0.00 +0.9 0.87 ± 11% perf-profile.calltrace.cycles-pp.__handle_mm_fault.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
0.16 ±173% +0.9 1.06 ± 19% perf-profile.calltrace.cycles-pp.ktime_get.clockevents_program_event.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack
0.00 +0.9 0.91 ± 10% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +0.9 0.94 ± 10% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +1.0 0.95 ± 16% perf-profile.calltrace.cycles-pp.select_task_rq_fair.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff
0.00 +1.0 0.96 ± 14% perf-profile.calltrace.cycles-pp.enqueue_task_fair.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle
0.00 +1.0 0.97 ± 14% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry
0.00 +1.0 1.02 ± 8% perf-profile.calltrace.cycles-pp.handle_mm_fault.do_user_addr_fault.exc_page_fault.asm_exc_page_fault.do_access
0.00 +1.0 1.05 ± 15% perf-profile.calltrace.cycles-pp.do_mmap.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.93 ± 20% +1.1 2.02 ± 16% perf-profile.calltrace.cycles-pp.__hrtimer_run_queues.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt
0.00 +1.4 1.44 ± 13% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff
0.00 +1.4 1.44 ± 16% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry.start_secondary
0.00 +1.5 1.49 ± 13% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_write_slowpath.down_write_killable.vm_mmap_pgoff.ksys_mmap_pgoff
0.00 +1.7 1.73 ± 16% perf-profile.calltrace.cycles-pp.flush_smp_call_function_from_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
0.00 +2.3 2.27 ± 9% perf-profile.calltrace.cycles-pp.__schedule.schedule.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
0.00 +2.3 2.29 ± 9% perf-profile.calltrace.cycles-pp.schedule.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
1.81 ± 16% +2.3 4.15 ± 18% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt
0.00 +2.4 2.39 ± 16% perf-profile.calltrace.cycles-pp.try_to_wake_up.wake_up_q.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff
1.83 ± 16% +2.4 4.23 ± 18% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.84 ± 16% +2.4 4.25 ± 18% perf-profile.calltrace.cycles-pp.asm_call_sysvec_on_stack.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.00 +2.4 2.44 ± 16% perf-profile.calltrace.cycles-pp.wake_up_q.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64
0.00 +3.1 3.10 ± 16% perf-profile.calltrace.cycles-pp.rwsem_wake.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe
4.80 ± 5% +3.1 7.93 ± 17% perf-profile.calltrace.cycles-pp.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
3.13 ± 12% +3.4 6.53 ± 17% perf-profile.calltrace.cycles-pp.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter.do_idle
0.00 +4.1 4.11 ± 16% perf-profile.calltrace.cycles-pp.do_rw_once
0.00 +8.2 8.21 ± 9% perf-profile.calltrace.cycles-pp.vm_mmap_pgoff.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.__mmap
0.00 +8.3 8.27 ± 9% perf-profile.calltrace.cycles-pp.ksys_mmap_pgoff.do_syscall_64.entry_SYSCALL_64_after_hwframe.__mmap
0.00 +8.3 8.28 ± 9% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__mmap
0.00 +8.3 8.30 ± 9% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__mmap
0.00 +8.4 8.44 ± 9% perf-profile.calltrace.cycles-pp.__mmap
0.13 ±173% +14.6 14.70 ± 40% perf-profile.calltrace.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault
0.27 ±100% +14.6 14.91 ± 39% perf-profile.calltrace.cycles-pp._raw_spin_lock_irq.rwsem_down_read_slowpath.do_user_addr_fault.exc_page_fault.asm_exc_page_fault
24.61 ± 2% +23.1 47.70 ± 2% perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry
30.68 +25.9 56.54 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
29.85 ± 2% +26.0 55.86 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.do_idle.cpu_startup_entry.start_secondary
35.35 +28.6 63.91 ± 5% perf-profile.calltrace.cycles-pp.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
35.35 +28.6 63.94 ± 5% perf-profile.calltrace.cycles-pp.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
35.35 +28.6 63.94 ± 5% perf-profile.calltrace.cycles-pp.start_secondary.secondary_startup_64_no_verify
35.55 +28.8 64.33 ± 5% perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
62.44 -60.5 1.90 ± 11% perf-profile.children.cycles-pp.rwsem_optimistic_spin
58.27 -56.7 1.56 ± 13% perf-profile.children.cycles-pp.osq_lock
59.24 -40.5 18.73 ± 30% perf-profile.children.cycles-pp.rwsem_down_read_slowpath
59.59 -38.3 21.27 ± 26% perf-profile.children.cycles-pp.do_user_addr_fault
59.59 -38.3 21.30 ± 26% perf-profile.children.cycles-pp.exc_page_fault
59.64 -37.7 21.98 ± 25% perf-profile.children.cycles-pp.asm_exc_page_fault
59.86 -35.0 24.88 ± 20% perf-profile.children.cycles-pp.do_access
0.74 ± 10% -0.6 0.11 ± 12% perf-profile.children.cycles-pp.rwsem_spin_on_owner
0.14 ± 8% -0.1 0.06 ± 14% perf-profile.children.cycles-pp.task_tick_fair
0.08 ± 13% +0.0 0.12 ± 18% perf-profile.children.cycles-pp.arch_cpu_idle_enter
0.08 ± 15% +0.0 0.12 ± 18% perf-profile.children.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.trigger_load_balance
0.01 ±173% +0.1 0.07 ± 17% perf-profile.children.cycles-pp.timerqueue_del
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.idle_cpu
0.00 +0.1 0.06 ± 11% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.00 +0.1 0.06 ± 13% perf-profile.children.cycles-pp.copy_fpregs_to_fpstate
0.00 +0.1 0.06 ± 20% perf-profile.children.cycles-pp.get_cpu_device
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.select_idle_sibling
0.06 ± 20% +0.1 0.13 ± 17% perf-profile.children.cycles-pp.__intel_pmu_enable_all
0.00 +0.1 0.07 ± 16% perf-profile.children.cycles-pp.timerqueue_add
0.01 ±173% +0.1 0.08 ± 19% perf-profile.children.cycles-pp.__remove_hrtimer
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.__wrgsbase_inactive
0.00 +0.1 0.07 ± 11% perf-profile.children.cycles-pp.vm_area_alloc
0.00 +0.1 0.07 ± 26% perf-profile.children.cycles-pp.wake_q_add
0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.enqueue_hrtimer
0.05 ± 67% +0.1 0.12 ± 14% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.menu_reflect
0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.ret_from_fork
0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.kthread
0.00 +0.1 0.08 ± 22% perf-profile.children.cycles-pp.run_local_timers
0.00 +0.1 0.08 ± 23% perf-profile.children.cycles-pp.io_serial_in
0.00 +0.1 0.08 ± 21% perf-profile.children.cycles-pp.reweight_entity
0.00 +0.1 0.08 ± 13% perf-profile.children.cycles-pp.kmem_cache_alloc
0.11 ± 20% +0.1 0.20 ± 19% perf-profile.children.cycles-pp.update_blocked_averages
0.12 ± 21% +0.1 0.21 ± 18% perf-profile.children.cycles-pp.run_rebalance_domains
0.00 +0.1 0.09 ± 17% perf-profile.children.cycles-pp.rcu_core
0.00 +0.1 0.09 ± 20% perf-profile.children.cycles-pp.rcu_eqs_enter
0.00 +0.1 0.09 ± 25% perf-profile.children.cycles-pp.ttwu_do_wakeup
0.00 +0.1 0.10 ± 18% perf-profile.children.cycles-pp.perf_event_mmap
0.01 ±173% +0.1 0.11 ± 19% perf-profile.children.cycles-pp.update_irq_load_avg
0.00 +0.1 0.10 ± 15% perf-profile.children.cycles-pp.__perf_sw_event
0.00 +0.1 0.11 ± 28% perf-profile.children.cycles-pp.call_cpuidle
0.03 ±100% +0.1 0.14 ± 16% perf-profile.children.cycles-pp.arch_scale_freq_tick
0.00 +0.1 0.11 ± 26% perf-profile.children.cycles-pp.rcu_eqs_exit
0.10 ± 27% +0.1 0.21 ± 9% perf-profile.children.cycles-pp.calc_global_load_tick
0.00 +0.1 0.11 ± 24% perf-profile.children.cycles-pp.tick_nohz_idle_enter
0.00 +0.1 0.11 ± 18% perf-profile.children.cycles-pp.serial8250_console_putchar
0.00 +0.1 0.12 ± 20% perf-profile.children.cycles-pp.serial8250_console_write
0.00 +0.1 0.12 ± 20% perf-profile.children.cycles-pp.wait_for_xmitr
0.00 +0.1 0.12 ± 20% perf-profile.children.cycles-pp.uart_console_write
0.11 ± 18% +0.1 0.24 ± 17% perf-profile.children.cycles-pp.update_sd_lb_stats
0.34 ± 9% +0.1 0.47 ± 13% perf-profile.children.cycles-pp.rebalance_domains
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.sysvec_irq_work
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.__sysvec_irq_work
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.irq_work_run
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.irq_work_single
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.printk
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.vprintk_emit
0.00 +0.1 0.13 ± 18% perf-profile.children.cycles-pp.console_unlock
0.12 ± 18% +0.1 0.26 ± 18% perf-profile.children.cycles-pp.find_busiest_group
0.06 ± 22% +0.1 0.20 ± 16% perf-profile.children.cycles-pp.newidle_balance
0.00 +0.1 0.14 ± 24% perf-profile.children.cycles-pp.cpuidle_governor_latency_req
0.01 ±173% +0.1 0.15 ± 22% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.15 ± 19% perf-profile.children.cycles-pp.send_call_function_single_ipi
0.00 +0.1 0.15 ± 19% perf-profile.children.cycles-pp.irq_work_run_list
0.00 +0.2 0.16 ± 23% perf-profile.children.cycles-pp.wake_q_add_safe
0.00 +0.2 0.16 ± 13% perf-profile.children.cycles-pp.hrtimer_get_next_event
0.03 ±102% +0.2 0.20 ± 17% perf-profile.children.cycles-pp.rcu_idle_exit
0.00 +0.2 0.17 ± 21% perf-profile.children.cycles-pp.___perf_sw_event
0.06 ± 15% +0.2 0.23 ± 20% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.15 ± 18% +0.2 0.33 ± 14% perf-profile.children.cycles-pp.load_balance
0.00 +0.2 0.18 ± 14% perf-profile.children.cycles-pp.llist_reverse_order
0.07 ± 10% +0.2 0.26 ± 11% perf-profile.children.cycles-pp.get_next_timer_interrupt
0.00 +0.2 0.20 ± 51% perf-profile.children.cycles-pp.find_vma
0.19 ± 16% +0.2 0.39 ± 16% perf-profile.children.cycles-pp.start_kernel
0.24 ± 8% +0.2 0.44 ± 21% perf-profile.children.cycles-pp.tick_nohz_irq_exit
0.18 ± 12% +0.2 0.38 ± 21% perf-profile.children.cycles-pp.perf_mux_hrtimer_handler
0.00 +0.2 0.20 ± 14% perf-profile.children.cycles-pp.__update_load_avg_se
0.39 ± 13% +0.2 0.60 ± 8% perf-profile.children.cycles-pp.scheduler_tick
0.00 +0.2 0.21 ± 19% perf-profile.children.cycles-pp.sync_regs
0.00 +0.2 0.21 ± 15% perf-profile.children.cycles-pp.__switch_to
0.00 +0.2 0.21 ± 13% perf-profile.children.cycles-pp.__list_del_entry_valid
0.01 ±173% +0.2 0.24 ± 59% perf-profile.children.cycles-pp.switch_mm_irqs_off
0.00 +0.2 0.22 ± 15% perf-profile.children.cycles-pp.__list_add_valid
0.12 ± 4% +0.2 0.35 ± 18% perf-profile.children.cycles-pp.lapic_next_deadline
0.07 ± 6% +0.2 0.30 ± 19% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.06 ± 11% +0.2 0.30 ± 9% perf-profile.children.cycles-pp.update_cfs_group
0.00 +0.2 0.24 ± 26% perf-profile.children.cycles-pp.__switch_to_asm
0.46 ± 9% +0.2 0.69 ± 14% perf-profile.children.cycles-pp.timekeeping_max_deferment
0.00 +0.2 0.24 ± 14% perf-profile.children.cycles-pp.cpuacct_charge
0.00 +0.2 0.25 ± 14% perf-profile.children.cycles-pp.set_next_entity
0.00 +0.3 0.26 ± 16% perf-profile.children.cycles-pp.vma_interval_tree_insert
0.00 +0.3 0.26 ± 12% perf-profile.children.cycles-pp.flush_smp_call_function_queue
0.08 ± 16% +0.3 0.34 ± 20% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.3 0.26 ± 19% perf-profile.children.cycles-pp.nr_iowait_cpu
0.00 +0.3 0.26 ± 19% perf-profile.children.cycles-pp.update_ts_time_stats
0.12 ± 13% +0.3 0.38 ± 19% perf-profile.children.cycles-pp.read_tsc
0.09 ± 23% +0.3 0.36 ± 17% perf-profile.children.cycles-pp.native_sched_clock
0.16 ± 6% +0.3 0.44 ± 22% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.10 ± 17% +0.3 0.38 ± 18% perf-profile.children.cycles-pp.sched_clock
0.27 ± 9% +0.3 0.55 ± 16% perf-profile.children.cycles-pp.tick_irq_enter
0.03 ±100% +0.3 0.33 ± 11% perf-profile.children.cycles-pp.down_read_trylock
0.04 ± 57% +0.3 0.34 ± 12% perf-profile.children.cycles-pp.down_read
0.00 +0.3 0.31 ± 16% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.11 ± 7% +0.3 0.42 ± 19% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
0.00 +0.3 0.32 ± 19% perf-profile.children.cycles-pp.llist_add_batch
0.00 +0.3 0.32 ± 19% perf-profile.children.cycles-pp.__smp_call_single_queue
0.10 ± 18% +0.3 0.42 ± 18% perf-profile.children.cycles-pp.sched_clock_cpu
0.04 ± 58% +0.3 0.38 ± 18% perf-profile.children.cycles-pp.vma_link
0.00 +0.3 0.34 ± 19% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.06 ± 7% +0.3 0.40 ± 11% perf-profile.children.cycles-pp.up_read
0.04 ± 58% +0.4 0.39 ± 13% perf-profile.children.cycles-pp.arch_get_unmapped_area_topdown
0.03 ±100% +0.4 0.38 ± 14% perf-profile.children.cycles-pp.vm_unmapped_area
0.00 +0.4 0.36 ± 11% perf-profile.children.cycles-pp.perf_trace_sched_wakeup_template
0.55 ± 10% +0.4 0.91 ± 15% perf-profile.children.cycles-pp.__softirqentry_text_start
0.55 ± 11% +0.4 0.91 ± 15% perf-profile.children.cycles-pp.do_softirq_own_stack
0.04 ± 58% +0.4 0.40 ± 13% perf-profile.children.cycles-pp.get_unmapped_area
0.35 ± 6% +0.4 0.72 ± 16% perf-profile.children.cycles-pp.irq_enter_rcu
0.71 ± 8% +0.4 1.10 ± 16% perf-profile.children.cycles-pp.irq_exit_rcu
0.01 ±173% +0.4 0.41 ± 19% perf-profile.children.cycles-pp.do_anonymous_page
0.70 ± 14% +0.4 1.14 ± 11% perf-profile.children.cycles-pp.update_process_times
0.26 ± 4% +0.5 0.71 ± 16% perf-profile.children.cycles-pp.native_irq_return_iret
0.71 ± 16% +0.5 1.17 ± 10% perf-profile.children.cycles-pp.tick_sched_handle
0.07 ± 19% +0.5 0.53 ± 14% perf-profile.children.cycles-pp.pick_next_task_fair
0.10 ± 15% +0.5 0.64 ± 15% perf-profile.children.cycles-pp._raw_spin_lock
0.00 +0.6 0.57 ± 13% perf-profile.children.cycles-pp.update_curr
0.08 ± 14% +0.6 0.65 ± 18% perf-profile.children.cycles-pp.mmap_region
0.69 ± 8% +0.6 1.27 ± 13% perf-profile.children.cycles-pp.tick_nohz_next_event
0.86 ± 15% +0.6 1.50 ± 11% perf-profile.children.cycles-pp.tick_sched_timer
0.00 +0.7 0.67 ± 17% perf-profile.children.cycles-pp.ttwu_queue_wakelist
0.10 ± 8% +0.7 0.77 ± 13% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.7 0.69 ± 15% perf-profile.children.cycles-pp.update_cfs_rq_h_load
0.00 +0.7 0.71 ± 17% perf-profile.children.cycles-pp.rwsem_mark_wake
0.00 +0.7 0.73 ± 5% perf-profile.children.cycles-pp.finish_task_switch
0.69 ± 14% +0.8 1.49 ± 18% perf-profile.children.cycles-pp.clockevents_program_event
0.10 ± 10% +0.8 0.91 ± 10% perf-profile.children.cycles-pp.__handle_mm_fault
0.76 ± 7% +0.8 1.57 ± 14% perf-profile.children.cycles-pp.tick_nohz_get_sleep_length
0.00 +0.8 0.81 ± 14% perf-profile.children.cycles-pp.dequeue_entity
0.01 ±173% +0.9 0.89 ± 13% perf-profile.children.cycles-pp.dequeue_task_fair
0.03 ±102% +0.9 0.94 ± 10% perf-profile.children.cycles-pp.schedule_idle
0.13 ± 10% +0.9 1.06 ± 15% perf-profile.children.cycles-pp.do_mmap
0.01 ±173% +0.9 0.95 ± 12% perf-profile.children.cycles-pp.enqueue_entity
0.12 ± 10% +0.9 1.06 ± 8% perf-profile.children.cycles-pp.handle_mm_fault
0.00 +1.0 0.97 ± 16% perf-profile.children.cycles-pp.select_task_rq_fair
1.17 ± 16% +1.0 2.21 ± 14% perf-profile.children.cycles-pp.__hrtimer_run_queues
0.03 ±102% +1.2 1.21 ± 14% perf-profile.children.cycles-pp.enqueue_task_fair
0.03 ±102% +1.2 1.22 ± 14% perf-profile.children.cycles-pp.ttwu_do_activate
1.12 ± 9% +1.3 2.42 ± 17% perf-profile.children.cycles-pp.ktime_get
0.04 ± 60% +1.4 1.48 ± 16% perf-profile.children.cycles-pp.sched_ttwu_pending
0.07 ± 13% +1.7 1.75 ± 16% perf-profile.children.cycles-pp.flush_smp_call_function_from_idle
2.13 ± 14% +2.3 4.44 ± 16% perf-profile.children.cycles-pp.hrtimer_interrupt
2.16 ± 14% +2.3 4.51 ± 16% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
0.12 ± 12% +2.4 2.49 ± 15% perf-profile.children.cycles-pp.try_to_wake_up
0.12 ± 12% +2.4 2.54 ± 15% perf-profile.children.cycles-pp.wake_up_q
0.17 ± 10% +2.5 2.69 ± 9% perf-profile.children.cycles-pp.schedule
2.73 ± 14% +2.8 5.57 ± 16% perf-profile.children.cycles-pp.asm_call_sysvec_on_stack
0.16 ± 13% +3.1 3.23 ± 16% perf-profile.children.cycles-pp.rwsem_wake
0.29 ± 7% +3.1 3.36 ± 16% perf-profile.children.cycles-pp.do_rw_once
4.39 ± 7% +3.3 7.70 ± 16% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.22 ± 13% +3.4 3.59 ± 9% perf-profile.children.cycles-pp.__schedule
3.50 ± 11% +3.4 6.89 ± 16% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
4.27 ± 9% +4.0 8.22 ± 9% perf-profile.children.cycles-pp.vm_mmap_pgoff
4.27 ± 9% +4.0 8.28 ± 9% perf-profile.children.cycles-pp.ksys_mmap_pgoff
4.35 ± 9% +4.1 8.47 ± 9% perf-profile.children.cycles-pp.do_syscall_64
4.35 ± 9% +4.1 8.49 ± 9% perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
0.00 +8.4 8.44 ± 9% perf-profile.children.cycles-pp.__mmap
0.44 ± 29% +15.8 16.25 ± 37% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.49 ± 26% +16.0 16.46 ± 36% perf-profile.children.cycles-pp._raw_spin_lock_irq
24.74 ± 2% +23.2 47.96 ± 2% perf-profile.children.cycles-pp.intel_idle
30.83 +26.0 56.88 ± 4% perf-profile.children.cycles-pp.cpuidle_enter_state
30.84 +26.1 56.89 ± 4% perf-profile.children.cycles-pp.cpuidle_enter
35.35 +28.6 63.94 ± 5% perf-profile.children.cycles-pp.start_secondary
35.55 +28.8 64.33 ± 5% perf-profile.children.cycles-pp.do_idle
35.55 +28.8 64.33 ± 5% perf-profile.children.cycles-pp.secondary_startup_64_no_verify
35.55 +28.8 64.33 ± 5% perf-profile.children.cycles-pp.cpu_startup_entry
57.93 -56.4 1.54 ± 13% perf-profile.self.cycles-pp.osq_lock
3.66 ± 11% -3.5 0.19 ± 14% perf-profile.self.cycles-pp.rwsem_optimistic_spin
3.60 ± 13% -1.8 1.79 ± 23% perf-profile.self.cycles-pp.menu_select
2.54 ± 20% -1.3 1.21 ± 21% perf-profile.self.cycles-pp.cpuidle_enter_state
0.44 ± 9% -0.3 0.10 ± 8% perf-profile.self.cycles-pp.rwsem_spin_on_owner
0.06 ± 6% +0.0 0.10 ± 21% perf-profile.self.cycles-pp.perf_mux_hrtimer_handler
0.08 ± 12% +0.0 0.12 ± 21% perf-profile.self.cycles-pp.tsc_verify_tsc_adjust
0.00 +0.1 0.06 ± 14% perf-profile.self.cycles-pp.idle_cpu
0.00 +0.1 0.06 ± 20% perf-profile.self.cycles-pp.wake_up_q
0.00 +0.1 0.06 ± 11% perf-profile.self.cycles-pp.find_vma
0.06 ± 13% +0.1 0.12 ± 18% perf-profile.self.cycles-pp.tick_sched_timer
0.00 +0.1 0.06 ± 13% perf-profile.self.cycles-pp.copy_fpregs_to_fpstate
0.00 +0.1 0.06 ± 17% perf-profile.self.cycles-pp.__softirqentry_text_start
0.00 +0.1 0.06 ± 20% perf-profile.self.cycles-pp.get_cpu_device
0.03 ±102% +0.1 0.10 ± 11% perf-profile.self.cycles-pp.rcu_sched_clock_irq
0.12 ± 26% +0.1 0.19 ± 17% perf-profile.self.cycles-pp.update_process_times
0.06 ± 20% +0.1 0.13 ± 17% perf-profile.self.cycles-pp.__intel_pmu_enable_all
0.00 +0.1 0.07 ± 12% perf-profile.self.cycles-pp.flush_smp_call_function_queue
0.00 +0.1 0.07 ± 14% perf-profile.self.cycles-pp.dequeue_entity
0.00 +0.1 0.07 ± 17% perf-profile.self.cycles-pp.__wrgsbase_inactive
0.00 +0.1 0.07 ± 26% perf-profile.self.cycles-pp.asm_sysvec_apic_timer_interrupt
0.00 +0.1 0.07 ± 22% perf-profile.self.cycles-pp.try_to_wake_up
0.00 +0.1 0.07 ± 26% perf-profile.self.cycles-pp.wake_q_add
0.00 +0.1 0.08 ± 16% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.08 ± 23% perf-profile.self.cycles-pp.io_serial_in
0.00 +0.1 0.08 ± 21% perf-profile.self.cycles-pp.reweight_entity
0.00 +0.1 0.09 ± 17% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.00 +0.1 0.09 ± 12% perf-profile.self.cycles-pp.rcu_idle_exit
0.08 ± 19% +0.1 0.17 ± 18% perf-profile.self.cycles-pp.update_sd_lb_stats
0.01 ±173% +0.1 0.11 ± 16% perf-profile.self.cycles-pp.update_irq_load_avg
0.00 +0.1 0.10 ± 13% perf-profile.self.cycles-pp.set_next_entity
0.00 +0.1 0.10 ± 27% perf-profile.self.cycles-pp.call_cpuidle
0.03 ±100% +0.1 0.14 ± 16% perf-profile.self.cycles-pp.arch_scale_freq_tick
0.10 ± 27% +0.1 0.21 ± 9% perf-profile.self.cycles-pp.calc_global_load_tick
0.15 ± 11% +0.1 0.27 ± 12% perf-profile.self.cycles-pp.tick_nohz_next_event
0.00 +0.1 0.11 ± 21% perf-profile.self.cycles-pp.enqueue_entity
0.00 +0.1 0.13 ± 29% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.1 0.13 ± 23% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.15 ± 19% perf-profile.self.cycles-pp.send_call_function_single_ipi
0.00 +0.1 0.15 ± 23% perf-profile.self.cycles-pp.___perf_sw_event
0.00 +0.2 0.16 ± 23% perf-profile.self.cycles-pp.wake_q_add_safe
0.00 +0.2 0.17 ± 6% perf-profile.self.cycles-pp.rwsem_down_write_slowpath
0.00 +0.2 0.18 ± 14% perf-profile.self.cycles-pp.llist_reverse_order
0.00 +0.2 0.19 ± 13% perf-profile.self.cycles-pp.ttwu_queue_wakelist
0.00 +0.2 0.20 ± 16% perf-profile.self.cycles-pp.__switch_to
0.00 +0.2 0.20 ± 18% perf-profile.self.cycles-pp.sched_ttwu_pending
0.00 +0.2 0.20 ± 13% perf-profile.self.cycles-pp.update_curr
0.00 +0.2 0.20 ± 14% perf-profile.self.cycles-pp.__update_load_avg_se
0.00 +0.2 0.20 ± 18% perf-profile.self.cycles-pp.sync_regs
0.06 ± 6% +0.2 0.27 ± 18% perf-profile.self.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.2 0.21 ± 19% perf-profile.self.cycles-pp.select_task_rq_fair
0.01 ±173% +0.2 0.22 ± 52% perf-profile.self.cycles-pp.switch_mm_irqs_off
0.00 +0.2 0.21 ± 13% perf-profile.self.cycles-pp.__list_del_entry_valid
0.00 +0.2 0.22 ± 15% perf-profile.self.cycles-pp.__list_add_valid
0.06 ± 11% +0.2 0.29 ± 7% perf-profile.self.cycles-pp.update_cfs_group
0.12 ± 4% +0.2 0.35 ± 17% perf-profile.self.cycles-pp.lapic_next_deadline
0.06 ± 7% +0.2 0.29 ± 10% perf-profile.self.cycles-pp.update_load_avg
0.00 +0.2 0.23 ± 25% perf-profile.self.cycles-pp.__switch_to_asm
0.46 ± 9% +0.2 0.69 ± 14% perf-profile.self.cycles-pp.timekeeping_max_deferment
0.15 ± 7% +0.2 0.39 ± 23% perf-profile.self.cycles-pp.ktime_get_update_offsets_now
0.00 +0.2 0.24 ± 14% perf-profile.self.cycles-pp.cpuacct_charge
0.06 ± 6% +0.3 0.32 ± 4% perf-profile.self.cycles-pp._raw_spin_lock_irq
0.00 +0.3 0.26 ± 16% perf-profile.self.cycles-pp.vma_interval_tree_insert
0.00 +0.3 0.26 ± 18% perf-profile.self.cycles-pp.nr_iowait_cpu
0.09 ± 19% +0.3 0.35 ± 18% perf-profile.self.cycles-pp.native_sched_clock
0.00 +0.3 0.26 ± 20% perf-profile.self.cycles-pp.enqueue_task_fair
0.11 ± 15% +0.3 0.38 ± 19% perf-profile.self.cycles-pp.read_tsc
0.04 ± 63% +0.3 0.32 ± 16% perf-profile.self.cycles-pp.do_idle
0.10 ± 12% +0.3 0.38 ± 21% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.00 +0.3 0.28 ± 17% perf-profile.self.cycles-pp.rwsem_mark_wake
0.00 +0.3 0.28 ± 13% perf-profile.self.cycles-pp.perf_trace_sched_wakeup_template
0.01 ±173% +0.3 0.31 ± 15% perf-profile.self.cycles-pp.down_read
0.00 +0.3 0.30 ± 17% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.03 ±100% +0.3 0.33 ± 11% perf-profile.self.cycles-pp.down_read_trylock
0.00 +0.3 0.32 ± 19% perf-profile.self.cycles-pp.llist_add_batch
0.05 ± 9% +0.3 0.40 ± 10% perf-profile.self.cycles-pp.up_read
0.03 ±100% +0.4 0.38 ± 14% perf-profile.self.cycles-pp.vm_unmapped_area
0.04 ± 57% +0.4 0.46 ± 3% perf-profile.self.cycles-pp.__handle_mm_fault
0.10 ± 15% +0.4 0.54 ± 18% perf-profile.self.cycles-pp._raw_spin_lock
0.26 ± 4% +0.5 0.71 ± 16% perf-profile.self.cycles-pp.native_irq_return_iret
0.00 +0.7 0.68 ± 4% perf-profile.self.cycles-pp.finish_task_switch
0.00 +0.7 0.69 ± 15% perf-profile.self.cycles-pp.update_cfs_rq_h_load
0.01 ±173% +0.7 0.70 ± 10% perf-profile.self.cycles-pp.__schedule
0.15 ± 7% +0.9 1.08 ± 2% perf-profile.self.cycles-pp.rwsem_down_read_slowpath
1.02 ± 9% +1.1 2.08 ± 17% perf-profile.self.cycles-pp.ktime_get
0.19 ± 10% +2.0 2.17 ± 14% perf-profile.self.cycles-pp.do_rw_once
0.20 ± 9% +2.1 2.27 ± 17% perf-profile.self.cycles-pp.do_access
0.44 ± 29% +15.8 16.25 ± 37% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
24.74 ± 2% +23.2 47.96 ± 2% perf-profile.self.cycles-pp.intel_idle
12249 ± 21% +106.7% 25324 ± 9% softirqs.CPU0.RCU
9537 ± 3% +149.8% 23829 ± 8% softirqs.CPU1.RCU
37131 +14.2% 42407 ± 2% softirqs.CPU1.SCHED
9016 ± 3% +163.1% 23716 ± 8% softirqs.CPU10.RCU
36655 +14.7% 42035 ± 2% softirqs.CPU10.SCHED
9122 ± 10% +156.8% 23428 ± 9% softirqs.CPU100.RCU
36099 ± 4% +16.5% 42065 softirqs.CPU100.SCHED
8711 ± 3% +171.0% 23606 ± 9% softirqs.CPU101.RCU
36894 +14.3% 42172 softirqs.CPU101.SCHED
8920 ± 6% +165.7% 23700 ± 9% softirqs.CPU102.RCU
35214 ± 7% +19.8% 42173 softirqs.CPU102.SCHED
8805 ± 3% +170.3% 23803 ± 10% softirqs.CPU103.RCU
36608 +13.4% 41507 ± 3% softirqs.CPU103.SCHED
8767 ± 6% +170.5% 23717 ± 9% softirqs.CPU104.RCU
36225 +16.1% 42066 ± 2% softirqs.CPU104.SCHED
8738 ± 4% +166.9% 23321 ± 9% softirqs.CPU105.RCU
36793 +13.6% 41794 softirqs.CPU105.SCHED
8733 ± 3% +165.3% 23168 ± 9% softirqs.CPU106.RCU
36486 +14.9% 41931 ± 2% softirqs.CPU106.SCHED
8835 ± 5% +160.9% 23053 ± 11% softirqs.CPU107.RCU
8803 ± 3% +171.0% 23859 ± 9% softirqs.CPU108.RCU
35808 ± 4% +17.5% 42068 ± 2% softirqs.CPU108.SCHED
8794 ± 6% +168.8% 23638 ± 9% softirqs.CPU109.RCU
36432 +14.9% 41845 ± 2% softirqs.CPU109.SCHED
8961 ± 3% +156.7% 23008 ± 10% softirqs.CPU11.RCU
36967 +16.2% 42944 ± 3% softirqs.CPU11.SCHED
8811 ± 3% +168.7% 23679 ± 9% softirqs.CPU110.RCU
36694 +14.0% 41823 softirqs.CPU110.SCHED
8740 ± 3% +168.7% 23482 ± 9% softirqs.CPU111.RCU
36615 +14.8% 42039 softirqs.CPU111.SCHED
8753 ± 4% +152.6% 22110 ± 9% softirqs.CPU112.RCU
34222 ± 10% +23.1% 42114 softirqs.CPU112.SCHED
8767 ± 4% +148.2% 21759 ± 7% softirqs.CPU113.RCU
32174 ± 15% +33.3% 42892 ± 2% softirqs.CPU113.SCHED
8833 ± 3% +151.4% 22207 ± 8% softirqs.CPU114.RCU
36688 +14.9% 42170 softirqs.CPU114.SCHED
8857 ± 6% +148.4% 22000 ± 8% softirqs.CPU115.RCU
36523 +14.3% 41734 ± 2% softirqs.CPU115.SCHED
8767 ± 4% +152.1% 22103 ± 7% softirqs.CPU116.RCU
36614 +14.8% 42051 softirqs.CPU116.SCHED
8928 ± 2% +147.7% 22120 ± 8% softirqs.CPU117.RCU
36080 ± 5% +12.9% 40746 ± 3% softirqs.CPU117.SCHED
8723 ± 4% +153.7% 22133 ± 9% softirqs.CPU118.RCU
36878 +14.5% 42219 softirqs.CPU118.SCHED
8716 ± 5% +153.3% 22078 ± 9% softirqs.CPU119.RCU
35451 ± 7% +18.6% 42050 ± 2% softirqs.CPU119.SCHED
9006 ± 2% +159.7% 23386 ± 8% softirqs.CPU12.RCU
33337 ± 19% +24.8% 41589 ± 2% softirqs.CPU12.SCHED
9041 ± 8% +153.7% 22940 ± 10% softirqs.CPU120.RCU
8568 ± 4% +161.3% 22389 ± 11% softirqs.CPU121.RCU
36059 ± 3% +17.1% 42220 softirqs.CPU121.SCHED
8673 ± 5% +155.6% 22170 ± 11% softirqs.CPU122.RCU
36904 +14.4% 42209 softirqs.CPU122.SCHED
8604 ± 4% +164.2% 22734 ± 14% softirqs.CPU123.RCU
36973 +11.2% 41121 ± 5% softirqs.CPU123.SCHED
8617 ± 3% +158.4% 22270 ± 10% softirqs.CPU124.RCU
36771 ± 2% +15.1% 42332 softirqs.CPU124.SCHED
8649 ± 3% +156.9% 22219 ± 11% softirqs.CPU125.RCU
36819 +15.1% 42380 softirqs.CPU125.SCHED
8699 ± 2% +156.1% 22279 ± 11% softirqs.CPU126.RCU
36230 ± 4% +16.7% 42282 softirqs.CPU126.SCHED
8627 ± 4% +158.5% 22306 ± 11% softirqs.CPU127.RCU
36525 +15.7% 42268 softirqs.CPU127.SCHED
8596 ± 4% +179.5% 24026 ± 13% softirqs.CPU128.RCU
34698 ± 10% +21.9% 42306 softirqs.CPU128.SCHED
8694 ± 2% +174.3% 23852 ± 13% softirqs.CPU129.RCU
35418 ± 7% +18.7% 42037 softirqs.CPU129.SCHED
9082 ± 2% +157.1% 23352 ± 9% softirqs.CPU13.RCU
35266 ± 8% +19.0% 41954 ± 2% softirqs.CPU13.SCHED
8603 ± 3% +178.0% 23918 ± 13% softirqs.CPU130.RCU
8684 ± 2% +180.0% 24314 ± 13% softirqs.CPU131.RCU
36756 ± 2% +14.9% 42233 softirqs.CPU131.SCHED
8720 ± 3% +177.7% 24218 ± 13% softirqs.CPU132.RCU
36747 +14.6% 42095 softirqs.CPU132.SCHED
8637 ± 2% +177.4% 23963 ± 13% softirqs.CPU133.RCU
36496 +15.2% 42052 softirqs.CPU133.SCHED
8525 ± 3% +179.5% 23823 ± 12% softirqs.CPU134.RCU
36286 ± 2% +15.4% 41882 softirqs.CPU134.SCHED
8753 +171.0% 23723 ± 14% softirqs.CPU135.RCU
36807 +16.8% 42989 ± 3% softirqs.CPU135.SCHED
8611 ± 3% +184.7% 24518 ± 9% softirqs.CPU136.RCU
36481 +15.5% 42141 softirqs.CPU136.SCHED
8729 ± 3% +177.3% 24202 ± 13% softirqs.CPU137.RCU
36853 +14.3% 42107 softirqs.CPU137.SCHED
8613 ± 4% +184.8% 24528 ± 13% softirqs.CPU138.RCU
36764 +15.1% 42317 softirqs.CPU138.SCHED
8620 ± 3% +175.8% 23771 ± 11% softirqs.CPU139.RCU
9816 ± 6% +145.6% 24107 ± 9% softirqs.CPU14.RCU
36928 +13.9% 42060 softirqs.CPU14.SCHED
8647 ± 3% +176.6% 23921 ± 12% softirqs.CPU140.RCU
36901 +14.5% 42247 softirqs.CPU140.SCHED
9132 ± 5% +162.2% 23946 ± 12% softirqs.CPU141.RCU
35892 ± 3% +17.4% 42128 softirqs.CPU141.SCHED
8711 ± 3% +176.4% 24079 ± 13% softirqs.CPU142.RCU
36811 ± 2% +14.9% 42297 softirqs.CPU142.SCHED
9133 ± 6% +166.2% 24311 ± 13% softirqs.CPU143.RCU
36958 +14.5% 42303 softirqs.CPU143.SCHED
8390 +195.8% 24816 ± 11% softirqs.CPU144.RCU
36622 +16.1% 42520 softirqs.CPU144.SCHED
8659 ± 5% +179.2% 24174 ± 11% softirqs.CPU145.RCU
36223 +17.1% 42409 softirqs.CPU145.SCHED
8521 +187.0% 24455 ± 11% softirqs.CPU146.RCU
37172 +14.1% 42408 softirqs.CPU146.SCHED
8447 +189.0% 24413 ± 11% softirqs.CPU147.RCU
36910 +15.2% 42503 softirqs.CPU147.SCHED
8600 +179.6% 24043 ± 11% softirqs.CPU148.RCU
36834 +14.9% 42310 softirqs.CPU148.SCHED
8560 ± 2% +187.2% 24585 ± 11% softirqs.CPU149.RCU
35934 ± 4% +18.0% 42387 softirqs.CPU149.SCHED
9415 ± 10% +151.8% 23709 ± 10% softirqs.CPU15.RCU
8420 ± 4% +189.3% 24357 ± 11% softirqs.CPU150.RCU
36758 +15.2% 42343 softirqs.CPU150.SCHED
8346 ± 2% +188.6% 24085 ± 11% softirqs.CPU151.RCU
36259 +17.0% 42433 softirqs.CPU151.SCHED
8566 ± 2% +184.7% 24388 ± 11% softirqs.CPU152.RCU
36466 ± 2% +16.1% 42327 softirqs.CPU152.SCHED
8444 +186.3% 24173 ± 11% softirqs.CPU153.RCU
36825 +14.9% 42299 softirqs.CPU153.SCHED
8532 +188.1% 24580 ± 11% softirqs.CPU154.RCU
36855 +15.0% 42372 softirqs.CPU154.SCHED
8474 +190.6% 24628 ± 11% softirqs.CPU155.RCU
36886 +14.9% 42385 softirqs.CPU155.SCHED
8364 +186.8% 23987 ± 11% softirqs.CPU156.RCU
36681 +15.3% 42298 softirqs.CPU156.SCHED
8416 ± 2% +189.3% 24344 ± 11% softirqs.CPU157.RCU
35229 ± 4% +19.5% 42109 softirqs.CPU157.SCHED
8367 +192.3% 24460 ± 11% softirqs.CPU158.RCU
36545 +15.9% 42342 softirqs.CPU158.SCHED
8496 ± 2% +188.8% 24535 ± 11% softirqs.CPU159.RCU
36626 +15.7% 42377 softirqs.CPU159.SCHED
9064 ± 3% +147.9% 22469 ± 9% softirqs.CPU16.RCU
36606 +15.3% 42206 softirqs.CPU16.SCHED
8523 +166.3% 22701 ± 11% softirqs.CPU160.RCU
36780 +15.5% 42463 softirqs.CPU160.SCHED
8654 ± 3% +163.0% 22758 ± 10% softirqs.CPU161.RCU
30196 ± 39% +40.2% 42339 softirqs.CPU161.SCHED
8529 ± 3% +166.4% 22724 ± 12% softirqs.CPU162.RCU
36548 +15.8% 42321 softirqs.CPU162.SCHED
8583 ± 4% +165.9% 22820 ± 10% softirqs.CPU163.RCU
36551 +15.8% 42326 softirqs.CPU163.SCHED
8736 ± 6% +161.2% 22818 ± 11% softirqs.CPU164.RCU
36843 +15.1% 42416 softirqs.CPU164.SCHED
8494 ± 3% +163.7% 22397 ± 10% softirqs.CPU165.RCU
36770 +15.2% 42372 softirqs.CPU165.SCHED
8519 +169.1% 22929 ± 11% softirqs.CPU166.RCU
35566 ± 3% +19.6% 42522 softirqs.CPU166.SCHED
8477 +174.1% 23237 ± 10% softirqs.CPU167.RCU
37004 +14.7% 42430 softirqs.CPU167.SCHED
8218 ± 2% +164.5% 21737 ± 14% softirqs.CPU168.RCU
36833 +15.6% 42594 softirqs.CPU168.SCHED
8200 +157.1% 21081 ± 13% softirqs.CPU169.RCU
34932 ± 8% +20.5% 42103 softirqs.CPU169.SCHED
9054 ± 3% +140.2% 21746 ± 7% softirqs.CPU17.RCU
8072 ± 2% +160.8% 21050 ± 14% softirqs.CPU170.RCU
37041 +13.8% 42139 softirqs.CPU170.SCHED
8243 ± 3% +156.1% 21108 ± 14% softirqs.CPU171.RCU
36950 +14.1% 42151 softirqs.CPU171.SCHED
8243 ± 3% +156.7% 21159 ± 14% softirqs.CPU172.RCU
35076 ± 9% +20.3% 42211 softirqs.CPU172.SCHED
9350 ± 16% +127.9% 21310 ± 14% softirqs.CPU173.RCU
35579 ± 4% +18.6% 42200 softirqs.CPU173.SCHED
8226 ± 2% +159.9% 21383 ± 14% softirqs.CPU174.RCU
36991 +14.2% 42241 softirqs.CPU174.SCHED
8276 ± 3% +156.1% 21195 ± 14% softirqs.CPU175.RCU
37055 +15.6% 42843 ± 2% softirqs.CPU175.SCHED
8476 ± 4% +166.9% 22622 ± 14% softirqs.CPU176.RCU
37290 +12.9% 42095 softirqs.CPU176.SCHED
8293 ± 2% +176.4% 22921 ± 14% softirqs.CPU177.RCU
8258 ± 3% +175.5% 22750 ± 14% softirqs.CPU178.RCU
35972 ± 3% +17.4% 42231 softirqs.CPU178.SCHED
8271 ± 4% +174.9% 22736 ± 14% softirqs.CPU179.RCU
37133 +13.8% 42272 softirqs.CPU179.SCHED
9148 ± 4% +145.6% 22469 ± 9% softirqs.CPU18.RCU
36457 +14.8% 41845 ± 3% softirqs.CPU18.SCHED
8362 ± 6% +172.8% 22811 ± 14% softirqs.CPU180.RCU
35142 ± 8% +19.7% 42082 softirqs.CPU180.SCHED
8215 ± 4% +172.5% 22389 ± 14% softirqs.CPU181.RCU
36431 +15.1% 41917 softirqs.CPU181.SCHED
8191 ± 4% +175.9% 22599 ± 13% softirqs.CPU182.RCU
36842 +14.1% 42033 softirqs.CPU182.SCHED
8250 ± 2% +175.9% 22764 ± 14% softirqs.CPU183.RCU
37102 +13.7% 42195 softirqs.CPU183.SCHED
8217 ± 3% +189.6% 23797 ± 16% softirqs.CPU184.RCU
37031 +14.1% 42259 softirqs.CPU184.SCHED
8280 ± 4% +173.4% 22640 ± 14% softirqs.CPU185.RCU
37074 +13.9% 42226 softirqs.CPU185.SCHED
8293 ± 5% +173.4% 22678 ± 14% softirqs.CPU186.RCU
36842 +14.1% 42030 softirqs.CPU186.SCHED
8230 ± 3% +179.2% 22981 ± 14% softirqs.CPU187.RCU
36985 +14.0% 42181 softirqs.CPU187.SCHED
8192 ± 2% +177.8% 22754 ± 14% softirqs.CPU188.RCU
37167 +13.2% 42086 softirqs.CPU188.SCHED
8392 ± 4% +173.5% 22950 ± 14% softirqs.CPU189.RCU
32862 ± 20% +28.0% 42054 softirqs.CPU189.SCHED
8969 ± 5% +148.1% 22251 ± 9% softirqs.CPU19.RCU
36427 +15.0% 41877 softirqs.CPU19.SCHED
8352 ± 4% +175.4% 22999 ± 12% softirqs.CPU190.RCU
36488 +15.6% 42184 softirqs.CPU190.SCHED
8316 ± 2% +169.9% 22447 ± 13% softirqs.CPU191.RCU
36926 +11.6% 41195 ± 2% softirqs.CPU191.SCHED
9326 ± 4% +158.7% 24130 ± 10% softirqs.CPU2.RCU
36357 ± 2% +16.4% 42312 softirqs.CPU2.SCHED
9089 ± 4% +144.6% 22228 ± 8% softirqs.CPU20.RCU
36405 +15.5% 42065 softirqs.CPU20.SCHED
9052 ± 4% +148.4% 22488 ± 9% softirqs.CPU21.RCU
9054 ± 3% +150.7% 22700 ± 8% softirqs.CPU22.RCU
36727 +14.6% 42108 softirqs.CPU22.SCHED
9295 ± 2% +139.3% 22247 ± 9% softirqs.CPU23.RCU
36677 +14.8% 42092 softirqs.CPU23.SCHED
9037 ± 4% +155.3% 23069 ± 12% softirqs.CPU24.RCU
36766 +16.3% 42763 softirqs.CPU24.SCHED
8818 ± 3% +151.5% 22180 ± 10% softirqs.CPU25.RCU
35807 ± 3% +17.8% 42173 softirqs.CPU25.SCHED
8850 ± 3% +151.3% 22240 ± 11% softirqs.CPU26.RCU
34656 ± 10% +22.0% 42284 softirqs.CPU26.SCHED
8951 ± 3% +151.3% 22494 ± 11% softirqs.CPU27.RCU
36709 +15.1% 42243 softirqs.CPU27.SCHED
10067 ± 17% +123.4% 22489 ± 10% softirqs.CPU28.RCU
8987 ± 3% +153.3% 22763 ± 11% softirqs.CPU29.RCU
36696 +15.4% 42355 softirqs.CPU29.SCHED
9228 ± 4% +160.8% 24064 ± 10% softirqs.CPU3.RCU
34189 ± 13% +23.8% 42332 softirqs.CPU3.SCHED
8811 ± 5% +156.3% 22583 ± 11% softirqs.CPU30.RCU
36454 ± 2% +15.9% 42258 softirqs.CPU30.SCHED
8873 ± 4% +151.6% 22322 ± 11% softirqs.CPU31.RCU
36527 +15.7% 42274 softirqs.CPU31.SCHED
9042 ± 2% +163.8% 23852 ± 12% softirqs.CPU32.RCU
36100 +16.9% 42210 softirqs.CPU32.SCHED
8908 ± 3% +165.1% 23615 ± 12% softirqs.CPU33.RCU
8954 ± 3% +170.2% 24195 ± 13% softirqs.CPU34.RCU
36214 +16.7% 42251 softirqs.CPU34.SCHED
9187 +163.4% 24202 ± 13% softirqs.CPU35.RCU
36507 +14.6% 41825 softirqs.CPU35.SCHED
9069 ± 3% +169.1% 24405 ± 13% softirqs.CPU36.RCU
36578 +15.6% 42267 softirqs.CPU36.SCHED
8963 ± 3% +171.8% 24358 ± 14% softirqs.CPU37.RCU
34994 ± 5% +20.2% 42079 softirqs.CPU37.SCHED
8932 ± 3% +173.5% 24427 ± 10% softirqs.CPU38.RCU
36137 +16.4% 42077 softirqs.CPU38.SCHED
9322 ± 4% +149.7% 23276 ± 16% softirqs.CPU39.RCU
36374 +16.0% 42201 softirqs.CPU39.SCHED
9144 ± 4% +162.2% 23977 ± 9% softirqs.CPU4.RCU
33161 ± 18% +26.3% 41892 softirqs.CPU4.SCHED
8953 ± 3% +168.3% 24025 ± 12% softirqs.CPU40.RCU
36479 +15.6% 42186 softirqs.CPU40.SCHED
9324 ± 6% +160.2% 24256 ± 13% softirqs.CPU41.RCU
36186 ± 2% +16.8% 42261 softirqs.CPU41.SCHED
9020 ± 3% +170.9% 24436 ± 12% softirqs.CPU42.RCU
36433 +16.0% 42255 softirqs.CPU42.SCHED
8983 ± 3% +169.8% 24238 ± 13% softirqs.CPU43.RCU
36587 +15.3% 42191 softirqs.CPU43.SCHED
8912 ± 3% +166.2% 23725 ± 12% softirqs.CPU44.RCU
36659 +15.0% 42158 softirqs.CPU44.SCHED
9058 ± 3% +162.8% 23801 ± 12% softirqs.CPU45.RCU
36559 +15.4% 42181 softirqs.CPU45.SCHED
8949 ± 3% +170.7% 24223 ± 13% softirqs.CPU46.RCU
36581 +15.6% 42278 softirqs.CPU46.SCHED
9046 ± 2% +167.4% 24187 ± 12% softirqs.CPU47.RCU
36555 +15.5% 42202 softirqs.CPU47.SCHED
8875 ± 4% +183.2% 25133 ± 11% softirqs.CPU48.RCU
35927 ± 6% +18.8% 42694 softirqs.CPU48.SCHED
8582 ± 2% +183.1% 24291 ± 10% softirqs.CPU49.RCU
36195 +17.0% 42354 softirqs.CPU49.SCHED
9099 ± 4% +161.9% 23833 ± 9% softirqs.CPU5.RCU
36206 ± 2% +16.8% 42305 softirqs.CPU5.SCHED
8808 ± 2% +177.7% 24457 ± 11% softirqs.CPU50.RCU
36560 +15.9% 42388 softirqs.CPU50.SCHED
8741 +183.6% 24789 ± 11% softirqs.CPU51.RCU
36497 +16.2% 42393 softirqs.CPU51.SCHED
8823 ± 2% +176.0% 24354 ± 11% softirqs.CPU52.RCU
36000 ± 3% +17.4% 42247 softirqs.CPU52.SCHED
8957 ± 2% +175.2% 24648 ± 11% softirqs.CPU53.RCU
35929 ± 4% +17.9% 42373 softirqs.CPU53.SCHED
8717 ± 3% +187.8% 25092 ± 12% softirqs.CPU54.RCU
37177 ± 2% +14.7% 42647 ± 2% softirqs.CPU54.SCHED
8741 ± 2% +181.7% 24620 ± 11% softirqs.CPU55.RCU
36406 +16.7% 42484 softirqs.CPU55.SCHED
8681 ± 2% +183.8% 24638 ± 10% softirqs.CPU56.RCU
36449 +15.1% 41936 ± 3% softirqs.CPU56.SCHED
8743 +178.3% 24332 ± 10% softirqs.CPU57.RCU
35188 ± 5% +20.6% 42431 softirqs.CPU57.SCHED
8774 ± 2% +181.1% 24662 ± 11% softirqs.CPU58.RCU
36475 +16.2% 42392 softirqs.CPU58.SCHED
8791 +183.8% 24946 ± 10% softirqs.CPU59.RCU
36478 +16.2% 42395 softirqs.CPU59.SCHED
9108 ± 5% +161.4% 23813 ± 9% softirqs.CPU6.RCU
8705 ± 2% +180.7% 24439 ± 10% softirqs.CPU60.RCU
36494 +16.2% 42394 softirqs.CPU60.SCHED
8742 ± 2% +179.3% 24418 ± 11% softirqs.CPU61.RCU
36403 +16.5% 42396 softirqs.CPU61.SCHED
8688 +184.9% 24751 ± 8% softirqs.CPU62.RCU
36392 +16.0% 42223 ± 2% softirqs.CPU62.SCHED
8710 +180.2% 24409 ± 11% softirqs.CPU63.RCU
34773 ± 7% +22.0% 42415 softirqs.CPU63.SCHED
8862 +163.2% 23323 ± 11% softirqs.CPU64.RCU
36578 +15.8% 42355 softirqs.CPU64.SCHED
9147 ± 5% +152.6% 23101 ± 10% softirqs.CPU65.RCU
36135 +17.6% 42486 softirqs.CPU65.SCHED
8811 +161.9% 23074 ± 11% softirqs.CPU66.RCU
36313 +16.8% 42407 softirqs.CPU66.SCHED
8783 ± 2% +166.6% 23419 ± 10% softirqs.CPU67.RCU
36134 ± 2% +16.4% 42070 ± 2% softirqs.CPU67.SCHED
8767 +175.0% 24108 ± 5% softirqs.CPU68.RCU
36375 +16.5% 42365 softirqs.CPU68.SCHED
8950 ± 5% +160.0% 23275 ± 10% softirqs.CPU69.RCU
36574 +15.8% 42351 softirqs.CPU69.SCHED
9032 ± 2% +166.3% 24057 ± 9% softirqs.CPU7.RCU
36498 +14.8% 41906 ± 3% softirqs.CPU7.SCHED
8756 +163.9% 23105 ± 10% softirqs.CPU70.RCU
8870 ± 2% +159.9% 23055 ± 10% softirqs.CPU71.RCU
36239 +17.3% 42518 softirqs.CPU71.SCHED
8735 ± 4% +154.4% 22225 ± 12% softirqs.CPU72.RCU
37073 +15.6% 42851 softirqs.CPU72.SCHED
8476 ± 2% +155.7% 21675 ± 13% softirqs.CPU73.RCU
36800 +14.5% 42146 softirqs.CPU73.SCHED
8601 ± 3% +151.1% 21597 ± 13% softirqs.CPU74.RCU
36993 +14.1% 42194 softirqs.CPU74.SCHED
8595 ± 3% +153.1% 21754 ± 14% softirqs.CPU75.RCU
36866 +14.5% 42217 softirqs.CPU75.SCHED
8512 ± 2% +152.7% 21510 ± 13% softirqs.CPU76.RCU
36504 +15.5% 42162 softirqs.CPU76.SCHED
8445 ± 2% +154.6% 21503 ± 14% softirqs.CPU77.RCU
36953 +14.6% 42356 softirqs.CPU77.SCHED
8459 ± 3% +157.3% 21769 ± 14% softirqs.CPU78.RCU
36966 +14.3% 42240 softirqs.CPU78.SCHED
8615 ± 3% +146.6% 21246 ± 14% softirqs.CPU79.RCU
36817 +14.6% 42192 softirqs.CPU79.SCHED
9188 ± 4% +160.4% 23927 ± 8% softirqs.CPU8.RCU
35750 ± 4% +17.9% 42132 softirqs.CPU8.SCHED
8535 ± 2% +167.3% 22816 ± 14% softirqs.CPU80.RCU
36354 ± 2% +15.8% 42113 softirqs.CPU80.SCHED
8468 ± 2% +171.4% 22986 ± 14% softirqs.CPU81.RCU
35271 ± 7% +19.5% 42161 softirqs.CPU81.SCHED
8583 ± 3% +166.6% 22881 ± 13% softirqs.CPU82.RCU
36810 +14.8% 42275 softirqs.CPU82.SCHED
8483 ± 3% +173.7% 23218 ± 14% softirqs.CPU83.RCU
36369 ± 2% +15.9% 42136 softirqs.CPU83.SCHED
8512 ± 4% +166.7% 22704 ± 14% softirqs.CPU84.RCU
36672 +13.4% 41601 ± 3% softirqs.CPU84.SCHED
8411 ± 3% +170.7% 22771 ± 13% softirqs.CPU85.RCU
36325 ± 3% +15.8% 42054 softirqs.CPU85.SCHED
8472 ± 2% +169.8% 22856 ± 13% softirqs.CPU86.RCU
33424 ± 16% +26.1% 42137 softirqs.CPU86.SCHED
8681 ± 5% +162.4% 22781 ± 14% softirqs.CPU87.RCU
37166 +13.5% 42185 softirqs.CPU87.SCHED
8827 ± 6% +158.8% 22846 ± 14% softirqs.CPU88.RCU
36737 +15.0% 42244 softirqs.CPU88.SCHED
8507 ± 3% +171.0% 23051 ± 14% softirqs.CPU89.RCU
8967 ± 4% +163.3% 23609 ± 9% softirqs.CPU9.RCU
36649 +14.0% 41796 softirqs.CPU9.SCHED
8437 ± 2% +170.9% 22853 ± 14% softirqs.CPU90.RCU
36763 +12.1% 41197 ± 2% softirqs.CPU90.SCHED
8454 ± 3% +172.9% 23067 ± 14% softirqs.CPU91.RCU
36976 +14.1% 42200 softirqs.CPU91.SCHED
8400 ± 3% +174.3% 23039 ± 13% softirqs.CPU92.RCU
36135 ± 3% +16.6% 42140 softirqs.CPU92.SCHED
8410 ± 2% +170.4% 22746 ± 13% softirqs.CPU93.RCU
34303 ± 10% +22.8% 42134 softirqs.CPU93.SCHED
8852 ± 6% +159.2% 22944 ± 14% softirqs.CPU94.RCU
36636 +15.4% 42262 softirqs.CPU94.SCHED
8531 ± 2% +163.9% 22517 ± 12% softirqs.CPU95.RCU
8676 ± 4% +182.5% 24507 ± 14% softirqs.CPU96.RCU
36310 ± 5% +14.4% 41553 ± 2% softirqs.CPU96.SCHED
8837 ± 3% +163.2% 23265 ± 9% softirqs.CPU97.RCU
36613 +12.7% 41251 softirqs.CPU97.SCHED
9017 ± 4% +166.8% 24056 ± 10% softirqs.CPU98.RCU
36646 +14.5% 41963 softirqs.CPU98.SCHED
8740 ± 3% +170.7% 23658 ± 9% softirqs.CPU99.RCU
9564 ± 46% -61.0% 3731 ± 24% softirqs.NET_RX
1679865 ± 2% +166.2% 4471848 ± 11% softirqs.RCU
6961169 +15.7% 8051724 softirqs.SCHED
61650 -21.7% 48273 ± 4% softirqs.TIMER
694214 ± 2% +251.0% 2436630 ± 4% interrupts.CAL:Function_call_interrupts
3524 ± 11% +236.6% 11864 ± 18% interrupts.CPU0.CAL:Function_call_interrupts
161.75 ± 10% +343.7% 717.75 ± 12% interrupts.CPU0.RES:Rescheduling_interrupts
3930 ± 11% +235.5% 13186 ± 8% interrupts.CPU1.CAL:Function_call_interrupts
976.00 ± 30% -52.0% 468.50 ± 14% interrupts.CPU1.NMI:Non-maskable_interrupts
976.00 ± 30% -52.0% 468.50 ± 14% interrupts.CPU1.PMI:Performance_monitoring_interrupts
148.75 ± 13% +267.4% 546.50 ± 21% interrupts.CPU1.RES:Rescheduling_interrupts
3441 ± 2% +270.4% 12749 ± 9% interrupts.CPU10.CAL:Function_call_interrupts
1117 ± 19% -58.0% 469.75 ± 14% interrupts.CPU10.NMI:Non-maskable_interrupts
1117 ± 19% -58.0% 469.75 ± 14% interrupts.CPU10.PMI:Performance_monitoring_interrupts
123.50 ± 16% +372.7% 583.75 ± 13% interrupts.CPU10.RES:Rescheduling_interrupts
117.25 ± 58% +141.8% 283.50 ± 15% interrupts.CPU10.TLB:TLB_shootdowns
3545 ± 5% +269.0% 13082 ± 9% interrupts.CPU100.CAL:Function_call_interrupts
1175 ± 43% -59.9% 471.00 ± 16% interrupts.CPU100.NMI:Non-maskable_interrupts
1175 ± 43% -59.9% 471.00 ± 16% interrupts.CPU100.PMI:Performance_monitoring_interrupts
128.50 ± 9% +413.2% 659.50 ± 18% interrupts.CPU100.RES:Rescheduling_interrupts
3591 ± 7% +261.4% 12979 ± 9% interrupts.CPU101.CAL:Function_call_interrupts
1025 ± 30% -60.0% 410.00 ± 25% interrupts.CPU101.NMI:Non-maskable_interrupts
1025 ± 30% -60.0% 410.00 ± 25% interrupts.CPU101.PMI:Performance_monitoring_interrupts
126.00 ± 14% +420.8% 656.25 ± 19% interrupts.CPU101.RES:Rescheduling_interrupts
122.00 ± 54% +142.4% 295.75 ± 10% interrupts.CPU101.TLB:TLB_shootdowns
3522 ± 6% +267.8% 12953 ± 10% interrupts.CPU102.CAL:Function_call_interrupts
1179 ± 23% -59.8% 474.50 ± 15% interrupts.CPU102.NMI:Non-maskable_interrupts
1179 ± 23% -59.8% 474.50 ± 15% interrupts.CPU102.PMI:Performance_monitoring_interrupts
114.50 ± 5% +1108.1% 1383 ± 84% interrupts.CPU102.RES:Rescheduling_interrupts
3595 ± 2% +268.4% 13246 ± 12% interrupts.CPU103.CAL:Function_call_interrupts
1203 ± 29% -67.0% 397.25 ± 24% interrupts.CPU103.NMI:Non-maskable_interrupts
1203 ± 29% -67.0% 397.25 ± 24% interrupts.CPU103.PMI:Performance_monitoring_interrupts
133.00 ± 16% +417.1% 687.75 ± 22% interrupts.CPU103.RES:Rescheduling_interrupts
3595 ± 3% +258.8% 12900 ± 11% interrupts.CPU104.CAL:Function_call_interrupts
1014 ± 23% -52.5% 481.75 ± 15% interrupts.CPU104.NMI:Non-maskable_interrupts
1014 ± 23% -52.5% 481.75 ± 15% interrupts.CPU104.PMI:Performance_monitoring_interrupts
122.25 ± 21% +420.2% 636.00 ± 19% interrupts.CPU104.RES:Rescheduling_interrupts
3644 ± 5% +256.4% 12988 ± 11% interrupts.CPU105.CAL:Function_call_interrupts
1185 ± 18% -60.8% 464.50 ± 14% interrupts.CPU105.NMI:Non-maskable_interrupts
1185 ± 18% -60.8% 464.50 ± 14% interrupts.CPU105.PMI:Performance_monitoring_interrupts
134.00 ± 27% +331.5% 578.25 ± 19% interrupts.CPU105.RES:Rescheduling_interrupts
3561 ± 3% +269.3% 13152 ± 10% interrupts.CPU106.CAL:Function_call_interrupts
1209 ± 21% -71.5% 345.25 ± 34% interrupts.CPU106.NMI:Non-maskable_interrupts
1209 ± 21% -71.5% 345.25 ± 34% interrupts.CPU106.PMI:Performance_monitoring_interrupts
128.50 ± 34% +370.0% 604.00 ± 16% interrupts.CPU106.RES:Rescheduling_interrupts
116.00 ± 53% +166.2% 308.75 ± 12% interrupts.CPU106.TLB:TLB_shootdowns
3722 ± 5% +255.6% 13235 ± 11% interrupts.CPU107.CAL:Function_call_interrupts
974.50 ± 23% -50.5% 482.00 ± 13% interrupts.CPU107.NMI:Non-maskable_interrupts
974.50 ± 23% -50.5% 482.00 ± 13% interrupts.CPU107.PMI:Performance_monitoring_interrupts
134.75 ± 10% +418.9% 699.25 ± 18% interrupts.CPU107.RES:Rescheduling_interrupts
3858 ± 8% +236.2% 12969 ± 7% interrupts.CPU108.CAL:Function_call_interrupts
1225 ± 13% -67.0% 403.75 ± 21% interrupts.CPU108.NMI:Non-maskable_interrupts
1225 ± 13% -67.0% 403.75 ± 21% interrupts.CPU108.PMI:Performance_monitoring_interrupts
133.25 ± 23% +448.6% 731.00 ± 17% interrupts.CPU108.RES:Rescheduling_interrupts
4061 ± 16% +222.0% 13079 ± 12% interrupts.CPU109.CAL:Function_call_interrupts
1018 ± 26% -58.2% 425.75 ± 33% interrupts.CPU109.NMI:Non-maskable_interrupts
1018 ± 26% -58.2% 425.75 ± 33% interrupts.CPU109.PMI:Performance_monitoring_interrupts
128.00 ± 21% +381.2% 616.00 ± 17% interrupts.CPU109.RES:Rescheduling_interrupts
135.75 ± 13% +80.3% 244.75 ± 26% interrupts.CPU109.TLB:TLB_shootdowns
3488 ± 3% +275.7% 13105 ± 10% interrupts.CPU11.CAL:Function_call_interrupts
934.50 ± 21% -53.7% 433.00 ± 33% interrupts.CPU11.NMI:Non-maskable_interrupts
934.50 ± 21% -53.7% 433.00 ± 33% interrupts.CPU11.PMI:Performance_monitoring_interrupts
124.50 ± 15% +398.8% 621.00 ± 14% interrupts.CPU11.RES:Rescheduling_interrupts
176.50 ± 40% +59.2% 281.00 ± 12% interrupts.CPU11.TLB:TLB_shootdowns
3576 ± 4% +260.6% 12899 ± 10% interrupts.CPU110.CAL:Function_call_interrupts
953.25 ± 19% -49.4% 482.00 ± 15% interrupts.CPU110.NMI:Non-maskable_interrupts
953.25 ± 19% -49.4% 482.00 ± 15% interrupts.CPU110.PMI:Performance_monitoring_interrupts
173.50 ± 43% +445.5% 946.50 ± 67% interrupts.CPU110.RES:Rescheduling_interrupts
152.25 ± 55% +104.8% 311.75 ± 9% interrupts.CPU110.TLB:TLB_shootdowns
3540 +266.9% 12990 ± 10% interrupts.CPU111.CAL:Function_call_interrupts
1165 ± 10% -63.1% 430.25 ± 32% interrupts.CPU111.NMI:Non-maskable_interrupts
1165 ± 10% -63.1% 430.25 ± 32% interrupts.CPU111.PMI:Performance_monitoring_interrupts
122.50 ± 22% +375.9% 583.00 ± 16% interrupts.CPU111.RES:Rescheduling_interrupts
3935 ± 11% +232.1% 13070 ± 10% interrupts.CPU112.CAL:Function_call_interrupts
1054 ± 11% -65.2% 367.00 ± 35% interrupts.CPU112.NMI:Non-maskable_interrupts
1054 ± 11% -65.2% 367.00 ± 35% interrupts.CPU112.PMI:Performance_monitoring_interrupts
145.75 ± 9% +360.9% 671.75 ± 27% interrupts.CPU112.RES:Rescheduling_interrupts
3502 ± 5% +280.2% 13316 ± 8% interrupts.CPU113.CAL:Function_call_interrupts
1085 ± 31% -55.0% 488.25 ± 15% interrupts.CPU113.NMI:Non-maskable_interrupts
1085 ± 31% -55.0% 488.25 ± 15% interrupts.CPU113.PMI:Performance_monitoring_interrupts
138.50 ± 11% +481.8% 805.75 ± 31% interrupts.CPU113.RES:Rescheduling_interrupts
136.50 ± 82% +115.8% 294.50 ± 25% interrupts.CPU113.TLB:TLB_shootdowns
3628 ± 4% +259.6% 13048 ± 9% interrupts.CPU114.CAL:Function_call_interrupts
1108 ± 30% -56.6% 481.00 ± 14% interrupts.CPU114.NMI:Non-maskable_interrupts
1108 ± 30% -56.6% 481.00 ± 14% interrupts.CPU114.PMI:Performance_monitoring_interrupts
129.25 ± 13% +438.5% 696.00 ± 26% interrupts.CPU114.RES:Rescheduling_interrupts
3483 ± 3% +277.8% 13157 ± 10% interrupts.CPU115.CAL:Function_call_interrupts
1167 ± 21% -59.4% 473.75 ± 13% interrupts.CPU115.NMI:Non-maskable_interrupts
1167 ± 21% -59.4% 473.75 ± 13% interrupts.CPU115.PMI:Performance_monitoring_interrupts
129.25 ± 19% +487.4% 759.25 ± 34% interrupts.CPU115.RES:Rescheduling_interrupts
60.25 ± 97% +354.4% 273.75 ± 16% interrupts.CPU115.TLB:TLB_shootdowns
3734 ± 2% +251.3% 13116 ± 9% interrupts.CPU116.CAL:Function_call_interrupts
1186 ± 22% -60.0% 474.50 ± 12% interrupts.CPU116.NMI:Non-maskable_interrupts
1186 ± 22% -60.0% 474.50 ± 12% interrupts.CPU116.PMI:Performance_monitoring_interrupts
146.75 ± 15% +396.4% 728.50 ± 36% interrupts.CPU116.RES:Rescheduling_interrupts
3436 ± 3% +288.8% 13361 ± 11% interrupts.CPU117.CAL:Function_call_interrupts
1100 ± 21% -58.3% 458.25 ± 10% interrupts.CPU117.NMI:Non-maskable_interrupts
1100 ± 21% -58.3% 458.25 ± 10% interrupts.CPU117.PMI:Performance_monitoring_interrupts
130.00 ± 23% +441.3% 703.75 ± 30% interrupts.CPU117.RES:Rescheduling_interrupts
3464 ± 4% +277.0% 13058 ± 9% interrupts.CPU118.CAL:Function_call_interrupts
1037 ± 29% -54.6% 471.00 ± 12% interrupts.CPU118.NMI:Non-maskable_interrupts
1037 ± 29% -54.6% 471.00 ± 12% interrupts.CPU118.PMI:Performance_monitoring_interrupts
173.50 ± 47% +1228.1% 2304 ± 79% interrupts.CPU118.RES:Rescheduling_interrupts
3373 +290.5% 13173 ± 11% interrupts.CPU119.CAL:Function_call_interrupts
881.25 ± 24% -46.6% 470.75 ± 15% interrupts.CPU119.NMI:Non-maskable_interrupts
881.25 ± 24% -46.6% 470.75 ± 15% interrupts.CPU119.PMI:Performance_monitoring_interrupts
123.75 ± 21% +581.8% 843.75 ± 44% interrupts.CPU119.RES:Rescheduling_interrupts
3411 ± 7% +278.2% 12901 ± 9% interrupts.CPU12.CAL:Function_call_interrupts
1379 ± 11% -65.4% 477.75 ± 14% interrupts.CPU12.NMI:Non-maskable_interrupts
1379 ± 11% -65.4% 477.75 ± 14% interrupts.CPU12.PMI:Performance_monitoring_interrupts
117.25 ± 6% +449.7% 644.50 ± 15% interrupts.CPU12.RES:Rescheduling_interrupts
86.75 ± 84% +209.2% 268.25 ± 25% interrupts.CPU12.TLB:TLB_shootdowns
3406 ± 3% +287.2% 13189 ± 7% interrupts.CPU120.CAL:Function_call_interrupts
993.50 ± 27% -52.4% 472.75 ± 20% interrupts.CPU120.NMI:Non-maskable_interrupts
993.50 ± 27% -52.4% 472.75 ± 20% interrupts.CPU120.PMI:Performance_monitoring_interrupts
120.50 ± 15% +437.3% 647.50 ± 30% interrupts.CPU120.RES:Rescheduling_interrupts
75.50 ±146% +475.8% 434.75 ± 55% interrupts.CPU120.TLB:TLB_shootdowns
3557 ± 4% +256.3% 12673 ± 14% interrupts.CPU121.CAL:Function_call_interrupts
1003 ± 21% -61.1% 390.50 ± 27% interrupts.CPU121.NMI:Non-maskable_interrupts
1003 ± 21% -61.1% 390.50 ± 27% interrupts.CPU121.PMI:Performance_monitoring_interrupts
119.25 ± 18% +366.5% 556.25 ± 30% interrupts.CPU121.RES:Rescheduling_interrupts
3815 ± 8% +232.4% 12682 ± 14% interrupts.CPU122.CAL:Function_call_interrupts
992.00 ± 13% -63.4% 362.75 ± 31% interrupts.CPU122.NMI:Non-maskable_interrupts
992.00 ± 13% -63.4% 362.75 ± 31% interrupts.CPU122.PMI:Performance_monitoring_interrupts
122.75 ± 24% +399.8% 613.50 ± 32% interrupts.CPU122.RES:Rescheduling_interrupts
3590 ± 7% +256.0% 12779 ± 13% interrupts.CPU123.CAL:Function_call_interrupts
867.00 ± 25% -60.8% 340.00 ± 43% interrupts.CPU123.NMI:Non-maskable_interrupts
867.00 ± 25% -60.8% 340.00 ± 43% interrupts.CPU123.PMI:Performance_monitoring_interrupts
117.50 ± 22% +408.5% 597.50 ± 30% interrupts.CPU123.RES:Rescheduling_interrupts
3632 ± 9% +254.8% 12886 ± 14% interrupts.CPU124.CAL:Function_call_interrupts
790.00 ± 22% -52.5% 375.00 ± 29% interrupts.CPU124.NMI:Non-maskable_interrupts
790.00 ± 22% -52.5% 375.00 ± 29% interrupts.CPU124.PMI:Performance_monitoring_interrupts
130.50 ± 22% +363.4% 604.75 ± 26% interrupts.CPU124.RES:Rescheduling_interrupts
3643 ± 5% +248.1% 12683 ± 12% interrupts.CPU125.CAL:Function_call_interrupts
894.75 ± 30% -54.1% 410.50 ± 23% interrupts.CPU125.NMI:Non-maskable_interrupts
894.75 ± 30% -54.1% 410.50 ± 23% interrupts.CPU125.PMI:Performance_monitoring_interrupts
131.75 ± 22% +364.9% 612.50 ± 22% interrupts.CPU125.RES:Rescheduling_interrupts
93.00 ±109% +221.2% 298.75 ± 13% interrupts.CPU125.TLB:TLB_shootdowns
3371 ± 6% +273.3% 12586 ± 12% interrupts.CPU126.CAL:Function_call_interrupts
908.00 ± 26% -55.3% 406.00 ± 24% interrupts.CPU126.NMI:Non-maskable_interrupts
908.00 ± 26% -55.3% 406.00 ± 24% interrupts.CPU126.PMI:Performance_monitoring_interrupts
152.25 ± 59% +704.4% 1224 ± 98% interrupts.CPU126.RES:Rescheduling_interrupts
74.00 ± 97% +306.4% 300.75 ± 14% interrupts.CPU126.TLB:TLB_shootdowns
3611 ± 3% +261.5% 13057 ± 10% interrupts.CPU127.CAL:Function_call_interrupts
796.00 ± 17% -51.2% 388.25 ± 29% interrupts.CPU127.NMI:Non-maskable_interrupts
796.00 ± 17% -51.2% 388.25 ± 29% interrupts.CPU127.PMI:Performance_monitoring_interrupts
122.00 ± 20% +346.5% 544.75 ± 34% interrupts.CPU127.RES:Rescheduling_interrupts
3532 ± 3% +270.0% 13070 ± 12% interrupts.CPU128.CAL:Function_call_interrupts
902.75 ± 34% -54.5% 410.50 ± 24% interrupts.CPU128.NMI:Non-maskable_interrupts
902.75 ± 34% -54.5% 410.50 ± 24% interrupts.CPU128.PMI:Performance_monitoring_interrupts
115.50 ± 10% +390.3% 566.25 ± 18% interrupts.CPU128.RES:Rescheduling_interrupts
115.50 ± 67% +167.7% 309.25 ± 20% interrupts.CPU128.TLB:TLB_shootdowns
3529 ± 4% +263.6% 12831 ± 14% interrupts.CPU129.CAL:Function_call_interrupts
968.25 ± 19% -51.8% 466.50 ± 19% interrupts.CPU129.NMI:Non-maskable_interrupts
968.25 ± 19% -51.8% 466.50 ± 19% interrupts.CPU129.PMI:Performance_monitoring_interrupts
112.00 ± 16% +359.6% 514.75 ± 21% interrupts.CPU129.RES:Rescheduling_interrupts
3687 ± 3% +249.5% 12888 ± 12% interrupts.CPU13.CAL:Function_call_interrupts
912.50 ± 28% -46.8% 485.25 ± 15% interrupts.CPU13.NMI:Non-maskable_interrupts
912.50 ± 28% -46.8% 485.25 ± 15% interrupts.CPU13.PMI:Performance_monitoring_interrupts
134.25 ± 4% +356.6% 613.00 ± 15% interrupts.CPU13.RES:Rescheduling_interrupts
117.50 ± 79% +95.5% 229.75 ± 29% interrupts.CPU13.TLB:TLB_shootdowns
3600 ± 5% +256.1% 12820 ± 14% interrupts.CPU130.CAL:Function_call_interrupts
872.50 ± 9% -47.9% 454.50 ± 16% interrupts.CPU130.NMI:Non-maskable_interrupts
872.50 ± 9% -47.9% 454.50 ± 16% interrupts.CPU130.PMI:Performance_monitoring_interrupts
105.75 ± 10% +370.0% 497.00 ± 24% interrupts.CPU130.RES:Rescheduling_interrupts
36.00 ±122% +704.2% 289.50 ± 10% interrupts.CPU130.TLB:TLB_shootdowns
3626 ± 3% +255.1% 12877 ± 12% interrupts.CPU131.CAL:Function_call_interrupts
968.00 ± 25% -50.4% 479.75 ± 17% interrupts.CPU131.NMI:Non-maskable_interrupts
968.00 ± 25% -50.4% 479.75 ± 17% interrupts.CPU131.PMI:Performance_monitoring_interrupts
102.75 ± 5% +364.0% 476.75 ± 25% interrupts.CPU131.RES:Rescheduling_interrupts
3481 ± 3% +262.4% 12616 ± 11% interrupts.CPU132.CAL:Function_call_interrupts
856.50 ± 28% -45.2% 469.00 ± 16% interrupts.CPU132.NMI:Non-maskable_interrupts
856.50 ± 28% -45.2% 469.00 ± 16% interrupts.CPU132.PMI:Performance_monitoring_interrupts
116.25 ± 17% +384.7% 563.50 ± 20% interrupts.CPU132.RES:Rescheduling_interrupts
3528 +269.1% 13025 ± 12% interrupts.CPU133.CAL:Function_call_interrupts
106.00 ± 17% +396.0% 525.75 ± 21% interrupts.CPU133.RES:Rescheduling_interrupts
3585 ± 3% +263.1% 13016 ± 13% interrupts.CPU134.CAL:Function_call_interrupts
115.50 ± 7% +319.0% 484.00 ± 22% interrupts.CPU134.RES:Rescheduling_interrupts
3377 ± 2% +281.4% 12880 ± 15% interrupts.CPU135.CAL:Function_call_interrupts
780.50 ± 30% -50.4% 387.00 ± 25% interrupts.CPU135.NMI:Non-maskable_interrupts
780.50 ± 30% -50.4% 387.00 ± 25% interrupts.CPU135.PMI:Performance_monitoring_interrupts
97.75 ± 8% +438.9% 526.75 ± 37% interrupts.CPU135.RES:Rescheduling_interrupts
3861 ± 7% +230.0% 12739 ± 13% interrupts.CPU136.CAL:Function_call_interrupts
115.50 ± 15% +391.8% 568.00 ± 20% interrupts.CPU136.RES:Rescheduling_interrupts
3641 ± 5% +253.5% 12873 ± 12% interrupts.CPU137.CAL:Function_call_interrupts
111.50 ± 16% +474.2% 640.25 ± 15% interrupts.CPU137.RES:Rescheduling_interrupts
3680 ± 3% +250.1% 12886 ± 9% interrupts.CPU138.CAL:Function_call_interrupts
97.75 ± 22% +341.9% 432.00 ± 25% interrupts.CPU138.RES:Rescheduling_interrupts
3670 ± 3% +256.7% 13090 ± 13% interrupts.CPU139.CAL:Function_call_interrupts
114.00 ± 5% +290.8% 445.50 ± 20% interrupts.CPU139.RES:Rescheduling_interrupts
3626 +255.9% 12904 ± 9% interrupts.CPU14.CAL:Function_call_interrupts
979.00 ± 16% -57.6% 415.50 ± 24% interrupts.CPU14.NMI:Non-maskable_interrupts
979.00 ± 16% -57.6% 415.50 ± 24% interrupts.CPU14.PMI:Performance_monitoring_interrupts
127.00 ± 14% +351.4% 573.25 ± 22% interrupts.CPU14.RES:Rescheduling_interrupts
3458 ± 6% +274.5% 12951 ± 14% interrupts.CPU140.CAL:Function_call_interrupts
105.00 ± 20% +290.7% 410.25 ± 21% interrupts.CPU140.RES:Rescheduling_interrupts
78.25 ± 96% +228.8% 257.25 ± 18% interrupts.CPU140.TLB:TLB_shootdowns
3426 ± 4% +275.1% 12853 ± 13% interrupts.CPU141.CAL:Function_call_interrupts
99.75 ± 10% +309.3% 408.25 ± 24% interrupts.CPU141.RES:Rescheduling_interrupts
140.75 ± 68% +108.3% 293.25 ± 9% interrupts.CPU141.TLB:TLB_shootdowns
3553 ± 5% +261.8% 12855 ± 12% interrupts.CPU142.CAL:Function_call_interrupts
107.00 ± 19% +268.7% 394.50 ± 29% interrupts.CPU142.RES:Rescheduling_interrupts
95.50 ±119% +244.2% 328.75 ± 8% interrupts.CPU142.TLB:TLB_shootdowns
3548 +261.2% 12816 ± 10% interrupts.CPU143.CAL:Function_call_interrupts
896.00 ± 39% -55.4% 399.75 ± 25% interrupts.CPU143.NMI:Non-maskable_interrupts
896.00 ± 39% -55.4% 399.75 ± 25% interrupts.CPU143.PMI:Performance_monitoring_interrupts
89.75 ± 7% +386.6% 436.75 ± 24% interrupts.CPU143.RES:Rescheduling_interrupts
82.75 ± 96% +275.2% 310.50 ± 10% interrupts.CPU143.TLB:TLB_shootdowns
3595 ± 11% +280.8% 13692 ± 7% interrupts.CPU144.CAL:Function_call_interrupts
896.25 ± 34% -46.4% 480.75 ± 13% interrupts.CPU144.NMI:Non-maskable_interrupts
896.25 ± 34% -46.4% 480.75 ± 13% interrupts.CPU144.PMI:Performance_monitoring_interrupts
114.50 ± 10% +346.9% 511.75 ± 18% interrupts.CPU144.RES:Rescheduling_interrupts
3585 ± 10% +258.5% 12851 ± 8% interrupts.CPU145.CAL:Function_call_interrupts
926.50 ± 26% -55.9% 408.75 ± 23% interrupts.CPU145.NMI:Non-maskable_interrupts
926.50 ± 26% -55.9% 408.75 ± 23% interrupts.CPU145.PMI:Performance_monitoring_interrupts
100.75 ± 12% +379.9% 483.50 ± 18% interrupts.CPU145.RES:Rescheduling_interrupts
4049 ± 17% +217.7% 12865 ± 8% interrupts.CPU146.CAL:Function_call_interrupts
102.75 ± 10% +369.3% 482.25 ± 19% interrupts.CPU146.RES:Rescheduling_interrupts
3614 ± 6% +263.4% 13135 ± 8% interrupts.CPU147.CAL:Function_call_interrupts
928.50 ± 28% -56.1% 408.00 ± 22% interrupts.CPU147.NMI:Non-maskable_interrupts
928.50 ± 28% -56.1% 408.00 ± 22% interrupts.CPU147.PMI:Performance_monitoring_interrupts
99.50 ± 11% +372.9% 470.50 ± 19% interrupts.CPU147.RES:Rescheduling_interrupts
3432 ± 4% +271.4% 12748 ± 8% interrupts.CPU148.CAL:Function_call_interrupts
954.25 ± 33% -56.4% 416.00 ± 24% interrupts.CPU148.NMI:Non-maskable_interrupts
954.25 ± 33% -56.4% 416.00 ± 24% interrupts.CPU148.PMI:Performance_monitoring_interrupts
103.00 ± 15% +345.9% 459.25 ± 18% interrupts.CPU148.RES:Rescheduling_interrupts
3467 ± 6% +285.2% 13358 ± 8% interrupts.CPU149.CAL:Function_call_interrupts
897.50 ± 31% -61.8% 342.50 ± 18% interrupts.CPU149.NMI:Non-maskable_interrupts
897.50 ± 31% -61.8% 342.50 ± 18% interrupts.CPU149.PMI:Performance_monitoring_interrupts
100.00 ± 10% +406.0% 506.00 ± 21% interrupts.CPU149.RES:Rescheduling_interrupts
3744 ± 15% +244.6% 12901 ± 11% interrupts.CPU15.CAL:Function_call_interrupts
132.75 ± 9% +325.0% 564.25 ± 23% interrupts.CPU15.RES:Rescheduling_interrupts
113.75 ± 55% +185.7% 325.00 ± 7% interrupts.CPU15.TLB:TLB_shootdowns
3291 ± 5% +295.5% 13016 ± 7% interrupts.CPU150.CAL:Function_call_interrupts
888.25 ± 30% -52.9% 418.00 ± 21% interrupts.CPU150.NMI:Non-maskable_interrupts
888.25 ± 30% -52.9% 418.00 ± 21% interrupts.CPU150.PMI:Performance_monitoring_interrupts
98.00 ± 7% +516.8% 604.50 ± 16% interrupts.CPU150.RES:Rescheduling_interrupts
135.25 ± 53% +119.6% 297.00 ± 12% interrupts.CPU150.TLB:TLB_shootdowns
3472 ± 4% +282.4% 13277 ± 11% interrupts.CPU151.CAL:Function_call_interrupts
792.75 ± 20% -48.5% 408.25 ± 23% interrupts.CPU151.NMI:Non-maskable_interrupts
792.75 ± 20% -48.5% 408.25 ± 23% interrupts.CPU151.PMI:Performance_monitoring_interrupts
141.50 ± 44% +318.6% 592.25 ± 14% interrupts.CPU151.RES:Rescheduling_interrupts
3272 ± 3% +275.1% 12276 ± 8% interrupts.CPU152.CAL:Function_call_interrupts
912.25 ± 40% -54.8% 412.00 ± 25% interrupts.CPU152.NMI:Non-maskable_interrupts
912.25 ± 40% -54.8% 412.00 ± 25% interrupts.CPU152.PMI:Performance_monitoring_interrupts
94.25 ± 7% +361.5% 435.00 ± 24% interrupts.CPU152.RES:Rescheduling_interrupts
132.75 ±100% +154.0% 337.25 ± 21% interrupts.CPU152.TLB:TLB_shootdowns
3541 ± 6% +281.3% 13501 ± 11% interrupts.CPU153.CAL:Function_call_interrupts
712.75 ± 15% -41.9% 414.00 ± 24% interrupts.CPU153.NMI:Non-maskable_interrupts
712.75 ± 15% -41.9% 414.00 ± 24% interrupts.CPU153.PMI:Performance_monitoring_interrupts
116.50 ± 34% +426.8% 613.75 ± 13% interrupts.CPU153.RES:Rescheduling_interrupts
3384 ± 3% +299.0% 13506 ± 8% interrupts.CPU154.CAL:Function_call_interrupts
824.75 ± 38% -49.2% 419.25 ± 23% interrupts.CPU154.NMI:Non-maskable_interrupts
824.75 ± 38% -49.2% 419.25 ± 23% interrupts.CPU154.PMI:Performance_monitoring_interrupts
111.50 ± 28% +480.3% 647.00 ± 17% interrupts.CPU154.RES:Rescheduling_interrupts
3412 ± 6% +287.7% 13229 ± 8% interrupts.CPU155.CAL:Function_call_interrupts
614.25 ± 20% -30.9% 424.75 ± 23% interrupts.CPU155.NMI:Non-maskable_interrupts
614.25 ± 20% -30.9% 424.75 ± 23% interrupts.CPU155.PMI:Performance_monitoring_interrupts
112.25 ± 25% +468.2% 637.75 ± 11% interrupts.CPU155.RES:Rescheduling_interrupts
3605 ± 9% +262.4% 13065 ± 10% interrupts.CPU156.CAL:Function_call_interrupts
716.75 ± 37% -44.4% 398.25 ± 19% interrupts.CPU156.NMI:Non-maskable_interrupts
716.75 ± 37% -44.4% 398.25 ± 19% interrupts.CPU156.PMI:Performance_monitoring_interrupts
120.00 ± 17% +426.2% 631.50 ± 16% interrupts.CPU156.RES:Rescheduling_interrupts
3461 ± 4% +282.6% 13243 ± 8% interrupts.CPU157.CAL:Function_call_interrupts
619.25 ± 10% -33.3% 412.75 ± 22% interrupts.CPU157.NMI:Non-maskable_interrupts
619.25 ± 10% -33.3% 412.75 ± 22% interrupts.CPU157.PMI:Performance_monitoring_interrupts
106.75 ± 28% +315.5% 443.50 ± 13% interrupts.CPU157.RES:Rescheduling_interrupts
3445 ± 5% +281.3% 13136 ± 12% interrupts.CPU158.CAL:Function_call_interrupts
790.50 ± 32% -48.0% 411.00 ± 24% interrupts.CPU158.NMI:Non-maskable_interrupts
790.50 ± 32% -48.0% 411.00 ± 24% interrupts.CPU158.PMI:Performance_monitoring_interrupts
143.50 ± 48% +657.3% 1086 ± 78% interrupts.CPU158.RES:Rescheduling_interrupts
3497 ± 2% +273.3% 13054 ± 9% interrupts.CPU159.CAL:Function_call_interrupts
1103 ± 32% -62.5% 414.00 ± 24% interrupts.CPU159.NMI:Non-maskable_interrupts
1103 ± 32% -62.5% 414.00 ± 24% interrupts.CPU159.PMI:Performance_monitoring_interrupts
120.25 ± 30% +425.8% 632.25 ± 15% interrupts.CPU159.RES:Rescheduling_interrupts
3602 ± 4% +259.2% 12941 ± 10% interrupts.CPU16.CAL:Function_call_interrupts
1050 ± 16% -58.6% 434.75 ± 33% interrupts.CPU16.NMI:Non-maskable_interrupts
1050 ± 16% -58.6% 434.75 ± 33% interrupts.CPU16.PMI:Performance_monitoring_interrupts
122.75 ± 7% +364.6% 570.25 ± 15% interrupts.CPU16.RES:Rescheduling_interrupts
156.50 ± 60% +82.6% 285.75 ± 8% interrupts.CPU16.TLB:TLB_shootdowns
3554 ± 8% +271.8% 13217 ± 8% interrupts.CPU160.CAL:Function_call_interrupts
849.00 ± 35% -43.7% 478.25 ± 13% interrupts.CPU160.NMI:Non-maskable_interrupts
849.00 ± 35% -43.7% 478.25 ± 13% interrupts.CPU160.PMI:Performance_monitoring_interrupts
99.25 ± 15% +514.9% 610.25 ± 12% interrupts.CPU160.RES:Rescheduling_interrupts
3671 ± 10% +256.4% 13084 ± 9% interrupts.CPU161.CAL:Function_call_interrupts
99.75 ± 12% +508.5% 607.00 ± 12% interrupts.CPU161.RES:Rescheduling_interrupts
3379 ± 6% +288.9% 13141 ± 10% interrupts.CPU162.CAL:Function_call_interrupts
96.00 ± 5% +499.5% 575.50 ± 18% interrupts.CPU162.RES:Rescheduling_interrupts
110.75 ± 86% +156.2% 283.75 ± 15% interrupts.CPU162.TLB:TLB_shootdowns
3749 ± 5% +249.1% 13090 ± 10% interrupts.CPU163.CAL:Function_call_interrupts
800.25 ± 17% -39.7% 482.25 ± 15% interrupts.CPU163.NMI:Non-maskable_interrupts
800.25 ± 17% -39.7% 482.25 ± 15% interrupts.CPU163.PMI:Performance_monitoring_interrupts
110.50 ± 7% +445.2% 602.50 ± 16% interrupts.CPU163.RES:Rescheduling_interrupts
3497 ± 2% +284.6% 13449 ± 10% interrupts.CPU164.CAL:Function_call_interrupts
103.75 ± 4% +510.1% 633.00 ± 16% interrupts.CPU164.RES:Rescheduling_interrupts
3473 ± 7% +284.5% 13355 ± 9% interrupts.CPU165.CAL:Function_call_interrupts
972.25 ± 36% -50.6% 480.50 ± 15% interrupts.CPU165.NMI:Non-maskable_interrupts
972.25 ± 36% -50.6% 480.50 ± 15% interrupts.CPU165.PMI:Performance_monitoring_interrupts
112.50 ± 9% +442.4% 610.25 ± 14% interrupts.CPU165.RES:Rescheduling_interrupts
3657 ± 5% +263.9% 13307 ± 7% interrupts.CPU166.CAL:Function_call_interrupts
1118 ± 27% -56.7% 484.25 ± 13% interrupts.CPU166.NMI:Non-maskable_interrupts
1118 ± 27% -56.7% 484.25 ± 13% interrupts.CPU166.PMI:Performance_monitoring_interrupts
102.75 ± 5% +504.1% 620.75 ± 14% interrupts.CPU166.RES:Rescheduling_interrupts
3421 ± 2% +288.4% 13291 ± 8% interrupts.CPU167.CAL:Function_call_interrupts
1080 ± 31% -55.2% 484.00 ± 16% interrupts.CPU167.NMI:Non-maskable_interrupts
1080 ± 31% -55.2% 484.00 ± 16% interrupts.CPU167.PMI:Performance_monitoring_interrupts
101.00 ± 14% +568.3% 675.00 ± 13% interrupts.CPU167.RES:Rescheduling_interrupts
3635 ± 6% +239.2% 12330 ± 19% interrupts.CPU168.CAL:Function_call_interrupts
1099 ± 22% -62.5% 411.75 ± 23% interrupts.CPU168.NMI:Non-maskable_interrupts
1099 ± 22% -62.5% 411.75 ± 23% interrupts.CPU168.PMI:Performance_monitoring_interrupts
123.25 ± 22% +340.4% 542.75 ± 23% interrupts.CPU168.RES:Rescheduling_interrupts
3532 ± 5% +222.2% 11381 ± 21% interrupts.CPU169.CAL:Function_call_interrupts
117.00 ± 13% +268.2% 430.75 ± 23% interrupts.CPU169.RES:Rescheduling_interrupts
3558 ± 2% +271.5% 13220 ± 11% interrupts.CPU17.CAL:Function_call_interrupts
879.00 ± 37% -52.3% 419.00 ± 24% interrupts.CPU17.NMI:Non-maskable_interrupts
879.00 ± 37% -52.3% 419.00 ± 24% interrupts.CPU17.PMI:Performance_monitoring_interrupts
125.75 ± 8% +394.0% 621.25 ± 23% interrupts.CPU17.RES:Rescheduling_interrupts
193.25 ± 29% +54.6% 298.75 ± 10% interrupts.CPU17.TLB:TLB_shootdowns
3708 ± 8% +216.1% 11723 ± 22% interrupts.CPU170.CAL:Function_call_interrupts
124.75 ± 13% +239.1% 423.00 ± 30% interrupts.CPU170.RES:Rescheduling_interrupts
171.50 ± 60% +81.9% 312.00 ± 16% interrupts.CPU170.TLB:TLB_shootdowns
3627 ± 11% +215.2% 11433 ± 21% interrupts.CPU171.CAL:Function_call_interrupts
870.25 ± 26% -46.0% 470.00 ± 19% interrupts.CPU171.NMI:Non-maskable_interrupts
870.25 ± 26% -46.0% 470.00 ± 19% interrupts.CPU171.PMI:Performance_monitoring_interrupts
121.75 ± 13% +254.8% 432.00 ± 28% interrupts.CPU171.RES:Rescheduling_interrupts
184.50 ± 28% +72.2% 317.75 ± 13% interrupts.CPU171.TLB:TLB_shootdowns
3585 ± 5% +225.8% 11679 ± 23% interrupts.CPU172.CAL:Function_call_interrupts
970.00 ± 32% -58.9% 399.00 ± 25% interrupts.CPU172.NMI:Non-maskable_interrupts
970.00 ± 32% -58.9% 399.00 ± 25% interrupts.CPU172.PMI:Performance_monitoring_interrupts
110.75 ± 7% +318.1% 463.00 ± 26% interrupts.CPU172.RES:Rescheduling_interrupts
3843 ± 8% +202.6% 11629 ± 22% interrupts.CPU173.CAL:Function_call_interrupts
1008 ± 25% -59.7% 406.00 ± 27% interrupts.CPU173.NMI:Non-maskable_interrupts
1008 ± 25% -59.7% 406.00 ± 27% interrupts.CPU173.PMI:Performance_monitoring_interrupts
135.50 ± 15% +229.7% 446.75 ± 25% interrupts.CPU173.RES:Rescheduling_interrupts
3586 ± 5% +237.4% 12101 ± 22% interrupts.CPU174.CAL:Function_call_interrupts
796.25 ± 24% -49.5% 402.25 ± 23% interrupts.CPU174.NMI:Non-maskable_interrupts
796.25 ± 24% -49.5% 402.25 ± 23% interrupts.CPU174.PMI:Performance_monitoring_interrupts
108.00 ± 22% +381.7% 520.25 ± 29% interrupts.CPU174.RES:Rescheduling_interrupts
129.50 ± 61% +138.4% 308.75 ± 16% interrupts.CPU174.TLB:TLB_shootdowns
3871 ± 8% +205.7% 11832 ± 22% interrupts.CPU175.CAL:Function_call_interrupts
121.00 ± 14% +298.3% 482.00 ± 24% interrupts.CPU175.RES:Rescheduling_interrupts
3790 ± 7% +216.7% 12003 ± 23% interrupts.CPU176.CAL:Function_call_interrupts
897.25 ± 26% -61.5% 345.75 ± 37% interrupts.CPU176.NMI:Non-maskable_interrupts
897.25 ± 26% -61.5% 345.75 ± 37% interrupts.CPU176.PMI:Performance_monitoring_interrupts
137.50 ± 19% +239.5% 466.75 ± 26% interrupts.CPU176.RES:Rescheduling_interrupts
3762 ± 7% +214.3% 11824 ± 22% interrupts.CPU177.CAL:Function_call_interrupts
826.00 ± 22% -63.8% 299.00 ± 49% interrupts.CPU177.NMI:Non-maskable_interrupts
826.00 ± 22% -63.8% 299.00 ± 49% interrupts.CPU177.PMI:Performance_monitoring_interrupts
129.50 ± 20% +262.0% 468.75 ± 26% interrupts.CPU177.RES:Rescheduling_interrupts
3855 ± 7% +209.2% 11923 ± 22% interrupts.CPU178.CAL:Function_call_interrupts
767.50 ± 48% -59.6% 309.75 ± 47% interrupts.CPU178.NMI:Non-maskable_interrupts
767.50 ± 48% -59.6% 309.75 ± 47% interrupts.CPU178.PMI:Performance_monitoring_interrupts
148.50 ± 36% +226.8% 485.25 ± 27% interrupts.CPU178.RES:Rescheduling_interrupts
3510 ± 6% +250.7% 12310 ± 23% interrupts.CPU179.CAL:Function_call_interrupts
1009 ± 38% -69.8% 304.25 ± 48% interrupts.CPU179.NMI:Non-maskable_interrupts
1009 ± 38% -69.8% 304.25 ± 48% interrupts.CPU179.PMI:Performance_monitoring_interrupts
115.00 ± 20% +330.9% 495.50 ± 25% interrupts.CPU179.RES:Rescheduling_interrupts
3528 ± 3% +275.1% 13235 ± 11% interrupts.CPU18.CAL:Function_call_interrupts
1106 ± 18% -56.3% 484.00 ± 14% interrupts.CPU18.NMI:Non-maskable_interrupts
1106 ± 18% -56.3% 484.00 ± 14% interrupts.CPU18.PMI:Performance_monitoring_interrupts
117.00 ± 20% +419.9% 608.25 ± 20% interrupts.CPU18.RES:Rescheduling_interrupts
86.25 ± 83% +233.0% 287.25 ± 12% interrupts.CPU18.TLB:TLB_shootdowns
3629 ± 6% +225.3% 11806 ± 23% interrupts.CPU180.CAL:Function_call_interrupts
123.50 ± 12% +279.1% 468.25 ± 24% interrupts.CPU180.RES:Rescheduling_interrupts
3833 ± 12% +199.6% 11483 ± 22% interrupts.CPU181.CAL:Function_call_interrupts
150.75 ± 14% +206.6% 462.25 ± 25% interrupts.CPU181.RES:Rescheduling_interrupts
3650 ± 7% +225.6% 11886 ± 21% interrupts.CPU182.CAL:Function_call_interrupts
166.25 ± 27% +169.0% 447.25 ± 27% interrupts.CPU182.RES:Rescheduling_interrupts
4067 ± 17% +190.4% 11810 ± 22% interrupts.CPU183.CAL:Function_call_interrupts
938.00 ± 28% -54.3% 429.00 ± 32% interrupts.CPU183.NMI:Non-maskable_interrupts
938.00 ± 28% -54.3% 429.00 ± 32% interrupts.CPU183.PMI:Performance_monitoring_interrupts
128.00 ± 19% +285.7% 493.75 ± 24% interrupts.CPU183.RES:Rescheduling_interrupts
135.75 ± 66% +96.7% 267.00 ± 12% interrupts.CPU183.TLB:TLB_shootdowns
3877 ± 7% +206.8% 11895 ± 21% interrupts.CPU184.CAL:Function_call_interrupts
137.25 ± 15% +291.6% 537.50 ± 24% interrupts.CPU184.RES:Rescheduling_interrupts
3864 ± 10% +218.7% 12316 ± 23% interrupts.CPU185.CAL:Function_call_interrupts
1241 ± 21% -66.5% 415.50 ± 35% interrupts.CPU185.NMI:Non-maskable_interrupts
1241 ± 21% -66.5% 415.50 ± 35% interrupts.CPU185.PMI:Performance_monitoring_interrupts
118.00 ± 20% +280.5% 449.00 ± 19% interrupts.CPU185.RES:Rescheduling_interrupts
3983 ± 8% +198.0% 11869 ± 22% interrupts.CPU186.CAL:Function_call_interrupts
127.25 ± 20% +252.1% 448.00 ± 23% interrupts.CPU186.RES:Rescheduling_interrupts
3736 ± 8% +217.9% 11875 ± 22% interrupts.CPU187.CAL:Function_call_interrupts
116.00 ± 19% +309.7% 475.25 ± 26% interrupts.CPU187.RES:Rescheduling_interrupts
105.50 ± 94% +203.6% 320.25 ± 13% interrupts.CPU187.TLB:TLB_shootdowns
4204 ± 21% +187.5% 12088 ± 23% interrupts.CPU188.CAL:Function_call_interrupts
1119 ± 21% -57.2% 479.50 ± 15% interrupts.CPU188.NMI:Non-maskable_interrupts
1119 ± 21% -57.2% 479.50 ± 15% interrupts.CPU188.PMI:Performance_monitoring_interrupts
132.25 ± 21% +267.1% 485.50 ± 27% interrupts.CPU188.RES:Rescheduling_interrupts
3737 ± 3% +219.7% 11947 ± 22% interrupts.CPU189.CAL:Function_call_interrupts
1084 ± 25% -56.5% 471.75 ± 15% interrupts.CPU189.NMI:Non-maskable_interrupts
1084 ± 25% -56.5% 471.75 ± 15% interrupts.CPU189.PMI:Performance_monitoring_interrupts
116.00 ± 17% +320.3% 487.50 ± 27% interrupts.CPU189.RES:Rescheduling_interrupts
3550 ± 3% +270.2% 13144 ± 11% interrupts.CPU19.CAL:Function_call_interrupts
1112 ± 12% -57.3% 474.50 ± 13% interrupts.CPU19.NMI:Non-maskable_interrupts
1112 ± 12% -57.3% 474.50 ± 13% interrupts.CPU19.PMI:Performance_monitoring_interrupts
129.75 ± 19% +319.5% 544.25 ± 20% interrupts.CPU19.RES:Rescheduling_interrupts
3723 ± 8% +224.3% 12072 ± 22% interrupts.CPU190.CAL:Function_call_interrupts
117.75 ± 18% +310.0% 482.75 ± 28% interrupts.CPU190.RES:Rescheduling_interrupts
158.75 ± 60% +76.7% 280.50 ± 10% interrupts.CPU190.TLB:TLB_shootdowns
3735 ± 10% +201.3% 11254 ± 21% interrupts.CPU191.CAL:Function_call_interrupts
948.00 ± 36% -50.4% 470.25 ± 14% interrupts.CPU191.NMI:Non-maskable_interrupts
948.00 ± 36% -50.4% 470.25 ± 14% interrupts.CPU191.PMI:Performance_monitoring_interrupts
106.75 ± 11% +336.8% 466.25 ± 22% interrupts.CPU191.RES:Rescheduling_interrupts
3551 ± 3% +276.8% 13382 ± 7% interrupts.CPU2.CAL:Function_call_interrupts
1165 ± 20% -59.7% 469.75 ± 13% interrupts.CPU2.NMI:Non-maskable_interrupts
1165 ± 20% -59.7% 469.75 ± 13% interrupts.CPU2.PMI:Performance_monitoring_interrupts
130.25 ± 6% +342.6% 576.50 ± 15% interrupts.CPU2.RES:Rescheduling_interrupts
3588 ± 4% +259.8% 12909 ± 11% interrupts.CPU20.CAL:Function_call_interrupts
1092 ± 23% -56.8% 471.50 ± 13% interrupts.CPU20.NMI:Non-maskable_interrupts
1092 ± 23% -56.8% 471.50 ± 13% interrupts.CPU20.PMI:Performance_monitoring_interrupts
129.00 ± 24% +349.4% 579.75 ± 17% interrupts.CPU20.RES:Rescheduling_interrupts
3647 ± 16% +252.2% 12847 ± 11% interrupts.CPU21.CAL:Function_call_interrupts
960.00 ± 25% -52.0% 461.00 ± 11% interrupts.CPU21.NMI:Non-maskable_interrupts
960.00 ± 25% -52.0% 461.00 ± 11% interrupts.CPU21.PMI:Performance_monitoring_interrupts
122.25 ± 8% +348.9% 548.75 ± 21% interrupts.CPU21.RES:Rescheduling_interrupts
3602 +259.5% 12950 ± 10% interrupts.CPU22.CAL:Function_call_interrupts
1074 ± 21% -56.0% 472.75 ± 11% interrupts.CPU22.NMI:Non-maskable_interrupts
1074 ± 21% -56.0% 472.75 ± 11% interrupts.CPU22.PMI:Performance_monitoring_interrupts
129.25 ± 7% +386.8% 629.25 ± 22% interrupts.CPU22.RES:Rescheduling_interrupts
54.25 ± 72% +320.7% 228.25 ± 37% interrupts.CPU22.TLB:TLB_shootdowns
3515 ± 3% +268.0% 12936 ± 10% interrupts.CPU23.CAL:Function_call_interrupts
1099 ± 17% -63.3% 403.00 ± 20% interrupts.CPU23.NMI:Non-maskable_interrupts
1099 ± 17% -63.3% 403.00 ± 20% interrupts.CPU23.PMI:Performance_monitoring_interrupts
120.75 ± 13% +380.1% 579.75 ± 15% interrupts.CPU23.RES:Rescheduling_interrupts
3661 ± 3% +256.1% 13037 ± 8% interrupts.CPU24.CAL:Function_call_interrupts
1189 ± 8% -65.9% 405.25 ± 27% interrupts.CPU24.NMI:Non-maskable_interrupts
1189 ± 8% -65.9% 405.25 ± 27% interrupts.CPU24.PMI:Performance_monitoring_interrupts
140.00 ± 16% +434.5% 748.25 ± 19% interrupts.CPU24.RES:Rescheduling_interrupts
3679 ± 2% +247.0% 12766 ± 15% interrupts.CPU25.CAL:Function_call_interrupts
1086 ± 24% -64.0% 391.25 ± 27% interrupts.CPU25.NMI:Non-maskable_interrupts
1086 ± 24% -64.0% 391.25 ± 27% interrupts.CPU25.PMI:Performance_monitoring_interrupts
118.50 ± 22% +340.7% 522.25 ± 22% interrupts.CPU25.RES:Rescheduling_interrupts
3680 ± 6% +248.0% 12807 ± 14% interrupts.CPU26.CAL:Function_call_interrupts
1243 ± 17% -70.9% 362.25 ± 30% interrupts.CPU26.NMI:Non-maskable_interrupts
1243 ± 17% -70.9% 362.25 ± 30% interrupts.CPU26.PMI:Performance_monitoring_interrupts
126.00 ± 10% +351.0% 568.25 ± 26% interrupts.CPU26.RES:Rescheduling_interrupts
103.75 ± 79% +189.2% 300.00 ± 8% interrupts.CPU26.TLB:TLB_shootdowns
3692 ± 5% +243.3% 12674 ± 13% interrupts.CPU27.CAL:Function_call_interrupts
921.25 ± 21% -71.2% 265.25 ± 24% interrupts.CPU27.NMI:Non-maskable_interrupts
921.25 ± 21% -71.2% 265.25 ± 24% interrupts.CPU27.PMI:Performance_monitoring_interrupts
133.75 ± 2% +332.3% 578.25 ± 21% interrupts.CPU27.RES:Rescheduling_interrupts
100.50 ±102% +172.4% 273.75 ± 24% interrupts.CPU27.TLB:TLB_shootdowns
3552 ± 6% +275.9% 13355 ± 12% interrupts.CPU28.CAL:Function_call_interrupts
1047 ± 21% -75.9% 252.75 ± 15% interrupts.CPU28.NMI:Non-maskable_interrupts
1047 ± 21% -75.9% 252.75 ± 15% interrupts.CPU28.PMI:Performance_monitoring_interrupts
116.75 ± 15% +366.8% 545.00 ± 22% interrupts.CPU28.RES:Rescheduling_interrupts
111.00 ±102% +183.6% 314.75 ± 9% interrupts.CPU28.TLB:TLB_shootdowns
3536 ± 3% +258.1% 12663 ± 12% interrupts.CPU29.CAL:Function_call_interrupts
879.50 ± 32% -68.5% 276.75 ± 17% interrupts.CPU29.NMI:Non-maskable_interrupts
879.50 ± 32% -68.5% 276.75 ± 17% interrupts.CPU29.PMI:Performance_monitoring_interrupts
131.00 ± 20% +392.6% 645.25 ± 22% interrupts.CPU29.RES:Rescheduling_interrupts
38.50 ±167% +545.5% 248.50 ± 41% interrupts.CPU29.TLB:TLB_shootdowns
3513 ± 4% +285.4% 13541 ± 7% interrupts.CPU3.CAL:Function_call_interrupts
124.75 ± 8% +366.1% 581.50 ± 20% interrupts.CPU3.RES:Rescheduling_interrupts
89.75 ± 47% +153.2% 227.25 ± 17% interrupts.CPU3.TLB:TLB_shootdowns
3494 ± 3% +258.4% 12524 ± 12% interrupts.CPU30.CAL:Function_call_interrupts
856.50 ± 14% -58.7% 353.50 ± 38% interrupts.CPU30.NMI:Non-maskable_interrupts
856.50 ± 14% -58.7% 353.50 ± 38% interrupts.CPU30.PMI:Performance_monitoring_interrupts
121.25 ± 12% +329.5% 520.75 ± 22% interrupts.CPU30.RES:Rescheduling_interrupts
86.50 ±119% +199.4% 259.00 ± 33% interrupts.CPU30.TLB:TLB_shootdowns
3761 ± 3% +238.8% 12741 ± 14% interrupts.CPU31.CAL:Function_call_interrupts
898.75 ± 8% -63.2% 331.00 ± 41% interrupts.CPU31.NMI:Non-maskable_interrupts
898.75 ± 8% -63.2% 331.00 ± 41% interrupts.CPU31.PMI:Performance_monitoring_interrupts
132.00 ± 16% +310.6% 542.00 ± 23% interrupts.CPU31.RES:Rescheduling_interrupts
3794 ± 7% +241.1% 12944 ± 12% interrupts.CPU32.CAL:Function_call_interrupts
127.50 ± 20% +353.3% 578.00 ± 22% interrupts.CPU32.RES:Rescheduling_interrupts
158.00 ± 66% +92.2% 303.75 ± 13% interrupts.CPU32.TLB:TLB_shootdowns
3523 ± 5% +260.0% 12684 ± 13% interrupts.CPU33.CAL:Function_call_interrupts
117.50 ± 2% +326.2% 500.75 ± 26% interrupts.CPU33.RES:Rescheduling_interrupts
3621 ± 2% +255.2% 12865 ± 13% interrupts.CPU34.CAL:Function_call_interrupts
839.25 ± 21% -46.1% 452.00 ± 16% interrupts.CPU34.NMI:Non-maskable_interrupts
839.25 ± 21% -46.1% 452.00 ± 16% interrupts.CPU34.PMI:Performance_monitoring_interrupts
122.25 ± 11% +368.3% 572.50 ± 23% interrupts.CPU34.RES:Rescheduling_interrupts
144.50 ± 81% +134.8% 339.25 ± 2% interrupts.CPU34.TLB:TLB_shootdowns
3680 ± 4% +247.2% 12778 ± 11% interrupts.CPU35.CAL:Function_call_interrupts
923.00 ± 26% -48.7% 473.75 ± 16% interrupts.CPU35.NMI:Non-maskable_interrupts
923.00 ± 26% -48.7% 473.75 ± 16% interrupts.CPU35.PMI:Performance_monitoring_interrupts
130.00 ± 12% +325.0% 552.50 ± 22% interrupts.CPU35.RES:Rescheduling_interrupts
3446 ± 2% +268.4% 12695 ± 11% interrupts.CPU36.CAL:Function_call_interrupts
814.00 ± 23% -51.5% 394.50 ± 22% interrupts.CPU36.NMI:Non-maskable_interrupts
814.00 ± 23% -51.5% 394.50 ± 22% interrupts.CPU36.PMI:Performance_monitoring_interrupts
106.50 ± 15% +410.3% 543.50 ± 19% interrupts.CPU36.RES:Rescheduling_interrupts
3700 ± 5% +247.8% 12871 ± 13% interrupts.CPU37.CAL:Function_call_interrupts
717.75 ± 35% -43.1% 408.75 ± 23% interrupts.CPU37.NMI:Non-maskable_interrupts
717.75 ± 35% -43.1% 408.75 ± 23% interrupts.CPU37.PMI:Performance_monitoring_interrupts
117.50 ± 14% +367.9% 549.75 ± 23% interrupts.CPU37.RES:Rescheduling_interrupts
3528 +262.6% 12796 ± 14% interrupts.CPU38.CAL:Function_call_interrupts
917.25 ± 50% -56.1% 403.00 ± 22% interrupts.CPU38.NMI:Non-maskable_interrupts
917.25 ± 50% -56.1% 403.00 ± 22% interrupts.CPU38.PMI:Performance_monitoring_interrupts
118.25 ± 9% +369.1% 554.75 ± 20% interrupts.CPU38.RES:Rescheduling_interrupts
3697 ± 10% +244.9% 12753 ± 14% interrupts.CPU39.CAL:Function_call_interrupts
113.75 ± 21% +368.4% 532.75 ± 19% interrupts.CPU39.RES:Rescheduling_interrupts
116.25 ± 78% +193.5% 341.25 ± 6% interrupts.CPU39.TLB:TLB_shootdowns
3487 ± 2% +274.6% 13062 ± 10% interrupts.CPU4.CAL:Function_call_interrupts
122.00 ± 16% +365.0% 567.25 ± 19% interrupts.CPU4.RES:Rescheduling_interrupts
3830 ± 10% +232.1% 12721 ± 13% interrupts.CPU40.CAL:Function_call_interrupts
818.00 ± 33% -51.3% 398.50 ± 23% interrupts.CPU40.NMI:Non-maskable_interrupts
818.00 ± 33% -51.3% 398.50 ± 23% interrupts.CPU40.PMI:Performance_monitoring_interrupts
119.00 ± 4% +381.5% 573.00 ± 23% interrupts.CPU40.RES:Rescheduling_interrupts
3514 +266.3% 12871 ± 12% interrupts.CPU41.CAL:Function_call_interrupts
1007 ± 19% -65.6% 346.50 ± 37% interrupts.CPU41.NMI:Non-maskable_interrupts
1007 ± 19% -65.6% 346.50 ± 37% interrupts.CPU41.PMI:Performance_monitoring_interrupts
116.25 ± 10% +374.0% 551.00 ± 26% interrupts.CPU41.RES:Rescheduling_interrupts
62.00 ± 88% +277.4% 234.00 ± 28% interrupts.CPU41.TLB:TLB_shootdowns
3723 ± 6% +248.5% 12978 ± 9% interrupts.CPU42.CAL:Function_call_interrupts
136.00 ± 14% +295.2% 537.50 ± 20% interrupts.CPU42.RES:Rescheduling_interrupts
45.75 ±139% +440.4% 247.25 ± 15% interrupts.CPU42.TLB:TLB_shootdowns
3752 ± 2% +234.6% 12555 ± 13% interrupts.CPU43.CAL:Function_call_interrupts
118.75 ± 21% +352.2% 537.00 ± 24% interrupts.CPU43.RES:Rescheduling_interrupts
3622 ± 3% +253.6% 12807 ± 12% interrupts.CPU44.CAL:Function_call_interrupts
1098 ± 17% -67.3% 359.50 ± 38% interrupts.CPU44.NMI:Non-maskable_interrupts
1098 ± 17% -67.3% 359.50 ± 38% interrupts.CPU44.PMI:Performance_monitoring_interrupts
126.75 ± 6% +339.3% 556.75 ± 24% interrupts.CPU44.RES:Rescheduling_interrupts
76.50 ±153% +319.3% 320.75 ± 12% interrupts.CPU44.TLB:TLB_shootdowns
3651 ± 5% +245.1% 12601 ± 13% interrupts.CPU45.CAL:Function_call_interrupts
1091 ± 7% -67.8% 351.75 ± 38% interrupts.CPU45.NMI:Non-maskable_interrupts
1091 ± 7% -67.8% 351.75 ± 38% interrupts.CPU45.PMI:Performance_monitoring_interrupts
119.50 ± 16% +350.0% 537.75 ± 19% interrupts.CPU45.RES:Rescheduling_interrupts
3481 ± 3% +264.5% 12690 ± 14% interrupts.CPU46.CAL:Function_call_interrupts
1052 ± 24% -66.3% 354.00 ± 37% interrupts.CPU46.NMI:Non-maskable_interrupts
1052 ± 24% -66.3% 354.00 ± 37% interrupts.CPU46.PMI:Performance_monitoring_interrupts
119.25 ± 15% +351.6% 538.50 ± 23% interrupts.CPU46.RES:Rescheduling_interrupts
3616 ± 4% +248.6% 12606 ± 11% interrupts.CPU47.CAL:Function_call_interrupts
1100 ± 22% -62.0% 418.25 ± 36% interrupts.CPU47.NMI:Non-maskable_interrupts
1100 ± 22% -62.0% 418.25 ± 36% interrupts.CPU47.PMI:Performance_monitoring_interrupts
108.00 ± 14% +408.8% 549.50 ± 17% interrupts.CPU47.RES:Rescheduling_interrupts
41.25 ±133% +570.3% 276.50 ± 22% interrupts.CPU47.TLB:TLB_shootdowns
3535 ± 9% +281.0% 13468 ± 5% interrupts.CPU48.CAL:Function_call_interrupts
925.75 ± 24% -59.8% 371.75 ± 45% interrupts.CPU48.NMI:Non-maskable_interrupts
925.75 ± 24% -59.8% 371.75 ± 45% interrupts.CPU48.PMI:Performance_monitoring_interrupts
127.25 ± 8% +432.2% 677.25 ± 13% interrupts.CPU48.RES:Rescheduling_interrupts
3647 ± 13% +261.5% 13187 ± 10% interrupts.CPU49.CAL:Function_call_interrupts
958.00 ± 32% -51.8% 462.00 ± 16% interrupts.CPU49.NMI:Non-maskable_interrupts
958.00 ± 32% -51.8% 462.00 ± 16% interrupts.CPU49.PMI:Performance_monitoring_interrupts
131.50 ± 12% +379.7% 630.75 ± 15% interrupts.CPU49.RES:Rescheduling_interrupts
3779 ± 8% +245.3% 13049 ± 9% interrupts.CPU5.CAL:Function_call_interrupts
113.50 ± 8% +471.6% 648.75 ± 19% interrupts.CPU5.RES:Rescheduling_interrupts
155.00 ± 32% +60.6% 249.00 ± 15% interrupts.CPU5.TLB:TLB_shootdowns
3724 ± 12% +248.1% 12963 ± 10% interrupts.CPU50.CAL:Function_call_interrupts
934.25 ± 23% -49.7% 470.25 ± 15% interrupts.CPU50.NMI:Non-maskable_interrupts
934.25 ± 23% -49.7% 470.25 ± 15% interrupts.CPU50.PMI:Performance_monitoring_interrupts
117.00 ± 10% +388.2% 571.25 ± 16% interrupts.CPU50.RES:Rescheduling_interrupts
3687 ± 9% +253.9% 13051 ± 8% interrupts.CPU51.CAL:Function_call_interrupts
964.00 ± 26% -50.8% 474.25 ± 17% interrupts.CPU51.NMI:Non-maskable_interrupts
964.00 ± 26% -50.8% 474.25 ± 17% interrupts.CPU51.PMI:Performance_monitoring_interrupts
129.00 ± 12% +357.6% 590.25 ± 12% interrupts.CPU51.RES:Rescheduling_interrupts
3725 ± 9% +246.1% 12891 ± 9% interrupts.CPU52.CAL:Function_call_interrupts
903.75 ± 44% -47.6% 474.00 ± 15% interrupts.CPU52.NMI:Non-maskable_interrupts
903.75 ± 44% -47.6% 474.00 ± 15% interrupts.CPU52.PMI:Performance_monitoring_interrupts
110.25 ± 11% +418.6% 571.75 ± 17% interrupts.CPU52.RES:Rescheduling_interrupts
172.50 ± 42% +63.0% 281.25 interrupts.CPU52.TLB:TLB_shootdowns
3854 ± 24% +236.8% 12982 ± 8% interrupts.CPU53.CAL:Function_call_interrupts
109.25 ± 13% +441.4% 591.50 ± 17% interrupts.CPU53.RES:Rescheduling_interrupts
3417 ± 3% +295.9% 13527 ± 8% interrupts.CPU54.CAL:Function_call_interrupts
793.00 ± 18% -40.8% 469.25 ± 16% interrupts.CPU54.NMI:Non-maskable_interrupts
793.00 ± 18% -40.8% 469.25 ± 16% interrupts.CPU54.PMI:Performance_monitoring_interrupts
125.25 ± 12% +421.6% 653.25 ± 12% interrupts.CPU54.RES:Rescheduling_interrupts
3512 ± 9% +278.2% 13281 ± 10% interrupts.CPU55.CAL:Function_call_interrupts
776.50 ± 31% -48.0% 404.00 ± 27% interrupts.CPU55.NMI:Non-maskable_interrupts
776.50 ± 31% -48.0% 404.00 ± 27% interrupts.CPU55.PMI:Performance_monitoring_interrupts
119.75 ± 14% +370.4% 563.25 ± 19% interrupts.CPU55.RES:Rescheduling_interrupts
140.00 ± 49% +106.1% 288.50 ± 17% interrupts.CPU55.TLB:TLB_shootdowns
3482 ± 7% +261.0% 12572 ± 9% interrupts.CPU56.CAL:Function_call_interrupts
897.00 ± 22% -48.0% 466.75 ± 16% interrupts.CPU56.NMI:Non-maskable_interrupts
897.00 ± 22% -48.0% 466.75 ± 16% interrupts.CPU56.PMI:Performance_monitoring_interrupts
116.00 ± 19% +379.5% 556.25 ± 16% interrupts.CPU56.RES:Rescheduling_interrupts
3594 ± 10% +263.4% 13061 ± 9% interrupts.CPU57.CAL:Function_call_interrupts
798.25 ± 7% -40.5% 475.00 ± 17% interrupts.CPU57.NMI:Non-maskable_interrupts
798.25 ± 7% -40.5% 475.00 ± 17% interrupts.CPU57.PMI:Performance_monitoring_interrupts
111.00 ± 9% +444.4% 604.25 ± 12% interrupts.CPU57.RES:Rescheduling_interrupts
3498 ± 3% +276.7% 13176 ± 9% interrupts.CPU58.CAL:Function_call_interrupts
858.00 ± 15% -44.2% 479.00 ± 16% interrupts.CPU58.NMI:Non-maskable_interrupts
858.00 ± 15% -44.2% 479.00 ± 16% interrupts.CPU58.PMI:Performance_monitoring_interrupts
101.75 ± 10% +480.1% 590.25 ± 14% interrupts.CPU58.RES:Rescheduling_interrupts
194.00 ± 35% +54.8% 300.25 ± 8% interrupts.CPU58.TLB:TLB_shootdowns
3487 ± 5% +276.2% 13119 ± 8% interrupts.CPU59.CAL:Function_call_interrupts
932.75 ± 31% -47.3% 491.75 ± 12% interrupts.CPU59.NMI:Non-maskable_interrupts
932.75 ± 31% -47.3% 491.75 ± 12% interrupts.CPU59.PMI:Performance_monitoring_interrupts
119.50 ± 10% +496.7% 713.00 ± 17% interrupts.CPU59.RES:Rescheduling_interrupts
136.50 ± 17% +61.9% 221.00 ± 22% interrupts.CPU59.TLB:TLB_shootdowns
3576 ± 3% +269.4% 13212 ± 10% interrupts.CPU6.CAL:Function_call_interrupts
1043 ± 16% -58.7% 430.75 ± 33% interrupts.CPU6.NMI:Non-maskable_interrupts
1043 ± 16% -58.7% 430.75 ± 33% interrupts.CPU6.PMI:Performance_monitoring_interrupts
119.00 ± 9% +408.4% 605.00 ± 12% interrupts.CPU6.RES:Rescheduling_interrupts
3509 ± 5% +264.8% 12804 ± 8% interrupts.CPU60.CAL:Function_call_interrupts
1138 ± 13% -59.9% 456.75 ± 16% interrupts.CPU60.NMI:Non-maskable_interrupts
1138 ± 13% -59.9% 456.75 ± 16% interrupts.CPU60.PMI:Performance_monitoring_interrupts
113.75 ± 11% +400.2% 569.00 ± 21% interrupts.CPU60.RES:Rescheduling_interrupts
3560 ± 5% +267.5% 13087 ± 10% interrupts.CPU61.CAL:Function_call_interrupts
121.50 ± 7% +386.8% 591.50 ± 16% interrupts.CPU61.RES:Rescheduling_interrupts
207.00 ± 30% +53.6% 318.00 ± 13% interrupts.CPU61.TLB:TLB_shootdowns
3470 ± 3% +278.0% 13117 ± 10% interrupts.CPU62.CAL:Function_call_interrupts
1070 ± 28% -55.2% 479.25 ± 17% interrupts.CPU62.NMI:Non-maskable_interrupts
1070 ± 28% -55.2% 479.25 ± 17% interrupts.CPU62.PMI:Performance_monitoring_interrupts
114.00 ± 4% +389.7% 558.25 ± 15% interrupts.CPU62.RES:Rescheduling_interrupts
93.00 ± 65% +175.0% 255.75 ± 22% interrupts.CPU62.TLB:TLB_shootdowns
3594 ± 5% +270.2% 13306 ± 7% interrupts.CPU63.CAL:Function_call_interrupts
996.75 ± 27% -52.3% 475.00 ± 16% interrupts.CPU63.NMI:Non-maskable_interrupts
996.75 ± 27% -52.3% 475.00 ± 16% interrupts.CPU63.PMI:Performance_monitoring_interrupts
106.25 ± 3% +440.7% 574.50 ± 18% interrupts.CPU63.RES:Rescheduling_interrupts
163.25 ± 40% +72.3% 281.25 ± 24% interrupts.CPU63.TLB:TLB_shootdowns
3603 ± 7% +260.6% 12995 ± 9% interrupts.CPU64.CAL:Function_call_interrupts
979.50 ± 24% -52.2% 467.75 ± 15% interrupts.CPU64.NMI:Non-maskable_interrupts
979.50 ± 24% -52.2% 467.75 ± 15% interrupts.CPU64.PMI:Performance_monitoring_interrupts
104.25 ± 10% +443.6% 566.75 ± 15% interrupts.CPU64.RES:Rescheduling_interrupts
3598 ± 7% +255.8% 12804 ± 9% interrupts.CPU65.CAL:Function_call_interrupts
873.50 ± 24% -44.8% 482.25 ± 13% interrupts.CPU65.NMI:Non-maskable_interrupts
873.50 ± 24% -44.8% 482.25 ± 13% interrupts.CPU65.PMI:Performance_monitoring_interrupts
115.50 ± 9% +451.3% 636.75 ± 17% interrupts.CPU65.RES:Rescheduling_interrupts
134.75 ± 36% +109.5% 282.25 ± 4% interrupts.CPU65.TLB:TLB_shootdowns
3546 ± 5% +264.0% 12910 ± 10% interrupts.CPU66.CAL:Function_call_interrupts
1243 ± 13% -63.1% 459.00 ± 18% interrupts.CPU66.NMI:Non-maskable_interrupts
1243 ± 13% -63.1% 459.00 ± 18% interrupts.CPU66.PMI:Performance_monitoring_interrupts
120.00 ± 7% +371.9% 566.25 ± 12% interrupts.CPU66.RES:Rescheduling_interrupts
3368 ± 8% +287.0% 13036 ± 9% interrupts.CPU67.CAL:Function_call_interrupts
109.00 ± 12% +420.2% 567.00 ± 13% interrupts.CPU67.RES:Rescheduling_interrupts
120.50 ± 70% +124.7% 270.75 ± 16% interrupts.CPU67.TLB:TLB_shootdowns
3358 ± 5% +287.0% 12995 ± 10% interrupts.CPU68.CAL:Function_call_interrupts
971.00 ± 27% -51.2% 474.00 ± 16% interrupts.CPU68.NMI:Non-maskable_interrupts
971.00 ± 27% -51.2% 474.00 ± 16% interrupts.CPU68.PMI:Performance_monitoring_interrupts
116.75 ± 15% +376.2% 556.00 ± 19% interrupts.CPU68.RES:Rescheduling_interrupts
111.00 ± 12% +106.8% 229.50 ± 34% interrupts.CPU68.TLB:TLB_shootdowns
3624 ± 7% +268.5% 13354 ± 9% interrupts.CPU69.CAL:Function_call_interrupts
112.75 ± 16% +382.0% 543.50 ± 14% interrupts.CPU69.RES:Rescheduling_interrupts
3480 ± 2% +269.5% 12861 ± 11% interrupts.CPU7.CAL:Function_call_interrupts
1253 ± 14% -62.7% 468.00 ± 16% interrupts.CPU7.NMI:Non-maskable_interrupts
1253 ± 14% -62.7% 468.00 ± 16% interrupts.CPU7.PMI:Performance_monitoring_interrupts
125.00 ± 12% +348.2% 560.25 ± 19% interrupts.CPU7.RES:Rescheduling_interrupts
3442 ± 6% +281.4% 13129 ± 8% interrupts.CPU70.CAL:Function_call_interrupts
110.75 ± 9% +408.8% 563.50 ± 17% interrupts.CPU70.RES:Rescheduling_interrupts
140.75 ± 32% +88.8% 265.75 ± 21% interrupts.CPU70.TLB:TLB_shootdowns
3521 ± 8% +270.0% 13031 ± 9% interrupts.CPU71.CAL:Function_call_interrupts
101.75 ± 8% +488.5% 598.75 ± 15% interrupts.CPU71.RES:Rescheduling_interrupts
3633 ± 10% +235.3% 12184 ± 20% interrupts.CPU72.CAL:Function_call_interrupts
1348 ± 10% -64.6% 477.75 ± 16% interrupts.CPU72.NMI:Non-maskable_interrupts
1348 ± 10% -64.6% 477.75 ± 16% interrupts.CPU72.PMI:Performance_monitoring_interrupts
154.75 ± 21% +288.0% 600.50 ± 23% interrupts.CPU72.RES:Rescheduling_interrupts
3492 ± 10% +223.2% 11287 ± 22% interrupts.CPU73.CAL:Function_call_interrupts
848.00 ± 25% -44.4% 471.75 ± 16% interrupts.CPU73.NMI:Non-maskable_interrupts
848.00 ± 25% -44.4% 471.75 ± 16% interrupts.CPU73.PMI:Performance_monitoring_interrupts
127.75 ± 9% +228.0% 419.00 ± 20% interrupts.CPU73.RES:Rescheduling_interrupts
3799 ± 9% +201.4% 11451 ± 22% interrupts.CPU74.CAL:Function_call_interrupts
1162 ± 12% -59.4% 471.75 ± 18% interrupts.CPU74.NMI:Non-maskable_interrupts
1162 ± 12% -59.4% 471.75 ± 18% interrupts.CPU74.PMI:Performance_monitoring_interrupts
134.25 ± 19% +210.4% 416.75 ± 25% interrupts.CPU74.RES:Rescheduling_interrupts
3599 ± 13% +218.6% 11467 ± 22% interrupts.CPU75.CAL:Function_call_interrupts
1113 ± 17% -58.0% 467.75 ± 19% interrupts.CPU75.NMI:Non-maskable_interrupts
1113 ± 17% -58.0% 467.75 ± 19% interrupts.CPU75.PMI:Performance_monitoring_interrupts
127.50 ± 26% +240.2% 433.75 ± 25% interrupts.CPU75.RES:Rescheduling_interrupts
3698 ± 15% +211.5% 11518 ± 22% interrupts.CPU76.CAL:Function_call_interrupts
1147 ± 18% -59.5% 465.00 ± 17% interrupts.CPU76.NMI:Non-maskable_interrupts
1147 ± 18% -59.5% 465.00 ± 17% interrupts.CPU76.PMI:Performance_monitoring_interrupts
130.25 ± 24% +250.9% 457.00 ± 26% interrupts.CPU76.RES:Rescheduling_interrupts
3557 ± 9% +247.5% 12361 ± 17% interrupts.CPU77.CAL:Function_call_interrupts
1059 ± 23% -55.8% 468.25 ± 17% interrupts.CPU77.NMI:Non-maskable_interrupts
1059 ± 23% -55.8% 468.25 ± 17% interrupts.CPU77.PMI:Performance_monitoring_interrupts
114.75 ± 16% +272.5% 427.50 ± 26% interrupts.CPU77.RES:Rescheduling_interrupts
3790 ± 10% +212.2% 11833 ± 23% interrupts.CPU78.CAL:Function_call_interrupts
942.50 ± 14% -50.5% 467.00 ± 19% interrupts.CPU78.NMI:Non-maskable_interrupts
942.50 ± 14% -50.5% 467.00 ± 19% interrupts.CPU78.PMI:Performance_monitoring_interrupts
144.25 ± 24% +223.4% 466.50 ± 23% interrupts.CPU78.RES:Rescheduling_interrupts
3620 ± 3% +225.0% 11767 ± 22% interrupts.CPU79.CAL:Function_call_interrupts
912.50 ± 16% -55.8% 403.50 ± 28% interrupts.CPU79.NMI:Non-maskable_interrupts
912.50 ± 16% -55.8% 403.50 ± 28% interrupts.CPU79.PMI:Performance_monitoring_interrupts
110.75 ± 20% +302.7% 446.00 ± 22% interrupts.CPU79.RES:Rescheduling_interrupts
3611 ± 5% +250.3% 12651 ± 10% interrupts.CPU8.CAL:Function_call_interrupts
951.50 ± 7% -54.4% 433.75 ± 33% interrupts.CPU8.NMI:Non-maskable_interrupts
951.50 ± 7% -54.4% 433.75 ± 33% interrupts.CPU8.PMI:Performance_monitoring_interrupts
122.25 ± 14% +386.3% 594.50 ± 15% interrupts.CPU8.RES:Rescheduling_interrupts
124.00 ± 75% +155.4% 316.75 ± 18% interrupts.CPU8.TLB:TLB_shootdowns
3868 ± 6% +197.5% 11507 ± 21% interrupts.CPU80.CAL:Function_call_interrupts
1215 ± 10% -61.7% 464.75 ± 19% interrupts.CPU80.NMI:Non-maskable_interrupts
1215 ± 10% -61.7% 464.75 ± 19% interrupts.CPU80.PMI:Performance_monitoring_interrupts
126.00 ± 14% +229.2% 414.75 ± 25% interrupts.CPU80.RES:Rescheduling_interrupts
3596 ± 4% +223.1% 11617 ± 22% interrupts.CPU81.CAL:Function_call_interrupts
1061 ± 23% -56.7% 459.00 ± 16% interrupts.CPU81.NMI:Non-maskable_interrupts
1061 ± 23% -56.7% 459.00 ± 16% interrupts.CPU81.PMI:Performance_monitoring_interrupts
123.25 ± 3% +280.9% 469.50 ± 25% interrupts.CPU81.RES:Rescheduling_interrupts
3815 ± 8% +211.8% 11895 ± 22% interrupts.CPU82.CAL:Function_call_interrupts
130.50 ± 14% +264.0% 475.00 ± 28% interrupts.CPU82.RES:Rescheduling_interrupts
3541 ± 8% +234.9% 11862 ± 22% interrupts.CPU83.CAL:Function_call_interrupts
1100 ± 7% -57.6% 466.75 ± 17% interrupts.CPU83.NMI:Non-maskable_interrupts
1100 ± 7% -57.6% 466.75 ± 17% interrupts.CPU83.PMI:Performance_monitoring_interrupts
123.00 ± 14% +308.7% 502.75 ± 24% interrupts.CPU83.RES:Rescheduling_interrupts
3865 ± 4% +203.2% 11720 ± 22% interrupts.CPU84.CAL:Function_call_interrupts
1199 ± 15% -60.7% 471.25 ± 13% interrupts.CPU84.NMI:Non-maskable_interrupts
1199 ± 15% -60.7% 471.25 ± 13% interrupts.CPU84.PMI:Performance_monitoring_interrupts
144.75 ± 10% +204.7% 441.00 ± 27% interrupts.CPU84.RES:Rescheduling_interrupts
3869 ± 2% +195.5% 11435 ± 21% interrupts.CPU85.CAL:Function_call_interrupts
1019 ± 14% -53.9% 469.75 ± 19% interrupts.CPU85.NMI:Non-maskable_interrupts
1019 ± 14% -53.9% 469.75 ± 19% interrupts.CPU85.PMI:Performance_monitoring_interrupts
127.25 ± 20% +230.3% 420.25 ± 23% interrupts.CPU85.RES:Rescheduling_interrupts
3700 ± 6% +213.8% 11611 ± 21% interrupts.CPU86.CAL:Function_call_interrupts
963.50 ± 25% -49.7% 485.00 ± 15% interrupts.CPU86.NMI:Non-maskable_interrupts
963.50 ± 25% -49.7% 485.00 ± 15% interrupts.CPU86.PMI:Performance_monitoring_interrupts
124.00 ± 25% +264.3% 451.75 ± 21% interrupts.CPU86.RES:Rescheduling_interrupts
3764 ± 11% +202.7% 11395 ± 22% interrupts.CPU87.CAL:Function_call_interrupts
893.50 ± 27% -46.8% 475.50 ± 13% interrupts.CPU87.NMI:Non-maskable_interrupts
893.50 ± 27% -46.8% 475.50 ± 13% interrupts.CPU87.PMI:Performance_monitoring_interrupts
116.25 ± 18% +266.5% 426.00 ± 28% interrupts.CPU87.RES:Rescheduling_interrupts
3632 ± 7% +231.6% 12045 ± 21% interrupts.CPU88.CAL:Function_call_interrupts
1147 ± 20% -58.6% 474.75 ± 16% interrupts.CPU88.NMI:Non-maskable_interrupts
1147 ± 20% -58.6% 474.75 ± 16% interrupts.CPU88.PMI:Performance_monitoring_interrupts
122.00 ± 16% +274.0% 456.25 ± 25% interrupts.CPU88.RES:Rescheduling_interrupts
3739 ± 6% +215.9% 11811 ± 23% interrupts.CPU89.CAL:Function_call_interrupts
1187 ± 28% -60.7% 466.50 ± 16% interrupts.CPU89.NMI:Non-maskable_interrupts
1187 ± 28% -60.7% 466.50 ± 16% interrupts.CPU89.PMI:Performance_monitoring_interrupts
122.00 ± 14% +260.5% 439.75 ± 23% interrupts.CPU89.RES:Rescheduling_interrupts
3541 ± 5% +256.0% 12606 ± 11% interrupts.CPU9.CAL:Function_call_interrupts
826.50 ± 21% -49.8% 414.75 ± 33% interrupts.CPU9.NMI:Non-maskable_interrupts
826.50 ± 21% -49.8% 414.75 ± 33% interrupts.CPU9.PMI:Performance_monitoring_interrupts
119.50 ± 16% +380.3% 574.00 ± 14% interrupts.CPU9.RES:Rescheduling_interrupts
3599 ± 4% +224.8% 11688 ± 22% interrupts.CPU90.CAL:Function_call_interrupts
891.75 ± 7% -48.3% 461.00 ± 18% interrupts.CPU90.NMI:Non-maskable_interrupts
891.75 ± 7% -48.3% 461.00 ± 18% interrupts.CPU90.PMI:Performance_monitoring_interrupts
123.25 ± 3% +283.8% 473.00 ± 21% interrupts.CPU90.RES:Rescheduling_interrupts
3608 ± 3% +227.5% 11817 ± 22% interrupts.CPU91.CAL:Function_call_interrupts
111.75 ± 12% +294.0% 440.25 ± 22% interrupts.CPU91.RES:Rescheduling_interrupts
3545 ± 5% +232.7% 11795 ± 20% interrupts.CPU92.CAL:Function_call_interrupts
1196 ± 15% -60.2% 476.00 ± 15% interrupts.CPU92.NMI:Non-maskable_interrupts
1196 ± 15% -60.2% 476.00 ± 15% interrupts.CPU92.PMI:Performance_monitoring_interrupts
134.25 ± 7% +236.9% 452.25 ± 27% interrupts.CPU92.RES:Rescheduling_interrupts
3651 ± 13% +217.4% 11589 ± 21% interrupts.CPU93.CAL:Function_call_interrupts
114.75 ± 20% +293.5% 451.50 ± 25% interrupts.CPU93.RES:Rescheduling_interrupts
3516 ± 5% +234.6% 11765 ± 21% interrupts.CPU94.CAL:Function_call_interrupts
948.25 ± 25% -50.2% 472.25 ± 16% interrupts.CPU94.NMI:Non-maskable_interrupts
948.25 ± 25% -50.2% 472.25 ± 16% interrupts.CPU94.PMI:Performance_monitoring_interrupts
127.50 ± 8% +312.7% 526.25 ± 25% interrupts.CPU94.RES:Rescheduling_interrupts
4030 ± 13% +180.7% 11311 ± 21% interrupts.CPU95.CAL:Function_call_interrupts
1095 ± 15% -57.7% 463.50 ± 13% interrupts.CPU95.NMI:Non-maskable_interrupts
1095 ± 15% -57.7% 463.50 ± 13% interrupts.CPU95.PMI:Performance_monitoring_interrupts
115.75 ± 10% +283.2% 443.50 ± 26% interrupts.CPU95.RES:Rescheduling_interrupts
3557 ± 5% +259.3% 12782 ± 11% interrupts.CPU96.CAL:Function_call_interrupts
119.75 ± 13% +371.2% 564.25 ± 18% interrupts.CPU96.RES:Rescheduling_interrupts
3490 ± 4% +287.2% 13515 ± 16% interrupts.CPU97.CAL:Function_call_interrupts
943.50 ± 35% -57.4% 402.25 ± 23% interrupts.CPU97.NMI:Non-maskable_interrupts
943.50 ± 35% -57.4% 402.25 ± 23% interrupts.CPU97.PMI:Performance_monitoring_interrupts
130.25 ± 17% +435.5% 697.50 ± 24% interrupts.CPU97.RES:Rescheduling_interrupts
3598 ± 6% +265.8% 13160 ± 12% interrupts.CPU98.CAL:Function_call_interrupts
1166 ± 19% -60.4% 461.50 ± 14% interrupts.CPU98.NMI:Non-maskable_interrupts
1166 ± 19% -60.4% 461.50 ± 14% interrupts.CPU98.PMI:Performance_monitoring_interrupts
111.00 ± 18% +420.7% 578.00 ± 13% interrupts.CPU98.RES:Rescheduling_interrupts
168.50 ± 72% +81.6% 306.00 ± 15% interrupts.CPU98.TLB:TLB_shootdowns
3455 ± 5% +300.4% 13834 ± 8% interrupts.CPU99.CAL:Function_call_interrupts
873.75 ± 28% -45.8% 473.25 ± 14% interrupts.CPU99.NMI:Non-maskable_interrupts
873.75 ± 28% -45.8% 473.25 ± 14% interrupts.CPU99.PMI:Performance_monitoring_interrupts
108.75 ± 17% +481.8% 632.75 ± 20% interrupts.CPU99.RES:Rescheduling_interrupts
90.75 ± 54% +466.4% 514.00 ± 4% interrupts.IWI:IRQ_work_interrupts
185055 ± 9% -54.5% 84131 ± 14% interrupts.NMI:Non-maskable_interrupts
185055 ± 9% -54.5% 84131 ± 14% interrupts.PMI:Performance_monitoring_interrupts
23309 ± 5% +373.8% 110434 ± 9% interrupts.RES:Rescheduling_interrupts
29544 ± 31% +69.3% 50026 ± 8% interrupts.TLB:TLB_shootdowns
vm-scalability.time.user_time
450 +---------------------------------------------------------------------+
| O |
400 |-+ O O O O O |
350 |-+O O O O O O |
| |
300 |-+ |
250 |-+ O O O O |
| |
200 |-+ |
150 |-+ |
| |
100 |-+ |
50 |-+ |
|..+.+..+.+..+..+.+..+.+..+..+.+..+.+..+.+..+..+.+..+.+..+..+.+..+.+..|
0 +---------------------------------------------------------------------+
vm-scalability.time.elapsed_time
325 +---------------------------------------------------------------------+
| O |
| |
320 |-+ |
| |
| |
315 |-+ |
| O O |
310 |-+O O O O O O O O O O O O |
| O |
| |
305 |-+ |
|..+. .+.+..+..+. .+..+.. .+.. .+.+..+..+.+.. .+. .+. |
| +. +..+ + +.+. +.+..+. +. +..|
300 +---------------------------------------------------------------------+
vm-scalability.time.elapsed_time.max
325 +---------------------------------------------------------------------+
| O |
| |
320 |-+ |
| |
| |
315 |-+ |
| O O |
310 |-+O O O O O O O O O O O O |
| O |
| |
305 |-+ |
|..+. .+.+..+..+. .+..+.. .+.. .+.+..+..+.+.. .+. .+. |
| +. +..+ + +.+. +.+..+. +. +..|
300 +---------------------------------------------------------------------+
vm-scalability.time.minor_page_faults
1.8e+08 +-----------------------------------------------------------------+
| O |
1.6e+08 |-+ |
1.4e+08 |-+ O O |
| |
1.2e+08 |-+ |
1e+08 |-+ |
| O O O O O O O O O |
8e+07 |-+ O O O O |
6e+07 |-+ |
| |
4e+07 |-+ |
2e+07 |-+ |
|.+..+.+..+.+..+.+..+.+.+..+.+..+.+..+.+..+.+.+..+.+..+.+..+.+..+.|
0 +-----------------------------------------------------------------+
vm-scalability.time.voluntary_context_switches
1.8e+08 +-----------------------------------------------------------------+
| O |
1.6e+08 |-+ |
1.4e+08 |-+ O O |
| |
1.2e+08 |-+ |
1e+08 |-+ O |
| O O O O O O O O O |
8e+07 |-+ O O O |
6e+07 |-+ |
| |
4e+07 |-+ |
2e+07 |-+ |
|.+..+. .+.+.. .+..+.+.. |
0 +-----------------------------------------------------------------+
perf-sched.total_wait_and_delay.count.ms
3.5e+06 +-----------------------------------------------------------------+
| O |
3e+06 |-+ |
| |
2.5e+06 |-+ |
| |
2e+06 |-+ |
| O O O O O O O O O |
1.5e+06 |-+ O O O |
| O O O |
1e+06 |-+ |
| |
500000 |.+..+.+..+.+.. .+.+..+.+..+.+..+.|
| +.+..+.+.+..+.+..+.+..+.+..+.+.+. |
0 +-----------------------------------------------------------------+
3e+06 +-----------------------------------------------------------------+
| O |
2.5e+06 |-+ |
| |
| |
2e+06 |-+ |
| |
1.5e+06 |-+ O O O O O O O O O |
| O O O |
1e+06 |-+O O O |
| |
| |
500000 |..+..+..+.+..+.. .+..|
| +..+..+..+..+..+.+..+..+..+..+..+..+..+.+..+. |
0 +-----------------------------------------------------------------+
600 +---------------------------------------------------------------------+
| + |
500 |-+ :+ |
| : + |
| : +.. |
400 |-+ : +.. +.. |
| .+.. .+..+ +. .. + |
300 |..+ .+.. .+ +..+.+..+.+ + +. .+.. +.. .+..|
| + +. +. + + |
200 |-+ + |
| |
| |
100 |-+ |
| |
0 +---------------------------------------------------------------------+
600 +---------------------------------------------------------------------+
| + |
500 |-+ :+ |
| : + |
| : +.. |
400 |-+ : +.. +.. |
| .+.. .+..+ +. .. + |
300 |..+ .+.. .+ +..+.+..+.+ + +. .+.. +.. .+..|
| + +. +. + + |
200 |-+ + |
| |
| |
100 |-+ |
| |
0 +---------------------------------------------------------------------+
vm-scalability.throughput
3e+06 +-----------------------------------------------------------------+
| |
2.5e+06 |-+ O |
| |
| O O |
2e+06 |-+ |
| |
1.5e+06 |-+ O |
| O O O O O O O O O O |
1e+06 |-+ O O |
| |
| |
500000 |-+ |
|.+..+.+..+.+..+.+..+.+.+..+.+..+.+..+.+..+.+.+..+.+..+.+..+.+..+.|
0 +-----------------------------------------------------------------+
vm-scalability.stddev_
700 +---------------------------------------------------------------------+
| |
600 |-.+ .+ +.. .+.+..|
|. + .+.+..+..+.+.. .+.+..+. .+. .+.. .+. + .. .+. |
500 |-+ +. +.+..+. +. +. + + + |
| |
400 |-+ |
| |
300 |-+ |
| |
200 |-+ |
| |
100 |-+ |
| |
0 +---------------------------------------------------------------------+
vm-scalability.median
14000 +-------------------------------------------------------------------+
| O |
12000 |-+ |
| O O |
10000 |-+ |
| |
8000 |-+ |
| O O O O O O O O O O |
6000 |-+ O O O |
| |
4000 |-+ |
| |
2000 |-+ |
|..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
0 +-------------------------------------------------------------------+
vm-scalability.workload
8e+08 +-------------------------------------------------------------------+
| O |
7e+08 |-+ |
6e+08 |-+ O O |
| |
5e+08 |-+ |
| |
4e+08 |-+O O O O O O O O O O |
| O O O |
3e+08 |-+ |
2e+08 |-+ |
| |
1e+08 |-+ |
|..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..+.+..|
0 +-------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[drm/i915/gt] c12b7a396f: perf-sanity-tests.Parse_event_definition_strings.fail
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: c12b7a396ff758a262002b5b326d83efeae71140 ("[Intel-gfx] [CI] drm/i915/gt: Track the overall awake/busy time")
url: https://github.com/0day-ci/linux/commits/Chris-Wilson/drm-i915-gt-Track-t...
base: git://anongit.freedesktop.org/drm/drm-tip drm-tip
in testcase: perf-sanity-tests
version: perf-x86_64-fa02fcd94b0c-1_20201126
with following parameters:
perf_compiler: gcc
ucode: 0xe2
on test machine: 4 threads Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz with 32G memory
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <oliver.sang(a)intel.com>
2020-12-16 20:52:52 make ARCH= EXTRA_CFLAGS=-fno-omit-frame-pointer -fsanitize=undefined -fsanitize=address -C /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf
make: Entering directory '/usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf'
BUILD: Doing 'make [33m-j4[m' parallel build
HOSTCC fixdep.o
HOSTLD fixdep-in.o
LINK fixdep
diff -u tools/include/uapi/drm/i915_drm.h include/uapi/drm/i915_drm.h
diff -u tools/include/uapi/linux/perf_event.h include/uapi/linux/perf_event.h
diff -u tools/include/uapi/linux/stat.h include/uapi/linux/stat.h
diff -u tools/include/linux/build_bug.h include/linux/build_bug.h
Auto-detecting system features:
... dwarf: [ [32mon[m ]
... dwarf_getlocations: [ [32mon[m ]
... glibc: [ [32mon[m ]
... libbfd: [ [32mon[m ]
... libbfd-buildid: [ [32mon[m ]
... libcap: [ [32mon[m ]
... libelf: [ [32mon[m ]
... libnuma: [ [32mon[m ]
... numa_num_possible_cpus: [ [32mon[m ]
... libperl: [ [32mon[m ]
... libpython: [ [32mon[m ]
... libcrypto: [ [32mon[m ]
... libunwind: [ [32mon[m ]
... libdw-dwarf-unwind: [ [32mon[m ]
... zlib: [ [32mon[m ]
... lzma: [ [32mon[m ]
... get_cpuid: [ [32mon[m ]
... bpf: [ [32mon[m ]
... libaio: [ [32mon[m ]
... libzstd: [ [32mon[m ]
... disassembler-four-args: [ [32mon[m ]
CC fd/array.o
CC exec-cmd.o
CC event-parse.o
CC core.o
CC cpumap.o
LD fd/libapi-in.o
CC fs/fs.o
CC help.o
CC fs/tracing_path.o
CC fs/cgroup.o
LD fs/libapi-in.o
CC cpu.o
CC debug.o
CC str_error_r.o
LD libapi-in.o
AR libapi.a
CC threadmap.o
GEN bpf_helper_defs.h
CC pager.o
MKDIR staticobjs/
CC evsel.o
CC staticobjs/libbpf.o
CC parse-options.o
CC evlist.o
CC event-plugin.o
CC trace-seq.o
CC parse-filter.o
CC mmap.o
CC parse-utils.o
CC kbuffer-parse.o
CC run-command.o
CC tep_strerror.o
CC event-parse-api.o
LD libtraceevent-in.o
LINK libtraceevent.a
CC sigchain.o
CC zalloc.o
CC xyarray.o
CC subcmd-config.o
LD libsubcmd-in.o
CC lib.o
AR libsubcmd.a
GEN common-cmds.h
LD libperf-in.o
AR libperf.a
MKDIR staticobjs/
CC staticobjs/bpf.o
CC staticobjs/nlattr.o
CC staticobjs/btf.o
CC staticobjs/libbpf_errno.o
CC staticobjs/str_error.o
CC staticobjs/netlink.o
CC staticobjs/bpf_prog_linfo.o
CC staticobjs/libbpf_probes.o
CC staticobjs/xsk.o
CC staticobjs/hashmap.o
CC staticobjs/btf_dump.o
CC staticobjs/ringbuf.o
HOSTCC pmu-events/json.o
HOSTCC pmu-events/jsmn.o
CC plugin_jbd2.o
LD staticobjs/libbpf-in.o
LINK libbpf.a
HOSTCC pmu-events/jevents.o
CC jvmti/libjvmti.o
LD plugin_jbd2-in.o
CC plugin_hrtimer.o
LD plugin_hrtimer-in.o
CC plugin_kmem.o
HOSTLD pmu-events/jevents-in.o
GEN perf-archive
GEN perf-with-kcore
LINK pmu-events/jevents
LD plugin_kmem-in.o
CC plugin_kvm.o
GEN pmu-events/pmu-events.c
LD plugin_kvm-in.o
CC plugin_mac80211.o
LD plugin_mac80211-in.o
CC plugin_sched_switch.o
LD plugin_sched_switch-in.o
CC plugin_function.o
CC pmu-events/pmu-events.o
LD plugin_function-in.o
CC plugin_futex.o
LD plugin_futex-in.o
CC plugin_xen.o
CC jvmti/jvmti_agent.o
LD plugin_xen-in.o
CC plugin_scsi.o
LD plugin_scsi-in.o
CC plugin_cfg80211.o
LD plugin_cfg80211-in.o
CC plugin_tlb.o
LD plugin_tlb-in.o
LINK plugin_jbd2.so
LINK plugin_hrtimer.so
LINK plugin_kmem.so
LINK plugin_kvm.so
LINK plugin_mac80211.so
LINK plugin_sched_switch.so
CC jvmti/libstring.o
LINK plugin_function.so
LD pmu-events/pmu-events-in.o
LINK plugin_futex.so
CC builtin-bench.o
LINK plugin_xen.so
CC jvmti/libctype.o
LINK plugin_scsi.so
LD jvmti/jvmti-in.o
CC builtin-annotate.o
LINK libperf-jvmti.so
LINK plugin_cfg80211.so
LINK plugin_tlb.so
CC builtin-config.o
GEN libtraceevent-dynamic-list
CC builtin-diff.o
CC builtin-evlist.o
GEN python/perf.so
CC builtin-ftrace.o
CC builtin-help.o
CC builtin-sched.o
CC builtin-buildid-list.o
CC builtin-buildid-cache.o
CC builtin-kallsyms.o
CC builtin-list.o
CC builtin-record.o
CC builtin-report.o
CC builtin-stat.o
CC builtin-timechart.o
CC builtin-top.o
CC builtin-script.o
CC builtin-kmem.o
CC builtin-lock.o
CC builtin-kvm.o
CC builtin-inject.o
CC builtin-mem.o
CC builtin-data.o
CC builtin-version.o
CC builtin-c2c.o
CC builtin-trace.o
CC builtin-probe.o
CC bench/sched-messaging.o
CC bench/sched-pipe.o
CC bench/syscall.o
CC bench/mem-functions.o
CC bench/futex-hash.o
CC bench/futex-wake.o
CC bench/futex-wake-parallel.o
CC bench/futex-requeue.o
CC bench/futex-lock-pi.o
CC bench/epoll-wait.o
CC bench/epoll-ctl.o
CC bench/synthesize.o
CC bench/kallsyms-parse.o
CC bench/find-bit-bench.o
CC bench/inject-buildid.o
CC bench/mem-memcpy-x86-64-asm.o
CC bench/mem-memset-x86-64-asm.o
CC bench/numa.o
CC tests/builtin-test.o
CC tests/parse-events.o
CC util/annotate.o
LD bench/perf-in.o
CC util/block-info.o
CC tests/dso-data.o
CC util/block-range.o
CC tests/attr.o
CC util/build-id.o
CC tests/vmlinux-kallsyms.o
CC tests/openat-syscall.o
CC arch/common.o
CC tests/openat-syscall-all-cpus.o
CC arch/x86/util/header.o
CC tests/openat-syscall-tp-fields.o
CC arch/x86/util/tsc.o
CC arch/x86/util/pmu.o
CC arch/x86/util/kvm-stat.o
CC tests/mmap-basic.o
CC arch/x86/tests/regs_load.o
CC arch/x86/tests/dwarf-unwind.o
CC arch/x86/util/perf_regs.o
CC arch/x86/tests/arch-tests.o
CC arch/x86/tests/rdpmc.o
CC arch/x86/util/topdown.o
CC tests/perf-record.o
CC arch/x86/util/machine.o
CC arch/x86/tests/perf-time-to-tsc.o
CC arch/x86/util/event.o
CC arch/x86/tests/insn-x86.o
CC util/cacheline.o
CC util/config.o
CC arch/x86/util/dwarf-regs.o
CC arch/x86/util/unwind-libunwind.o
CC tests/evsel-roundtrip-name.o
CC arch/x86/util/auxtrace.o
CC arch/x86/tests/intel-pt-pkt-decoder-test.o
CC tests/evsel-tp-sched.o
CC arch/x86/util/archinsn.o
CC arch/x86/tests/bp-modify.o
CC tests/fdarray.o
CC arch/x86/util/intel-pt.o
LD arch/x86/tests/perf-in.o
CC arch/x86/util/intel-bts.o
CC util/copyfile.o
CC tests/pmu.o
CC tests/pmu-events.o
CC util/ctype.o
CC util/db-export.o
CC util/env.o
CC util/event.o
CC tests/hists_common.o
LD arch/x86/util/perf-in.o
LD arch/x86/perf-in.o
LD arch/perf-in.o
CC tests/hists_link.o
CC tests/hists_filter.o
CC util/evlist.o
CC tests/hists_output.o
CC util/sideband_evlist.o
CC tests/hists_cumulate.o
CC util/evsel.o
CC tests/python-use.o
CC tests/bp_signal.o
CC tests/bp_signal_overflow.o
CC tests/bp_account.o
CC tests/wp.o
CC util/evsel_fprintf.o
CC tests/task-exit.o
CC tests/sw-clock.o
CC tests/mmap-thread-lookup.o
CC util/perf_event_attr_fprintf.o
CC tests/thread-maps-share.o
CC tests/switch-tracking.o
CC tests/keep-tracking.o
CC tests/code-reading.o
CC util/evswitch.o
CC util/find_bit.o
CC tests/sample-parsing.o
CC util/get_current_dir_name.o
CC util/kallsyms.o
CC util/levenshtein.o
CC util/llvm-utils.o
CC tests/parse-no-sample-id-all.o
CC tests/kmod-path.o
CC tests/thread-map.o
CC ui/setup.o
CC ui/helpline.o
CC tests/llvm.o
CC ui/progress.o
CC ui/util.o
CC tests/bpf.o
CC tests/topology.o
CC ui/hist.o
CC util/mmap.o
CC util/memswap.o
CC tests/mem.o
CC tests/cpumap.o
CC ui/stdio/hist.o
BISON util/parse-events-bison.c
CC tests/stat.o
CC util/perf_regs.o
CC util/path.o
CC tests/event_update.o
CC util/print_binary.o
CC util/rlimit.o
CC tests/event-times.o
CC util/argv_split.o
CC util/rbtree.o
CC tests/expr.o
CC tests/backward-ring-buffer.o
CC tests/sdt.o
CC tests/is_printable_array.o
CC ui/browser.o
CC tests/bitmap.o
CC tests/perf-hooks.o
CC tests/clang.o
CC tests/unit_number__scnprintf.o
CC tests/mem2node.o
CC util/libstring.o
CC tests/maps.o
CC util/bitmap.o
CC util/hweight.o
CC util/smt.o
CC ui/browsers/annotate.o
CC tests/time-utils-test.o
CC util/strbuf.o
CC tests/genelf.o
CC util/string.o
CC tests/api-io.o
CC util/strlist.o
CC tests/demangle-java-test.o
CC util/strfilter.o
CC tests/pfm.o
CC tests/parse-metric.o
CC tests/pe-file-parsing.o
CC tests/expand-cgroup.o
CC ui/browsers/hists.o
CC tests/dwarf-unwind.o
CC tests/llvm-src-base.o
CC tests/llvm-src-kbuild.o
CC tests/llvm-src-prologue.o
CC tests/llvm-src-relocation.o
LD tests/perf-in.o
CC scripts/perl/Perf-Trace-Util/Context.o
LD scripts/perl/Perf-Trace-Util/perf-in.o
CC scripts/python/Perf-Trace-Util/Context.o
CC util/top.o
LD scripts/python/Perf-Trace-Util/perf-in.o
LD scripts/perf-in.o
CC trace/beauty/clone.o
CC trace/beauty/fcntl.o
CC util/usage.o
CC trace/beauty/flock.o
CC util/dso.o
CC trace/beauty/fsmount.o
CC trace/beauty/fspick.o
CC trace/beauty/ioctl.o
CC ui/tui/setup.o
CC ui/tui/util.o
CC trace/beauty/kcmp.o
CC trace/beauty/mount_flags.o
CC trace/beauty/move_mount.o
CC trace/beauty/pkey_alloc.o
CC ui/tui/helpline.o
CC ui/tui/progress.o
CC trace/beauty/arch_prctl.o
CC trace/beauty/prctl.o
LD ui/tui/perf-in.o
CC trace/beauty/renameat.o
CC trace/beauty/sockaddr.o
CC trace/beauty/socket.o
CC util/dsos.o
CC trace/beauty/statx.o
CC trace/beauty/sync_file_range.o
CC trace/beauty/tracepoints/x86_irq_vectors.o
CC trace/beauty/tracepoints/x86_msr.o
CC util/symbol.o
LD trace/beauty/tracepoints/perf-in.o
LD trace/beauty/perf-in.o
CC util/symbol_fprintf.o
CC util/color.o
CC util/color_config.o
CC util/metricgroup.o
CC util/header.o
CC util/callchain.o
CC util/values.o
CC util/debug.o
CC util/fncache.o
CC util/machine.o
CC util/map.o
CC util/pstack.o
CC util/session.o
CC util/sample-raw.o
CC util/s390-sample-raw.o
CC util/syscalltbl.o
CC util/ordered-events.o
CC util/namespaces.o
CC ui/browsers/map.o
CC util/comm.o
CC util/thread.o
CC util/thread_map.o
CC ui/browsers/scripts.o
CC perf.o
CC util/trace-event-parse.o
CC ui/browsers/header.o
CC util/parse-events-bison.o
CC ui/browsers/res_sample.o
BISON util/pmu-bison.c
CC util/trace-event-read.o
CC util/trace-event-info.o
LD ui/browsers/perf-in.o
LD ui/perf-in.o
CC util/trace-event-scripting.o
CC util/trace-event.o
CC util/svghelper.o
CC util/sort.o
CC util/hist.o
CC util/util.o
CC util/cpumap.o
CC util/affinity.o
CC util/cputopo.o
CC util/cgroup.o
CC util/target.o
CC util/rblist.o
CC util/intlist.o
CC util/vdso.o
CC util/counts.o
CC util/stat.o
CC util/stat-shadow.o
CC util/stat-display.o
CC util/perf_api_probe.o
CC util/record.o
CC util/srcline.o
CC util/srccode.o
CC util/synthetic-events.o
CC util/data.o
CC util/tsc.o
CC util/cloexec.o
CC util/call-path.o
CC util/rwsem.o
CC util/thread-stack.o
CC util/spark.o
CC util/topdown.o
CC util/stream.o
CC util/auxtrace.o
CC util/intel-pt-decoder/intel-pt-pkt-decoder.o
GEN util/intel-pt-decoder/inat-tables.c
CC util/intel-pt-decoder/intel-pt-log.o
CC util/intel-pt-decoder/intel-pt-decoder.o
CC util/arm-spe-decoder/arm-spe-pkt-decoder.o
CC util/scripting-engines/trace-event-perl.o
CC util/arm-spe-decoder/arm-spe-decoder.o
LD util/arm-spe-decoder/perf-in.o
CC util/scripting-engines/trace-event-python.o
CC util/intel-pt.o
CC util/intel-bts.o
LD util/scripting-engines/perf-in.o
CC util/arm-spe.o
CC util/s390-cpumsf.o
CC util/intel-pt-decoder/intel-pt-insn-decoder.o
CC util/parse-branch-options.o
CC util/dump-insn.o
CC util/parse-regs-options.o
CC util/parse-sublevel-options.o
CC util/term.o
CC util/help-unknown-cmd.o
CC util/mem-events.o
CC util/vsprintf.o
CC util/units.o
CC util/time-utils.o
BISON util/expr-bison.c
CC util/branch.o
CC util/mem2node.o
LD util/intel-pt-decoder/perf-in.o
CC util/clockid.o
CC util/bpf-loader.o
CC util/bpf_map.o
CC util/bpf-prologue.o
CC util/symbol-elf.o
CC util/probe-file.o
CC util/probe-event.o
CC util/probe-finder.o
CC util/dwarf-aux.o
CC util/dwarf-regs.o
CC util/unwind-libunwind-local.o
CC util/unwind-libunwind.o
CC util/data-convert-bt.o
CC util/zlib.o
CC util/lzma.o
CC util/zstd.o
CC util/cap.o
CC util/demangle-java.o
CC util/demangle-rust.o
CC util/jitdump.o
CC util/genelf.o
CC util/genelf_debug.o
CC util/perf-hooks.o
CC util/bpf-event.o
FLEX util/parse-events-flex.c
FLEX util/pmu-flex.c
CC util/pmu-bison.o
FLEX util/expr-flex.c
CC util/expr-bison.o
CC util/expr.o
CC util/parse-events.o
CC util/parse-events-flex.o
CC util/pmu.o
CC util/pmu-flex.o
CC util/expr-flex.o
LD util/perf-in.o
LD perf-in.o
LINK perf
make: Leaving directory '/usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf'
2020-12-16 20:54:07 cd /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf
2020-12-16 20:54:07 mkdir -p /pkg
2020-12-16 20:54:07 mkdir -p /kbuild/obj/x86_64/x86_64-rhel-8.3
2020-12-16 20:54:07 cp /pkg/linux/x86_64-rhel-8.3/gcc-9/c12b7a396ff758a262002b5b326d83efeae71140/vmlinux.xz /tmp
2020-12-16 20:54:08 unxz -k /tmp/vmlinux.xz
2020-12-16 20:54:12 cp /tmp/vmlinux /kbuild/obj/x86_64/x86_64-rhel-8.3
ignored_by_lkp: BPF filter
ignored_by_lkp: LLVM search and compile
ignored_by_lkp: Add vfs_getname probe to get syscall args filenames
ignored_by_lkp: Use vfs_getname probe to get syscall args filenames
ignored_by_lkp: Check open filename arg using perf trace + vfs_getname
ignored_by_lkp: builtin clang support
2020-12-16 20:54:12 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 1
1: vmlinux symtab matches kallsyms : Ok
2020-12-16 20:54:13 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 2
2: Detect openat syscall event : Ok
2020-12-16 20:54:13 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 3
3: Detect openat syscall event on all cpus : Ok
2020-12-16 20:54:13 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 4
4: Read samples using the mmap interface : FAILED!
2020-12-16 20:54:13 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 5
5: Test data source output : Ok
2020-12-16 20:54:13 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 6
6: Parse event definition strings : FAILED!
2020-12-16 20:54:14 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 7
7: Simple expression parser : Ok
2020-12-16 20:54:15 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 8
8: PERF_RECORD_* events & perf_sample fields : Ok
2020-12-16 20:54:17 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 9
9: Parse perf pmu format : Ok
2020-12-16 20:54:17 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 10
10: PMU events :
10.1: PMU event table sanity : Ok
10.2: PMU event map aliases : Ok
10.3: Parsing of PMU event table metrics : Skip (some metrics failed)
10.4: Parsing of PMU event table metrics with fake PMUs : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 11
11: DSO data read : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 12
12: DSO data cache : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 13
13: DSO data reopen : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 14
14: Roundtrip evsel->name : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 15
15: Parse sched tracepoints fields : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 16
16: syscalls:sys_enter_openat event fields : Ok
2020-12-16 20:54:19 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 17
17: Setup struct perf_event_attr : Ok
2020-12-16 20:54:33 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 18
18: Match and link multiple hists : Ok
2020-12-16 20:54:33 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 19
19: 'import perf' in python : FAILED!
2020-12-16 20:54:33 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 20
20: Breakpoint overflow signal handler : Ok
2020-12-16 20:54:33 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 21
21: Breakpoint overflow sampling : Ok
2020-12-16 20:54:33 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 22
22: Breakpoint accounting : Ok
2020-12-16 20:54:33 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 23
23: Watchpoint :
23.1: Read Only Watchpoint : Skip
23.2: Write Only Watchpoint : Ok
23.3: Read / Write Watchpoint : Ok
23.4: Modify Watchpoint : Ok
2020-12-16 20:54:34 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 24
24: Number of exit events of a simple workload : FAILED!
2020-12-16 20:54:34 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 25
25: Software clock events period values : FAILED!
2020-12-16 20:54:34 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 26
26: Object code reading : FAILED!
2020-12-16 20:54:37 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 27
27: Sample parsing : Ok
2020-12-16 20:54:37 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 28
28: Use a dummy software event to keep tracking : FAILED!
2020-12-16 20:54:37 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 29
29: Parse with no sample_id_all bit set : Ok
2020-12-16 20:54:37 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 30
30: Filter hist entries : Ok
2020-12-16 20:54:37 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 31
31: Lookup mmap thread : FAILED!
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 32
32: Share thread maps : Ok
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 33
33: Sort output of hist entries : Ok
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 34
34: Cumulate child hist entries : Ok
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 35
35: Track with sched_switch : FAILED!
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 36
36: Filter fds with revents mask in a fdarray : Ok
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 37
37: Add fd to a fdarray, making it autogrow : Ok
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 38
38: kmod_path__parse : Ok
2020-12-16 20:54:38 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 39
39: Thread map : Ok
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 41
41: Session topology : FAILED!
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 43
43: Synthesize thread map : FAILED!
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 44
44: Remove thread map : FAILED!
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 45
45: Synthesize cpu map : Ok
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 46
46: Synthesize stat config : Ok
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 47
47: Synthesize stat : Ok
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 48
48: Synthesize stat round : Ok
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 49
49: Synthesize attr update : FAILED!
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 50
50: Event times : Ok
2020-12-16 20:54:39 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 51
51: Read backward ring buffer : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 52
52: Print cpu map : FAILED!
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 53
53: Merge cpu map : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 54
54: Probe SDT events : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 55
55: is_printable_array : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 56
56: Print bitmap : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 57
57: perf hooks : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 59
59: unit_number__scnprintf : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 60
60: mem2node : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 61
61: time utils : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 62
62: Test jit_write_elf : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 63
63: Test libpfm4 support : Skip (not compiled in)
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 64
64: Test api io : Ok
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 65
65: maps__merge_in : FAILED!
2020-12-16 20:54:40 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 66
66: Demangle Java : Ok
2020-12-16 20:54:41 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 67
67: Parse and process metrics : Ok
2020-12-16 20:54:41 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 68
68: PE file support : FAILED!
2020-12-16 20:54:41 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 69
69: Event expansion for cgroups : Ok
2020-12-16 20:54:41 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 70
70: x86 rdpmc : Ok
2020-12-16 20:54:41 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 71
71: Convert perf time to TSC : FAILED!
2020-12-16 20:54:41 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 72
72: DWARF unwind : FAILED!
2020-12-16 20:54:42 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 73
73: x86 instruction decoder - new instructions : Ok
2020-12-16 20:54:42 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 74
74: Intel PT packet decoder : Ok
2020-12-16 20:54:42 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 75
75: x86 bp modify : Ok
2020-12-16 20:54:42 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 76
76: probe libc's inet_pton & backtrace it with ping : Ok
2020-12-16 20:54:44 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 80
80: build id cache operations : FAILED!
2020-12-16 20:54:45 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 81
81: Zstd perf.data compression/decompression : FAILED!
2020-12-16 20:54:46 sudo /usr/src/perf_selftests-x86_64-rhel-8.3-c12b7a396ff758a262002b5b326d83efeae71140/tools/perf/perf test 82
82: Check Arm CoreSight trace data recording and synthesized samples: Skip
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
Thanks,
Oliver Sang
1 year, 5 months
- 1
- 0
[mm/swap.c] 9ea77f3f71: BUG:using_smp_processor_id()in_preemptible
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 9ea77f3f71ccc1dfd0f712ca6bbe4c0c1148504b ("mm/swap.c: extend the usage to pagevec_lru_add")
https://github.com/alexshi/linux.git next
in testcase: locktorture
version:
with following parameters:
runtime: 300s
test: cpuhotplug
test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors.
test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+--------------------------------------------+------------+------------+
| | b8bdb66afc | 9ea77f3f71 |
+--------------------------------------------+------------+------------+
| boot_successes | 12 | 24 |
| boot_failures | 0 | 8 |
| BUG:using_smp_processor_id()in_preemptible | 0 | 8 |
+--------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 383.127104] BUG: using smp_processor_id() in preemptible [00000000] code: torture_onoff/278
[ 383.128857] caller is debug_smp_processor_id+0x12/0x20
[ 383.129449] CPU: 0 PID: 278 Comm: torture_onoff Not tainted 5.10.0-rc5-next-20201126-00004-g9ea77f3f71cc #1
[ 383.130514] Call Trace:
[ 383.130802] dump_stack+0x6d/0x8b
[ 383.131157] check_preemption_disabled+0xcc/0xd0
[ 383.131640] ? debug_smp_processor_id+0x12/0x20
[ 383.132150] debug_smp_processor_id+0x12/0x20
[ 383.132634] pagevec_lru_move_fn+0x24/0x130
[ 383.133120] ? perf_trace_mm_lru_insertion+0x1c0/0x1c0
[ 383.133684] ? kvm_clock_read+0x15/0x30
[ 383.134111] ? kvm_sched_clock_read+0x8/0x20
[ 383.134570] ? sched_clock+0x11/0x20
[ 383.134976] ? sched_clock_cpu+0x1f/0x170
[ 383.135410] ? _raw_spin_unlock_irqrestore+0x55/0x70
[ 383.135952] ? __this_cpu_preempt_check+0xf/0x11
[ 383.136438] ? lockdep_hardirqs_on+0x87/0x120
[ 383.136903] ? lockdep_hardirqs_on_prepare+0xce/0x1e0
[ 383.137435] ? _raw_spin_unlock_irqrestore+0x55/0x70
[ 383.137964] ? skb_dequeue+0x4c/0x70
[ 383.138357] ? trace_hardirqs_on+0x2b/0x100
[ 383.138820] lru_add_drain_cpu+0x14a/0x270
[ 383.139272] ? __this_cpu_preempt_check+0xf/0x11
[ 383.139770] page_alloc_cpu_dead+0xb/0x30
[ 383.140240] ? drain_pages+0x50/0x50
[ 383.140636] cpuhp_invoke_callback+0xa5/0xa30
[ 383.141124] ? rcu_read_lock_sched_held+0x2f/0x60
[ 383.141637] ? cpuhp_kick_ap_work+0x16b/0x300
[ 383.142124] ? padata_replace+0xc0/0xc0
[ 383.142546] ? cpus_read_lock+0xd0/0xd0
[ 383.143006] _cpu_down+0xbd/0x210
[ 383.143394] cpu_down+0x30/0x60
[ 383.143760] cpu_device_down+0x10/0x20
[ 383.144186] cpu_subsys_offline+0x8/0x10
[ 383.144624] device_offline+0x97/0xd0
[ 383.145053] remove_cpu+0x1b/0x30
[ 383.145431] torture_offline+0x78/0x130 [torture]
[ 383.145961] torture_onoff+0x101/0x180 [torture]
[ 383.146479] kthread+0x103/0x140
[ 383.146863] ? torture_kthread_stopping+0x90/0x90 [torture]
[ 383.147500] ? kthread_unpark+0x70/0x70
[ 383.147968] ret_from_fork+0x1c/0x30
[ 384.116936] _warn_unseeded_randomness: 55 callbacks suppressed
[ 384.116956] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 384.125680] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 384.125693] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 386.162110] x86: Booting SMP configuration:
[ 386.162722] smpboot: Booting Node 0 Processor 1 APIC 0x1
[ 386.163796] kvm-clock: cpu 1, msr 2a5c021, secondary cpu clock
[ 386.163863] masked ExtINT on CPU#1
[ 386.187921] kvm-guest: stealtime: cpu 1, msr 29e1ea00
[ 386.225131] _warn_unseeded_randomness: 12 callbacks suppressed
[ 386.225146] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 386.238328] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 386.238341] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 389.247041] smpboot: CPU 1 is now offline
[ 389.247796] BUG: using smp_processor_id() in preemptible [00000000] code: torture_onoff/278
[ 389.249042] caller is debug_smp_processor_id+0x12/0x20
[ 389.249711] CPU: 0 PID: 278 Comm: torture_onoff Not tainted 5.10.0-rc5-next-20201126-00004-g9ea77f3f71cc #1
[ 389.250956] Call Trace:
[ 389.251277] dump_stack+0x6d/0x8b
[ 389.251709] check_preemption_disabled+0xcc/0xd0
[ 389.252334] ? debug_smp_processor_id+0x12/0x20
[ 389.252886] debug_smp_processor_id+0x12/0x20
[ 389.253434] pagevec_lru_move_fn+0x24/0x130
[ 389.253970] ? perf_trace_mm_lru_insertion+0x1c0/0x1c0
[ 389.254599] ? kvm_clock_read+0x15/0x30
[ 389.256002] ? kvm_sched_clock_read+0x8/0x20
[ 389.256525] ? sched_clock+0x11/0x20
[ 389.256982] ? sched_clock_cpu+0x1f/0x170
[ 389.257506] ? _raw_spin_unlock_irqrestore+0x55/0x70
[ 389.258064] ? __this_cpu_preempt_check+0xf/0x11
[ 389.258559] ? lockdep_hardirqs_on+0x87/0x120
[ 389.259065] ? lockdep_hardirqs_on_prepare+0xce/0x1e0
[ 389.259607] ? _raw_spin_unlock_irqrestore+0x55/0x70
[ 389.260184] ? skb_dequeue+0x4c/0x70
[ 389.260633] ? trace_hardirqs_on+0x2b/0x100
[ 389.261156] lru_add_drain_cpu+0x14a/0x270
[ 389.261649] ? __this_cpu_preempt_check+0xf/0x11
[ 389.262215] page_alloc_cpu_dead+0xb/0x30
[ 389.262716] ? drain_pages+0x50/0x50
[ 389.263160] cpuhp_invoke_callback+0xa5/0xa30
[ 389.263712] ? rcu_read_lock_sched_held+0x2f/0x60
[ 389.264278] ? cpuhp_kick_ap_work+0x16b/0x300
[ 389.264827] ? padata_replace+0xc0/0xc0
[ 389.265318] ? cpus_read_lock+0xd0/0xd0
[ 389.265797] _cpu_down+0xbd/0x210
[ 389.266261] cpu_down+0x30/0x60
[ 389.266671] cpu_device_down+0x10/0x20
[ 389.267197] cpu_subsys_offline+0x8/0x10
[ 389.267697] device_offline+0x97/0xd0
[ 389.268218] remove_cpu+0x1b/0x30
[ 389.268643] torture_offline+0x78/0x130 [torture]
[ 389.269233] torture_onoff+0x101/0x180 [torture]
[ 389.269828] kthread+0x103/0x140
[ 389.270274] ? torture_kthread_stopping+0x90/0x90 [torture]
[ 389.270954] ? kthread_unpark+0x70/0x70
[ 389.271433] ret_from_fork+0x1c/0x30
[ 389.307153] _warn_unseeded_randomness: 12 callbacks suppressed
[ 389.307168] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 389.316406] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 389.316422] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 390.443917] Writes: Total: 115915631 Max/Min: 29238663/28661495 Fail: 0
[ 393.384895] _warn_unseeded_randomness: 12 callbacks suppressed
[ 393.384908] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 393.395187] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 393.395200] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 398.544900] _warn_unseeded_randomness: 12 callbacks suppressed
[ 398.544913] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 398.553483] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 398.553495] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 398.607466] some processes do not quit in time
[ 398.607482]
[ 399.815021] _warn_unseeded_randomness: 35 callbacks suppressed
[ 399.815034] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 399.820517] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 399.820529] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 399.853791] kill 211
[ 399.853926]
[ 399.901301] kill 209
[ 399.901319]
[ 401.037214] _warn_unseeded_randomness: 64 callbacks suppressed
[ 401.037227] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 401.048281] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 401.048325] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 401.330103] x86: Booting SMP configuration:
[ 401.330677] smpboot: Booting Node 0 Processor 1 APIC 0x1
[ 401.331506] kvm-clock: cpu 1, msr 2a5c021, secondary cpu clock
[ 401.331556] masked ExtINT on CPU#1
[ 401.378387] kvm-guest: stealtime: cpu 1, msr 29e1ea00
[ 402.132951] _warn_unseeded_randomness: 22 callbacks suppressed
[ 402.132964] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 402.132975] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 402.132982] random: get_random_u32 called from arch_align_stack+0x35/0x50 with crng_init=1
[ 403.152191] _warn_unseeded_randomness: 26 callbacks suppressed
[ 403.152203] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 403.157309] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 403.157320] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 403.680246] curl (394) used greatest stack depth: 5960 bytes left
[ 404.087681] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/cgi-bin/lkp-jobfile-append-var?job_fil... -O /dev/null
[ 404.087700]
[ 404.282910] _warn_unseeded_randomness: 112 callbacks suppressed
[ 404.282922] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 404.289776] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 404.289787] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 404.404541] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/cgi-bin/lkp-jobfile-append-var?job_fil... -O /dev/null
[ 404.404558]
[ 404.983779] LKP: rebooting
[ 404.983824]
[ 405.085542] /usr/bin/wget -q --timeout=1800 --tries=1 --local-encoding=UTF-8 http://internal-lkp-server:80/~lkp/cgi-bin/lkp-wtmp?tbox_name=vm-snb-i386... -O /dev/null
[ 405.085559]
[ 405.618560] _warn_unseeded_randomness: 73 callbacks suppressed
[ 405.618574] random: get_random_u32 called from copy_process+0x23e/0x1610 with crng_init=1
[ 405.624966] random: get_random_u32 called from arch_rnd+0x25/0x40 with crng_init=1
[ 405.624979] random: get_random_u32 called from randomize_stack_top+0x35/0x50 with crng_init=1
[ 405.632207] sysrq: Emergency Sync
[ 405.633111] sysrq: Resetting
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc5-next-20201126-00004-g9ea77f3f71cc .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 5 months
- 1
- 0
[btrfs] 639bd575b7: stress-ng.fallocate.ops_per_sec 29.2% improvement
by kernel test robot
Greeting,
FYI, we noticed a 29.2% improvement of stress-ng.fallocate.ops_per_sec due to commit:
commit: 639bd575b7c7fa326abadd2ef3e374a5a24eb40b ("btrfs: fix race leading to unnecessary transaction commit when logging inode")
https://git.kernel.org/cgit/linux/kernel/git/kdave/linux.git for-5.11
in testcase: stress-ng
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 512G memory
with following parameters:
nr_threads: 10%
disk: 1HDD
testtime: 30s
class: filesystem
cpufreq_governor: performance
ucode: 0x5003003
fs: btrfs
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
class/compiler/cpufreq_governor/disk/fs/kconfig/nr_threads/rootfs/tbox_group/testcase/testtime/ucode:
filesystem/gcc-9/performance/1HDD/btrfs/x86_64-rhel-8.3/10%/debian-10.4-x86_64-20200603.cgz/lkp-csl-2sp7/stress-ng/30s/0x5003003
commit:
47d3db41e1 ("btrfs: fix race that makes inode logging fallback to transaction commit")
639bd575b7 ("btrfs: fix race leading to unnecessary transaction commit when logging inode")
47d3db41e190ca4a 639bd575b7c7fa326abadd2ef3e
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
:4 25% 1:4 last_state.exit_fail
:4 25% 1:4 last_state.is_incomplete_run
%stddev %change %stddev
\ | \
2651 +12.2% 2975 stress-ng.copy-file.ops
88.13 +12.2% 98.92 stress-ng.copy-file.ops_per_sec
235137 ± 2% -10.9% 209428 stress-ng.dnotify.ops
7837 ± 2% -10.9% 6980 stress-ng.dnotify.ops_per_sec
87982 ± 2% +29.3% 113796 ± 2% stress-ng.fallocate.ops
2929 +29.2% 3785 ± 2% stress-ng.fallocate.ops_per_sec
9735 ± 2% +12.5% 10952 ± 4% vmstat.io.bo
77531 +2.4% 79363 vmstat.system.cs
0.01 ± 8% -27.9% 0.01 ± 25% perf-sched.sch_delay.max.ms.__x64_sys_pause.do_syscall_64.entry_SYSCALL_64_after_hwframe.[unknown]
1.57 ± 98% -97.0% 0.05 ± 70% perf-sched.sch_delay.max.ms.rwsem_down_write_slowpath.chmod_common.do_fchmodat.__x64_sys_fchmodat
4.11 ± 14% -13.6% 3.55 perf-sched.total_sch_delay.max.ms
1.68 ± 11% -17.8% 1.38 ± 4% perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
1.69 ± 11% -17.5% 1.39 ± 4% perf-sched.wait_time.avg.ms.do_syslog.part.0.kmsg_read.vfs_read
3.36 ± 11% -17.9% 2.76 ± 4% perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
3.38 ± 11% -17.5% 2.79 ± 4% perf-sched.wait_time.max.ms.do_syslog.part.0.kmsg_read.vfs_read
6021597 +4.0% 6260885 proc-vmstat.nr_dirtied
2867201 ± 2% +13.2% 3245422 ± 4% proc-vmstat.nr_written
43993 ± 4% -34.5% 28827 ± 22% proc-vmstat.numa_pages_migrated
385987 ± 3% -9.4% 349671 ± 5% proc-vmstat.numa_pte_updates
1367672 +2.6% 1403411 proc-vmstat.pgactivate
43993 ± 4% -34.5% 28827 ± 22% proc-vmstat.pgmigrate_success
11946072 ± 2% +12.4% 13426061 ± 4% proc-vmstat.pgpgout
52487 ± 5% -10.0% 47236 ± 4% slabinfo.Acpi-Parse.active_objs
719.25 ± 5% -9.6% 650.33 ± 4% slabinfo.Acpi-Parse.active_slabs
52538 ± 5% -9.5% 47525 ± 4% slabinfo.Acpi-Parse.num_objs
719.25 ± 5% -9.6% 650.33 ± 4% slabinfo.Acpi-Parse.num_slabs
1978 ± 14% -27.0% 1444 ± 20% slabinfo.biovec-64.active_objs
1978 ± 14% -27.0% 1444 ± 20% slabinfo.biovec-64.num_objs
29323 -9.6% 26504 ± 4% slabinfo.kmalloc-192.active_objs
29468 -9.5% 26676 ± 4% slabinfo.kmalloc-192.num_objs
17656 ± 7% -6.0% 16600 ± 6% slabinfo.kmalloc-rcl-64.num_objs
3502 ± 5% -10.0% 3152 ± 3% slabinfo.sock_inode_cache.active_objs
3502 ± 5% -10.0% 3152 ± 3% slabinfo.sock_inode_cache.num_objs
13.41 ± 19% -20.6% 10.66 perf-stat.i.MPKI
1.10 ± 24% -0.3 0.83 perf-stat.i.branch-miss-rate%
78169 +2.4% 80056 perf-stat.i.context-switches
2.76 ± 3% -3.8% 2.66 perf-stat.i.cpi
68.47 -1.5 66.99 perf-stat.i.iTLB-load-miss-rate%
3241453 ± 5% +7.2% 3474825 perf-stat.i.iTLB-loads
0.44 +2.7% 0.45 perf-stat.i.ipc
947672 +2.3% 969530 perf-stat.i.node-loads
80.19 -1.1 79.06 perf-stat.overall.iTLB-load-miss-rate%
77621 +2.3% 79439 perf-stat.ps.context-switches
3235337 ± 5% +7.2% 3468144 perf-stat.ps.iTLB-loads
946313 +2.4% 968610 perf-stat.ps.node-loads
338636 ± 10% -35.3% 219050 ± 13% sched_debug.cfs_rq:/.load.max
65313 ± 12% -23.1% 50201 ± 15% sched_debug.cfs_rq:/.load.stddev
3.57 ± 24% -31.8% 2.43 ± 28% sched_debug.cfs_rq:/.removed.load_avg.avg
110.38 ± 21% -40.6% 65.53 ± 33% sched_debug.cfs_rq:/.removed.load_avg.max
19.11 ± 22% -36.8% 12.08 ± 23% sched_debug.cfs_rq:/.removed.load_avg.stddev
1.56 ± 28% -49.1% 0.80 ± 39% sched_debug.cfs_rq:/.removed.runnable_avg.avg
55.38 ± 22% -43.2% 31.44 ± 29% sched_debug.cfs_rq:/.removed.runnable_avg.max
8.78 ± 26% -50.3% 4.37 ± 25% sched_debug.cfs_rq:/.removed.runnable_avg.stddev
1.56 ± 28% -49.1% 0.80 ± 39% sched_debug.cfs_rq:/.removed.util_avg.avg
55.38 ± 22% -43.2% 31.44 ± 29% sched_debug.cfs_rq:/.removed.util_avg.max
8.78 ± 26% -50.3% 4.37 ± 25% sched_debug.cfs_rq:/.removed.util_avg.stddev
101399 ± 22% +57.1% 159259 ± 18% sched_debug.cpu.avg_idle.min
100591 ± 5% -17.4% 83116 ± 10% softirqs.CPU1.RCU
76493 ± 4% +9.2% 83510 softirqs.CPU21.RCU
90799 ± 7% -13.7% 78317 ± 2% softirqs.CPU3.RCU
1840 ±100% +514.5% 11310 ± 66% softirqs.CPU35.BLOCK
1305 ± 77% +681.6% 10206 ± 46% softirqs.CPU36.BLOCK
1.00 ±173% +1.1e+06% 11219 ±137% softirqs.CPU37.NET_RX
2968 ±110% +178.8% 8276 ± 39% softirqs.CPU40.BLOCK
143346 ± 2% -8.4% 131373 softirqs.CPU62.SCHED
72798 ± 3% +15.5% 84051 ± 6% softirqs.CPU69.RCU
88925 ± 2% -16.6% 74161 ± 4% softirqs.CPU73.RCU
80135 ± 8% -11.7% 70793 ± 7% softirqs.CPU79.RCU
927.50 ± 28% +1082.2% 10965 ±123% softirqs.CPU80.BLOCK
1323 ± 96% +690.3% 10462 ± 44% softirqs.CPU83.BLOCK
524.75 ± 33% +987.9% 5709 ± 64% softirqs.CPU85.BLOCK
80997 ± 7% -12.3% 71034 ± 2% softirqs.CPU89.RCU
78331 ± 6% -8.3% 71848 ± 5% softirqs.CPU92.RCU
0.70 ± 7% +0.1 0.84 ± 2% perf-profile.calltrace.cycles-pp.btrfs_get_delayed_node.btrfs_get_or_create_delayed_node.btrfs_delayed_update_inode.btrfs_update_inode.btrfs_dirty_inode
0.71 ± 6% +0.1 0.85 ± 2% perf-profile.calltrace.cycles-pp.btrfs_get_or_create_delayed_node.btrfs_delayed_update_inode.btrfs_update_inode.btrfs_dirty_inode.btrfs_setattr
0.57 ± 6% +0.2 0.73 ± 9% perf-profile.calltrace.cycles-pp.mutex_lock.btrfs_delayed_update_inode.btrfs_update_inode.btrfs_dirty_inode.btrfs_setattr
1.40 ± 11% +0.2 1.59 ± 2% perf-profile.calltrace.cycles-pp.__kmalloc.security_prepare_creds.prepare_creds.do_faccessat.do_syscall_64
2.10 ± 10% +0.3 2.40 perf-profile.calltrace.cycles-pp.apparmor_cred_free.security_cred_free.put_cred_rcu.do_faccessat.do_syscall_64
0.29 ±100% +0.3 0.60 ± 2% perf-profile.calltrace.cycles-pp.inode_permission.link_path_walk.path_lookupat.filename_lookup.do_faccessat
3.04 ± 10% +0.4 3.42 perf-profile.calltrace.cycles-pp.security_cred_free.put_cred_rcu.do_faccessat.do_syscall_64.entry_SYSCALL_64_after_hwframe
0.09 ± 4% +0.0 0.11 perf-profile.children.cycles-pp.__put_cred
0.11 ± 9% +0.0 0.14 perf-profile.children.cycles-pp.inode_get_bytes
0.20 ± 5% +0.0 0.22 ± 2% perf-profile.children.cycles-pp.syscall_enter_from_user_mode
0.27 ± 9% +0.0 0.31 ± 4% perf-profile.children.cycles-pp.__check_heap_object
0.01 ±173% +0.0 0.06 ± 8% perf-profile.children.cycles-pp.posix_acl_chmod
0.30 ± 8% +0.0 0.34 ± 3% perf-profile.children.cycles-pp.vfs_getattr
0.07 ± 62% +0.0 0.11 ± 8% perf-profile.children.cycles-pp.calc_global_load_tick
0.40 ± 9% +0.1 0.45 perf-profile.children.cycles-pp.__mod_memcg_lruvec_state
0.00 +0.1 0.05 ± 8% perf-profile.children.cycles-pp.__fdget_raw
0.33 ± 4% +0.1 0.39 ± 5% perf-profile.children.cycles-pp.__list_del_entry_valid
0.41 ± 13% +0.1 0.49 ± 4% perf-profile.children.cycles-pp.tick_sched_handle
0.40 ± 14% +0.1 0.49 ± 3% perf-profile.children.cycles-pp.update_process_times
0.72 ± 7% +0.1 0.85 ± 2% perf-profile.children.cycles-pp.btrfs_get_or_create_delayed_node
0.70 ± 7% +0.1 0.84 ± 2% perf-profile.children.cycles-pp.btrfs_get_delayed_node
1.44 ± 10% +0.2 1.64 ± 2% perf-profile.children.cycles-pp.__kmalloc
1.44 ± 11% +0.2 1.64 perf-profile.children.cycles-pp.inode_permission
1.76 ± 10% +0.2 1.97 perf-profile.children.cycles-pp.link_path_walk
2.10 ± 10% +0.3 2.41 perf-profile.children.cycles-pp.apparmor_cred_free
1.52 ± 7% +0.3 1.84 ± 7% perf-profile.children.cycles-pp.mutex_lock
3.04 ± 10% +0.4 3.42 perf-profile.children.cycles-pp.security_cred_free
0.08 ± 5% +0.0 0.10 ± 4% perf-profile.self.cycles-pp.__put_cred
0.13 ± 10% +0.0 0.15 ± 6% perf-profile.self.cycles-pp.rcu_read_unlock_strict
0.19 ± 4% +0.0 0.22 ± 3% perf-profile.self.cycles-pp.syscall_enter_from_user_mode
0.26 ± 9% +0.0 0.30 ± 5% perf-profile.self.cycles-pp.__check_heap_object
0.07 ± 62% +0.0 0.11 ± 8% perf-profile.self.cycles-pp.calc_global_load_tick
0.33 ± 6% +0.1 0.38 ± 3% perf-profile.self.cycles-pp.generic_permission
0.32 ± 5% +0.1 0.39 ± 4% perf-profile.self.cycles-pp.__list_del_entry_valid
0.69 ± 7% +0.1 0.83 ± 2% perf-profile.self.cycles-pp.btrfs_get_delayed_node
2.09 ± 10% +0.3 2.39 perf-profile.self.cycles-pp.apparmor_cred_free
1.43 ± 7% +0.3 1.74 ± 7% perf-profile.self.cycles-pp.mutex_lock
0.50 ±173% +4.4e+05% 2190 ±141% interrupts.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
46.50 ±158% -99.3% 0.33 ±141% interrupts.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
3.00 ±117% +7.3e+05% 21877 ±137% interrupts.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
417.00 ±170% -99.9% 0.33 ±141% interrupts.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
400.00 ±170% -99.4% 2.33 ±141% interrupts.94:PCI-MSI.31981627-edge.i40e-eth0-TxRx-58
39402 ± 19% +38.0% 54359 ± 17% interrupts.CPU0.CAL:Function_call_interrupts
2079 ±161% -94.7% 111.00 ± 26% interrupts.CPU1.NMI:Non-maskable_interrupts
2079 ±161% -94.7% 111.00 ± 26% interrupts.CPU1.PMI:Performance_monitoring_interrupts
30657 ± 22% +79.4% 55013 ± 13% interrupts.CPU1.TLB:TLB_shootdowns
38766 ± 15% -16.5% 32388 ± 13% interrupts.CPU10.CAL:Function_call_interrupts
2996 ± 24% +100.4% 6003 ± 32% interrupts.CPU10.RES:Rescheduling_interrupts
41076 ± 11% -19.7% 32991 ± 21% interrupts.CPU10.TLB:TLB_shootdowns
5914 ± 13% -42.2% 3419 ± 11% interrupts.CPU11.RES:Rescheduling_interrupts
2082 ±161% -93.5% 134.67 ± 2% interrupts.CPU12.NMI:Non-maskable_interrupts
2082 ±161% -93.5% 134.67 ± 2% interrupts.CPU12.PMI:Performance_monitoring_interrupts
38621 ± 17% -20.9% 30553 ± 14% interrupts.CPU13.CAL:Function_call_interrupts
41286 ± 26% -31.2% 28408 ± 3% interrupts.CPU13.TLB:TLB_shootdowns
158.00 ± 4% -14.8% 134.67 ± 4% interrupts.CPU14.NMI:Non-maskable_interrupts
158.00 ± 4% -14.8% 134.67 ± 4% interrupts.CPU14.PMI:Performance_monitoring_interrupts
29511 ± 32% +156.3% 75635 ± 48% interrupts.CPU15.CAL:Function_call_interrupts
31482 ± 34% +169.2% 84756 ± 47% interrupts.CPU15.TLB:TLB_shootdowns
1610 ±156% -93.1% 111.33 ± 29% interrupts.CPU16.NMI:Non-maskable_interrupts
1610 ±156% -93.1% 111.33 ± 29% interrupts.CPU16.PMI:Performance_monitoring_interrupts
4311 ± 46% +136.6% 10203 ± 28% interrupts.CPU16.RES:Rescheduling_interrupts
30592 ± 14% +79.6% 54930 ± 12% interrupts.CPU17.CAL:Function_call_interrupts
33043 ± 20% +74.3% 57598 ± 10% interrupts.CPU17.TLB:TLB_shootdowns
153.25 ± 4% -11.7% 135.33 ± 2% interrupts.CPU18.NMI:Non-maskable_interrupts
153.25 ± 4% -11.7% 135.33 ± 2% interrupts.CPU18.PMI:Performance_monitoring_interrupts
2083 ±160% -95.8% 88.33 ± 32% interrupts.CPU2.NMI:Non-maskable_interrupts
2083 ±160% -95.8% 88.33 ± 32% interrupts.CPU2.PMI:Performance_monitoring_interrupts
4705 ± 5% +61.1% 7578 ± 20% interrupts.CPU2.RES:Rescheduling_interrupts
28936 ± 18% +74.1% 50369 ± 14% interrupts.CPU21.CAL:Function_call_interrupts
27459 ± 6% +25.7% 34512 ± 12% interrupts.CPU22.CAL:Function_call_interrupts
45.75 ±161% -100.0% 0.00 interrupts.CPU23.59:PCI-MSI.31981592-edge.i40e-eth0-TxRx-23
3617 ± 95% -96.1% 140.00 interrupts.CPU29.NMI:Non-maskable_interrupts
3617 ± 95% -96.1% 140.00 interrupts.CPU29.PMI:Performance_monitoring_interrupts
37715 ± 15% +90.9% 71983 ± 8% interrupts.CPU3.CAL:Function_call_interrupts
2587 ±122% -95.6% 114.33 ± 28% interrupts.CPU3.NMI:Non-maskable_interrupts
2587 ±122% -95.6% 114.33 ± 28% interrupts.CPU3.PMI:Performance_monitoring_interrupts
34590 ± 19% +135.2% 81364 ± 9% interrupts.CPU3.TLB:TLB_shootdowns
156.75 ± 4% -24.3% 118.67 ± 29% interrupts.CPU30.NMI:Non-maskable_interrupts
156.75 ± 4% -24.3% 118.67 ± 29% interrupts.CPU30.PMI:Performance_monitoring_interrupts
7562 ± 21% -64.7% 2670 ± 27% interrupts.CPU31.RES:Rescheduling_interrupts
1656 ±156% -91.6% 139.00 interrupts.CPU32.NMI:Non-maskable_interrupts
1656 ±156% -91.6% 139.00 interrupts.CPU32.PMI:Performance_monitoring_interrupts
5667 ± 56% -97.6% 137.67 interrupts.CPU33.NMI:Non-maskable_interrupts
5667 ± 56% -97.6% 137.67 interrupts.CPU33.PMI:Performance_monitoring_interrupts
7325 ± 56% -55.6% 3254 ± 62% interrupts.CPU34.RES:Rescheduling_interrupts
47968 ± 40% -35.4% 31008 ± 30% interrupts.CPU35.TLB:TLB_shootdowns
5151 ± 17% -43.4% 2914 ± 32% interrupts.CPU36.RES:Rescheduling_interrupts
2.25 ±148% +9.7e+05% 21877 ±137% interrupts.CPU37.73:PCI-MSI.31981606-edge.i40e-eth0-TxRx-37
34879 ± 26% -29.5% 24577 ± 5% interrupts.CPU38.CAL:Function_call_interrupts
35800 ± 29% -30.8% 24771 ± 5% interrupts.CPU38.TLB:TLB_shootdowns
55336 ± 29% -32.9% 37155 ± 18% interrupts.CPU39.TLB:TLB_shootdowns
3979 ± 35% +85.1% 7363 ± 10% interrupts.CPU41.RES:Rescheduling_interrupts
416.25 ±170% -100.0% 0.00 interrupts.CPU42.78:PCI-MSI.31981611-edge.i40e-eth0-TxRx-42
39832 ± 40% -37.6% 24870 ± 8% interrupts.CPU43.CAL:Function_call_interrupts
45399 ± 40% -44.6% 25157 ± 8% interrupts.CPU43.TLB:TLB_shootdowns
32705 ± 17% -18.2% 26756 ± 6% interrupts.CPU45.TLB:TLB_shootdowns
1106 ±147% -86.6% 148.33 ± 3% interrupts.CPU47.NMI:Non-maskable_interrupts
1106 ±147% -86.6% 148.33 ± 3% interrupts.CPU47.PMI:Performance_monitoring_interrupts
40893 ± 31% -34.3% 26855 ± 13% interrupts.CPU47.TLB:TLB_shootdowns
3222 ± 41% +83.4% 5908 ± 31% interrupts.CPU53.RES:Rescheduling_interrupts
91.25 ± 27% +45.0% 132.33 ± 5% interrupts.CPU55.NMI:Non-maskable_interrupts
91.25 ± 27% +45.0% 132.33 ± 5% interrupts.CPU55.PMI:Performance_monitoring_interrupts
3438 ± 12% +85.4% 6375 ± 33% interrupts.CPU55.RES:Rescheduling_interrupts
90.50 ± 26% +61.0% 145.67 ± 8% interrupts.CPU57.NMI:Non-maskable_interrupts
90.50 ± 26% +61.0% 145.67 ± 8% interrupts.CPU57.PMI:Performance_monitoring_interrupts
40603 ± 7% -19.7% 32584 ± 10% interrupts.CPU58.CAL:Function_call_interrupts
3412 ± 28% +96.2% 6696 ± 31% interrupts.CPU58.RES:Rescheduling_interrupts
45704 ± 6% -26.4% 33632 ± 12% interrupts.CPU58.TLB:TLB_shootdowns
5961 ± 15% -32.6% 4015 ± 24% interrupts.CPU59.RES:Rescheduling_interrupts
3823 ± 96% -96.3% 143.00 ± 72% interrupts.CPU6.NMI:Non-maskable_interrupts
3823 ± 96% -96.3% 143.00 ± 72% interrupts.CPU6.PMI:Performance_monitoring_interrupts
7698 ± 40% -45.7% 4182 ± 27% interrupts.CPU63.RES:Rescheduling_interrupts
34611 ± 20% +40.9% 48764 ± 8% interrupts.CPU64.CAL:Function_call_interrupts
5193 ± 42% +92.1% 9977 ± 22% interrupts.CPU64.RES:Rescheduling_interrupts
33042 ± 8% +54.5% 51036 ± 14% interrupts.CPU64.TLB:TLB_shootdowns
31485 ± 27% +66.2% 52337 ± 37% interrupts.CPU65.CAL:Function_call_interrupts
150.75 ± 4% -27.3% 109.67 ± 27% interrupts.CPU66.NMI:Non-maskable_interrupts
150.75 ± 4% -27.3% 109.67 ± 27% interrupts.CPU66.PMI:Performance_monitoring_interrupts
32638 ± 13% +49.0% 48628 ± 15% interrupts.CPU69.CAL:Function_call_interrupts
0.25 ±173% +8.8e+05% 2189 ±141% interrupts.CPU7.43:PCI-MSI.31981576-edge.i40e-eth0-TxRx-7
31333 ± 11% +56.0% 48893 ± 23% interrupts.CPU71.CAL:Function_call_interrupts
43604 ± 23% -24.4% 32971 ± 21% interrupts.CPU75.CAL:Function_call_interrupts
1794 ± 91% -92.3% 138.33 interrupts.CPU77.NMI:Non-maskable_interrupts
1794 ± 91% -92.3% 138.33 interrupts.CPU77.PMI:Performance_monitoring_interrupts
160.75 ± 6% -10.4% 144.00 ± 3% interrupts.CPU78.NMI:Non-maskable_interrupts
160.75 ± 6% -10.4% 144.00 ± 3% interrupts.CPU78.PMI:Performance_monitoring_interrupts
7759 ± 20% -66.7% 2583 ± 15% interrupts.CPU79.RES:Rescheduling_interrupts
1272 ±151% -89.1% 138.33 interrupts.CPU80.NMI:Non-maskable_interrupts
1272 ±151% -89.1% 138.33 interrupts.CPU80.PMI:Performance_monitoring_interrupts
3192 ± 66% -95.7% 137.67 interrupts.CPU81.NMI:Non-maskable_interrupts
3192 ± 66% -95.7% 137.67 interrupts.CPU81.PMI:Performance_monitoring_interrupts
41009 ± 23% -25.3% 30627 ± 13% interrupts.CPU83.CAL:Function_call_interrupts
42888 ± 26% -30.9% 29645 ± 2% interrupts.CPU83.TLB:TLB_shootdowns
5727 ± 20% -37.3% 3590 ± 37% interrupts.CPU84.RES:Rescheduling_interrupts
39107 ± 25% -28.9% 27794 ± 14% interrupts.CPU85.CAL:Function_call_interrupts
7873 ± 75% -61.4% 3036 ± 42% interrupts.CPU85.RES:Rescheduling_interrupts
43902 ± 32% -28.6% 31363 ± 11% interrupts.CPU85.TLB:TLB_shootdowns
45248 ± 36% -31.2% 31146 ± 28% interrupts.CPU86.CAL:Function_call_interrupts
47668 ± 38% -26.2% 35171 ± 27% interrupts.CPU86.TLB:TLB_shootdowns
41769 ± 23% -26.9% 30537 ± 23% interrupts.CPU88.CAL:Function_call_interrupts
152.50 ± 5% -25.5% 113.67 ± 28% interrupts.CPU88.NMI:Non-maskable_interrupts
152.50 ± 5% -25.5% 113.67 ± 28% interrupts.CPU88.PMI:Performance_monitoring_interrupts
46135 ± 24% -25.8% 34241 ± 24% interrupts.CPU88.TLB:TLB_shootdowns
46305 ± 23% -38.7% 28402 ± 8% interrupts.CPU89.CAL:Function_call_interrupts
4112 ± 26% +83.9% 7564 ± 6% interrupts.CPU89.RES:Rescheduling_interrupts
148.50 ± 9% -22.6% 115.00 ± 27% interrupts.CPU9.NMI:Non-maskable_interrupts
148.50 ± 9% -22.6% 115.00 ± 27% interrupts.CPU9.PMI:Performance_monitoring_interrupts
43780 ± 40% -34.3% 28764 ± 3% interrupts.CPU90.CAL:Function_call_interrupts
4730 ± 45% -43.5% 2671 ± 27% interrupts.CPU90.RES:Rescheduling_interrupts
44682 ± 41% -31.0% 30833 ± 6% interrupts.CPU90.TLB:TLB_shootdowns
48742 ± 20% -44.3% 27151 ± 11% interrupts.CPU91.CAL:Function_call_interrupts
53696 ± 22% -45.8% 29108 ± 3% interrupts.CPU91.TLB:TLB_shootdowns
157.25 ± 5% -13.1% 136.67 interrupts.CPU92.NMI:Non-maskable_interrupts
157.25 ± 5% -13.1% 136.67 interrupts.CPU92.PMI:Performance_monitoring_interrupts
846.00 ±138% -81.8% 153.67 ± 3% interrupts.CPU95.NMI:Non-maskable_interrupts
846.00 ±138% -81.8% 153.67 ± 3% interrupts.CPU95.PMI:Performance_monitoring_interrupts
stress-ng.copy-file.ops
3000 +--------------------------------------------------------------------+
| |
2500 |..+.+..+..+ +..+.+..+..+.+..+..+.+..+.+..+..+.+..+..+.+..+ |
| : : |
| : : |
2000 |-+ : : |
| : : |
1500 |-+ : : |
| : : |
1000 |-+ : : |
| : : |
| :: |
500 |-+ :: |
| : |
0 +--------------------------------------------------------------------+
stress-ng.copy-file.ops_per_sec
100 +---------------------------------------------------------------------+
90 |-+ |
|..+.+..+..+ +..+..+.+..+..+.+..+..+.+..+..+.+..+..+..+.+..+ |
80 |-+ : : |
70 |-+ : : |
| : : |
60 |-+ : : |
50 |-+ : : |
40 |-+ : : |
| : : |
30 |-+ : : |
20 |-+ :: |
| :: |
10 |-+ : |
0 +---------------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 5 months
- 1
- 0
c2f4ca83b5: BUG:KASAN:use-after-free_in_dma_unmap_page_attrs
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: c2f4ca83b5ff95fd02b404b38072f4b92adf68dd ("[PATCH] [PATCH] Keep offset when mapping data via SWIOTLB.")
url: https://github.com/0day-ci/linux/commits/Jianxiong-Gao/Keep-offset-when-m...
base: https://git.kernel.org/cgit/linux/kernel/git/konrad/swiotlb.git linux-next
in testcase: locktorture
version:
with following parameters:
runtime: 300s
test: default
test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors.
test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt
on test machine: qemu-system-x86_64 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+----------------------------------------------------------------------------+------------+------------+
| | fc0021aa34 | c2f4ca83b5 |
+----------------------------------------------------------------------------+------------+------------+
| boot_successes | 0 | 0 |
| boot_failures | 4 | 12 |
| Kernel_panic-not_syncing:VFS:Unable_to_mount_root_fs_on_unknown-block(#,#) | 4 | 1 |
| BUG:KASAN:slab-out-of-bounds_in_e1000_clean_rx_irq | 0 | 1 |
| IP-Config:Auto-configuration_of_network_failed | 0 | 6 |
| BUG:KASAN:use-after-free_in_dma_unmap_page_attrs | 0 | 5 |
| BUG:KASAN:use-after-free_in_e1000_clean_rx_irq | 0 | 1 |
+----------------------------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 21.445939] BUG: KASAN: use-after-free in dma_unmap_page_attrs+0xce/0x158
[ 21.446537] Write of size 1522 at addr ffff8881539a0180 by task swapper/1
[ 21.447132]
[ 21.447282] CPU: 0 PID: 1 Comm: swapper Not tainted 5.10.0-rc1-00003-gc2f4ca83b5ff #1
[ 21.447966] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.12.0-1 04/01/2014
[ 21.448694] Call Trace:
[ 21.448922] <IRQ>
[ 21.449119] print_address_description+0x1c/0x413
[ 21.449524] ? lock_acquire+0x124/0x153
[ 21.449764] ? kasan_report+0xc0/0x190
[ 21.450007] ? dma_unmap_page_attrs+0xce/0x158
[ 21.450284] kasan_report+0x157/0x190
[ 21.450517] ? dma_unmap_page_attrs+0xce/0x158
[ 21.450798] check_memory_region+0x13d/0x145
[ 21.451066] memcpy+0x39/0x58
[ 21.451257] dma_unmap_page_attrs+0xce/0x158
[ 21.451528] e1000_clean_rx_irq+0x41e/0xb8e
[ 21.451802] ? e1000_clean_jumbo_rx_irq+0x135c/0x135c
[ 21.452115] e1000_clean+0xef/0x4f3
[ 21.452336] ? trace_hardirqs_on+0x2d/0x38
[ 21.452592] ? _raw_spin_unlock_irq+0x24/0x2d
[ 21.452865] ? e1000_clean_tx_irq+0x125b/0x125b
[ 21.453151] ? tracer_hardirqs_on+0x16/0x172
[ 21.453432] net_rx_action+0x257/0x5ec
[ 21.453670] ? napi_busy_loop+0x20d/0x20d
[ 21.453926] ? tracer_hardirqs_on+0x16/0x172
[ 21.454196] __do_softirq+0x24d/0x545
[ 21.454433] asm_call_irq_on_stack+0xf/0x20
[ 21.454692] </IRQ>
[ 21.454832] do_softirq_own_stack+0x2e/0x3a
[ 21.455093] do_softirq+0x44/0x54
[ 21.455303] __local_bh_enable_ip+0x4f/0x5d
[ 21.455563] __dev_queue_xmit+0xce4/0xd30
[ 21.455818] ? netdev_core_pick_tx+0x1b9/0x1b9
[ 21.456094] ? memset+0x22/0x42
[ 21.456294] ? __alloc_skb+0x345/0x47d
[ 21.456531] ? skb_scrub_packet+0x170/0x170
[ 21.456792] ? __x64_sys_getrandom+0xe5/0xe5
[ 21.457058] ? memcpy+0x39/0x58
[ 21.457269] ic_bootp_send_if+0x11a1/0x11ce
[ 21.457537] ip_auto_config+0x476/0xb7e
[ 21.457780] ? root_nfs_parse_addr+0xfc/0xfc
[ 21.458047] ? lock_downgrade+0x4aa/0x4aa
[ 21.458299] ? lock_acquire+0x124/0x153
[ 21.458546] ? root_nfs_parse_addr+0xfc/0xfc
[ 21.458810] ? do_one_initcall+0xf2/0x25a
[ 21.459059] do_one_initcall+0xf2/0x25a
[ 21.459298] ? perf_trace_initcall_level+0x2eb/0x2eb
[ 21.459604] ? parameq+0x2d/0x2d
[ 21.459807] ? kasan_save_stack+0x25/0x3c
[ 21.460056] ? __kasan_kmalloc+0x70/0x7e
[ 21.460363] ? trace_kmalloc+0x44/0x54
[ 21.460597] ? __kmalloc+0x13a/0x164
[ 21.460826] do_basic_setup+0x1bb/0x1ea
[ 21.461071] kernel_init_freeable+0x130/0x15a
[ 21.461349] ? rest_init+0x12f/0x12f
[ 21.461575] kernel_init+0xd/0x10c
[ 21.461790] ret_from_fork+0x1f/0x30
[ 21.462026]
[ 21.462127] Allocated by task 1:
[ 21.462333] kasan_save_stack+0x1b/0x3c
[ 21.462574] kasan_set_track+0x1b/0x20
[ 21.462808] __kasan_kmalloc+0x70/0x7e
[ 21.463104] slab_post_alloc_hook+0x3c/0x167
[ 21.463369] kmem_cache_alloc+0xd5/0x150
[ 21.463614] acpi_ut_create_generic_state+0x5d/0x93
[ 21.463914] acpi_ut_create_update_state+0x18/0xac
[ 21.464210] acpi_ut_create_update_state_and_push+0x2a/0x46
[ 21.464552] acpi_ut_update_object_reference+0x331/0x548
[ 21.464879] acpi_ds_do_implicit_return+0x19a/0x1a7
[ 21.465180] acpi_ds_is_result_used+0xa5/0x6e2
[ 21.465466] acpi_ds_delete_result_if_not_used+0xe3/0x14e
[ 21.465799] acpi_ds_exec_end_op+0x127f/0x12f1
[ 21.466075] acpi_ps_parse_loop+0x14ac/0x15c6
[ 21.466345] acpi_ps_parse_aml+0x40c/0xc3b
[ 21.466601] acpi_ps_execute_method+0x672/0x7e6
[ 21.466886] acpi_ns_evaluate+0xa53/0xf5b
[ 21.467137] acpi_ut_evaluate_object+0x11d/0x452
[ 21.467423] acpi_rs_get_prt_method_data+0x93/0x123
[ 21.467725] acpi_get_irq_routing_table+0xbb/0x110
[ 21.468023] acpi_pci_irq_find_prt_entry+0x155/0xa07
[ 21.468329] acpi_pci_irq_lookup+0x80/0x84b
[ 21.468589] acpi_pci_irq_enable+0x281/0x512
[ 21.468857] do_pci_enable_device+0x86/0x157
[ 21.469122] pci_enable_device_flags+0x1d1/0x223
[ 21.469497] e1000_probe+0x117/0x2327
[ 21.469822] pci_device_probe+0x19d/0x32b
[ 21.470179] really_probe+0x321/0x7fd
[ 21.470507] driver_probe_device+0xeb/0x13f
[ 21.470879] device_driver_attach+0xc6/0xfd
[ 21.471251] __driver_attach+0x141/0x148
[ 21.471600] bus_for_each_dev+0xfd/0x149
[ 21.471949] bus_add_driver+0x2bb/0x455
[ 21.472291] driver_register+0x247/0x2c6
[ 21.472642] e1000_init_module+0x42/0x77
[ 21.472995] do_one_initcall+0xf2/0x25a
[ 21.473332] do_basic_setup+0x1bb/0x1ea
[ 21.473674] kernel_init_freeable+0x130/0x15a
[ 21.474053] kernel_init+0xd/0x10c
[ 21.474358] ret_from_fork+0x1f/0x30
[ 21.474677]
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc1-00003-gc2f4ca83b5ff .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=x86_64 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 5 months
- 1
- 0
[lib] 1333d0ba67: WARNING:at_kernel/locking/lockdep.c:#lockdep_register_key
by kernel test robot
Greeting,
FYI, we noticed the following commit (built with gcc-9):
commit: 1333d0ba67aa139cd33d20039e3a1dd9c79ec546 ("[PATCH v3] lib: stackdepot: Add support to configure STACK_HASH_SIZE")
url: https://github.com/0day-ci/linux/commits/vjitta-codeaurora-org/lib-stackd...
base: https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git a2f5ea9e314ba6778f885c805c921e9362ec0420
in testcase: locktorture
version:
with following parameters:
runtime: 300s
test: default
test-description: This torture test consists of creating a number of kernel threads which acquire the lock and hold it for specific amount of time, thus simulating different critical region behaviors.
test-url: https://www.kernel.org/doc/Documentation/locking/locktorture.txt
on test machine: qemu-system-i386 -enable-kvm -cpu SandyBridge -smp 2 -m 8G
caused below changes (please refer to attached dmesg/kmsg for entire log/backtrace):
+-----------------------------------------------------------+------------+------------+
| | a2f5ea9e31 | 1333d0ba67 |
+-----------------------------------------------------------+------------+------------+
| boot_successes | 4 | 15 |
| boot_failures | 0 | 10 |
| WARNING:at_kernel/locking/lockdep.c:#lockdep_register_key | 0 | 10 |
| EIP:lockdep_register_key | 0 | 10 |
+-----------------------------------------------------------+------------+------------+
If you fix the issue, kindly add following tag
Reported-by: kernel test robot <rong.a.chen(a)intel.com>
[ 9.506645] WARNING: CPU: 1 PID: 193 at kernel/locking/lockdep.c:1177 lockdep_register_key+0x178/0x210
[ 9.507533] Modules linked in: bochs_drm(+) drm_vram_helper drm_ttm_helper ttm crc32_pclmul drm_kms_helper rapl snd_pcm drm snd_timer drm_panel_orientation_quirks fb snd fbdev i2c_piix4 i2c_core piix(+) qemu_fw_cfg
[ 9.509376] CPU: 1 PID: 193 Comm: udevd Not tainted 5.10.0-rc7-00035-g1333d0ba67aa #1
[ 9.510125] EIP: lockdep_register_key+0x178/0x210
[ 9.510589] Code: b5 00 20 b0 42 85 c0 0f 84 35 ff ff ff 89 58 04 8b 1d 6c 72 be 42 85 db 0f 85 5f ff ff ff e9 29 ff ff ff 8d b4 26 00 00 00 00 <0f> 0b 8d 65 f4 5b 5e 5f 5d c3 8d b6 00 00 00 00 89 c2 b8 08 70 be
[ 9.512369] EAX: 00000001 EBX: 42782b48 ECX: 00000003 EDX: 41dff601
[ 9.512966] ESI: 42782b48 EDI: 42782b6c EBP: 42515c48 ESP: 42515c38
[ 9.513565] DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 EFLAGS: 00010202
[ 9.514245] CR0: 80050033 CR2: 3fda9000 CR3: 024fc9a0 CR4: 000406f0
[ 9.514843] DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000
[ 9.515462] DR6: fffe0ff0 DR7: 00000400
[ 9.515831] Call Trace:
[ 9.516079] ? alloc_workqueue+0x13f/0x3b0
[ 9.516489] ? ttm_mem_global_init+0x35/0x2e0 [ttm]
[ 9.516961] ? slob_alloc+0x1dd/0x1f0
[ 9.517382] ? ttm_bo_device_init+0x15a/0x290 [ttm]
[ 9.517857] ? drm_vram_helper_alloc_mm+0x5f/0xe0 [drm_vram_helper]
[ 9.518464] ? bochs_mm_init+0x16/0x30 [bochs_drm]
[ 9.518920] ? bochs_pci_probe+0xef/0x140 [bochs_drm]
[ 9.519506] ? pci_device_probe+0xcc/0x140
[ 9.519901] ? really_probe+0x1bd/0x3f0
[ 9.520274] ? driver_probe_device+0x55/0x180
[ 9.520694] ? mutex_lock_nested+0x14/0x20
[ 9.521096] ? __device_driver_lock+0x1d/0x40
[ 9.521515] ? device_driver_attach+0x49/0x50
[ 9.521942] ? __driver_attach+0x89/0x130
[ 9.522323] ? device_driver_attach+0x50/0x50
[ 9.522737] ? bus_for_each_dev+0x4c/0x80
[ 9.523126] ? driver_attach+0x14/0x20
[ 9.523506] ? device_driver_attach+0x50/0x50
[ 9.523964] ? bus_add_driver+0x14f/0x1c0
[ 9.524353] ? pci_bus_num_vf+0x10/0x10
[ 9.524727] ? driver_register+0x61/0xb0
[ 9.525108] ? 0xdfbab000
[ 9.525363] ? __pci_register_driver+0x4d/0x60
[ 9.525796] ? bochs_init+0x20/0x1000 [bochs_drm]
[ 9.526245] ? do_one_initcall+0x54/0x230
[ 9.526636] ? slob_alloc+0x90/0x1f0
[ 9.527031] ? __kmalloc+0x62/0x1a0
[ 9.527392] ? do_init_module+0x1a/0x3f0
[ 9.527777] ? do_init_module+0x49/0x3f0
[ 9.528157] ? __vfree+0x1d/0x50
[ 9.528480] ? load_module+0x1098/0x1260
[ 9.528860] ? __ia32_sys_finit_module+0x89/0xd0
[ 9.529290] ? do_int80_syscall_32+0x2c/0x40
[ 9.529701] ? entry_INT80_32+0xed/0xed
[ 9.530078] ---[ end trace 735bd35c911b2630 ]---
To reproduce:
# build kernel
cd linux
cp config-5.10.0-rc7-00035-g1333d0ba67aa .config
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 olddefconfig prepare modules_prepare bzImage modules
make HOSTCC=gcc-9 CC=gcc-9 ARCH=i386 INSTALL_MOD_PATH=<mod-install-dir> modules_install
cd <mod-install-dir>
find lib/ | cpio -o -H newc --quiet | gzip > modules.cgz
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp qemu -k <bzImage> -m modules.cgz job-script # job-script is attached in this email
Thanks,
Rong Chen
1 year, 5 months
- 1
- 0
[crypto] daf88f3757: fio.write_iops 5.9% improvement
by kernel test robot
Greeting,
FYI, we noticed a 5.9% improvement of fio.write_iops due to commit:
commit: daf88f3757ecb7aed4dd05a1ca8c8b4ac378d6c3 ("crypto: qat - remove unused function")
https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git master
in testcase: fio-basic
on test machine: 96 threads Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz with 256G memory
with following parameters:
disk: 2pmem
fs: xfs
mount_option: dax
runtime: 200s
nr_task: 50%
time_based: tb
rw: write
bs: 4k
ioengine: mmap
test_size: 200G
cpufreq_governor: performance
ucode: 0x5003003
test-description: Fio is a tool that will spawn a number of threads or processes doing a particular type of I/O action as specified by the user.
test-url: https://github.com/axboe/fio
Details are as below:
-------------------------------------------------------------------------------------------------->
To reproduce:
git clone https://github.com/intel/lkp-tests.git
cd lkp-tests
bin/lkp install job.yaml # job file is attached in this email
bin/lkp run job.yaml
=========================================================================================
bs/compiler/cpufreq_governor/disk/fs/ioengine/kconfig/mount_option/nr_task/rootfs/runtime/rw/tbox_group/test_size/testcase/time_based/ucode:
4k/gcc-9/performance/2pmem/xfs/mmap/x86_64-rhel-8.3/dax/50%/debian-10.4-x86_64-20200603.cgz/200s/write/lkp-csl-2sp6/200G/fio-basic/tb/0x5003003
commit:
v5.10-rc1
daf88f3757 ("crypto: qat - remove unused function")
v5.10-rc1 daf88f3757ecb7aed4dd05a1ca8
---------------- ---------------------------
fail:runs %reproduction fail:runs
| | |
0:1 106% 1:4 perf-profile.children.cycles-pp.error_entry
0:1 19% 0:4 perf-profile.self.cycles-pp.error_entry
%stddev %change %stddev
\ | \
0.09 +0.0 0.11 ± 8% perf-profile.self.cycles-pp.xfs_direct_write_iomap_begin
0.01 -0.0 0.00 fio.latency_1000us%
0.01 -0.0 0.00 fio.latency_10ms%
52.71 +30.8 83.51 fio.latency_20us%
0.01 -0.0 0.00 fio.latency_250ms%
0.01 -0.0 0.00 fio.latency_4ms%
47.28 -30.9 16.42 ± 8% fio.latency_50us%
23750 -3.2% 22982 ± 2% fio.time.involuntary_context_switches
4.714e+08 +5.9% 4.994e+08 fio.time.minor_page_faults
4.714e+08 +5.9% 4.994e+08 fio.workload
9206 +5.9% 9753 fio.write_bw_MBps
21888 -6.1% 20544 fio.write_clat_90%_us
23424 -6.0% 22016 fio.write_clat_95%_us
27008 -4.7% 25728 fio.write_clat_99%_us
20030 -5.8% 18866 fio.write_clat_mean_us
10094 -23.6% 7715 ± 18% fio.write_clat_stddev
2356822 +5.9% 2496918 fio.write_iops
15.67 -1.9% 15.37 boot-time.dhcp
1678 -4.9% 1595 ± 4% boot-time.idle
142207 +27.7% 181659 ± 3% meminfo.Active
142079 +27.8% 181543 ± 3% meminfo.Active(anon)
5253120 +39.0% 7303680 ± 14% meminfo.DirectMap2M
1032574 +20.6% 1245626 ± 15% numa-numastat.node0.local_node
1063704 +19.3% 1268874 ± 14% numa-numastat.node0.numa_hit
99.00 +7991.7% 8010 ±167% numa-numastat.node1.other_node
1095 +20.0% 1314 ± 10% slabinfo.Acpi-Parse.active_objs
1095 +20.0% 1314 ± 10% slabinfo.Acpi-Parse.num_objs
3903 +15.2% 4497 ± 2% slabinfo.kmalloc-rcl-64.active_objs
3903 +15.2% 4497 ± 2% slabinfo.kmalloc-rcl-64.num_objs
1974 +21.4% 2397 ± 5% slabinfo.kmalloc-rcl-96.active_objs
1974 +21.4% 2397 ± 5% slabinfo.kmalloc-rcl-96.num_objs
4224 -9.7% 3816 ± 3% slabinfo.skbuff_head_cache.active_objs
4224 -9.7% 3816 ± 3% slabinfo.skbuff_head_cache.num_objs
168.00 +87.5% 315.00 ± 33% slabinfo.xfs_buf.active_objs
168.00 +87.5% 315.00 ± 33% slabinfo.xfs_buf.num_objs
520.00 -52.1% 249.00 ± 71% numa-vmstat.node0.nr_active_anon
7575 +15.7% 8761 ± 8% numa-vmstat.node0.nr_kernel_stack
3731 +1893.7% 74386 ±161% numa-vmstat.node0.nr_mapped
336.00 -41.5% 196.50 ± 51% numa-vmstat.node0.nr_mlock
860.00 +8249.9% 71809 ±167% numa-vmstat.node0.nr_shmem
24648 +15.7% 28508 ± 8% numa-vmstat.node0.nr_slab_unreclaimable
520.00 -52.1% 249.00 ± 71% numa-vmstat.node0.nr_zone_active_anon
34802 +29.7% 45154 ± 3% numa-vmstat.node1.nr_active_anon
17541 +52.0% 26657 ± 27% numa-vmstat.node1.nr_anon_pages
34802 +29.7% 45154 ± 3% numa-vmstat.node1.nr_zone_active_anon
21522 +318.3% 90028 ± 61% numa-vmstat.node1.numa_other
2176 -49.7% 1095 ± 66% numa-meminfo.node0.Active
2080 -52.1% 995.50 ± 71% numa-meminfo.node0.Active(anon)
159744 -26.0% 118206 ± 20% numa-meminfo.node0.AnonHugePages
7582 +15.6% 8764 ± 8% numa-meminfo.node0.KernelStack
14358 +1971.7% 297452 ±161% numa-meminfo.node0.Mapped
3775134 +18.3% 4467361 ± 13% numa-meminfo.node0.MemUsed
1344 -41.6% 785.50 ± 51% numa-meminfo.node0.Mlocked
98606 +15.7% 114046 ± 8% numa-meminfo.node0.SUnreclaim
3439 +8252.3% 287235 ±167% numa-meminfo.node0.Shmem
139195 +29.7% 180575 ± 3% numa-meminfo.node1.Active
139163 +29.7% 180559 ± 3% numa-meminfo.node1.Active(anon)
39355 +107.6% 81695 ± 29% numa-meminfo.node1.AnonHugePages
70147 +52.0% 106637 ± 27% numa-meminfo.node1.AnonPages
35315 +28.5% 45393 ± 3% proc-vmstat.nr_active_anon
574816 +2.1% 587055 proc-vmstat.nr_file_pages
16071 +2.8% 16516 proc-vmstat.nr_kernel_stack
458909 +6.1% 487082 proc-vmstat.nr_page_table_pages
317028 +3.4% 327836 proc-vmstat.nr_shmem
51381 -1.1% 50830 proc-vmstat.nr_slab_unreclaimable
35315 +28.5% 45393 ± 3% proc-vmstat.nr_zone_active_anon
2752314 +4.8% 2884284 proc-vmstat.numa_hit
2720860 +4.9% 2852909 proc-vmstat.numa_local
550.00 +1693.2% 9862 ± 67% proc-vmstat.numa_pages_migrated
70822 +31.3% 92981 ± 3% proc-vmstat.pgactivate
2852741 +5.0% 2995650 proc-vmstat.pgalloc_normal
4.726e+08 +5.9% 5.006e+08 proc-vmstat.pgfault
2649470 +4.5% 2769520 proc-vmstat.pgfree
550.00 +1693.2% 9862 ± 67% proc-vmstat.pgmigrate_success
38080 +5.0% 39999 proc-vmstat.pgreuse
920942 +5.9% 975683 proc-vmstat.thp_fault_fallback
157.77 -100.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.avg
8445 -100.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.max
1088 -100.0% 0.00 sched_debug.cfs_rq:/.MIN_vruntime.stddev
157.77 -100.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.avg
8445 -100.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.max
1088 -100.0% 0.00 sched_debug.cfs_rq:/.max_vruntime.stddev
191356 -13.8% 165009 ± 7% sched_debug.cfs_rq:/.min_vruntime.max
1.25 -20.0% 1.00 sched_debug.cfs_rq:/.nr_running.max
1063 +8.5% 1153 ± 4% sched_debug.cfs_rq:/.runnable_avg.max
1063 +8.3% 1151 ± 4% sched_debug.cfs_rq:/.util_avg.max
2.62 +12.9% 2.96 ± 3% sched_debug.cpu.clock.stddev
0.00 +21.2% 0.00 ± 18% sched_debug.cpu.next_balance.stddev
1.25 -20.0% 1.00 sched_debug.cpu.nr_running.max
41575 -23.4% 31826 ± 17% sched_debug.cpu.nr_switches.max
37046 -28.9% 26350 ± 26% sched_debug.cpu.sched_count.max
18461 -28.9% 13121 ± 26% sched_debug.cpu.sched_goidle.max
19536 -33.5% 13000 ± 26% sched_debug.cpu.ttwu_count.max
5010 +312.7% 20675 ± 38% softirqs.CPU10.SCHED
4120 +401.1% 20647 ± 42% softirqs.CPU12.SCHED
4225 +372.0% 19942 ± 39% softirqs.CPU13.SCHED
4708 +437.7% 25312 ± 5% softirqs.CPU14.SCHED
5302 +278.4% 20065 ± 40% softirqs.CPU15.SCHED
5022 +301.2% 20147 ± 40% softirqs.CPU16.SCHED
4280 +368.8% 20062 ± 41% softirqs.CPU17.SCHED
4686 +330.4% 20170 ± 39% softirqs.CPU18.SCHED
4110 +383.4% 19869 ± 40% softirqs.CPU21.SCHED
5551 +267.4% 20393 ± 39% softirqs.CPU22.SCHED
5109 +285.5% 19693 ± 40% softirqs.CPU23.SCHED
4594 +418.7% 23828 ± 16% softirqs.CPU3.SCHED
33085 -69.9% 9959 ±103% softirqs.CPU30.SCHED
27523 -64.3% 9831 ± 97% softirqs.CPU34.SCHED
26158 -84.1% 4148 ± 10% softirqs.CPU35.SCHED
26085 -83.6% 4288 ± 13% softirqs.CPU36.SCHED
3832 +434.8% 20494 ± 45% softirqs.CPU4.SCHED
26639 -59.1% 10888 ± 79% softirqs.CPU41.SCHED
14491 -69.4% 4433 ± 21% softirqs.CPU47.SCHED
3952 +448.8% 21687 ± 45% softirqs.CPU5.SCHED
26317 -73.8% 6906 ± 75% softirqs.CPU51.SCHED
16151 -100.0% 0.50 ±173% softirqs.CPU53.NET_RX
28193 -65.6% 9705 ±108% softirqs.CPU53.SCHED
12886 -53.9% 5946 ± 2% softirqs.CPU62.RCU
29154 -86.6% 3910 ± 9% softirqs.CPU62.SCHED
73.00 +3777.1% 2830 ±165% softirqs.CPU64.TIMER
3677 +110.8% 7751 ± 54% softirqs.CPU69.RCU
4405 +360.8% 20300 ± 44% softirqs.CPU7.SCHED
3702 +457.0% 20619 ± 47% softirqs.CPU79.SCHED
4573 +282.4% 17486 ± 47% softirqs.CPU8.SCHED
3581 +655.1% 27039 ± 3% softirqs.CPU83.SCHED
3620 +622.6% 26158 ± 2% softirqs.CPU84.SCHED
4440 +359.6% 20406 ± 44% softirqs.CPU9.SCHED
3555 +95.5% 6950 ± 76% softirqs.CPU92.SCHED
13752 +94.0% 26681 ± 2% softirqs.CPU95.SCHED
30585 -71.2% 8799 ± 26% softirqs.NET_RX
6.178e+09 +3.5% 6.396e+09 perf-stat.i.branch-instructions
0.39 -0.0 0.38 perf-stat.i.branch-miss-rate%
69.60 +1.8 71.39 perf-stat.i.cache-miss-rate%
1.832e+08 +5.1% 1.925e+08 perf-stat.i.cache-misses
4.93 -3.4% 4.76 perf-stat.i.cpi
736.97 -4.5% 703.46 perf-stat.i.cycles-between-cache-misses
7.055e+09 +3.3% 7.285e+09 perf-stat.i.dTLB-loads
12407035 +5.1% 13040942 perf-stat.i.dTLB-store-misses
2.629e+09 +5.8% 2.781e+09 perf-stat.i.dTLB-stores
2.707e+10 +3.8% 2.809e+10 perf-stat.i.instructions
0.20 +3.4% 0.21 perf-stat.i.ipc
169.10 +3.8% 175.48 perf-stat.i.metric.M/sec
2337072 +5.9% 2475099 perf-stat.i.minor-faults
318763 +8.9% 347151 ± 3% perf-stat.i.node-loads
73.28 -25.2 48.03 ± 32% perf-stat.i.node-store-miss-rate%
59253072 -31.6% 40500590 ± 34% perf-stat.i.node-store-misses
21486078 +102.2% 43449458 ± 29% perf-stat.i.node-stores
2338463 +5.9% 2476485 perf-stat.i.page-faults
0.39 -0.0 0.37 ± 2% perf-stat.overall.branch-miss-rate%
69.77 +1.8 71.53 perf-stat.overall.cache-miss-rate%
4.94 -3.6% 4.77 perf-stat.overall.cpi
730.45 -4.8% 695.59 perf-stat.overall.cycles-between-cache-misses
0.20 +3.7% 0.21 perf-stat.overall.ipc
73.39 -25.4 48.03 ± 32% perf-stat.overall.node-store-miss-rate%
11596 -2.0% 11361 perf-stat.overall.path-length
6.147e+09 +3.5% 6.364e+09 perf-stat.ps.branch-instructions
1.823e+08 +5.1% 1.915e+08 perf-stat.ps.cache-misses
7.02e+09 +3.3% 7.249e+09 perf-stat.ps.dTLB-loads
12345529 +5.1% 12975883 perf-stat.ps.dTLB-store-misses
2.616e+09 +5.8% 2.767e+09 perf-stat.ps.dTLB-stores
2.694e+10 +3.8% 2.795e+10 perf-stat.ps.instructions
2325462 +5.9% 2462734 perf-stat.ps.minor-faults
317211 +8.9% 345458 ± 3% perf-stat.ps.node-loads
58958077 -31.6% 40298328 ± 34% perf-stat.ps.node-store-misses
21379396 +102.2% 43232155 ± 29% perf-stat.ps.node-stores
2326850 +5.9% 2464121 perf-stat.ps.page-faults
5.466e+12 +3.8% 5.674e+12 perf-stat.total.instructions
15863 -100.0% 3.00 ±100% interrupts.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
179.00 -99.4% 1.00 ±173% interrupts.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
7248 -100.0% 0.00 interrupts.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
536.00 -99.8% 1.00 ±173% interrupts.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
24603 -100.0% 1.00 ±173% interrupts.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
48892 -2.3% 47789 interrupts.CAL:Function_call_interrupts
630.00 -35.7% 405.25 ± 23% interrupts.CPU0.CAL:Function_call_interrupts
242.00 +209.5% 749.00 ± 34% interrupts.CPU1.CAL:Function_call_interrupts
7818 -43.0% 4452 ± 55% interrupts.CPU10.NMI:Non-maskable_interrupts
7818 -43.0% 4452 ± 55% interrupts.CPU10.PMI:Performance_monitoring_interrupts
197.00 -67.8% 63.50 ±119% interrupts.CPU10.RES:Rescheduling_interrupts
203.00 -72.0% 56.75 ±134% interrupts.CPU12.RES:Rescheduling_interrupts
206.00 -71.2% 59.25 ±128% interrupts.CPU13.RES:Rescheduling_interrupts
15863 -100.0% 2.50 ±107% interrupts.CPU14.50:PCI-MSI.31981583-edge.i40e-eth0-TxRx-14
7799 -54.2% 3574 ± 34% interrupts.CPU14.NMI:Non-maskable_interrupts
7799 -54.2% 3574 ± 34% interrupts.CPU14.PMI:Performance_monitoring_interrupts
198.00 -92.4% 15.00 ± 27% interrupts.CPU14.RES:Rescheduling_interrupts
7799 -38.3% 4808 ± 43% interrupts.CPU15.NMI:Non-maskable_interrupts
7799 -38.3% 4808 ± 43% interrupts.CPU15.PMI:Performance_monitoring_interrupts
195.00 -69.5% 59.50 ±125% interrupts.CPU15.RES:Rescheduling_interrupts
7798 -38.3% 4807 ± 43% interrupts.CPU16.NMI:Non-maskable_interrupts
7798 -38.3% 4807 ± 43% interrupts.CPU16.PMI:Performance_monitoring_interrupts
197.00 -70.1% 59.00 ±125% interrupts.CPU16.RES:Rescheduling_interrupts
7797 -38.3% 4807 ± 43% interrupts.CPU17.NMI:Non-maskable_interrupts
7797 -38.3% 4807 ± 43% interrupts.CPU17.PMI:Performance_monitoring_interrupts
201.00 -71.6% 57.00 ±131% interrupts.CPU17.RES:Rescheduling_interrupts
7798 -38.4% 4806 ± 43% interrupts.CPU18.NMI:Non-maskable_interrupts
7798 -38.4% 4806 ± 43% interrupts.CPU18.PMI:Performance_monitoring_interrupts
200.00 -70.4% 59.25 ±126% interrupts.CPU18.RES:Rescheduling_interrupts
7.00 +771.4% 61.00 ±127% interrupts.CPU20.RES:Rescheduling_interrupts
7798 -38.4% 4806 ± 43% interrupts.CPU21.NMI:Non-maskable_interrupts
7798 -38.4% 4806 ± 43% interrupts.CPU21.PMI:Performance_monitoring_interrupts
202.00 -70.3% 60.00 ±121% interrupts.CPU21.RES:Rescheduling_interrupts
7797 -42.9% 4449 ± 55% interrupts.CPU22.NMI:Non-maskable_interrupts
7797 -42.9% 4449 ± 55% interrupts.CPU22.PMI:Performance_monitoring_interrupts
193.00 -68.1% 61.50 ±117% interrupts.CPU22.RES:Rescheduling_interrupts
7797 -42.9% 4449 ± 55% interrupts.CPU23.NMI:Non-maskable_interrupts
7797 -42.9% 4449 ± 55% interrupts.CPU23.PMI:Performance_monitoring_interrupts
193.00 -67.7% 62.25 ±119% interrupts.CPU23.RES:Rescheduling_interrupts
2398 -83.0% 408.50 ± 25% interrupts.CPU24.CAL:Function_call_interrupts
9.00 +1452.8% 139.75 ± 55% interrupts.CPU25.RES:Rescheduling_interrupts
2887 +128.1% 6584 ± 32% interrupts.CPU26.NMI:Non-maskable_interrupts
2887 +128.1% 6584 ± 32% interrupts.CPU26.PMI:Performance_monitoring_interrupts
19.00 +1527.6% 309.25 ± 59% interrupts.CPU26.RES:Rescheduling_interrupts
179.00 -99.4% 1.00 ±173% interrupts.CPU27.63:PCI-MSI.31981596-edge.i40e-eth0-TxRx-27
1550 -63.9% 559.75 ± 30% interrupts.CPU27.CAL:Function_call_interrupts
2881 +86.4% 5369 ± 45% interrupts.CPU27.NMI:Non-maskable_interrupts
2881 +86.4% 5369 ± 45% interrupts.CPU27.PMI:Performance_monitoring_interrupts
529.00 -73.1% 142.50 ± 41% interrupts.CPU27.RES:Rescheduling_interrupts
689.00 -31.9% 469.25 ± 7% interrupts.CPU28.CAL:Function_call_interrupts
2861 +129.6% 6570 ± 32% interrupts.CPU28.NMI:Non-maskable_interrupts
2861 +129.6% 6570 ± 32% interrupts.CPU28.PMI:Performance_monitoring_interrupts
2864 +87.2% 5360 ± 45% interrupts.CPU29.NMI:Non-maskable_interrupts
2864 +87.2% 5360 ± 45% interrupts.CPU29.PMI:Performance_monitoring_interrupts
9.00 +1344.4% 130.00 ± 58% interrupts.CPU29.RES:Rescheduling_interrupts
7819 -67.6% 2533 ± 24% interrupts.CPU3.NMI:Non-maskable_interrupts
7819 -67.6% 2533 ± 24% interrupts.CPU3.PMI:Performance_monitoring_interrupts
209.00 -82.1% 37.50 ±119% interrupts.CPU3.RES:Rescheduling_interrupts
7248 -100.0% 0.00 interrupts.CPU30.66:PCI-MSI.31981599-edge.i40e-eth0-TxRx-30
7.00 +2071.4% 152.00 ± 52% interrupts.CPU31.RES:Rescheduling_interrupts
138.00 -51.4% 67.00 ± 57% interrupts.CPU31.TLB:TLB_shootdowns
8.00 +1800.0% 152.00 ± 52% interrupts.CPU32.RES:Rescheduling_interrupts
6.00 +2491.7% 155.50 ± 48% interrupts.CPU33.RES:Rescheduling_interrupts
6.00 +2608.3% 162.50 ± 53% interrupts.CPU34.RES:Rescheduling_interrupts
2860 +172.8% 7802 interrupts.CPU35.NMI:Non-maskable_interrupts
2860 +172.8% 7802 interrupts.CPU35.PMI:Performance_monitoring_interrupts
11.00 +1738.6% 202.25 ± 2% interrupts.CPU35.RES:Rescheduling_interrupts
599.00 -22.7% 463.25 ± 3% interrupts.CPU36.CAL:Function_call_interrupts
2877 +171.2% 7802 interrupts.CPU36.NMI:Non-maskable_interrupts
2877 +171.2% 7802 interrupts.CPU36.PMI:Performance_monitoring_interrupts
19.00 +947.4% 199.00 ± 2% interrupts.CPU36.RES:Rescheduling_interrupts
137.00 -42.9% 78.25 ± 44% interrupts.CPU37.TLB:TLB_shootdowns
2864 +129.3% 6568 ± 32% interrupts.CPU38.NMI:Non-maskable_interrupts
2864 +129.3% 6568 ± 32% interrupts.CPU38.PMI:Performance_monitoring_interrupts
13.00 +1140.4% 161.25 ± 50% interrupts.CPU38.RES:Rescheduling_interrupts
117.00 -37.2% 73.50 ± 50% interrupts.CPU38.TLB:TLB_shootdowns
2858 +129.9% 6570 ± 32% interrupts.CPU39.NMI:Non-maskable_interrupts
2858 +129.9% 6570 ± 32% interrupts.CPU39.PMI:Performance_monitoring_interrupts
9.00 +1333.3% 129.00 ± 56% interrupts.CPU39.RES:Rescheduling_interrupts
203.00 -70.3% 60.25 ±133% interrupts.CPU4.RES:Rescheduling_interrupts
9.00 +1572.2% 150.50 ± 48% interrupts.CPU40.RES:Rescheduling_interrupts
2857 +129.8% 6566 ± 32% interrupts.CPU41.NMI:Non-maskable_interrupts
2857 +129.8% 6566 ± 32% interrupts.CPU41.PMI:Performance_monitoring_interrupts
11.00 +1265.9% 150.25 ± 50% interrupts.CPU41.RES:Rescheduling_interrupts
2857 +130.2% 6575 ± 32% interrupts.CPU42.NMI:Non-maskable_interrupts
2857 +130.2% 6575 ± 32% interrupts.CPU42.PMI:Performance_monitoring_interrupts
10.00 +1390.0% 149.00 ± 49% interrupts.CPU42.RES:Rescheduling_interrupts
144.00 -41.8% 83.75 ± 36% interrupts.CPU42.TLB:TLB_shootdowns
2857 +129.9% 6568 ± 32% interrupts.CPU43.NMI:Non-maskable_interrupts
2857 +129.9% 6568 ± 32% interrupts.CPU43.PMI:Performance_monitoring_interrupts
11.00 +1247.7% 148.25 ± 49% interrupts.CPU43.RES:Rescheduling_interrupts
2857 +68.3% 4809 ± 43% interrupts.CPU44.NMI:Non-maskable_interrupts
2857 +68.3% 4809 ± 43% interrupts.CPU44.PMI:Performance_monitoring_interrupts
2857 +129.9% 6567 ± 32% interrupts.CPU45.NMI:Non-maskable_interrupts
2857 +129.9% 6567 ± 32% interrupts.CPU45.PMI:Performance_monitoring_interrupts
18.00 +770.8% 156.75 ± 50% interrupts.CPU45.RES:Rescheduling_interrupts
2857 +129.9% 6568 ± 32% interrupts.CPU46.NMI:Non-maskable_interrupts
2857 +129.9% 6568 ± 32% interrupts.CPU46.PMI:Performance_monitoring_interrupts
15.00 +888.3% 148.25 ± 48% interrupts.CPU46.RES:Rescheduling_interrupts
2894 +169.5% 7799 interrupts.CPU47.NMI:Non-maskable_interrupts
2894 +169.5% 7799 interrupts.CPU47.PMI:Performance_monitoring_interrupts
109.00 +86.9% 203.75 ± 5% interrupts.CPU47.RES:Rescheduling_interrupts
536.00 -99.9% 0.75 ±173% interrupts.CPU48.84:PCI-MSI.31981617-edge.i40e-eth0-TxRx-48
7.00 +1467.9% 109.75 ± 88% interrupts.CPU49.RES:Rescheduling_interrupts
1429 +273.1% 5332 ± 46% interrupts.CPU50.NMI:Non-maskable_interrupts
1429 +273.1% 5332 ± 46% interrupts.CPU50.PMI:Performance_monitoring_interrupts
1429 +445.4% 7793 interrupts.CPU51.NMI:Non-maskable_interrupts
1429 +445.4% 7793 interrupts.CPU51.PMI:Performance_monitoring_interrupts
12.00 +1406.2% 180.75 ± 24% interrupts.CPU51.RES:Rescheduling_interrupts
1429 +359.4% 6565 ± 32% interrupts.CPU52.NMI:Non-maskable_interrupts
1429 +359.4% 6565 ± 32% interrupts.CPU52.PMI:Performance_monitoring_interrupts
3.00 +5100.0% 156.00 ± 56% interrupts.CPU52.RES:Rescheduling_interrupts
24603 -100.0% 0.75 ±173% interrupts.CPU53.89:PCI-MSI.31981622-edge.i40e-eth0-TxRx-53
1429 +359.2% 6561 ± 32% interrupts.CPU54.NMI:Non-maskable_interrupts
1429 +359.2% 6561 ± 32% interrupts.CPU54.PMI:Performance_monitoring_interrupts
1432 +358.6% 6566 ± 32% interrupts.CPU55.NMI:Non-maskable_interrupts
1432 +358.6% 6566 ± 32% interrupts.CPU55.PMI:Performance_monitoring_interrupts
1429 +359.1% 6561 ± 32% interrupts.CPU56.NMI:Non-maskable_interrupts
1429 +359.1% 6561 ± 32% interrupts.CPU56.PMI:Performance_monitoring_interrupts
0.00 +1.3e+104% 131.50 ± 63% interrupts.CPU56.RES:Rescheduling_interrupts
1429 +359.5% 6566 ± 32% interrupts.CPU57.NMI:Non-maskable_interrupts
1429 +359.5% 6566 ± 32% interrupts.CPU57.PMI:Performance_monitoring_interrupts
0.00 +1.5e+104% 154.50 ± 57% interrupts.CPU57.RES:Rescheduling_interrupts
1429 +359.4% 6565 ± 32% interrupts.CPU58.NMI:Non-maskable_interrupts
1429 +359.4% 6565 ± 32% interrupts.CPU58.PMI:Performance_monitoring_interrupts
205.00 -51.7% 99.00 ± 66% interrupts.CPU6.RES:Rescheduling_interrupts
1433 +358.1% 6565 ± 32% interrupts.CPU60.NMI:Non-maskable_interrupts
1433 +358.1% 6565 ± 32% interrupts.CPU60.PMI:Performance_monitoring_interrupts
6.00 +2545.8% 158.75 ± 52% interrupts.CPU60.RES:Rescheduling_interrupts
1437 +358.7% 6592 ± 31% interrupts.CPU61.NMI:Non-maskable_interrupts
1437 +358.7% 6592 ± 31% interrupts.CPU61.PMI:Performance_monitoring_interrupts
2859 +172.8% 7799 interrupts.CPU62.NMI:Non-maskable_interrupts
2859 +172.8% 7799 interrupts.CPU62.PMI:Performance_monitoring_interrupts
3.00 +6825.0% 207.75 interrupts.CPU62.RES:Rescheduling_interrupts
487.00 -9.4% 441.25 ± 3% interrupts.CPU63.CAL:Function_call_interrupts
2858 +130.4% 6585 ± 31% interrupts.CPU63.NMI:Non-maskable_interrupts
2858 +130.4% 6585 ± 31% interrupts.CPU63.PMI:Performance_monitoring_interrupts
5.00 +3050.0% 157.50 ± 52% interrupts.CPU63.RES:Rescheduling_interrupts
1188 -62.5% 446.00 ± 5% interrupts.CPU64.CAL:Function_call_interrupts
8.00 +1903.1% 160.25 ± 49% interrupts.CPU64.RES:Rescheduling_interrupts
2857 +129.8% 6566 ± 32% interrupts.CPU65.NMI:Non-maskable_interrupts
2857 +129.8% 6566 ± 32% interrupts.CPU65.PMI:Performance_monitoring_interrupts
3.00 +5141.7% 157.25 ± 53% interrupts.CPU65.RES:Rescheduling_interrupts
2858 +129.8% 6568 ± 32% interrupts.CPU66.NMI:Non-maskable_interrupts
2858 +129.8% 6568 ± 32% interrupts.CPU66.PMI:Performance_monitoring_interrupts
5.00 +3040.0% 157.00 ± 54% interrupts.CPU66.RES:Rescheduling_interrupts
0.00 +1.1e+104% 108.50 ± 90% interrupts.CPU67.RES:Rescheduling_interrupts
2858 +129.8% 6567 ± 32% interrupts.CPU69.NMI:Non-maskable_interrupts
2858 +129.8% 6567 ± 32% interrupts.CPU69.PMI:Performance_monitoring_interrupts
0.00 +1.6e+104% 156.00 ± 55% interrupts.CPU69.RES:Rescheduling_interrupts
7798 -42.9% 4450 ± 55% interrupts.CPU7.NMI:Non-maskable_interrupts
7798 -42.9% 4450 ± 55% interrupts.CPU7.PMI:Performance_monitoring_interrupts
2858 +129.8% 6567 ± 32% interrupts.CPU70.NMI:Non-maskable_interrupts
2858 +129.8% 6567 ± 32% interrupts.CPU70.PMI:Performance_monitoring_interrupts
2.00 +7862.5% 159.25 ± 53% interrupts.CPU70.RES:Rescheduling_interrupts
2863 +129.3% 6566 ± 32% interrupts.CPU71.NMI:Non-maskable_interrupts
2863 +129.3% 6566 ± 32% interrupts.CPU71.PMI:Performance_monitoring_interrupts
4.00 +4056.2% 166.25 ± 53% interrupts.CPU71.RES:Rescheduling_interrupts
215.00 -70.7% 63.00 ±130% interrupts.CPU74.RES:Rescheduling_interrupts
120.00 -33.5% 79.75 ± 52% interrupts.CPU75.TLB:TLB_shootdowns
119.00 -35.7% 76.50 ± 55% interrupts.CPU76.TLB:TLB_shootdowns
207.00 -61.0% 80.75 ±101% interrupts.CPU77.RES:Rescheduling_interrupts
205.00 -73.3% 54.75 ±157% interrupts.CPU79.RES:Rescheduling_interrupts
199.00 -60.4% 78.75 ±100% interrupts.CPU8.RES:Rescheduling_interrupts
119.00 -31.5% 81.50 ± 53% interrupts.CPU80.TLB:TLB_shootdowns
204.00 -95.2% 9.75 ± 66% interrupts.CPU83.RES:Rescheduling_interrupts
114.00 -46.1% 61.50 ± 56% interrupts.CPU83.TLB:TLB_shootdowns
205.00 -94.5% 11.25 ± 50% interrupts.CPU84.RES:Rescheduling_interrupts
123.00 -23.8% 93.75 ± 29% interrupts.CPU85.TLB:TLB_shootdowns
127.00 -29.3% 89.75 ± 43% interrupts.CPU86.TLB:TLB_shootdowns
206.00 -71.5% 58.75 ±143% interrupts.CPU88.RES:Rescheduling_interrupts
207.00 -72.6% 56.75 ±150% interrupts.CPU89.RES:Rescheduling_interrupts
201.00 -71.5% 57.25 ±139% interrupts.CPU9.RES:Rescheduling_interrupts
206.00 -73.8% 54.00 ±161% interrupts.CPU90.RES:Rescheduling_interrupts
165.00 -44.1% 92.25 ± 32% interrupts.CPU90.TLB:TLB_shootdowns
124.00 -28.4% 88.75 ± 30% interrupts.CPU92.TLB:TLB_shootdowns
125.00 -27.2% 91.00 ± 29% interrupts.CPU93.TLB:TLB_shootdowns
7793 -51.5% 3775 ± 30% interrupts.CPU95.NMI:Non-maskable_interrupts
7793 -51.5% 3775 ± 30% interrupts.CPU95.PMI:Performance_monitoring_interrupts
232.00 -89.0% 25.50 ± 93% interrupts.CPU95.RES:Rescheduling_interrupts
153.00 -36.3% 97.50 ± 41% interrupts.CPU95.TLB:TLB_shootdowns
553.00 +31.7% 728.50 ± 3% interrupts.IWI:IRQ_work_interrupts
404122 +30.2% 526250 ± 12% interrupts.NMI:Non-maskable_interrupts
404122 +30.2% 526250 ± 12% interrupts.PMI:Performance_monitoring_interrupts
fio.write_bw_MBps
10100 +-------------------------------------------------------------------+
10000 |-+O |
| O |
9900 |-+ O O |
9800 |-+ O O O O O |
| O O O O O |
9700 |-+ O O O O O |
9600 |-+ |
9500 |-+ |
| |
9400 |-+ |
9300 |.. ..+.. |
| +. +... |
9200 |-+ + |
9100 +-------------------------------------------------------------------+
fio.write_iops
2.6e+06 +----------------------------------------------------------------+
| |
| O O |
2.55e+06 |-+ |
| O O |
| O O O O O |
2.5e+06 |-+ O O O O O O |
| O O O O |
2.45e+06 |-+ |
| |
| |
2.4e+06 |-+ |
|.. ..+.. |
| +. +.. |
2.35e+06 +----------------------------------------------------------------+
fio.write_clat_mean_us
20200 +-------------------------------------------------------------------+
20000 |-+ ..+ |
| .+... .+. |
19800 |.+ +. |
19600 |-+ |
| |
19400 |-+ |
19200 |-+ |
19000 |-+ O O O O O |
| O O O O O |
18800 |-+ O O O O O |
18600 |-+ O O |
| O |
18400 |-+O |
18200 +-------------------------------------------------------------------+
fio.write_clat_90__us
22000 +-------------------------------------------------------------------+
| .+...+ |
|..+...+. |
21500 |-+ |
| |
| |
21000 |-+ |
| |
20500 |-+ O O O O O O O O O O |
| O O O O O |
| |
20000 |-+ O O |
| O O |
| |
19500 +-------------------------------------------------------------------+
fio.latency_20us_
95 +----------------------------------------------------------------------+
| O O |
90 |-+ O O O |
85 |-+ O O O O O O O O |
| O O O O O O |
80 |-+ |
75 |-+ |
| |
70 |-+ |
65 |-+ |
| |
60 |...+..+.. |
55 |-+ . |
| +..+ |
50 +----------------------------------------------------------------------+
fio.latency_50us_
50 +----------------------------------------------------------------------+
| .+..+ |
45 |-+ .. |
40 |...+..+ |
| |
35 |-+ |
30 |-+ |
| |
25 |-+ |
20 |-+ |
| O O O O O O |
15 |-+ O O O O O O O O |
10 |-+ O O O |
| O O |
5 +----------------------------------------------------------------------+
fio.workload
5.15e+08 +----------------------------------------------------------------+
| O |
5.1e+08 |-+ O |
5.05e+08 |-+ O |
| O O O O O |
5e+08 |-+ O O O O O |
4.95e+08 |-+ O O O O O |
| |
4.9e+08 |-+ |
4.85e+08 |-+ |
| |
4.8e+08 |-+ ..+.. |
4.75e+08 |..+. |
| +.. |
4.7e+08 +----------------------------------------------------------------+
fio.time.minor_page_faults
5.15e+08 +----------------------------------------------------------------+
| O |
5.1e+08 |-+ O |
5.05e+08 |-+ O |
| O O O O O |
5e+08 |-+ O O O O O |
4.95e+08 |-+ O O O O O |
| |
4.9e+08 |-+ |
4.85e+08 |-+ |
| |
4.8e+08 |-+ ..+.. |
4.75e+08 |..+. |
| +.. |
4.7e+08 +----------------------------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Rong Chen
1 year, 5 months
- 1
- 0