3:47 a.m.
There is some documentation in the Lustre Manual under Lustre I/O Tuneables. I am not sure
all those stats are explained. The numbers you show are the total events since stats were
last cleared.
In general with Lustre stats, it’s more useful to use the llstat tool, which gives units
of measurement.
For example,
llstat -i5 /proc/fs/lustre/osc/lustre-OST0000-osc-ffff88106f3f9800/stats
Will give you stats output every five seconds, with averages.
/usr/bin/llstat: STATS on 04/18/14
/proc/fs/lustre/osc/lustre-OST0000-osc-ffff88106f3f9800/stats on 192.168.123.1@o2ib1
snapshot_time 1397842824.281735
req_waittime 42955
req_active 42955
ost_connect 1
ost_statfs 1
ldlm_cancel 21422
obd_ping 109
/proc/fs/lustre/osc/lustre-OST0000-osc-ffff88106f3f9800/stats @ 1397842829.281968
Name Cur.Count Cur.Rate #Events Unit last min
avg max stddev
req_waittime 0 0 42955 [usec] 0 77
292.76 4957 60.86
req_active 0 0 42955 [reqs] 0 1
1.02 8 0.16
ost_connect 0 0 1 [usec] 0 4957
4957.00 4957 0.00
ost_statfs 0 0 1 [usec] 0 738
738.00 738 0.00
ldlm_cancel 0 0 21422 [usec] 0 77
260.07 854 56.40
obd_ping 0 0 109 [usec] 0 113
243.21 741 89.57
I am not sure of the version of Lustre you are running. I believe ost_read is the number
of operations, vs read_bytes being the amount of data.
Cliffw
From: John Bauer <bauerj@iodoctors.com<mailto:bauerj@iodoctors.com>>
Organization: I/O Doctors LLC
Date: Friday, April 18, 2014 at 10:31 AM
To: "hpdd-discuss@lists.01.org<mailto:hpdd-discuss@lists.01.org>"
<hpdd-discuss@lists.01.org<mailto:hpdd-discuss@lists.01.org>>
Subject: [HPDD-discuss] osc stats counters
The following file apparently has Lustre OSC stats in it. Is there documentation
available that
indicates what each of the lines means. In particular, what is the difference between
read_bytes and ost_read?
Are the values the running totals for the row since file system mount?
John
/proc/fs/lustre/osc/snx11015-OST0000-osc-ffff8808381e0000/stats
snapshot_time 1397841718.126663 secs.usecs
req_waittime 2370938 samples [usec] 64 11992149 11787252572 2139161199259986
req_active 2370938 samples [reqs] 1 252 3961773 27928693
read_bytes 81641 samples [bytes] 0 1048576 49692607499 51037352316634067
write_bytes 146046 samples [bytes] 2 1048576 118340950281
122537746430813161
ost_setattr 24696 samples [usec] 93 936337 45466625 3251232572025
ost_read 81641 samples [usec] 133 510339 710744844 27099012628290
ost_write 146046 samples [usec] 8172 2551890 10266664753 1651144117197951
ost_destroy 61266 samples [usec] 112 11992149 191880022 306113736622700
ost_get_info 281 samples [usec] 128 1196 139459 79825089
ost_connect 1 samples [usec] 455 455 455 207025
ost_punch 2238 samples [usec] 124 51836 1141645 9568413975
ost_statfs 448 samples [usec] 120 50275 255436 4579695620
ost_sync 448 samples [usec] 219 1510 185503 80068341
ldlm_cancel 331307 samples [usec] 71 251227 174384435 6559962480531
obd_ping 6148 samples [usec] 122 11676031 14657745 136341998948419
--
John Bauer
I/O Doctors LLC
507-766-0378
bauerj@iodoctors.com<mailto:bauerj@iodoctors.com>