Skip to content

Commit e0ff279

Browse files
wkliaowkliao
committed
Doc: update with the new feature of adding pthread IDs
1 parent ed97f54 commit e0ff279

File tree

1 file changed

+78
-27
lines changed

1 file changed

+78
-27
lines changed

‎darshan-util/doc/darshan-util.rst‎

Lines changed: 78 additions & 27 deletions
Original file line numberDiff line numberDiff line change
@@ -1352,37 +1352,75 @@ captured from both POSIX and MPI-IO interfaces. Example output is given below:
13521352
# DXT_POSIX module data
13531353
# ***************************************************
13541354
1355-
# DXT, file_id: 16457598720760448348, file_name: /tmp/test/testFile
1356-
# DXT, rank: 0, hostname: shane-thinkpad
1357-
# DXT, write_count: 4, read_count: 4
1358-
# DXT, mnt_pt: /, fs_type: ext4
1359-
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s)
1360-
X_POSIX 0 write 0 0 262144 0.0029 0.0032
1361-
X_POSIX 0 write 1 262144 262144 0.0032 0.0035
1362-
X_POSIX 0 write 2 524288 262144 0.0035 0.0038
1363-
X_POSIX 0 write 3 786432 262144 0.0038 0.0040
1364-
X_POSIX 0 read 0 0 262144 0.0048 0.0048
1365-
X_POSIX 0 read 1 262144 262144 0.0049 0.0049
1366-
X_POSIX 0 read 2 524288 262144 0.0049 0.0050
1367-
X_POSIX 0 read 3 786432 262144 0.0050 0.0051
1355+
# DXT, file_id: 12998263815182938503, file_name: /tmp/test/testFile
1356+
# DXT, rank: 0, hostname: acfs.ece.northwestern.edu
1357+
# DXT, write_count: 4, read_count: 3
1358+
# DXT, mnt_pt: /homes, fs_type: autofs
1359+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1360+
X_POSIX 0 write 0 0 30 0.0018 0.0018 139823019705024
1361+
X_POSIX 0 write 1 120 10 0.0019 0.0020 139822945752832
1362+
X_POSIX 0 write 2 130 10 0.0021 0.0021 139822937360128
1363+
X_POSIX 0 write 3 140 10 0.0022 0.0022 139822861645568
1364+
X_POSIX 0 read 0 0 10 0.0019 0.0019 139822945752832
1365+
X_POSIX 0 read 1 10 10 0.0020 0.0020 139822937360128
1366+
X_POSIX 0 read 2 20 10 0.0022 0.0022 139822861645568
1367+
1368+
# DXT, file_id: 12998263815182938503, file_name: /tmp/test/testFile
1369+
# DXT, rank: 1, hostname: acfs.ece.northwestern.edu
1370+
# DXT, write_count: 4, read_count: 3
1371+
# DXT, mnt_pt: /homes, fs_type: autofs
1372+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1373+
X_POSIX 1 write 0 30 30 0.0018 0.0018 140244736549568
1374+
X_POSIX 1 write 1 180 10 0.0019 0.0019 140244662597376
1375+
X_POSIX 1 write 2 190 10 0.0022 0.0022 140244654204672
1376+
X_POSIX 1 write 3 200 10 0.0022 0.0022 140244573746944
1377+
X_POSIX 1 read 0 60 10 0.0019 0.0019 140244662597376
1378+
X_POSIX 1 read 1 70 10 0.0022 0.0022 140244654204672
1379+
X_POSIX 1 read 2 80 10 0.0022 0.0022 140244573746944
13681380
13691381
# ***************************************************
13701382
# DXT_MPIIO module data
13711383
# ***************************************************
13721384
1373-
# DXT, file_id: 16457598720760448348, file_name: /tmp/test/testFile
1374-
# DXT, rank: 0, hostname: shane-thinkpad
1375-
# DXT, write_count: 4, read_count: 4
1376-
# DXT, mnt_pt: /, fs_type: ext4
1377-
# Module Rank Wt/Rd Segment Length Start(s) End(s)
1378-
X_MPIIO 0 write 0 262144 0.0029 0.0032
1379-
X_MPIIO 0 write 1 262144 0.0032 0.0035
1380-
X_MPIIO 0 write 2 262144 0.0035 0.0038
1381-
X_MPIIO 0 write 3 262144 0.0038 0.0040
1382-
X_MPIIO 0 read 0 262144 0.0048 0.0049
1383-
X_MPIIO 0 read 1 262144 0.0049 0.0049
1384-
X_MPIIO 0 read 2 262144 0.0049 0.0050
1385-
X_MPIIO 0 read 3 262144 0.0050 0.0051
1385+
# DXT, file_id: 12998263815182938503, file_name: /tmp/test/testFile
1386+
# DXT, rank: 0, hostname: acfs.ece.northwestern.edu
1387+
# DXT, write_count: 4, read_count: 3
1388+
# DXT, mnt_pt: /homes, fs_type: autofs
1389+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1390+
X_MPIIO 0 write 0 0 30 0.0018 0.0018 139823019705024
1391+
X_MPIIO 0 write 1 120 10 0.0019 0.0020 139822945752832
1392+
X_MPIIO 0 write 2 130 10 0.0020 0.0021 139822937360128
1393+
X_MPIIO 0 write 3 140 10 0.0022 0.0022 139822861645568
1394+
X_MPIIO 0 read 0 0 10 0.0019 0.0019 139822945752832
1395+
X_MPIIO 0 read 1 10 10 0.0020 0.0020 139822937360128
1396+
X_MPIIO 0 read 2 20 10 0.0022 0.0022 139822861645568
1397+
1398+
# DXT, file_id: 12998263815182938503, file_name: /tmp/test/testFile
1399+
# DXT, rank: 1, hostname: acfs.ece.northwestern.edu
1400+
# DXT, write_count: 4, read_count: 3
1401+
# DXT, mnt_pt: /homes, fs_type: autofs
1402+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1403+
X_MPIIO 1 write 0 30 30 0.0018 0.0018 140244736549568
1404+
X_MPIIO 1 write 1 180 10 0.0019 0.0019 140244662597376
1405+
X_MPIIO 1 write 2 190 10 0.0022 0.0022 140244654204672
1406+
X_MPIIO 1 write 3 200 10 0.0022 0.0022 140244573746944
1407+
X_MPIIO 1 read 0 60 10 0.0019 0.0019 140244662597376
1408+
X_MPIIO 1 read 1 70 10 0.0019 0.0022 140244654204672
1409+
X_MPIIO 1 read 2 80 10 0.0022 0.0022 140244573746944
1410+
1411+
.. note::
1412+
Starting from Darshan version 3.6.0, there is an additional column at the
1413+
end showing the pthread ID. For Darshan log files generated from the earlier
1414+
versions will show -1 as Pthread-ID. An example is given below.
1415+
1416+
.. code-block::
1417+
1418+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1419+
X_POSIX 2 write 0 16 8 0.0022 0.0022 -1
1420+
1421+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1422+
X_MPIIO 3 write 0 24 8 0.0022 0.0022 -1
1423+
13861424
13871425
DXT POSIX module
13881426
-------------------------------------
@@ -1406,7 +1444,17 @@ The output format for each individual I/O operation segment is:
14061444

14071445
.. code-block::
14081446
1409-
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s)
1447+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s) Pthread-ID
1448+
1449+
.. note::
1450+
Starting from Darshan version 3.6.0, there is an additional column at the
1451+
end showing the pthread ID. When using the DXT parser of an earlier version
1452+
to parse a Darshan log file generated from earlier version, the columns will
1453+
not include "Pthread-ID", for example:
1454+
1455+
.. code-block::
1456+
1457+
# Module Rank Wt/Rd Segment Offset Length Start(s) End(s)
14101458
14111459
* Module: corresponding DXT module (DXT_POSIX or DXT_MPIIO)
14121460
* Rank: process rank responsible for I/O operation
@@ -1416,6 +1464,9 @@ The output format for each individual I/O operation segment is:
14161464
* Length: length of the I/O operation in bytes
14171465
* Start: timestamp of the start of the operation (w.r.t. application start time)
14181466
* End: timestamp of the end of the operation (w.r.t. application start time)
1467+
* Pthread-ID: pthread ID of the calling thread. When using DXT parser from
1468+
version 3.6.0 and later to parse log files generated from earlier versions of
1469+
Darshan, the values of Pthread-ID will be -1.
14191470

14201471
DXT MPI-IO module
14211472
-------------------------------------

0 commit comments

Comments
 (0)