Skip to content

Commit 05157b0

Browse files
author
Shane Snyder
committed
updated pydarshan docs
1 parent a266ae5 commit 05157b0

File tree

1 file changed

+83
-1
lines changed

1 file changed

+83
-1
lines changed

darshan-util/pydarshan/docs/usage.rst

Lines changed: 83 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,9 @@ example job summary report can be viewed `HERE <https://www.mcs.anl.gov/research
1313

1414
Usage of this job summary tool is described below. ::
1515

16-
usage: darshan summary [-h] [--output OUTPUT] [--enable_dxt_heatmap] log_path
16+
usage: darshan summary [-h] [--output OUTPUT] [--enable_dxt_heatmap]
17+
[--exclude_names EXCLUDE_NAMES] [--include_names INCLUDE_NAMES]
18+
log_path
1719

1820
Generates a Darshan Summary Report
1921

@@ -24,6 +26,10 @@ Usage of this job summary tool is described below. ::
2426
-h, --help show this help message and exit
2527
--output OUTPUT Specify output filename.
2628
--enable_dxt_heatmap Enable DXT-based versions of I/O activity heatmaps.
29+
--exclude_names EXCLUDE_NAMES
30+
regex patterns for file record names to exclude in summary report
31+
--include_names INCLUDE_NAMES
32+
regex patterns for file record names to include in summary report
2733

2834
For example, the following command would generate an HTML job summary report
2935
for a Darshan log file named `example.darshan`.
@@ -36,6 +42,82 @@ If ``--output`` option is not specified, the output HTML report will be based
3642
on the input log file name (i.e., the above command would generate an HTML
3743
report named `example_report.html`).
3844

45+
Other Darshan CLI tools
46+
-----------------------
47+
48+
There are also command line tools available for quickly printing terminal output
49+
describing general I/O statistics of one or more input Darhan logs.
50+
The ``job_stats`` tool is used to summarize key job-level I/O parameters for each
51+
of a given set of Darshan logs, ordering the jobs according to some I/O metric.
52+
Alternatively, the ``file_stats`` is used to summarize key file-level I/O
53+
parameters for each file accessed across a set of Darshan logs, with the files
54+
ordered according to some I/O metric.
55+
56+
Usage of the ``job_stats`` tool is described below. ::
57+
58+
usage: darshan job_stats [-h] [--log_paths_file LOG_PATHS_FILE] [--module [{POSIX,MPI-IO,STDIO}]]
59+
[--order_by [{perf_by_slowest,time_by_slowest,total_bytes,total_files}]] [--limit [LIMIT]]
60+
[--csv] [--exclude_names EXCLUDE_NAMES] [--include_names INCLUDE_NAMES]
61+
[log_paths [log_paths ...]]
62+
63+
Print statistics describing key metadata and I/O performance metrics for a given list of jobs.
64+
65+
positional arguments:
66+
log_paths specify the paths to Darshan log files
67+
68+
optional arguments:
69+
-h, --help show this help message and exit
70+
--log_paths_file LOG_PATHS_FILE
71+
specify the path to a manifest file listing Darshan log files
72+
--module [{POSIX,MPI-IO,STDIO}], -m [{POSIX,MPI-IO,STDIO}]
73+
specify the Darshan module to generate job stats for (default: POSIX)
74+
--order_by [{perf_by_slowest,time_by_slowest,total_bytes,total_files}], -o [{perf_by_slowest,time_by_slowest,total_bytes,total_files}]
75+
specify the I/O metric to order jobs by (default: total_bytes)
76+
--limit [LIMIT], -l [LIMIT]
77+
limit output to the top LIMIT number of jobs according to selected metric
78+
--csv, -c output job stats in CSV format
79+
--exclude_names EXCLUDE_NAMES, -e EXCLUDE_NAMES
80+
regex patterns for file record names to exclude in stats
81+
--include_names INCLUDE_NAMES, -i INCLUDE_NAMES
82+
regex patterns for file record names to include in stats
83+
84+
Options allow for users to calculate stats for specific modules, to use a number of different
85+
I/O statistics to order jobs, to limit output to the top N jobs, to print in CSV format
86+
(rather than default Rich printing), and to filter file names within jobs.
87+
Note that users can either provide the list of Darshan logs directly on the command line
88+
or use a manifest file in cases where many logs are to be analyzed at once.
89+
90+
Usage of the ``file_stats`` tool is described below. ::
91+
92+
usage: darshan file_stats [-h] [--log_paths_file LOG_PATHS_FILE] [--module [{POSIX,MPI-IO,STDIO}]]
93+
[--order_by [{bytes_read,bytes_written,reads,writes,total_jobs}]] [--limit [LIMIT]] [--csv]
94+
[--exclude_names EXCLUDE_NAMES] [--include_names INCLUDE_NAMES]
95+
[log_paths [log_paths ...]]
96+
97+
Print statistics describing key metadata and I/O performance metrics for files accessed by a given list of jobs.
98+
99+
positional arguments:
100+
log_paths specify the paths to Darshan log files
101+
102+
optional arguments:
103+
-h, --help show this help message and exit
104+
--log_paths_file LOG_PATHS_FILE
105+
specify the path to a manifest file listing Darshan log files
106+
--module [{POSIX,MPI-IO,STDIO}], -m [{POSIX,MPI-IO,STDIO}]
107+
specify the Darshan module to generate file stats for (default: POSIX)
108+
--order_by [{bytes_read,bytes_written,reads,writes,total_jobs}], -o [{bytes_read,bytes_written,reads,writes,total_jobs}]
109+
specify the I/O metric to order files by (default: bytes_read)
110+
--limit [LIMIT], -l [LIMIT]
111+
limit output to the top LIMIT number of jobs according to selected metric
112+
--csv, -c output file stats in CSV format
113+
--exclude_names EXCLUDE_NAMES, -e EXCLUDE_NAMES
114+
regex patterns for file record names to exclude in stats
115+
--include_names INCLUDE_NAMES, -i INCLUDE_NAMES
116+
regex patterns for file record names to include in stats
117+
118+
The options for the ``file_stats`` are largely identical to that of ``file_stats`` other
119+
than slightly different I/O metrics that can be used to sort output.
120+
39121
Darshan Report interface
40122
------------------------
41123

0 commit comments

Comments
 (0)