@@ -13,7 +13,9 @@ example job summary report can be viewed `HERE <https://www.mcs.anl.gov/research
1313
1414Usage of this job summary tool is described below. ::
1515
16- usage: darshan summary [-h] [--output OUTPUT] [--enable_dxt_heatmap] log_path
16+ usage: darshan summary [-h] [--output OUTPUT] [--enable_dxt_heatmap]
17+ [--exclude_names EXCLUDE_NAMES] [--include_names INCLUDE_NAMES]
18+ log_path
1719
1820 Generates a Darshan Summary Report
1921
@@ -24,6 +26,10 @@ Usage of this job summary tool is described below. ::
2426 -h, --help show this help message and exit
2527 --output OUTPUT Specify output filename.
2628 --enable_dxt_heatmap Enable DXT-based versions of I/O activity heatmaps.
29+ --exclude_names EXCLUDE_NAMES
30+ regex patterns for file record names to exclude in summary report
31+ --include_names INCLUDE_NAMES
32+ regex patterns for file record names to include in summary report
2733
2834For example, the following command would generate an HTML job summary report
2935for a Darshan log file named `example.darshan `.
@@ -36,6 +42,82 @@ If ``--output`` option is not specified, the output HTML report will be based
3642on the input log file name (i.e., the above command would generate an HTML
3743report named `example_report.html `).
3844
45+ Other Darshan CLI tools
46+ -----------------------
47+
48+ There are also command line tools available for quickly printing terminal output
49+ describing general I/O statistics of one or more input Darhan logs.
50+ The ``job_stats `` tool is used to summarize key job-level I/O parameters for each
51+ of a given set of Darshan logs, ordering the jobs according to some I/O metric.
52+ Alternatively, the ``file_stats `` is used to summarize key file-level I/O
53+ parameters for each file accessed across a set of Darshan logs, with the files
54+ ordered according to some I/O metric.
55+
56+ Usage of the ``job_stats `` tool is described below. ::
57+
58+ usage: darshan job_stats [-h] [--log_paths_file LOG_PATHS_FILE] [--module [{POSIX,MPI-IO,STDIO}]]
59+ [--order_by [{perf_by_slowest,time_by_slowest,total_bytes,total_files}]] [--limit [LIMIT]]
60+ [--csv] [--exclude_names EXCLUDE_NAMES] [--include_names INCLUDE_NAMES]
61+ [log_paths [log_paths ...]]
62+
63+ Print statistics describing key metadata and I/O performance metrics for a given list of jobs.
64+
65+ positional arguments:
66+ log_paths specify the paths to Darshan log files
67+
68+ optional arguments:
69+ -h, --help show this help message and exit
70+ --log_paths_file LOG_PATHS_FILE
71+ specify the path to a manifest file listing Darshan log files
72+ --module [{POSIX,MPI-IO,STDIO}], -m [{POSIX,MPI-IO,STDIO}]
73+ specify the Darshan module to generate job stats for (default: POSIX)
74+ --order_by [{perf_by_slowest,time_by_slowest,total_bytes,total_files}], -o [{perf_by_slowest,time_by_slowest,total_bytes,total_files}]
75+ specify the I/O metric to order jobs by (default: total_bytes)
76+ --limit [LIMIT], -l [LIMIT]
77+ limit output to the top LIMIT number of jobs according to selected metric
78+ --csv, -c output job stats in CSV format
79+ --exclude_names EXCLUDE_NAMES, -e EXCLUDE_NAMES
80+ regex patterns for file record names to exclude in stats
81+ --include_names INCLUDE_NAMES, -i INCLUDE_NAMES
82+ regex patterns for file record names to include in stats
83+
84+ Options allow for users to calculate stats for specific modules, to use a number of different
85+ I/O statistics to order jobs, to limit output to the top N jobs, to print in CSV format
86+ (rather than default Rich printing), and to filter file names within jobs.
87+ Note that users can either provide the list of Darshan logs directly on the command line
88+ or use a manifest file in cases where many logs are to be analyzed at once.
89+
90+ Usage of the ``file_stats `` tool is described below. ::
91+
92+ usage: darshan file_stats [-h] [--log_paths_file LOG_PATHS_FILE] [--module [{POSIX,MPI-IO,STDIO}]]
93+ [--order_by [{bytes_read,bytes_written,reads,writes,total_jobs}]] [--limit [LIMIT]] [--csv]
94+ [--exclude_names EXCLUDE_NAMES] [--include_names INCLUDE_NAMES]
95+ [log_paths [log_paths ...]]
96+
97+ Print statistics describing key metadata and I/O performance metrics for files accessed by a given list of jobs.
98+
99+ positional arguments:
100+ log_paths specify the paths to Darshan log files
101+
102+ optional arguments:
103+ -h, --help show this help message and exit
104+ --log_paths_file LOG_PATHS_FILE
105+ specify the path to a manifest file listing Darshan log files
106+ --module [{POSIX,MPI-IO,STDIO}], -m [{POSIX,MPI-IO,STDIO}]
107+ specify the Darshan module to generate file stats for (default: POSIX)
108+ --order_by [{bytes_read,bytes_written,reads,writes,total_jobs}], -o [{bytes_read,bytes_written,reads,writes,total_jobs}]
109+ specify the I/O metric to order files by (default: bytes_read)
110+ --limit [LIMIT], -l [LIMIT]
111+ limit output to the top LIMIT number of jobs according to selected metric
112+ --csv, -c output file stats in CSV format
113+ --exclude_names EXCLUDE_NAMES, -e EXCLUDE_NAMES
114+ regex patterns for file record names to exclude in stats
115+ --include_names INCLUDE_NAMES, -i INCLUDE_NAMES
116+ regex patterns for file record names to include in stats
117+
118+ The options for the ``file_stats `` are largely identical to that of ``file_stats `` other
119+ than slightly different I/O metrics that can be used to sort output.
120+
39121Darshan Report interface
40122------------------------
41123
0 commit comments