Skip to content

Commit 28c0467

Browse files
authored
Campaign Reader engine doc. Some fixes to other files. (#4944)
* Campaign Reader engine doc. Some fixes to other files. * ruff
1 parent 7e33763 commit 28c0467

4 files changed

Lines changed: 36 additions & 4 deletions

File tree

docs/user_guide/source/engines/bp5.rst

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -165,9 +165,9 @@ This engine allows the user to fine tune the buffering operations through the fo
165165
tells the reader to ignore any FlattenSteps parameter supplied
166166
to the writer.
167167

168-
=============================== ===================== ===========================================================
169-
**Key** **Value Format** **Default** and Examples
170-
=============================== ===================== ===========================================================
168+
================================ ===================== ===========================================================
169+
**Key** **Value Format** **Default** and Examples
170+
================================ ===================== ===========================================================
171171
OpenTimeoutSecs float **0** for *ReadRandomAccess* mode, **3600** for *Read* mode, ``10.0``, ``5``
172172
BeginStepPollingFrequencySecs float **1**, 10.0
173173
AggregationType string **TwoLevelShm**, EveryoneWritesSerial, DataSizeBased, EveryoneWrites
@@ -197,7 +197,7 @@ This engine allows the user to fine tune the buffering operations through the fo
197197
Threads integer >= 0 **0**, 1, 32
198198
FlattenSteps boolean **off**, on, true, false
199199
IgnoreFlattenSteps boolean **off**, on, true, false
200-
=============================== ===================== ===========================================================
200+
================================ ===================== ===========================================================
201201

202202
S3 Object Storage
203203
-----------------
Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,30 @@
1+
***************
2+
Campaign Reader
3+
***************
4+
5+
The Campaign Reader Engine is a specialty engine made for reading Campaign files (.aca) created with `hpc-campaign <https://hpc-campaign.readthedocs.io>`_ tools. See an `example <../advanced/campaign_management.html>`_.
6+
7+
It is an engine, that uses other engine (BP5, HDF5, Timeseries) to open ADIOS/HDF5 datasets added to the campaign file. It directly supports reading images and text files added to the campaign file.
8+
9+
1. **hostname**: Use this name as local hostname. If the host of a replica of a dataset in the campaign file matches this hostname, it will be regarded as locally readable replica (i.e., its path must be a local path). The default hostname is read from *~/.config/hpc-campaign/config.yaml*.
10+
11+
#. **campaignstorepath**: Use this base path to find campaign files using their relative path/name. Having all campaign files organized under a common base path allows for finding them using a simple relative path under that base path. The default value is read from *~/.config/hpc-campaign/config.yaml*.
12+
13+
#. **cachepath**: Local disk path where extracted pieces from the campaign file are stored, as well as data downloaded by ADIOS when reading remote data. The default value is read from *~/.config/hpc-campaign/config.yaml*.
14+
15+
#. **include-dataset**: As a campaign file contains more and more datasets the open time will increase linearly since ADIOS has to create a reading engine for each BP/HDF5 file, to open that dataset and process it's metadata. If one is only interested in specific datasets in the campaign, a semicolon-separated (;) list of regular expressions can be provided to only open datasets that match one of those expressions.
16+
17+
#. **exclude-dataset**: Similar to the previous option, datasets can be excluded from processing by providing a semicolon-separated list of regular expressions.
18+
19+
#. **verbose**: print debug information on what is happening when reading a campaign file.
20+
21+
=============================== ===================== ===========================================================
22+
**Key** **Value Format** **Default** and Examples
23+
=============================== ===================== ===========================================================
24+
hostname string **hostname** from *~/.config/hpc-campaign/config.yaml*
25+
campaignstorepath string **campaignstorepath** from *~/.config/hpc-campaign/config.yaml*
26+
cachepath string **cachepath** from *~/.config/hpc-campaign/config.yaml*
27+
include-dataset string "include-dataset=.*/images;.*/data"
28+
exclude-dataset string "exclude-dataset=logs/.*"
29+
verbose integer **0**, 0..5
30+
=============================== ===================== ===========================================================

docs/user_guide/source/engines/engines.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -27,3 +27,4 @@ Parameters are passed at:
2727
.. include:: inline.rst
2828
.. include:: null.rst
2929
.. include:: plugin.rst
30+
.. include:: campaign.rst

python/adios2/stream.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -926,6 +926,7 @@ def minmax(self, name, step: Optional[int] = None, block_info_list: list = []) -
926926
- 'rra' mode:
927927
- the global all-step min/max if 'step' is not given,
928928
- the given step's min/max
929+
929930
If 'bis' is given as the result of previous all_blocks_info() call, it will be used
930931
instead of querying again.
931932

0 commit comments

Comments
 (0)