Caliper How To

Scratch pad for Caliper + Thicket/Hatchet notes.

General Caliper Services

Runtime Report

CALI_CONFIG=runtime-report

Event Tracing

CALI_CONFIG=event-trace

Sample Based Profiling

CALI_CONFIG=sample-report

GPU Caliper Services

https://software.llnl.gov/Caliper/GPUProfiling.html

(TODO: list most useful config/services)

(TODO: CUDA and ROCm Build constraints)

MPI Caliper Services

https://software.llnl.gov/Caliper/MPIProfiling.html

Overall MPI Report

CALI_CONFIG=mpi-report

Profile MPI calls inside of Caliper annotated regions

CALI_CONFIG=runtime-report,profile.mpi 

(TODO: Are there MPI build constraints?)

Ascent Caliper Integration Tasks

Allow ascent_options.yaml entries to control caliper services.

We support options for Caliper config, services, and output_file:

https://github.com/Alpine-DAV/ascent/blob/207d6fb7cc57352640abff9f0aee77b70842821b/src/libs/ascent/utils/ascent_annotations.cpp#L76

Caliper Visualization

import hatchet as ht
gf = ht.GraphFrame.from_caliperreader("output.cali")
print(gf.tree())

Simple Virtual Env Setup w/ Hatchet and Thicket Perf Tools

python3 -m venv caliper_viz
caliper_viz/bin/pip3 install llnl-hatchet llnl-thicket
caliper_vis/bin/python3 -c "import hatchet as ht;gf = ht.GraphFrame.from_caliperreader('output.cali'); print(gf.tree());"

Example to convert cali record file to json:

cali-query -q "select function,sum(sum#time.duration),inclusive_sum(sum#time.duration) group by function format json-split" output.cali > cali_output.json