ENH: DAOS and DFS modules#1014

Merged

shanedsnyder merged 70 commits intomainfrom

snyder/dev-daos-module-3.4

May 8, 2025

Commits on May 7, 2025

initial stubbed out DAOS DFS module

Shane Snyder
authored and
Shane Snyder
committed
first cut at entire dfs runtime/util code

Shane Snyder
authored and
Shane Snyder
committed
autoconf/automake support for daos module

Shane Snyder
authored and
Shane Snyder
committed
adopt new darshan-core module api

Shane Snyder
authored and
Shane Snyder
committed
fix up new compile errors/warnings

Shane Snyder
authored and
Shane Snyder
committed
teach automake about daos ld-opts

Shane Snyder
authored and
Shane Snyder
committed
updated comments on missing functionality

Shane Snyder
authored and
Shane Snyder
committed
comment out move/exchange wrappers, need more work

Shane Snyder
authored and
Shane Snyder
committed
changes to support instrumenting obj_global2local

Shane Snyder
authored and
Shane Snyder
committed
add example log to temporarily test with

Shane Snyder
authored and
Shane Snyder
committed
MAINT: PR 739 revisions

tylerjereddy
authored and
Shane Snyder
committed
added new IOR example log files

Shane Snyder
authored and
Shane Snyder
committed
MAINT: PR 739 revisions

tylerjereddy
authored and
Shane Snyder
committed
MAINT: PR 739 revisions

tylerjereddy
authored and
Shane Snyder
committed
MAINT: PR 739 revisions

tylerjereddy
authored and
Shane Snyder
committed
MAINT: PR 739 revisions

tylerjereddy
authored and
Shane Snyder
committed
rename existing DAOS files to DFS

Shane Snyder
authored and
Shane Snyder
committed
fix header guard

Shane Snyder
authored and
Shane Snyder
committed
instrument initial DAOS obj/array routines

Shane Snyder
authored and
Shane Snyder
committed
more instrumentation of native daos APIs

Shane Snyder
authored and
Shane Snyder
committed
more includes needed for DAOS header ac checks

Shane Snyder
authored and
Shane Snyder
committed
use filename rather than OID to generate DFS IDs

Shane Snyder
authored and
Shane Snyder
committed
Revert "use filename rather than OID to generate DFS IDs"

Shane Snyder
authored and
Shane Snyder
committed
make sure to set object oid in daos redux

Shane Snyder
authored and
Shane Snyder
committed
add DAOS module access size histogram

Shane Snyder
authored and
Shane Snyder
committed
add wrapper for dfs_remove

Shane Snyder
authored and
Shane Snyder
committed
only instrument DFS calls if no error

Shane Snyder
authored and
Shane Snyder
committed
move locking for DAOS module

Shane Snyder
authored and
Shane Snyder
committed
add daos kv api instrumentation

Shane Snyder
authored and
Shane Snyder
committed
drop support for dfs_stat, dfs_move, dfs_exchange

Shane Snyder
authored and
Shane Snyder
committed
add more DAOS counters

Shane Snyder
authored and
Shane Snyder
committed
generate record id properly for dfs_remove

Shane Snyder
authored and
Shane Snyder
committed
bug fix in DAOS IOD size calculation

Shane Snyder
authored and
Shane Snyder
committed
don't count kv_get size if no buf given

Shane Snyder
authored and
Shane Snyder
committed
don't get oclass_name

Shane Snyder
authored and
Shane Snyder
committed
store DFS pool/cont UUIDs in file records

Shane Snyder
authored and
Shane Snyder
committed
update DAOS module to include pool/cont uuids
Shane Snyder
committed
refactor darshan_core_register_record
Shane Snyder
committed
add darshan-util code to handle multiple namerecs
Shane Snyder
committed
improved comments

Shane Snyder
authored and
Shane Snyder
committed
finish implementing DAOS/DFS logutils functions

Shane Snyder
authored and
Shane Snyder
committed
add accumulator and advanced parser support

Shane Snyder
authored and
Shane Snyder
committed
updated comments about global2local support

Shane Snyder
authored and
Shane Snyder
committed
proper size calculation for array API

Shane Snyder
authored and
Shane Snyder
committed
drop DFS_USE_DTX counter

Shane Snyder
authored and
Shane Snyder
committed
filter out DFS records that do no I/O operations

Shane Snyder
authored and
Shane Snyder
committed
cleanup some runtime daos/dfs code
Shane Snyder
committed
updated darshan-runtime docs for daos

Shane Snyder
authored and
Shane Snyder
committed
updated darshan-util docs for daos

Shane Snyder
authored and
Shane Snyder
committed
small darshan-util tweaks
Shane Snyder
committed
add checks for libuuid to darshan-util configure

Shane Snyder
authored and
Shane Snyder
committed
updated pydarshan for DFS module

Shane Snyder
authored and
Shane Snyder
committed
pydarshan updates for DAOS module

Shane Snyder
authored and
Shane Snyder
committed
forgot to compare DFS vs DAOS values

Shane Snyder
authored and
Shane Snyder
committed
drop DAOS records with no real I/O activity

Shane Snyder
authored and
Shane Snyder
committed
updated pydarshan to support DFS/DAOS heatmaps

Shane Snyder
authored and
Shane Snyder
committed
enforce order for DAOS heatmag figs

Shane Snyder
authored and
Shane Snyder
committed
add more DAOS ops to opcount plots

Shane Snyder
authored and
Shane Snyder
committed
generate module overview table for DAOS

Shane Snyder
authored and
Shane Snyder
committed
update DAOS opcount tests

Shane Snyder
authored and
Shane Snyder
committed
add heatmap support for DFS/DAOS modules

Shane Snyder
authored and
Shane Snyder
committed
gracefully handle case with no DFS mount info

Shane Snyder
authored and
Shane Snyder
committed
add async support to DFS/DAOS modules

Shane Snyder
authored and
Shane Snyder
committed
daos not enabled by default fix in docs
Shane Snyder
committed

Commits on May 8, 2025

updated util docs
Shane Snyder
committed
updated Darshan log
Shane Snyder
committed
fix PyDarshan DAOS struct def
Shane Snyder
committed
fix op count label
Shane Snyder
committed
updated pytest
Shane Snyder
committed
bug fix in pydarshan tests
Shane Snyder
committed