Issues on LANL HPC Machines (or building with ACML or MKL)

Tusas has been tested and is known to work on the LANL HPC machines Pinto and Moonlight. There is a major issue in that there is no working CLapack installed. CLapack is required for the error estimator and gradient recovery capabilities in Tusas. Currently a fix on pinto requires two steps:

1. Configure Trilinos with the ACML enabled do-configure-acml script.

2. Configure Tusas as follows:

$ cmake -DTRILINOS_DIR=/lustre/scratch2/yellow/cnewman/trilinos-12.6.4-Source/GCC_5_3_0_MPI_OMP_OPT/ -DTUSAS_CXX_FLAGS=“-DTUSAS_HAVE_ACML” .

Most tests fail on the head node as there is no access to mpi. Most tests fail on an interactive node as serial runs are not permitted. The best bet to see what kind of testing coverage is run on an interactive node as:

$ ctest -R Par

to run only parallel tests. At this time, PhaseHeatQuadPar diffs significantly. This is being investigated.

Similarly, to build against Intel MKL:

$ cmake -DTRILINOS_DIR=/lustre/scratch2/yellow/cnewman/trilinos-12.6.4-Source/GCC_5_3_0_MPI_OMP_OPT/ -DTUSAS_CXX_FLAGS=“-DTUSAS_HAVE_MKL” .

This approach assumes Trilinos was built with Intel + MKL with a similar do-configure file.

For help with this and issues on other platforms contact [email protected].