remhos changes

[rfhaque]

Description

This PR:

1. Adds a variant to experiment.py, application.py and package.py for enabling gpu-aware-mpi in remhos
2. Enables umpire in hypre and mfem
3. Enables GPU aware MPI in mfem

Adding/modifying a benchmark (docs: Adding a Benchmark)

• If package.py upstreamed to Spack is insufficient, add/modify repo/benchmark_name/package.py plus: create, self-assign, and link here a follow up issue with a link to the PR in the Spack repo.
• If application.py upstreamed to Ramble is insufficient, add/modify repo/benchmark_name/application.py plus: create, self-assign, and link here a follow up issue with a link to the PR in the Ramble repo.
• Add/modify an experiments/benchmark_name/experiment.py to define an experiment

This PR depends on

• The laghos source PR shared umpire device pool and mfem GPU-aware MPI CEED/Remhos#55 being merged
• Implementation of variable pool sizes in Remhos (similar to anticipated changes to shared device umpire pool CEED/Laghos#198)
• Remhos GPU branch being merged GPU + FOM CEED/Remhos#49
• Updating Remhos to point at the develop branch
• Cleaning up gpu-aware
• Resolving MFEM package conflict

[pearce8]

Need to think about GPU-aware MPI

[pearce8]

@nhanford Do we want a variant on this?

[pearce8]

@nhanford Do you think this is a reasonable way to pass on gpu aware requirements?

[codecov-commenter]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 65.14%. Comparing base (f7077b8) to head (c7cdb77).
⚠️ Report is 1 commits behind head on develop.

Additional details and impacted files

@@             Coverage Diff             @@
##           develop    #1141      +/-   ##
===========================================
+ Coverage    65.02%   65.14%   +0.12%     
===========================================
  Files           44       44              
  Lines         3274     3274              
  Branches       261      261              
===========================================
+ Hits          2129     2133       +4     
+ Misses        1135     1131       -4     
  Partials        10       10              

see 1 file with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.