Problems of using MOOSE with hip #28386

ljeft · 2024-08-15T13:32:31Z

ljeft
Aug 15, 2024

Hello, just the other week I successfully ran a couple of MOOSE cases using MOOSE (HIP) in an offline environment.#27635 (comment)
I was going to try to run my files using hip, but there were some issues and I'm now opening another discussion.
This is the.i file

[Mesh]
  [gen]
    type = GeneratedMeshGenerator
    dim = 2
    xmin = 0
    xmax = 1.0
    ymin = 0
    ymax = 1.0
    nx = 16
    ny = 16
  []
[]

[Modules]
  [IncompressibleNavierStokes]
    equation_type = steady-state

    velocity_boundary = 'bottom right top             left'
    velocity_function = '0 0    0 0   lid_function 0  0 0'
    initial_velocity = '1e-15 1e-15 0'
    add_standard_velocity_variables_for_ad = false

    pressure_pinned_node = 0

    density_name = rho
    dynamic_viscosity_name = mu

    use_ad = true
    laplace = true
    family = LAGRANGE
    order = FIRST

    add_temperature_equation = true
    fixed_temperature_boundary = 'bottom top'
    temperature_function = '1 0'

    supg = true
    pspg = true
  []
[]


[Materials]
  [const]
    type = ADGenericConstantMaterial
    prop_names = 'rho mu cp k'
    prop_values = '1  1  1  .01'
  []
[]

[Functions]
  [lid_function]
    # We pick a function that is exactly represented in the velocity
    # space so that the Dirichlet conditions are the same regardless
    # of the mesh spacing.
    type = ParsedFunction
    expression = '4*x*(1-x)'
  []
[]

[Preconditioning]
  [SMP]
    type = SMP
    full = true
  []
[]

[Executioner]
  type = Steady
  solve_type = 'NEWTON'
  petsc_options_iname = '-pc_type -sub_pc_factor_levels -ksp_gmres_restart'
  petsc_options_value = 'asm      6                     200'
  line_search = 'none'
  nl_rel_tol = 1e-12
  nl_max_its = 6
[]

[Outputs]
  exodus = true
[]

And then this is an error

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1



*** ERROR ***
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:14.1: section '[Modules]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:15.3: section '[Modules/IncompressibleNavierStokes]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax




*** ERROR ***
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:14.1: section '[Modules]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:15.3: section '[Modules/IncompressibleNavierStokes]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax




*** ERROR ***
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:14.1: section '[Modules]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:15.3: section '[Modules/IncompressibleNavierStokes]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax




*** ERROR ***
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:14.1: section '[Modules]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:15.3: section '[Modules/IncompressibleNavierStokes]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax




*** ERROR ***
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:14.1: section '[Modules]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:15.3: section '[Modules/IncompressibleNavierStokes]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax




*** ERROR ***
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:14.1: section '[Modules]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax
/opt/projects/fish/example1/./ad_lid_driven_action_stabilized_steady.i:15.3: section '[Modules/IncompressibleNavierStokes]' does not have an associated "Action".
 Common causes:
- you misspelled the Action/section name
- the app you are running does not support this Action/syntax


--------------------------------------------------------------------------
MPI_ABORT was invoked on rank 1 in communicator MPI_COMM_WORLD
with errorcode 1.

NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI processes.
You may or may not see output from other processes, depending on
exactly when Open MPI kills them.
--------------------------------------------------------------------------
[e9a45d4c9858:04666] 5 more processes have sent help message help-mpi-api.txt / mpi-abort
[e9a45d4c9858:04666] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages

GiudGiud · 2024-08-15T14:53:42Z

GiudGiud
Aug 15, 2024
Collaborator

Hello

Which executable are you using?
Do you have the NavierStokes module selected in the Makefile?

Guillaume

12 replies

ljeft Aug 19, 2024
Author

Nice! I solved the problem.But it doesn't look like the GPU call was successful.Now it's stuck on Finished Executing.

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

                                                                               [  0.13 s] [  281 MB]
Framework Information:
MOOSE Version:           git commit 23349b84fa on 2024-05-14
LibMesh Version:         
PETSc Version:           3.21.0
SLEPc Version:           3.21.0
Current Time:            Mon Aug 19 21:21:50 2024
Executable Timestamp:    Mon Aug 19 21:12:07 2024

Parallelism:
  Num Processors:          6
  Num Threads:             1

Mesh: 
  Parallel Type:           replicated
  Mesh Dimension:          2
  Spatial Dimension:       2
  Nodes:                   
    Total:                 289
    Local:                 57
    Min/Max/Avg:           39/58/48
  Elems:                   
    Total:                 256
    Local:                 42
    Min/Max/Avg:           42/43/42
  Num Subdomains:          1
  Num Partitions:          6
  Partitioner:             metis

Nonlinear System:
  Num DOFs:                1156
  Num Local DOFs:          228
  Variables:               "velocity" { "temperature" "p" } 
  Finite Element Types:    "LAGRANGE_VEC" "LAGRANGE" 
  Approximation Orders:    "FIRST" "FIRST" 

Execution Information:
  Executioner:             Steady
  Solver Mode:             NEWTON
  PETSc Preconditioner:    asm 
  MOOSE Preconditioner:    SMP

Currently Executing
    Computing Residual..                                                                 [ 18.76 s] [ 3881 MB]
 0 Nonlinear |R| = 2.883606e+00
      0 Linear |R| = 2.883606e+00
      1 Linear |R| = 1.129123e+00
      2 Linear |R| = 6.765157e-01
      3 Linear |R| = 4.265281e-01
      4 Linear |R| = 2.484776e-01
      5 Linear |R| = 1.716801e-01
      6 Linear |R| = 1.131606e-01
      7 Linear |R| = 5.605766e-02
      8 Linear |R| = 2.447656e-02
      9 Linear |R| = 1.060166e-02
     10 Linear |R| = 5.663119e-03
     11 Linear |R| = 3.970825e-03
     12 Linear |R| = 2.069557e-03
     13 Linear |R| = 1.235481e-03
     14 Linear |R| = 6.456912e-04
     15 Linear |R| = 4.631259e-04
     16 Linear |R| = 4.202744e-04
     17 Linear |R| = 3.971985e-04
     18 Linear |R| = 3.832264e-04
     19 Linear |R| = 3.709511e-04
     20 Linear |R| = 3.631348e-04
     21 Linear |R| = 3.235885e-04
     22 Linear |R| = 1.833163e-04
     23 Linear |R| = 7.047422e-05
     24 Linear |R| = 2.524252e-05
 1 Nonlinear |R| = 1.406771e-02
      0 Linear |R| = 1.406771e-02
      1 Linear |R| = 1.065019e-02
      2 Linear |R| = 6.604399e-03
      3 Linear |R| = 3.995772e-03
      4 Linear |R| = 2.843103e-03
      5 Linear |R| = 2.112097e-03
      6 Linear |R| = 1.571859e-03
      7 Linear |R| = 1.137326e-03
      8 Linear |R| = 6.472439e-04
      9 Linear |R| = 3.574544e-04
     10 Linear |R| = 1.607620e-04
     11 Linear |R| = 6.973255e-05
     12 Linear |R| = 5.012895e-05
     13 Linear |R| = 3.372698e-05
     14 Linear |R| = 2.526075e-05
     15 Linear |R| = 2.335607e-05
     16 Linear |R| = 2.267512e-05
     17 Linear |R| = 2.236576e-05
     18 Linear |R| = 2.191895e-05
     19 Linear |R| = 1.829626e-05
     20 Linear |R| = 1.019462e-05
     21 Linear |R| = 3.101049e-06
     22 Linear |R| = 9.725092e-07
     23 Linear |R| = 4.620495e-07
     24 Linear |R| = 2.434045e-07
     25 Linear |R| = 7.779505e-08
 2 Nonlinear |R| = 2.436942e-05
      0 Linear |R| = 2.436942e-05
      1 Linear |R| = 2.100170e-05
      2 Linear |R| = 1.154197e-05
      3 Linear |R| = 5.889819e-06
      4 Linear |R| = 2.719385e-06
      5 Linear |R| = 1.132952e-06
      6 Linear |R| = 8.574563e-07
      7 Linear |R| = 3.316367e-07
      8 Linear |R| = 1.607685e-07
      9 Linear |R| = 6.271318e-08
     10 Linear |R| = 3.869024e-08
     11 Linear |R| = 2.127475e-08
     12 Linear |R| = 8.533365e-09
     13 Linear |R| = 4.762458e-09
     14 Linear |R| = 2.726666e-09
     15 Linear |R| = 2.456777e-09
     16 Linear |R| = 2.410392e-09
     17 Linear |R| = 2.383263e-09
     18 Linear |R| = 2.324288e-09
     19 Linear |R| = 2.158825e-09
     20 Linear |R| = 1.761493e-09
     21 Linear |R| = 1.276972e-09
     22 Linear |R| = 6.562060e-10
     23 Linear |R| = 3.057528e-10
     24 Linear |R| = 7.837094e-11
 3 Nonlinear |R| = 7.833585e-11
      0 Linear |R| = 7.833585e-11
      1 Linear |R| = 2.727161e-11
      2 Linear |R| = 1.600795e-11
      3 Linear |R| = 1.119909e-11
      4 Linear |R| = 7.506921e-12
      5 Linear |R| = 5.708014e-12
      6 Linear |R| = 4.282402e-12
      7 Linear |R| = 3.432880e-12
      8 Linear |R| = 3.150891e-12
      9 Linear |R| = 3.026839e-12
     10 Linear |R| = 2.970765e-12
     11 Linear |R| = 2.939493e-12
     12 Linear |R| = 2.904254e-12
     13 Linear |R| = 2.792848e-12
     14 Linear |R| = 2.467258e-12
     15 Linear |R| = 1.978194e-12
     16 Linear |R| = 1.375283e-12
     17 Linear |R| = 1.072043e-12
     18 Linear |R| = 7.191072e-13
     19 Linear |R| = 2.080654e-13
     20 Linear |R| = 5.665910e-14
     21 Linear |R| = 1.494565e-14
     22 Linear |R| = 3.960232e-15
     23 Linear |R| = 1.239174e-15
     24 Linear |R| = 2.512574e-16
 4 Nonlinear |R| = 9.340726e-16
SNES Object: 6 MPI processes
  type: newtonls
  maximum iterations=6, maximum function evaluations=10000
  tolerances: relative=1e-12, absolute=1e-50, solution=0.
  total number of linear solver iterations=97
  total number of function evaluations=5
  norm schedule ALWAYS
  SNESLineSearch Object: 6 MPI processes
    type: basic
    maxstep=1.000000e+08, minlambda=1.000000e-12
    tolerances: relative=1.000000e-08, absolute=1.000000e-15, lambda=1.000000e-08
    maximum iterations=40
  KSP Object: 6 MPI processes
    type: gmres
      restart=200, using Classical (unmodified) Gram-Schmidt Orthogonalization with no iterative refinement
      happy breakdown tolerance 1e-30
    maximum iterations=10000, initial guess is zero
    tolerances: relative=1e-05, absolute=1e-50, divergence=1e+100
    right preconditioning
    using UNPRECONDITIONED norm type for convergence test
  PC Object: 6 MPI processes
    type: asm
      total subdomain blocks = 6, amount of overlap = 1
      restriction/interpolation type - RESTRICT
      Local solver information for first block is in the following KSP and PC objects on rank 0:
      Use -ksp_view ::ascii_info_detail to display information for all blocks
      KSP Object: (sub_) 1 MPI process
        type: preonly
        maximum iterations=10000, initial guess is zero
        tolerances: relative=1e-05, absolute=1e-50, divergence=10000.
        left preconditioning
        using NONE norm type for convergence test
      PC Object: (sub_) 1 MPI process
        type: ilu
          out-of-place factorization
          6 levels of fill
          tolerance for zero pivot 2.22045e-14
          matrix ordering: natural
          factor fill ratio given 1., needed 6.74796
            Factored matrix follows:
              Mat Object: (sub_) 1 MPI process
                type: seqaijhipsparse
                rows=300, cols=300
                package used to perform factorization: hipsparse
                total: nonzeros=46399, allocated nonzeros=46399
                  using I-node routines: found 221 nodes, limit used is 5
        linear system matrix = precond matrix:
        Mat Object: (sub_) 1 MPI process
          type: seqaijhipsparse
          rows=300, cols=300
          total: nonzeros=6876, allocated nonzeros=6876
          total number of mallocs used during MatSetValues calls=0
            not using I-node routines
    linear system matrix = precond matrix:
    Mat Object: () 6 MPI processes
      type: mpiaijhipsparse
      rows=1156, cols=1156
      total: nonzeros=28812, allocated nonzeros=40992
      total number of mallocs used during MatSetValues calls=0
        not using I-node (on process 0) routines
  Finished Solving                                                                       [ 21.09 s] [ 4094 MB]
 Solve Converged!

Outlier Variable Residual Norms:
  velocity: 9.038889e-16
Finished Executing                                                                       [ 21.14 s] [ 4094 MB]

GiudGiud Aug 19, 2024
Collaborator

interesting.
if you open it in a debugger, you can kill it where it's stuck and get a full backtrace of where it is stuck

You can attach a debugger now if it s still running, you dont need to start the process in a debugger to do this

ljeft Aug 20, 2024
Author

And when I break it and try to run it, it's stuck here, but it's already worked out.

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

[LOG_ERROR] ROCR-Runtime_5.2_docker/src/core/runtime/interrupt_signal.cpp:135: Create events pool failed. return value: 0x1

                                                                               [  0.13 s] [  281 MB]
Framework Information:
MOOSE Version:           git commit 23349b84fa on 2024-05-14
LibMesh Version:         
PETSc Version:           3.21.0
SLEPc Version:           3.21.0
Current Time:            Tue Aug 20 14:30:25 2024
Executable Timestamp:    Mon Aug 19 21:12:07 2024

Parallelism:
  Num Processors:          6
  Num Threads:             1

Mesh: 
  Parallel Type:           replicated
  Mesh Dimension:          2
  Spatial Dimension:       2
  Nodes:                   
    Total:                 289
    Local:                 57
    Min/Max/Avg:           39/58/48
  Elems:                   
    Total:                 256
    Local:                 42
    Min/Max/Avg:           42/43/42
  Num Subdomains:          1
  Num Partitions:          6
  Partitioner:             metis

Nonlinear System:
  Num DOFs:                1156
  Num Local DOFs:          228
  Variables:               "velocity" { "temperature" "p" } 
  Finite Element Types:    "LAGRANGE_VEC" "LAGRANGE" 
  Approximation Orders:    "FIRST" "FIRST" 

Execution Information:
  Executioner:             Steady
  Solver Mode:             NEWTON
  PETSc Preconditioner:    asm 
  MOOSE Preconditioner:    SMP

Currently Executing
    Computing Residual..                                                                 [ 18.41 s] [ 3881 MB]
 0 Nonlinear |R| = 2.883606e+00
      0 Linear |R| = 2.883606e+00
      1 Linear |R| = 1.129123e+00
      2 Linear |R| = 6.765157e-01
      3 Linear |R| = 4.265281e-01
      4 Linear |R| = 2.484776e-01
      5 Linear |R| = 1.716801e-01
      6 Linear |R| = 1.131606e-01
      7 Linear |R| = 5.605766e-02
      8 Linear |R| = 2.447656e-02
      9 Linear |R| = 1.060166e-02
     10 Linear |R| = 5.663119e-03
     11 Linear |R| = 3.970825e-03
     12 Linear |R| = 2.069557e-03
     13 Linear |R| = 1.235481e-03
     14 Linear |R| = 6.456912e-04
     15 Linear |R| = 4.631259e-04
     16 Linear |R| = 4.202744e-04
     17 Linear |R| = 3.971985e-04
     18 Linear |R| = 3.832264e-04
     19 Linear |R| = 3.709511e-04
     20 Linear |R| = 3.631348e-04
     21 Linear |R| = 3.235885e-04
     22 Linear |R| = 1.833163e-04
     23 Linear |R| = 7.047422e-05
     24 Linear |R| = 2.524252e-05
 1 Nonlinear |R| = 1.406771e-02
      0 Linear |R| = 1.406771e-02
      1 Linear |R| = 1.065019e-02
      2 Linear |R| = 6.604399e-03
      3 Linear |R| = 3.995772e-03
      4 Linear |R| = 2.843103e-03
      5 Linear |R| = 2.112097e-03
      6 Linear |R| = 1.571859e-03
      7 Linear |R| = 1.137326e-03
      8 Linear |R| = 6.472439e-04
      9 Linear |R| = 3.574544e-04
     10 Linear |R| = 1.607620e-04
     11 Linear |R| = 6.973255e-05
     12 Linear |R| = 5.012895e-05
     13 Linear |R| = 3.372698e-05
     14 Linear |R| = 2.526075e-05
     15 Linear |R| = 2.335607e-05
     16 Linear |R| = 2.267512e-05
     17 Linear |R| = 2.236576e-05
     18 Linear |R| = 2.191895e-05
     19 Linear |R| = 1.829626e-05
     20 Linear |R| = 1.019462e-05
     21 Linear |R| = 3.101049e-06
     22 Linear |R| = 9.725092e-07
     23 Linear |R| = 4.620495e-07
     24 Linear |R| = 2.434045e-07
     25 Linear |R| = 7.779505e-08
 2 Nonlinear |R| = 2.436942e-05
      0 Linear |R| = 2.436942e-05
      1 Linear |R| = 2.100170e-05
      2 Linear |R| = 1.154197e-05
      3 Linear |R| = 5.889819e-06
      4 Linear |R| = 2.719385e-06
      5 Linear |R| = 1.132952e-06
      6 Linear |R| = 8.574563e-07
      7 Linear |R| = 3.316367e-07
      8 Linear |R| = 1.607685e-07
      9 Linear |R| = 6.271318e-08
     10 Linear |R| = 3.869024e-08
     11 Linear |R| = 2.127475e-08
     12 Linear |R| = 8.533365e-09
     13 Linear |R| = 4.762458e-09
     14 Linear |R| = 2.726666e-09
     15 Linear |R| = 2.456778e-09
     16 Linear |R| = 2.410392e-09
     17 Linear |R| = 2.383263e-09
     18 Linear |R| = 2.324288e-09
     19 Linear |R| = 2.158825e-09
     20 Linear |R| = 1.761493e-09
     21 Linear |R| = 1.276972e-09
     22 Linear |R| = 6.562060e-10
     23 Linear |R| = 3.057528e-10
     24 Linear |R| = 7.837094e-11
 3 Nonlinear |R| = 7.833588e-11
      0 Linear |R| = 7.833588e-11
      1 Linear |R| = 2.727159e-11
      2 Linear |R| = 1.600793e-11
      3 Linear |R| = 1.119907e-11
      4 Linear |R| = 7.506910e-12
      5 Linear |R| = 5.708004e-12
      6 Linear |R| = 4.282392e-12
      7 Linear |R| = 3.432871e-12
      8 Linear |R| = 3.150881e-12
      9 Linear |R| = 3.026829e-12
     10 Linear |R| = 2.970755e-12
     11 Linear |R| = 2.939484e-12
     12 Linear |R| = 2.904245e-12
     13 Linear |R| = 2.792840e-12
     14 Linear |R| = 2.467252e-12
     15 Linear |R| = 1.978189e-12
     16 Linear |R| = 1.375282e-12
     17 Linear |R| = 1.072042e-12
     18 Linear |R| = 7.191068e-13
     19 Linear |R| = 2.080655e-13
     20 Linear |R| = 5.665901e-14
     21 Linear |R| = 1.494562e-14
     22 Linear |R| = 3.960230e-15
     23 Linear |R| = 1.239172e-15
     24 Linear |R| = 2.512570e-16
 4 Nonlinear |R| = 8.321811e-16
SNES Object: 6 MPI processes
  type: newtonls
  maximum iterations=6, maximum function evaluations=10000
  tolerances: relative=1e-12, absolute=1e-50, solution=0.
  total number of linear solver iterations=97
  total number of function evaluations=5
  norm schedule ALWAYS
  SNESLineSearch Object: 6 MPI processes
    type: basic
    maxstep=1.000000e+08, minlambda=1.000000e-12
    tolerances: relative=1.000000e-08, absolute=1.000000e-15, lambda=1.000000e-08
    maximum iterations=40
  KSP Object: 6 MPI processes
    type: gmres
      restart=200, using Classical (unmodified) Gram-Schmidt Orthogonalization with no iterative refinement
      happy breakdown tolerance 1e-30
    maximum iterations=10000, initial guess is zero
    tolerances: relative=1e-05, absolute=1e-50, divergence=1e+100
    right preconditioning
    using UNPRECONDITIONED norm type for convergence test
  PC Object: 6 MPI processes
    type: asm
      total subdomain blocks = 6, amount of overlap = 1
      restriction/interpolation type - RESTRICT
      Local solver information for first block is in the following KSP and PC objects on rank 0:
      Use -ksp_view ::ascii_info_detail to display information for all blocks
      KSP Object: (sub_) 1 MPI process
        type: preonly
        maximum iterations=10000, initial guess is zero
        tolerances: relative=1e-05, absolute=1e-50, divergence=10000.
        left preconditioning
        using NONE norm type for convergence test
      PC Object: (sub_) 1 MPI process
        type: ilu
          out-of-place factorization
          6 levels of fill
          tolerance for zero pivot 2.22045e-14
          matrix ordering: natural
          factor fill ratio given 1., needed 6.74796
            Factored matrix follows:
              Mat Object: (sub_) 1 MPI process
                type: seqaijhipsparse
                rows=300, cols=300
                package used to perform factorization: hipsparse
                total: nonzeros=46399, allocated nonzeros=46399
                  using I-node routines: found 221 nodes, limit used is 5
        linear system matrix = precond matrix:
        Mat Object: (sub_) 1 MPI process
          type: seqaijhipsparse
          rows=300, cols=300
          total: nonzeros=6876, allocated nonzeros=6876
          total number of mallocs used during MatSetValues calls=0
            not using I-node routines
    linear system matrix = precond matrix:
    Mat Object: () 6 MPI processes
      type: mpiaijhipsparse
      rows=1156, cols=1156
      total: nonzeros=28812, allocated nonzeros=40992
      total number of mallocs used during MatSetValues calls=0
        not using I-node (on process 0) routines
  Finished Solving                                                                       [ 20.94 s] [ 4094 MB]
 Solve Converged!

Outlier Variable Residual Norms:
  velocity: 7.982800e-16
Finished Executing                                                                       [ 20.99 s] [ 4094 MB]
WARNING! There are options you set that were not used!
WARNING! could be spelling mistake, etc!
There is one unused database option. It is:
Option left: name:-mat_type value: aijhipsparse source: command line

GiudGiud Aug 20, 2024
Collaborator

And when I break it and try to run it

what do you mean by "break it" ?

it's stuck here

stuck where? at the end of the solve still?

but it's already worked out.

what do you mean?

ljeft Aug 22, 2024
Author

As a result, it stays stuck in Option left: name:-mat_type value: aijhipsparse source: command line will not end and then ctrl+c force interrupt, then I checked the out.e file and found that the result is no problem.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Problems of using MOOSE with hip #28386

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment 12 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Problems of using MOOSE with hip #28386

Uh oh!

ljeft Aug 15, 2024

Replies: 1 comment · 12 replies

Uh oh!

GiudGiud Aug 15, 2024 Collaborator

Uh oh!

ljeft Aug 19, 2024 Author

Uh oh!

GiudGiud Aug 19, 2024 Collaborator

Uh oh!

ljeft Aug 20, 2024 Author

Uh oh!

GiudGiud Aug 20, 2024 Collaborator

Uh oh!

ljeft Aug 22, 2024 Author

ljeft
Aug 15, 2024

Replies: 1 comment 12 replies

GiudGiud
Aug 15, 2024
Collaborator

ljeft Aug 19, 2024
Author

GiudGiud Aug 19, 2024
Collaborator

ljeft Aug 20, 2024
Author

GiudGiud Aug 20, 2024
Collaborator

ljeft Aug 22, 2024
Author