-
Notifications
You must be signed in to change notification settings - Fork 2
Description
I have observed errors triggered by the combined use of GridapPETSc and GridapGmsh as it is done in the expansion driver. Eliminating the line using GridapGmsh and the line include("Expansion.jl") in GridapMHD.jl, these errors do not arise (none of them).
The way the errors manifest depend on how GridapPETSc is installed. I considered two options
- choosing a 32 bit PETSc installation (configured without
--with-64-bit-indices) - choosing a 64 bit PETSc installation (configured with
--with-64-bit-indices)
When using GridapGmsh a dependency on Metis, which is compiled with 32 bits (see here) is introduced. It is possible to bypass the call to Metis from MUMPS, which can be done through the option "-mat_mumps_icntl_7 0" in PETSc arguments that selects using AMD ordering. Therefore, I consider the following commands
julia --project=. -e ' using GridapMHD; GridapMHD.hunt(nc=(10,10),np=(1,1),backend=:sequential,solver=:petsc,petsc_options="-snes_monitor -ksp_error_if_not_converged true -ksp_converged_reason -ksp_type preonly -pc_type lu -pc_factor_mat_solver_type mumps")'julia --project=. -e ' using GridapMHD; GridapMHD.hunt(nc=(10,10),np=(1,1),backend=:sequential,solver=:petsc,petsc_options="-snes_monitor -ksp_error_if_not_converged true -ksp_converged_reason -ksp_type preonly -pc_type lu -pc_factor_mat_solver_type mumps -mat_mumps_icntl_7 0")'mpiexec -n 1 julia --project=. -e 'using GridapMHD; GridapMHD.hunt(np=(1,1),nc=(10,10),backend=:mpi,solver=:petsc,petsc_options="-snes_monitor -ksp_error_if_not_converged true -ksp_converged_reason -ksp_type preonly -pc_type lu -pc_factor_mat_solver_type mumps")'mpiexec -n 1 julia --project=. -e 'using GridapMHD; GridapMHD.hunt(np=(1,1),nc=(10,10),backend=:mpi,solver=:petsc,petsc_options="-snes_monitor -ksp_error_if_not_converged true -ksp_converged_reason -ksp_type preonly -pc_type lu -pc_factor_mat_solver_type mumps -mat_mumps_icntl_7 0")'
The behavior of these four commands under the three installations mentioned above is summarized in the following table, that points to the errors detailed below (which are very similar, always crashing at mumps.c:1686 with different info values though).
| Command\Installation | 1 | 2 |
|---|---|---|
| 1 | E1 | Segfault |
| 2 | E2 | E3 |
| 3 | Ok | Segfault |
| 4 | Ok | Ok |
E1
0 SNES Function norm 9.371663405638e-03
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Error in external library
[0]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: INFOG(1)=-9, INFO(2)=77201
[0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
[0]PETSC ERROR: Petsc Release Version 3.15.4, Sep 01, 2021
[0]PETSC ERROR: GridapPETSc on a named pc80120 by jprincipe Wed Jul 13 09:56:33 2022
[0]PETSC ERROR: Configure options -prefix=/opt/petsc/3.15.4_32bit_idx --with-cc=mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-mumps --download-scalapack --download-parmetis --download-metis --download-ptscotch --with-debugging --with-x=0 --with-shared-libraries=1 --with-mpi=1
[0]PETSC ERROR: #1 MatFactorNumeric_MUMPS() at /home/jprincipe/Prog/petsc-3.15.4/src/mat/impls/aij/mpi/mumps/mumps.c:1686
[0]PETSC ERROR: #2 MatLUFactorNumeric() at /home/jprincipe/Prog/petsc-3.15.4/src/mat/interface/matrix.c:3194
[0]PETSC ERROR: #3 PCSetUp_LU() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/pc/impls/factor/lu/lu.c:131
[0]PETSC ERROR: #4 PCSetUp() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/pc/interface/precon.c:1017
[0]PETSC ERROR: #5 KSPSetUp() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:406
[0]PETSC ERROR: #6 KSPSolve_Private() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:850
[0]PETSC ERROR: #7 KSPSolve() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:1085
[0]PETSC ERROR: #8 SNESSolve_NEWTONLS() at /home/jprincipe/Prog/petsc-3.15.4/src/snes/impls/ls/ls.c:225
[0]PETSC ERROR: #9 SNESSolve() at /home/jprincipe/Prog/petsc-3.15.4/src/snes/interface/snes.c:4653
ERROR: Petsc returned with error code: 76
Stacktrace:
[1] macro expansion
@ ~/.julia/packages/GridapPETSc/RVmej/src/Config.jl:88 [inlined]
[2] solve!(x::PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}, nls::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.AlgebraicOpFromFEOp, #unused#::Nothing)
@ GridapPETSc ~/.julia/packages/GridapPETSc/RVmej/src/PETScNonlinearSolvers.jl:185
[3] solve!(x::PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}, nls::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.AlgebraicOpFromFEOp)
@ Gridap.Algebra ~/.julia/packages/Gridap/AsRWv/src/Algebra/NonlinearSolvers.jl:22
[4] solve!(u::GridapDistributed.DistributedMultiFieldFEFunction{Vector{GridapDistributed.DistributedCellField{A, <:GridapDistributed.DistributedFEFunctionData{T}} where {A, T}}, PartitionedArrays.SequentialData{Gridap.MultiField.MultiFieldFEFunction{Gridap.MultiField.MultiFieldCellField{Gridap.CellData.ReferenceDomain}}, 3}, PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}}, solver::Gridap.FESpaces.NonlinearFESolver, feop::Gridap.FESpaces.FEOperatorFromWeakForm, cache::Nothing)
@ Gridap.FESpaces ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:163
[5] solve!
@ ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:14 [inlined]
[6] solve!(uh::GridapDistributed.DistributedMultiFieldFEFunction{Vector{GridapDistributed.DistributedCellField{A, <:GridapDistributed.DistributedFEFunctionData{T}} where {A, T}}, PartitionedArrays.SequentialData{Gridap.MultiField.MultiFieldFEFunction{Gridap.MultiField.MultiFieldCellField{Gridap.CellData.ReferenceDomain}}, 3}, PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}}, solver::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.FEOperatorFromWeakForm)
@ Gridap.FESpaces ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:18
[7] main(_params::Dict{Symbol, Any})
@ GridapMHD ~/Prog/GridapMHD.jl/src/Main.jl:507
[8] #22
@ ~/Prog/GridapMHD.jl/src/Hunt.jl:135 [inlined]
[9] with(f::GridapMHD.var"#22#26"{Dict{Symbol, Any}, Dict{Symbol, Any}}; kwargs::Base.Pairs{Symbol, Vector{SubString{String}}, Tuple{Symbol}, NamedTuple{(:args,), Tuple{Vector{SubString{String}}}}})
@ GridapPETSc ~/.julia/packages/GridapPETSc/RVmej/src/Environment.jl:38
[10] _hunt(; parts::PartitionedArrays.SequentialData{Int64, 3}, nc::Tuple{Int64, Int64}, ν::Float64, ρ::Float64, σ::Float64, B::Tuple{Float64, Float64, Float64}, f::Tuple{Float64, Float64, Float64}, L::Float64, u0::Float64, B0::Float64, nsums::Int64, vtk::Bool, title::String, path::String, debug::Bool, solver::Symbol, verbose::Bool, kmap::Int64, petsc_options::String)
@ GridapMHD ~/Prog/GridapMHD.jl/src/Hunt.jl:130
[11] #17
@ ~/Prog/GridapMHD.jl/src/Hunt.jl:19 [inlined]
[12] prun(driver::GridapMHD.var"#17#19"{String, Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol, Symbol}, NamedTuple{(:nc, :solver, :petsc_options), Tuple{Tuple{Int64, Int64}, Symbol, String}}}, String}, b::PartitionedArrays.SequentialBackend, nparts::Tuple{Int64, Int64, Int64})
@ PartitionedArrays ~/.julia/packages/PartitionedArrays/fem1y/src/Interfaces.jl:35
[13] hunt(; backend::Symbol, np::Tuple{Int64, Int64}, parts::Nothing, title::String, nruns::Int64, path::String, kwargs::Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol, Symbol}, NamedTuple{(:nc, :solver, :petsc_options), Tuple{Tuple{Int64, Int64}, Symbol, String}}})
@ GridapMHD ~/Prog/GridapMHD.jl/src/Hunt.jl:18
[14] top-level scope
@ none:1
E2
0 SNES Function norm 9.371663405638e-03
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Error in external library
[0]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: INFOG(1)=-9, INFO(2)=1278664
[0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
[0]PETSC ERROR: Petsc Release Version 3.15.4, Sep 01, 2021
[0]PETSC ERROR: GridapPETSc on a named pc80120 by jprincipe Wed Jul 13 10:01:10 2022
[0]PETSC ERROR: Configure options -prefix=/opt/petsc/3.15.4_32bit_idx --with-cc=mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-mumps --download-scalapack --download-parmetis --download-metis --download-ptscotch --with-debugging --with-x=0 --with-shared-libraries=1 --with-mpi=1
[0]PETSC ERROR: #1 MatFactorNumeric_MUMPS() at /home/jprincipe/Prog/petsc-3.15.4/src/mat/impls/aij/mpi/mumps/mumps.c:1686
[0]PETSC ERROR: #2 MatLUFactorNumeric() at /home/jprincipe/Prog/petsc-3.15.4/src/mat/interface/matrix.c:3194
[0]PETSC ERROR: #3 PCSetUp_LU() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/pc/impls/factor/lu/lu.c:131
[0]PETSC ERROR: #4 PCSetUp() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/pc/interface/precon.c:1017
[0]PETSC ERROR: #5 KSPSetUp() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:406
[0]PETSC ERROR: #6 KSPSolve_Private() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:850
[0]PETSC ERROR: #7 KSPSolve() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:1085
[0]PETSC ERROR: #8 SNESSolve_NEWTONLS() at /home/jprincipe/Prog/petsc-3.15.4/src/snes/impls/ls/ls.c:225
[0]PETSC ERROR: #9 SNESSolve() at /home/jprincipe/Prog/petsc-3.15.4/src/snes/interface/snes.c:4653
ERROR: Petsc returned with error code: 76
Stacktrace:
[1] macro expansion
@ ~/.julia/packages/GridapPETSc/RVmej/src/Config.jl:88 [inlined]
[2] solve!(x::PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}, nls::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.AlgebraicOpFromFEOp, #unused#::Nothing)
@ GridapPETSc ~/.julia/packages/GridapPETSc/RVmej/src/PETScNonlinearSolvers.jl:185
[3] solve!(x::PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}, nls::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.AlgebraicOpFromFEOp)
@ Gridap.Algebra ~/.julia/packages/Gridap/AsRWv/src/Algebra/NonlinearSolvers.jl:22
[4] solve!(u::GridapDistributed.DistributedMultiFieldFEFunction{Vector{GridapDistributed.DistributedCellField{A, <:GridapDistributed.DistributedFEFunctionData{T}} where {A, T}}, PartitionedArrays.SequentialData{Gridap.MultiField.MultiFieldFEFunction{Gridap.MultiField.MultiFieldCellField{Gridap.CellData.ReferenceDomain}}, 3}, PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}}, solver::Gridap.FESpaces.NonlinearFESolver, feop::Gridap.FESpaces.FEOperatorFromWeakForm, cache::Nothing)
@ Gridap.FESpaces ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:163
[5] solve!
@ ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:14 [inlined]
[6] solve!(uh::GridapDistributed.DistributedMultiFieldFEFunction{Vector{GridapDistributed.DistributedCellField{A, <:GridapDistributed.DistributedFEFunctionData{T}} where {A, T}}, PartitionedArrays.SequentialData{Gridap.MultiField.MultiFieldFEFunction{Gridap.MultiField.MultiFieldCellField{Gridap.CellData.ReferenceDomain}}, 3}, PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}}, solver::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.FEOperatorFromWeakForm)
@ Gridap.FESpaces ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:18
[7] main(_params::Dict{Symbol, Any})
@ GridapMHD ~/Prog/GridapMHD.jl/src/Main.jl:507
[8] #22
@ ~/Prog/GridapMHD.jl/src/Hunt.jl:135 [inlined]
[9] with(f::GridapMHD.var"#22#26"{Dict{Symbol, Any}, Dict{Symbol, Any}}; kwargs::Base.Pairs{Symbol, Vector{SubString{String}}, Tuple{Symbol}, NamedTuple{(:args,), Tuple{Vector{SubString{String}}}}})
@ GridapPETSc ~/.julia/packages/GridapPETSc/RVmej/src/Environment.jl:38
[10] _hunt(; parts::PartitionedArrays.SequentialData{Int64, 3}, nc::Tuple{Int64, Int64}, ν::Float64, ρ::Float64, σ::Float64, B::Tuple{Float64, Float64, Float64}, f::Tuple{Float64, Float64, Float64}, L::Float64, u0::Float64, B0::Float64, nsums::Int64, vtk::Bool, title::String, path::String, debug::Bool, solver::Symbol, verbose::Bool, kmap::Int64, petsc_options::String)
@ GridapMHD ~/Prog/GridapMHD.jl/src/Hunt.jl:130
[11] #17
@ ~/Prog/GridapMHD.jl/src/Hunt.jl:19 [inlined]
[12] prun(driver::GridapMHD.var"#17#19"{String, Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol, Symbol}, NamedTuple{(:nc, :solver, :petsc_options), Tuple{Tuple{Int64, Int64}, Symbol, String}}}, String}, b::PartitionedArrays.SequentialBackend, nparts::Tuple{Int64, Int64, Int64})
@ PartitionedArrays ~/.julia/packages/PartitionedArrays/fem1y/src/Interfaces.jl:35
[13] hunt(; backend::Symbol, np::Tuple{Int64, Int64}, parts::Nothing, title::String, nruns::Int64, path::String, kwargs::Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol, Symbol}, NamedTuple{(:nc, :solver, :petsc_options), Tuple{Tuple{Int64, Int64}, Symbol, String}}})
@ GridapMHD ~/Prog/GridapMHD.jl/src/Hunt.jl:18
[14] top-level scope
@ none:1
E3
0 SNES Function norm 9.371663405638e-03
[0]PETSC ERROR: --------------------- Error Message --------------------------------------------------------------
[0]PETSC ERROR: Error in external library
[0]PETSC ERROR: Error reported by MUMPS in numerical factorization phase: INFOG(1)=-9, INFO(2)=1889946
[0]PETSC ERROR: See https://petsc.org/release/faq/ for trouble shooting.
[0]PETSC ERROR: Petsc Release Version 3.15.4, Sep 01, 2021
[0]PETSC ERROR: GridapPETSc on a named pc80120 by jprincipe Wed Jul 13 10:11:07 2022
[0]PETSC ERROR: Configure options -prefix=/opt/petsc/3.15.4 --with-cc=mpicc --with-cxx=mpicxx --with-fc=mpif90 --download-mumps --download-scalapack --download-parmetis --download-metis --download-ptscotch --with-debugging --with-x=0 --with-shared-libraries=1 --with-mpi=1 --with-64-bit-indices
[0]PETSC ERROR: #1 MatFactorNumeric_MUMPS() at /home/jprincipe/Prog/petsc-3.15.4/src/mat/impls/aij/mpi/mumps/mumps.c:1686
[0]PETSC ERROR: #2 MatLUFactorNumeric() at /home/jprincipe/Prog/petsc-3.15.4/src/mat/interface/matrix.c:3194
[0]PETSC ERROR: #3 PCSetUp_LU() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/pc/impls/factor/lu/lu.c:131
[0]PETSC ERROR: #4 PCSetUp() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/pc/interface/precon.c:1017
[0]PETSC ERROR: #5 KSPSetUp() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:406
[0]PETSC ERROR: #6 KSPSolve_Private() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:850
[0]PETSC ERROR: #7 KSPSolve() at /home/jprincipe/Prog/petsc-3.15.4/src/ksp/ksp/interface/itfunc.c:1085
[0]PETSC ERROR: #8 SNESSolve_NEWTONLS() at /home/jprincipe/Prog/petsc-3.15.4/src/snes/impls/ls/ls.c:225
[0]PETSC ERROR: #9 SNESSolve() at /home/jprincipe/Prog/petsc-3.15.4/src/snes/interface/snes.c:4653
ERROR: Petsc returned with error code: 76
Stacktrace:
[1] macro expansion
@ ~/.julia/packages/GridapPETSc/RVmej/src/Config.jl:88 [inlined]
[2] solve!(x::PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}, nls::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.AlgebraicOpFromFEOp, #unused#::Nothing)
@ GridapPETSc ~/.julia/packages/GridapPETSc/RVmej/src/PETScNonlinearSolvers.jl:185
[3] solve!(x::PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}, nls::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.AlgebraicOpFromFEOp)
@ Gridap.Algebra ~/.julia/packages/Gridap/AsRWv/src/Algebra/NonlinearSolvers.jl:22
[4] solve!(u::GridapDistributed.DistributedMultiFieldFEFunction{Vector{GridapDistributed.DistributedCellField{A, <:GridapDistributed.DistributedFEFunctionData{T}} where {A, T}}, PartitionedArrays.SequentialData{Gridap.MultiField.MultiFieldFEFunction{Gridap.MultiField.MultiFieldCellField{Gridap.CellData.ReferenceDomain}}, 3}, PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}}, solver::Gridap.FESpaces.NonlinearFESolver, feop::Gridap.FESpaces.FEOperatorFromWeakForm, cache::Nothing)
@ Gridap.FESpaces ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:163
[5] solve!
@ ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:14 [inlined]
[6] solve!(uh::GridapDistributed.DistributedMultiFieldFEFunction{Vector{GridapDistributed.DistributedCellField{A, <:GridapDistributed.DistributedFEFunctionData{T}} where {A, T}}, PartitionedArrays.SequentialData{Gridap.MultiField.MultiFieldFEFunction{Gridap.MultiField.MultiFieldCellField{Gridap.CellData.ReferenceDomain}}, 3}, PartitionedArrays.PVector{Float64, PartitionedArrays.SequentialData{Vector{Float64}, 3}, PartitionedArrays.PRange{PartitionedArrays.SequentialData{PartitionedArrays.IndexSet, 3}, PartitionedArrays.Exchanger{PartitionedArrays.SequentialData{Vector{Int32}, 3}, PartitionedArrays.SequentialData{PartitionedArrays.Table{Int32}, 3}}, Nothing}}}, solver::GridapPETSc.PETScNonlinearSolver{typeof(GridapPETSc.snes_from_options)}, op::Gridap.FESpaces.FEOperatorFromWeakForm)
@ Gridap.FESpaces ~/.julia/packages/Gridap/AsRWv/src/FESpaces/FESolvers.jl:18
[7] main(_params::Dict{Symbol, Any})
@ GridapMHD ~/Prog/GridapMHD.jl/src/Main.jl:507
[8] #22
@ ~/Prog/GridapMHD.jl/src/Hunt.jl:135 [inlined]
[9] with(f::GridapMHD.var"#22#26"{Dict{Symbol, Any}, Dict{Symbol, Any}}; kwargs::Base.Pairs{Symbol, Vector{SubString{String}}, Tuple{Symbol}, NamedTuple{(:args,), Tuple{Vector{SubString{String}}}}})
@ GridapPETSc ~/.julia/packages/GridapPETSc/RVmej/src/Environment.jl:38
[10] _hunt(; parts::PartitionedArrays.SequentialData{Int64, 3}, nc::Tuple{Int64, Int64}, ν::Float64, ρ::Float64, σ::Float64, B::Tuple{Float64, Float64, Float64}, f::Tuple{Float64, Float64, Float64}, L::Float64, u0::Float64, B0::Float64, nsums::Int64, vtk::Bool, title::String, path::String, debug::Bool, solver::Symbol, verbose::Bool, kmap::Int64, petsc_options::String)
@ GridapMHD ~/Prog/GridapMHD.jl/src/Hunt.jl:130
[11] #17
@ ~/Prog/GridapMHD.jl/src/Hunt.jl:19 [inlined]
[12] prun(driver::GridapMHD.var"#17#19"{String, Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol, Symbol}, NamedTuple{(:nc, :solver, :petsc_options), Tuple{Tuple{Int64, Int64}, Symbol, String}}}, String}, b::PartitionedArrays.SequentialBackend, nparts::Tuple{Int64, Int64, Int64})
@ PartitionedArrays ~/.julia/packages/PartitionedArrays/fem1y/src/Interfaces.jl:35
[13] hunt(; backend::Symbol, np::Tuple{Int64, Int64}, parts::Nothing, title::String, nruns::Int64, path::String, kwargs::Base.Pairs{Symbol, Any, Tuple{Symbol, Symbol, Symbol}, NamedTuple{(:nc, :solver, :petsc_options), Tuple{Tuple{Int64, Int64}, Symbol, String}}})
@ GridapMHD ~/Prog/GridapMHD.jl/src/Hunt.jl:18
[14] top-level scope
@ none:1