MPT ERROR: Rank 0(g:0) is aborting with error code 1734831948.
	Process ID: 36529, Host: r2i3n31, Program: /glade/scratch/lsapucci/mpas_tutorial/MPAS-Model/atmosphere_model
	MPT Version: HPE MPT 2.25  08/14/21 03:05:20

MPT: --------stack traceback-------
MPT: Attaching to program: /proc/36529/exe, process 36529
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/lib64/libm.so.6
MPT: Try: zypper install -C "debuginfo(build-id)=cc12cf31ea4a157ebc7ac7bdfc09d5bfa3e0f3e0"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/lib64/libm.so.6)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/lib64/libdl.so.2
MPT: Try: zypper install -C "debuginfo(build-id)=86536433e7d5a205deca926f6f00436b2ff206b1"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/lib64/libdl.so.2)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/lib64/librt.so.1
MPT: Try: zypper install -C "debuginfo(build-id)=e12cd7e73c31cb8765cba03a3c2f9efc2d043ff8"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/lib64/librt.so.1)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/lib64/libpthread.so.0
MPT: Try: zypper install -C "debuginfo(build-id)=9fa703da2a52d78cc49877c18843db7b1ad9049b"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/lib64/libpthread.so.0)
MPT: [Thread debugging using libthread_db enabled]
MPT: Using host libthread_db library "/glade/u/apps/ch/os/lib64/libthread_db.so.1".
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/lib64/libc.so.6
MPT: Try: zypper install -C "debuginfo(build-id)=72aaaa4006e91624304a210a7f945b61d3d643b4"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/lib64/libc.so.6)
MPT: 
MPT: warning: the debug information found in "/usr/lib/debug//lib64/ld-2.22.so.debug" does not match "/lib64/ld-linux-x86-64.so.2" (CRC mismatch).
MPT: 
MPT: 
MPT: warning: the debug information found in "/usr/lib/debug//lib64/ld-2.22.so.debug" does not match "/lib64/ld-linux-x86-64.so.2" (CRC mismatch).
MPT: 
MPT: (No debugging symbols found in /lib64/ld-linux-x86-64.so.2)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/usr/lib64/libibverbs.so.1
MPT: Try: zypper install -C "debuginfo(build-id)=ad6d98e9e3042e77c051f1f27e971460bf1e428b"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/usr/lib64/libibverbs.so.1)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/usr/lib64/libnl-route-3.so.200
MPT: Try: zypper install -C "debuginfo(build-id)=4c08f43bb18e99a7df4bad5c4a52bac67ddf9b8d"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/usr/lib64/libnl-route-3.so.200)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/usr/lib64/libnl-3.so.200
MPT: Try: zypper install -C "debuginfo(build-id)=3ae04b58bd81ea7745dba789d89937e719309568"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/usr/lib64/libnl-3.so.200)
MPT: Missing separate debuginfo for /glade/u/apps/ch/os/usr/lib64/libmlx5.so.1
MPT: Try: zypper install -C "debuginfo(build-id)=ba8002518966160a27c335e04ce8932989f69056"
MPT: (No debugging symbols found in /glade/u/apps/ch/os/usr/lib64/libmlx5.so.1)
MPT: 0x00002b96bb4567da in waitpid ()
MPT:    from /glade/u/apps/ch/os/lib64/libpthread.so.0
MPT: Missing separate debuginfos, use: zypper install glibc-debuginfo-2.22-100.27.3.x86_64
MPT: (gdb) #0  0x00002b96bb4567da in waitpid ()
MPT:    from /glade/u/apps/ch/os/lib64/libpthread.so.0
MPT: #1  0x00002b96bb79bc66 in mpi_sgi_system (
MPT: #2  MPI_SGI_stacktraceback (
MPT:     header=header@entry=0x7ffc8948efa0 "MPT ERROR: Rank 0(g:0) is aborting with error code 1734831948.\n\tProcess ID: 36529, Host: r2i3n31, Program: /glade/scratch/lsapucci/mpas_tutorial/MPAS-Model/atmosphere_model\n\tMPT Version: HPE MPT 2.25 "...) at sig.c:340
MPT: #3  0x00002b96bb6ccc49 in print_traceback (ecode=1734831948) at abort.c:255
MPT: #4  0x00002b96bb6ccf2a in PMPI_Abort (comm=<optimized out>, 
MPT:     errorcode=1734831948) at abort.c:70
MPT: #5  0x00002b96bb6cd267 in pmpi_abort__ ()
MPT:    from /glade/u/apps/ch/opt/mpt/2.25/lib/libmpi.so
MPT: #6  0x000000000085e7bf in __mpas_log_MOD_mpas_log_write ()
MPT: #7  0x00000000007e19d8 in __mpas_block_decomp_MOD_mpas_block_decomp_cells_for_proc ()
MPT: #8  0x000000000081e093 in __mpas_bootstrapping_MOD_mpas_bootstrap_framework_phase1 ()
MPT: #9  0x00000000004064c4 in __mpas_subdriver_MOD_mpas_init ()
MPT: #10 0x00000000004050a1 in main ()
MPT: (gdb) A debugging session is active.
MPT: 
MPT: 	Inferior 1 [process 36529] will be detached.
MPT: 
MPT: Quit anyway? (y or n) [answered Y; input not from terminal]
MPT: Detaching from program: /proc/36529/exe, process 36529
MPT: [Inferior 1 (process 36529) detached]

MPT: -----stack traceback ends-----
MPT ERROR: MPI_COMM_WORLD rank 0 has terminated without calling MPI_Finalize()
	aborting job
/var/spool/pbs/mom_priv/jobs/3410126.chadmin1.ib0.cheyenne.ucar.edu.SC: line 28: 36519 Killed                  mpiexec_mpt ./atmosphere_model