Error running xsmooth_sem

[aakash10gupta]

Description

xsmooth_sem only runs for NPROC = 4 while it fails for other values of NPROC. Files attached below are for the case of NPROC = 8. Failure was also seen with NPROC = 48, but those files are not provided here. When running all of these mentioned test cases with xsmooth_sem_pde instead of xsmooth_sem, the smoothing processes ran fine.

Files to reproduce the error using the steps mentioned below -
smoothing.zip

Affected SPECFEM3D version

d1653cd (the bug probably occurred much prior to this commit)

Your software and hardware environment

HPC cluster - chinook04 (UAF)
icc (ICC) 2021.9.0 20230302
ifort (IFORT) 2021.9.0 20230302

Reproduction steps

1. Clone latest specfem devel branch [d1653cd] and compile using make all.
2. Also compile create_adjsrc_traveltime.f90 by running make in its respective folder, and move the thus created xcreate_adjsrc_traveltime to the bin folder.
3. In a clean new working directory unzip the contents of the above attached zipped folder.
4. Also copy the specfem bin folder containing the compiled binary executable files into the working directory.
5. Run the kernels.bash script on a slurm managed cluster or otherwise.
6. After the kernels.bash script has completely run, in the OUTPUT_FILES folder check the smoothing log files (sample log files are attached below). The vtk files for the kernels are generated but the vtk file for the smoothed beta_kernel is not.

Logs

output_smooth_sem.txt - specfem log file for xsmooth_sem
output_smooth_kernels.txt - standard output (stdout)

OS

Rocky Linux 8.10 (Green Obsidian)