p3 runtime params reorg #3039

mahf708 · 2024-10-15T21:09:43Z

rename all p3 runtime params, add slightly better docs, reformat code, and encapsulate away the loading of runtime params

[BFB]

splitting accretion exponents into two specific ones (one for qc and for one qr) will ncessitate a non-bit-for-bit change due to order of operation in finite precision. [NBFB]

due to finitely accurate calculation, incorporating the autoconversion radius parameter at runtime necessitates a not-bit-for-bit change due to finite precision. [NBFB]

github-actions · 2024-10-15T21:10:59Z

PR Preview Action v1.4.8
🚀 Deployed preview to https://E3SM-Project.github.io/scream/pr-preview/pr-3039/
on branch `gh-pages` at 2024-10-18 15:26 UTC

E3SM-Bot · 2024-10-15T21:34:18Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6160
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`0021003`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5916
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`0021003`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: mahf708

E3SM-Bot · 2024-10-15T22:57:20Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6160
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`0021003`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5916
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`0021003`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

SCREAM_PullRequest_Autotester_Weaver # 6160 FAILED (click to see last 100 lines of console output)


Build type full_sp_debug failed at testing time. Here'''s a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here'''s a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx

weaver failed'

errors='Build type full_debug failed at testing time. Here'''s a list of failed tests:

32:p3_tests_omp1

34:p3_sk_tests_omp1

36:p3_run_and_cmp_cxx

149:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp

Build type full_sp_debug failed at testing time. Here'''s a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here'''s a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx

weaver failed'

SA_FAILURES_DETAILS+='Build type full_debug failed at testing time. Here'''s a list of failed tests:

32:p3_tests_omp1

34:p3_sk_tests_omp1

36:p3_run_and_cmp_cxx

149:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp

Build type full_sp_debug failed at testing time. Here'''s a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here'''s a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx

weaver failed'

[[ 1 == 0 ]]
[[ weaver == \m\a\p\p\y ]]
set +x

######################################################

FAILS DETECTED:

SCREAM STANDALONE TESTING FAILED!

Build type full_debug failed at testing time. Here's a list of failed tests:

32:p3_tests_omp1

34:p3_sk_tests_omp1

36:p3_run_and_cmp_cxx

149:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp

Build type full_sp_debug failed at testing time. Here's a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here's a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6160/scream/components/eamxx

weaver failed

######################################################

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins17237409294323902963.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

SCREAM_PullRequest_Autotester_Mappy # 5916 FAILED (click to see last 100 lines of console output)


112:p3_tests_omp4
113:p3_tests_omp5
114:p3_tests_omp6
115:p3_tests_omp7
116:p3_tests_omp8
117:p3_tests_omp9
118:p3_tests_omp10
119:p3_tests_omp11
120:p3_tests_omp12
121:p3_tests_omp13
122:p3_tests_omp14
123:p3_tests_omp15
124:p3_tests_omp16
141:p3_sk_tests_omp1
142:p3_sk_tests_omp2
143:p3_sk_tests_omp3
144:p3_sk_tests_omp4
145:p3_sk_tests_omp5
146:p3_sk_tests_omp6
147:p3_sk_tests_omp7
148:p3_sk_tests_omp8
149:p3_sk_tests_omp9
150:p3_sk_tests_omp10
151:p3_sk_tests_omp11
152:p3_sk_tests_omp12
153:p3_sk_tests_omp13
154:p3_sk_tests_omp14
155:p3_sk_tests_omp15
156:p3_sk_tests_omp16
Build type release failed at testing time. Here's a list of failed tests:

517:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on mappy with cmd: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5916/scream/components/eamxx && source /projects/sems/modulefiles/utils/sems-modules-init.sh && module purge && module load sems-cmake/3.27.9 sems-git/2.42.0 sems-gcc/11.4.0 sems-openmpi-no-cuda/4.1.6 sems-netcdf-c/4.9.2 sems-netcdf-cxx/4.2 sems-netcdf-fortran/4.6.1 sems-parallel-netcdf/1.12.3 sems-openblas && export GATOR_INITIAL_MB=4000MB && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy

RUN: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5916/scream/components/eamxx && source /projects/sems/modulefiles/utils/sems-modules-init.sh && module purge && module load sems-cmake/3.27.9 sems-git/2.42.0 sems-gcc/11.4.0 sems-openmpi-no-cuda/4.1.6 sems-netcdf-c/4.9.2 sems-netcdf-cxx/4.2 sems-netcdf-fortran/4.6.1 sems-parallel-netcdf/1.12.3 sems-openblas && export GATOR_INITIAL_MB=4000MB && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy

FROM: /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5916/scream/components/eamxx

mappy failed

SCREAM V1 TESTING FAILED!

Waiting for tests to finish

DIFF ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20241015_162417_lqrlrw

DIFF ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20241015_162417_lqrlrw

DIFF ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20241015_162417_lqrlrw

DIFF ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels--scream-output-preset-5.C.20241015_162417_lqrlrw

DIFF ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_p3--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_p3--scream-output-preset-5.C.20241015_162417_lqrlrw

DIFF ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_shoc--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_shoc--scream-output-preset-5.C.20241015_162417_lqrlrw

DIFF ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20241015_162417_lqrlrw

PASS ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-arm97 RUN

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-arm97.C.20241015_162417_lqrlrw

PASS ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-comble RUN

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-comble.C.20241015_162417_lqrlrw

DIFF ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-dycomsrf01 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-dycomsrf01.C.20241015_162417_lqrlrw

DIFF ERS_P16_Ln22.ne30pg2_ne30pg2.FRCE-SCREAMv1-DP.mappy_gnu (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FRCE-SCREAMv1-DP.mappy_gnu.C.20241015_162417_lqrlrw

DIFF PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20241015_162417_lqrlrw

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20241015_162417_lqrlrw

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-drydep (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-drydep.C.20241015_162417_lqrlrw

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20241015_162417_lqrlrw

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-wetscav (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-wetscav.C.20241015_162417_lqrlrw

DIFF SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20241015_162417_lqrlrw

test-scheduler took 1882.6098463535309 seconds

######################################################

Build step 'Execute shell' marked build as failure

$ ssh-agent -k

unset SSH_AUTH_SOCK;

unset SSH_AGENT_PID;

echo Agent pid 2219550 killed;

[ssh-agent] Stopped.

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs
squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel
[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins6553726697854228655.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

mahf708 · 2024-10-15T22:59:12Z

all DIFFs in #3039 (comment) are expected

bartgol

Looks good. Just a minor style comment, not a road blocker.

components/eamxx/src/physics/p3/p3_functions.hpp

E3SM-Bot · 2024-10-16T02:55:40Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6163
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`551a307`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5919
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`551a307`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: mahf708

E3SM-Bot · 2024-10-16T04:10:43Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6163
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`551a307`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5919
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	Non-B4B;p3
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`551a307`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

SCREAM_PullRequest_Autotester_Weaver # 6163 FAILED (click to see last 100 lines of console output)


Build type full_sp_debug failed at testing time. Here'''s a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here'''s a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx

weaver failed'

errors='Build type full_debug failed at testing time. Here'''s a list of failed tests:

32:p3_tests_omp1

34:p3_sk_tests_omp1

36:p3_run_and_cmp_cxx

149:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp

Build type full_sp_debug failed at testing time. Here'''s a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here'''s a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx

weaver failed'

SA_FAILURES_DETAILS+='Build type full_debug failed at testing time. Here'''s a list of failed tests:

32:p3_tests_omp1

34:p3_sk_tests_omp1

36:p3_run_and_cmp_cxx

149:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp

Build type full_sp_debug failed at testing time. Here'''s a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here'''s a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx

weaver failed'

[[ 1 == 0 ]]
[[ weaver == \m\a\p\p\y ]]
set +x

######################################################

FAILS DETECTED:

SCREAM STANDALONE TESTING FAILED!

Build type full_debug failed at testing time. Here's a list of failed tests:

32:p3_tests_omp1

34:p3_sk_tests_omp1

36:p3_run_and_cmp_cxx

149:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp

Build type full_sp_debug failed at testing time. Here's a list of failed tests:

30:p3_tests_omp1

32:p3_sk_tests_omp1

34:p3_run_and_cmp_cxx

77:p3_standalone_baseline_cmp
Build type release failed at testing time. Here's a list of failed tests:

148:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6163/scream/components/eamxx

weaver failed

######################################################

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins3982171729819593731.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

SCREAM_PullRequest_Autotester_Mappy # 5919 FAILED (click to see last 100 lines of console output)


112:p3_tests_omp4
113:p3_tests_omp5
114:p3_tests_omp6
115:p3_tests_omp7
116:p3_tests_omp8
117:p3_tests_omp9
118:p3_tests_omp10
119:p3_tests_omp11
120:p3_tests_omp12
121:p3_tests_omp13
122:p3_tests_omp14
123:p3_tests_omp15
124:p3_tests_omp16
141:p3_sk_tests_omp1
142:p3_sk_tests_omp2
143:p3_sk_tests_omp3
144:p3_sk_tests_omp4
145:p3_sk_tests_omp5
146:p3_sk_tests_omp6
147:p3_sk_tests_omp7
148:p3_sk_tests_omp8
149:p3_sk_tests_omp9
150:p3_sk_tests_omp10
151:p3_sk_tests_omp11
152:p3_sk_tests_omp12
153:p3_sk_tests_omp13
154:p3_sk_tests_omp14
155:p3_sk_tests_omp15
156:p3_sk_tests_omp16
Build type release failed at testing time. Here's a list of failed tests:

517:homme_shoc_cld_spa_p3_rrtmgp_128levels_baseline_cmp
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on mappy with cmd: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5919/scream/components/eamxx && source /projects/sems/modulefiles/utils/sems-modules-init.sh && module purge && module load sems-cmake/3.27.9 sems-git/2.42.0 sems-gcc/11.4.0 sems-openmpi-no-cuda/4.1.6 sems-netcdf-c/4.9.2 sems-netcdf-cxx/4.2 sems-netcdf-fortran/4.6.1 sems-parallel-netcdf/1.12.3 sems-openblas && export GATOR_INITIAL_MB=4000MB && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy

RUN: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5919/scream/components/eamxx && source /projects/sems/modulefiles/utils/sems-modules-init.sh && module purge && module load sems-cmake/3.27.9 sems-git/2.42.0 sems-gcc/11.4.0 sems-openmpi-no-cuda/4.1.6 sems-netcdf-c/4.9.2 sems-netcdf-cxx/4.2 sems-netcdf-fortran/4.6.1 sems-parallel-netcdf/1.12.3 sems-openblas && export GATOR_INITIAL_MB=4000MB && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy

FROM: /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5919/scream/components/eamxx

mappy failed

SCREAM V1 TESTING FAILED!

Waiting for tests to finish

DIFF ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20241015_213508_qyseiy

DIFF ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20241015_213508_qyseiy

DIFF ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20241015_213508_qyseiy

DIFF ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels--scream-output-preset-5.C.20241015_213508_qyseiy

DIFF ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_p3--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_p3--scream-output-preset-5.C.20241015_213508_qyseiy

DIFF ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_shoc--scream-output-preset-5 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_shoc--scream-output-preset-5.C.20241015_213508_qyseiy

DIFF ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20241015_213508_qyseiy

PASS ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-arm97 RUN

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-arm97.C.20241015_213508_qyseiy

PASS ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-comble RUN

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-comble.C.20241015_213508_qyseiy

DIFF ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-dycomsrf01 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-dycomsrf01.C.20241015_213508_qyseiy

DIFF ERS_P16_Ln22.ne30pg2_ne30pg2.FRCE-SCREAMv1-DP.mappy_gnu (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FRCE-SCREAMv1-DP.mappy_gnu.C.20241015_213508_qyseiy

DIFF PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20241015_213508_qyseiy

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20241015_213508_qyseiy

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-drydep (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-drydep.C.20241015_213508_qyseiy

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20241015_213508_qyseiy

DIFF SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-wetscav (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-wetscav.C.20241015_213508_qyseiy

DIFF SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase BASELINE)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20241015_213508_qyseiy

test-scheduler took 2012.6644132137299 seconds

######################################################

Build step 'Execute shell' marked build as failure

$ ssh-agent -k

unset SSH_AUTH_SOCK;

unset SSH_AGENT_PID;

echo Agent pid 3328199 killed;

[ssh-agent] Stopped.

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs
squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel
[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins7024128940306537116.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

mahf708 · 2024-10-18T15:26:16Z

@bartgol I think I'd like this merged sooner rather than later. I promise I will come back to it and clean up these two TODO items due to the BFB stuff. Can you take one more look? Thanks!

E3SM-Bot · 2024-10-18T15:59:47Z

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

E3SM-Bot · 2024-10-18T16:01:26Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6178
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`6c14dc9`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5930
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`6c14dc9`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: mahf708

E3SM-Bot · 2024-10-18T16:25:08Z

Status Flag 'Pull Request AutoTester' - Error: Jenkins Jobs - A user has pushed a change to the PR before testing completed. NEW EVENT 'committed', ID C_kwDOCEfuetoAKDM0Y2Q0Zjc2ZmVlMjhkMjU1MjYyODRhOTZlMmFkMTlkYjIwMzQxYzU... The Jenkins Jobs will be shutdown; Testing of this PR must occur again.

E3SM-Bot · 2024-10-18T16:25:35Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6178
Status: ERROR

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`6c14dc9`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5930
Status: ERROR

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`6c14dc9`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`75ef2ed`
TEST_REPO_ALIAS	SCREAM

SCREAM_PullRequest_Autotester_Weaver # 6178 ERROR (click to see last 100 lines of console output)


/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/shoc/impl/shoc_main_impl.hpp: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::shoc::Functions >::shoc_init(const Int&, const Int&, scream::shoc::Functions >::view_1d >&)::; Tag = __nv_dl_tag*, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >&), scream::shoc::Functions >::shoc_init, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const int; F2 = const int; F3 = const Kokkos::View*, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >; F4 = Kokkos::View, Kokkos::MemoryTraits<0> >]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/shoc/impl/shoc_main_impl.hpp:31:456: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
   31 |   Kokkos::parallel_for(policy, KOKKOS_LAMBDA(const MemberType& team) {
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Cuda/Kokkos_Cuda_Parallel_Team.hpp: In constructor 'Kokkos::Impl::ParallelFor, Kokkos::Cuda>::ParallelFor(const FunctorType&, const Policy&) [with FunctorType = scream::MAMWetscav::Preprocess; Properties = {Kokkos::Cuda}]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Cuda/Kokkos_Cuda_Parallel_Team.hpp:533:1: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
  533 |   ParallelFor(const FunctorType& arg_functor, const Policy& arg_policy)
      | ^ ~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/share/io/scorpio_output.cpp: In member function 'std::vector scream::AtmosphereOutput::get_var_dof_offsets(const scream::FieldLayout&)':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/share/io/scorpio_output.cpp:1131:20: warning: 'min_gid' may be used uninitialized in this function [-Wmaybe-uninitialized]
 1131 |       auto offset = (gid-min_gid)*col_size;
      |               ~~~~~^~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/share/io/scorpio_output.cpp:1088:24: note: 'min_gid' was declared here
 1088 |   AbstractGrid::gid_type min_gid;
      |                        ^~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/p3/eamxx_p3_process_interface.cpp: In member function 'virtual void scream::P3Microphysics::set_grids(std::shared_ptr)':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/p3/eamxx_p3_process_interface.cpp:57:88: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
   57 |   FieldLayout scalar3d_layout_mid { {COL,LEV}, {m_num_cols,m_num_levs} };
      |                                                                                        ^         
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::shoc::update_prognostics_implicit_f(ekat::Int, ekat::Int, ekat::Int, ekat::Int, scream::Real, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*)::; Tag = __nv_dl_tag; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = int; F2 = int; F3 = const Kokkos::View, Kokkos::MemoryTraits<1> >; F4 = const Kokkos::View, Kokkos::MemoryTraits<1> >]':
nvcc_internal_extended_lambda_implementation:462:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/mam/eamxx_mam_microphysics_process_interface.cpp: In member function 'void scream::MAMMicrophysics::set_defaults_()':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/mam/eamxx_mam_microphysics_process_interface.cpp:47:6: note: the layout of aggregates containing vectors with 4-byte alignment has changed in GCC 5
   47 | void MAMMicrophysics::set_defaults_() {
      |      ^~~~~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/KokkosExp_MDRangePolicy.hpp: In copy constructor 'Kokkos::MDRangePolicy, Kokkos::IndexType >::MDRangePolicy(const Kokkos::MDRangePolicy, Kokkos::IndexType >&)':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/KokkosExp_MDRangePolicy.hpp:153:8: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
  153 | struct MDRangePolicy : public Kokkos::Impl::PolicyTraits {
      |        ^~~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp: In function 'void Kokkos::parallel_for(const string&, const ExecPolicy&, const FunctorType&) [with ExecPolicy = Kokkos::MDRangePolicy, Kokkos::IndexType >; FunctorType = Kokkos::Impl::ViewCopy, Kokkos::MemoryTraits<0> >, Kokkos::View, Kokkos::MemoryTraits<0> >, Kokkos::LayoutRight, Kokkos::Cuda, 2, int>; Enable = void]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp:133:1: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
  133 | inline void parallel_for(const std::string& str, const ExecPolicy& policy,
      | ^~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/shoc/impl/shoc_main_impl.hpp: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::shoc::Functions >::shoc_init(const Int&, const Int&, scream::shoc::Functions >::view_1d >&)::; Tag = __nv_dl_tag*, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >&), scream::shoc::Functions >::shoc_init, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const int; F2 = const int; F3 = const Kokkos::View*, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >; F4 = Kokkos::View, Kokkos::MemoryTraits<0> >]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/shoc/impl/shoc_main_impl.hpp:31:456: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
   31 |   Kokkos::parallel_for(policy, KOKKOS_LAMBDA(const MemberType& team) {
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::Nudging::run_impl(double)::; Tag = __nv_dl_tag; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = bool; F2 = ekat::LinInterp; F3 = Kokkos::View**, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >; F4 = Kokkos::View**, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >; F5 = Kokkos::View*, Kokkos::LayoutRight, Kokkos::Device, Kokkos::MemoryTraits<0> >]':
nvcc_internal_extended_lambda_implementation:591:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp: In function 'void Kokkos::parallel_for(const string&, const ExecPolicy&, const FunctorType&) [with ExecPolicy = Kokkos::RangePolicy<>; FunctorType = scream::P3Microphysics::p3_preamble; Enable = void]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp:133:1: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
  133 | inline void parallel_for(const std::string& str, const ExecPolicy& policy,
      | ^~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_View.hpp: In lambda function:
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_View.hpp:840:32: warning: 'ws_idx_broadcast' may be used uninitialized in this function [-Wmaybe-uninitialized]
  840 |     return m_map.m_impl_handle[i0];
      |                                ^~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/src/ekat/kokkos/ekat_kokkos_utils.hpp:584:5: note: 'ws_idx_broadcast' was declared here
  584 |       int ws_idx_broadcast;
      |     ^ ~~~~~~~~~~~~~~
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp: In function 'void Kokkos::parallel_for(const string&, const ExecPolicy&, const FunctorType&) [with ExecPolicy = Kokkos::MDRangePolicy >; FunctorType = __nv_hdl_wrapper_t, void(int, int, int), const Kokkos::View, Kokkos::MemoryTraits<0> >, const double, const Kokkos::View, Kokkos::MemoryTraits<0> >, const Kokkos::View, Kokkos::MemoryTraits<0> >, const Kokkos::View, Kokkos::MemoryTraits<0> >, const double, const Kokkos::View, Kokkos::MemoryTraits<0> >, const Kokkos::View, Kokkos::MemoryTraits<0> >, const Kokkos::View, Kokkos::MemoryTraits<0> > >; Enable = void]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/externals/ekat/extern/kokkos/core/src/Kokkos_Parallel.hpp:133:1: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
  133 | inline void parallel_for(const std::string& str, const ExecPolicy& policy,
      | ^~~~~~~~~~~~
[ 64%] Linking CXX static library libspa.a
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::shoc::update_prognostics_implicit_f(ekat::Int, ekat::Int, ekat::Int, ekat::Int, scream::Real, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*, scream::Real*)::; Tag = __nv_dl_tag; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = int; F2 = int; F3 = const Kokkos::View, Kokkos::MemoryTraits<1> >; F4 = const Kokkos::View, Kokkos::MemoryTraits<1> >]':
nvcc_internal_extended_lambda_implementation:462:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
[ 64%] Built target spa
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/mam/eamxx_mam_aci_functions.hpp: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::_GLOBAL__N__fdc6d476_35_eamxx_mam_aci_process_interface_cpp_59b60e8b::store_liquid_cloud_fraction(haero::ThreadTeamPolicy, const scream::mam_coupling::DryAtmosphere&, scream::MAMAci::const_view_2d, scream::MAMAci::const_view_2d, int, int, scream::MAMAci::view_2d, scream::MAMAci::view_2d)::; Tag = __nv_dl_tag, const scream::mam_coupling::DryAtmosphere&, Kokkos::View, Kokkos::MemoryTraits<0> >, Kokkos::View, Kokkos::MemoryTraits<0> >, int, int, Kokkos::View, Kokkos::MemoryTraits<0> >, Kokkos::View, Kokkos::MemoryTraits<0> >), scream::_GLOBAL__N__fdc6d476_35_eamxx_mam_aci_process_interface_cpp_59b60e8b::store_liquid_cloud_fraction, 1>; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const int; F2 = const int; F3 = Kokkos::View, Kokkos::MemoryTraits<0> >; F4 = Kokkos::View, Kokkos::MemoryTraits<0> >; F5 = Kokkos::View, Kokkos::MemoryTraits<0> >; F6 = const Kokkos::View, Kokkos::MemoryTraits<0> >; F7 = Kokkos::View, Kokkos::MemoryTraits<0> >; F8 = const Kokkos::View, Kokkos::MemoryTraits<0> >]':
/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx/src/physics/mam/eamxx_mam_aci_functions.hpp:179:933: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
  179 |   Kokkos::parallel_for(
      |                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                     ^
[ 64%] Linking CXX static library libscream_io.a
[ 64%] Built target scream_io
[ 64%] Linking CXX static library libdiagnostics.a
[ 64%] Built target diagnostics
gmake[1]: *** [CMakeFiles/Makefile2:4876: src/physics/p3/CMakeFiles/p3_sk.dir/all] Error 2
[ 64%] Linking CXX static library libshoc_sk.a
[ 64%] Built target shoc_sk
[ 64%] Linking CXX static library libmam.a
[ 64%] Built target mam
[ 64%] Linking CXX static library libnudging.a
[ 64%] Built target nudging
[ 64%] Linking CXX static library libshoc.a
[ 64%] Built target shoc
nvcc_internal_extended_lambda_implementation: In static member function 'static void* __nv_hdl_wrapper_t::manager::do_copy(void*) [with Lambda = scream::RRTMGPRadiation::run_impl(double)::; Tag = __nv_dl_tag; OpFuncR = void; OpFuncArgs = {const Kokkos::Impl::CudaTeamMember&}; F1 = const int; F2 = const int; F3 = yakl::Array; F4 = Kokkos::View, Kokkos::MemoryTraits<0> >]':
nvcc_internal_extended_lambda_implementation:690:19: note: the layout of aggregates containing vectors with 8-byte alignment has changed in GCC 5
[ 64%] Linking CXX static library libscream_rrtmgp.a
[ 64%] Built target scream_rrtmgp
gmake: *** [Makefile:166: all] Error 2
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver

FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6178/scream/components/eamxx

weaver failed

######################################################

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins8905323947434508458.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

SCREAM_PullRequest_Autotester_Mappy # 5930 ERROR (click to see last 100 lines of console output)


[ 66%] Linking CXX static library libshoc.a
In file included from /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.cpp:2:
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.hpp: At global scope:
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.hpp:104:10: warning: 'scream::MAMSrfOnlineEmiss::srf_emiss_' has a field 'scream::MAMSrfOnlineEmiss::srf_emiss_::timeState_' whose type uses the anonymous namespace [-Wsubobject-linkage]
  104 |   struct srf_emiss_ {
      |          ^~~~~~~~~~
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.hpp:104:10: warning: 'scream::MAMSrfOnlineEmiss::srf_emiss_' has a field 'scream::MAMSrfOnlineEmiss::srf_emiss_::data_start_' whose type uses the anonymous namespace [-Wsubobject-linkage]
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.hpp:104:10: warning: 'scream::MAMSrfOnlineEmiss::srf_emiss_' has a field 'scream::MAMSrfOnlineEmiss::srf_emiss_::data_end_' whose type uses the anonymous namespace [-Wsubobject-linkage]
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.hpp:104:10: warning: 'scream::MAMSrfOnlineEmiss::srf_emiss_' has a field 'scream::MAMSrfOnlineEmiss::srf_emiss_::data_out_' whose type uses the anonymous namespace [-Wsubobject-linkage]
[ 66%] Built target shoc
In file included from /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/srf_emission.hpp:138,
                 from /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.hpp:9,
                 from /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.cpp:2:
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/srf_emission_impl.hpp: In instantiation of 'static void scream::mam_coupling::{anonymous}::srfEmissFunctions::update_srfEmiss_data_from_file(std::shared_ptr&, const scream::util::TimeStamp&, int, scream::AbstractRemapper&, scream::mam_coupling::{anonymous}::srfEmissFunctions::srfEmissInput&) [with ScalarType = double; DeviceType = Kokkos::Device]':
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/eamxx_mam_srf_and_online_emissions_process_interface.cpp:210:19:   required from here
/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx/src/physics/mam/srf_emission_impl.hpp:214:13: warning: unused variable 'ncols' [-Wunused-variable]
  214 |   const int ncols = layout.dim(COL);
      |             ^~~~~
gmake[1]: *** [CMakeFiles/Makefile2:4877: src/physics/p3/CMakeFiles/p3_sk.dir/all] Error 2
gmake[1]: *** Waiting for unfinished jobs....
[ 66%] Linking CXX static library libscream_io.a
[ 66%] Built target scream_io
[ 66%] Linking CXX static library libdiagnostics.a
[ 66%] Built target diagnostics
gmake[1]: *** [CMakeFiles/Makefile2:4842: src/physics/p3/CMakeFiles/p3.dir/all] Error 2
[ 66%] Linking CXX static library libmam.a
[ 66%] Built target mam
[ 66%] Linking CXX static library libnudging.a
[ 66%] Built target nudging
[ 66%] Linking CXX static library libscream_rrtmgp.a
[ 66%] Built target scream_rrtmgp
gmake: *** [Makefile:166: all] Error 2
Error(s) occurred during test phase

OVERALL STATUS: FAIL

Starting analysis on mappy with cmd: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx && source /projects/sems/modulefiles/utils/sems-modules-init.sh && module purge && module load sems-cmake/3.27.9 sems-git/2.42.0 sems-gcc/11.4.0 sems-openmpi-no-cuda/4.1.6 sems-netcdf-c/4.9.2 sems-netcdf-cxx/4.2 sems-netcdf-fortran/4.6.1 sems-parallel-netcdf/1.12.3 sems-openblas && export GATOR_INITIAL_MB=4000MB && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy

RUN: cd /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx && source /projects/sems/modulefiles/utils/sems-modules-init.sh && module purge && module load sems-cmake/3.27.9 sems-git/2.42.0 sems-gcc/11.4.0 sems-openmpi-no-cuda/4.1.6 sems-netcdf-c/4.9.2 sems-netcdf-cxx/4.2 sems-netcdf-fortran/4.6.1 sems-parallel-netcdf/1.12.3 sems-openblas && export GATOR_INITIAL_MB=4000MB && export OMP_PROC_BIND=spread && true &&  ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m mappy

FROM: /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5930/scream/components/eamxx

mappy failed

SCREAM V1 TESTING FAILED!

Waiting for tests to finish

FAIL ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERP_D_Lh4.ne4_ne4.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20241018_100751_2drtv3

FAIL ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERP_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-4.C.20241018_100751_2drtv3

FAIL ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_D_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-rad_frequency_2--scream-output-preset-5.C.20241018_100751_2drtv3

FAIL ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels--scream-output-preset-5 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels--scream-output-preset-5.C.20241018_100751_2drtv3

FAIL ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_p3--scream-output-preset-5 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_p3--scream-output-preset-5.C.20241018_100751_2drtv3

FAIL ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_shoc--scream-output-preset-5 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln22.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-small_kernels_shoc--scream-output-preset-5.C.20241018_100751_2drtv3

FAIL ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_Ln9.ne4_ne4.F2000-SCREAMv1-AQP1.mappy_gnu.scream-output-preset-2.C.20241018_100751_2drtv3

FAIL ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-arm97 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-arm97.C.20241018_100751_2drtv3

FAIL ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-comble (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-comble.C.20241018_100751_2drtv3

FAIL ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-dycomsrf01 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FIOP-SCREAMv1-DP.mappy_gnu.scream-dpxx-dycomsrf01.C.20241018_100751_2drtv3

FAIL ERS_P16_Ln22.ne30pg2_ne30pg2.FRCE-SCREAMv1-DP.mappy_gnu (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/ERS_P16_Ln22.ne30pg2_ne30pg2.FRCE-SCREAMv1-DP.mappy_gnu.C.20241018_100751_2drtv3

FAIL PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/PET_Ln9_P32x2.ne4pg2_ne4pg2.F2010-SCREAMv1.mappy_gnu.scream-output-preset-1.C.20241018_100751_2drtv3

FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-aci.C.20241018_100751_2drtv3

FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-drydep (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-drydep.C.20241018_100751_2drtv3

FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-optics.C.20241018_100751_2drtv3

FAIL SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-wetscav (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln5.ne4pg2_oQU480.F2010-SCREAMv1-MPASSI.mappy_gnu.scream-mam4xx-wetscav.C.20241018_100751_2drtv3

FAIL SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3 (phase MODEL_BUILD)

Case dir: /home/e3sm-jenkins/acme/scratch/SMS_D_Ln9.ne4_ne4.F2010-SCREAMv1-noAero.mappy_gnu.scream-output-preset-3.C.20241018_100751_2drtv3

test-scheduler took 760.9846796989441 seconds

######################################################

Build step 'Execute shell' marked build as failure

$ ssh-agent -k

unset SSH_AUTH_SOCK;

unset SSH_AGENT_PID;

echo Agent pid 2291981 killed;

[ssh-agent] Stopped.

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs
squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel
[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins9760716221581348498.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

bartgol · 2024-10-18T16:48:52Z

Obv, merging is contingent to testing passing. The nonbfb stuff we saw in p3_tests is not to be overlooked.

mahf708 · 2024-10-18T17:37:28Z

Obv, merging is contingent to testing passing. The nonbfb stuff we saw in p3_tests is not to be overlooked.

Yes, of course, we are relying on the automerge here (no manual merge).

I believe I manually verified all of this on pm-gpu --- the p3_tests were failing due to one of these two NBFB changes. I am fairly certain of that. If the AT returns different results, I will debug over the weekend.

mahf708 · 2024-10-18T17:38:37Z

components/eamxx/src/physics/p3/impl/p3_autoconversion_impl.hpp

+
+  Scalar CONS3;
+  // TODO: always default to second branch after BFB stuff is addressed
+  if(autoconversion_radius == sp(25.0e-6)) {


This is the only part I am so-so about. I think the == was failing without sp but I cannot remember. It took me a few hours to realize what was happening, but now I can't be so sure what it was (hopefully sp...)

^^^ @bartgol

E3SM-Bot · 2024-10-18T17:46:30Z

Status Flag 'Pull Request AutoTester' - User Requested Retest - Label AT: RETEST will be reset after testing.

E3SM-Bot · 2024-10-18T17:49:13Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6180
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`34cd4f7`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`624e53c`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5932
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`34cd4f7`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`624e53c`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: mahf708

AaronDonahue

Just had a question about formatting.

components/eamxx/src/physics/p3/p3_functions.hpp

E3SM-Bot · 2024-10-18T19:14:06Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6180
Status: PASSED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`34cd4f7`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`624e53c`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5932
Status: PASSED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	BFB;p3;AT: RETEST;AT: AUTOMERGE
PULLREQUESTNUM	3039
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`34cd4f7`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`624e53c`
TEST_REPO_ALIAS	SCREAM

E3SM-Bot · 2024-10-18T19:14:33Z

Status Flag 'Pull Request AutoTester' - AutoMerge IS ENABLED, but the Label AT: AUTOMERGE is not set. Either set Label AT: AUTOMERGE or manually merge the PR...

mahf708 · 2024-10-18T20:08:56Z

Since AT passed, I am going to merge. I will address Aaron's comment in a separate issue; @hassanbeydoun and I have upcoming P3 PRs, so there will be ample opportunity to address it.

mahf708 added 4 commits October 15, 2024 13:33

rename p3 runtime params, better docs, format code

84f59d5

split accretion exponents into two

790974e

splitting accretion exponents into two specific ones (one for qc and for one qr) will ncessitate a non-bit-for-bit change due to order of operation in finite precision. [NBFB]

incorporate autoconversion radius as a runtime param

630cf31

due to finitely accurate calculation, incorporating the autoconversion radius parameter at runtime necessitates a not-bit-for-bit change due to finite precision. [NBFB]

refactor loading runtime options from file

0021003

mahf708 added the p3 regarding p3 microphysics label Oct 15, 2024

mahf708 requested review from bartgol and AaronDonahue October 15, 2024 21:09

mahf708 added the Non-B4B Not bit for bit label Oct 15, 2024

mahf708 requested a review from hassanbeydoun October 15, 2024 21:09

bartgol previously approved these changes Oct 15, 2024

View reviewed changes

components/eamxx/src/physics/p3/p3_functions.hpp Outdated Show resolved Hide resolved

rename argin to params

551a307

mahf708 dismissed bartgol’s stale review via 551a307 October 16, 2024 01:45

mahf708 added BFB Bit for bit AT: RETEST and removed Non-B4B Not bit for bit labels Oct 18, 2024

mahf708 requested a review from bartgol October 18, 2024 15:25

restore BFB in order to merge PR

34cd4f7

mahf708 force-pushed the mahf708/p3/runtime-params branch from 6c14dc9 to 34cd4f7 Compare October 18, 2024 16:24

E3SM-Bot removed the AT: RETEST label Oct 18, 2024

mahf708 added the AT: RETEST label Oct 18, 2024

bartgol approved these changes Oct 18, 2024

View reviewed changes

mahf708 commented Oct 18, 2024

View reviewed changes

AaronDonahue reviewed Oct 18, 2024

View reviewed changes

components/eamxx/src/physics/p3/p3_functions.hpp Show resolved Hide resolved

mahf708 removed the AT: AUTOMERGE label Oct 18, 2024

E3SM-Bot removed the AT: RETEST label Oct 18, 2024

mahf708 added the AT: AUTOMERGE label Oct 18, 2024

mahf708 mentioned this pull request Oct 18, 2024

improve p3 runtime struct #3048

Closed

mahf708 merged commit 16049f2 into master Oct 18, 2024
6 checks passed

mahf708 deleted the mahf708/p3/runtime-params branch October 18, 2024 20:09

p3 runtime params reorg #3039

p3 runtime params reorg #3039

Uh oh!

Conversation

mahf708 commented Oct 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions bot commented Oct 15, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

E3SM-Bot commented Oct 15, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 15, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

Uh oh!

mahf708 commented Oct 15, 2024

Uh oh!

bartgol left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

E3SM-Bot commented Oct 16, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 16, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

Uh oh!

mahf708 commented Oct 18, 2024

Uh oh!

E3SM-Bot commented Oct 18, 2024

Uh oh!

E3SM-Bot commented Oct 18, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 18, 2024

Uh oh!

E3SM-Bot commented Oct 18, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

Uh oh!

bartgol commented Oct 18, 2024

Uh oh!

mahf708 commented Oct 18, 2024

Uh oh!

mahf708 commented Oct 15, 2024 •

edited

Loading

github-actions bot commented Oct 15, 2024 •

edited

Loading