EAMxx: refactor machine_specs.py file #3069

bartgol · 2024-10-28T18:23:02Z

The new format makes machines derived classes from a Machine class type, where mach properties are (static) members of the class rather than free functions. There are still a couple free fcns, since they are more general, or it was not worth to spend time refactor them.

This makes adding new items to a machine easier: one only needs to add a default for the base class, and then add the peculiar config to the specific machine obj. No need to change all the entries in the dict.

jgfouca

This looks a lot better!

E3SM-Bot · 2024-10-28T18:45:46Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6238
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`e83d47d`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5978
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`e83d47d`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: bartgol

E3SM-Bot · 2024-10-28T18:56:26Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6238
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`e83d47d`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5978
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`e83d47d`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

SCREAM_PullRequest_Autotester_Weaver # 6238 FAILED (click to see last 100 lines of console output)


+++ export __LMOD_REF_COUNT_CMAKE_PREFIX_PATH
+++ CMAKE_PREFIX_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe
+++ export CMAKE_PREFIX_PATH
+++ __LMOD_REF_COUNT_LD_LIBRARY_PATH='/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib:1;/opt/lsf/10.1/linux3.10-glibc2.17-ppc64le/lib:1'
+++ export __LMOD_REF_COUNT_LD_LIBRARY_PATH
+++ LD_LIBRARY_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib:/opt/lsf/10.1/linux3.10-glibc2.17-ppc64le/lib
+++ export LD_LIBRARY_PATH
+++ __LMOD_REF_COUNT_LIBRARY_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib:1
+++ export __LMOD_REF_COUNT_LIBRARY_PATH
+++ LIBRARY_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib
+++ export LIBRARY_PATH
+++ LOADEDMODULES=python/3.10.8
+++ export LOADEDMODULES
+++ __LMOD_REF_COUNT_MANPATH='/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/share/man:1;/opt/lsf/10.1/man:1'
+++ export __LMOD_REF_COUNT_MANPATH
+++ MANPATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/share/man:/opt/lsf/10.1/man::
+++ export MANPATH
+++ __LMOD_REF_COUNT_MODULEPATH='/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/compilers:1;/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/utilities/linux-rhel8-ppc64le/Core:1'
+++ export __LMOD_REF_COUNT_MODULEPATH
+++ MODULEPATH=/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/compilers:/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/utilities/linux-rhel8-ppc64le/Core
+++ export MODULEPATH
+++ __LMOD_REF_COUNT_PATH='/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/bin:1;/opt/lsf/10.1/linux3.10-glibc2.17-ppc64le/etc:1;/opt/lsf/10.1/linux3.10-glibc2.17-ppc64le/bin:1;/usr/local/bin:1;/usr/bin:1;/usr/local/sbin:1;/usr/sbin:1;/home/e3sm-jenkins/.local/bin:1;/home/e3sm-jenkins/bin:1'
+++ export __LMOD_REF_COUNT_PATH
+++ PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/bin:/opt/lsf/10.1/linux3.10-glibc2.17-ppc64le/etc:/opt/lsf/10.1/linux3.10-glibc2.17-ppc64le/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/e3sm-jenkins/.local/bin:/home/e3sm-jenkins/bin
+++ export PATH
+++ __LMOD_REF_COUNT_PKG_CONFIG_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib/pkgconfig:1
+++ export __LMOD_REF_COUNT_PKG_CONFIG_PATH
+++ PKG_CONFIG_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib/pkgconfig
+++ export PKG_CONFIG_PATH
+++ PYTHON_BIN=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/bin
+++ export PYTHON_BIN
+++ PYTHON_INC=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/include
+++ export PYTHON_INC
+++ PYTHON_LIB=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib
+++ export PYTHON_LIB
+++ PYTHON_ROOT=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe
+++ export PYTHON_ROOT
+++ PYTHON_VERSION=3.10.8
+++ export PYTHON_VERSION
+++ _LMFILES_=/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/utilities/linux-rhel8-ppc64le/Core/python/3.10.8.lua
+++ export _LMFILES_
+++ _ModuleTable001_=X01vZHVsZVRhYmxlXyA9IHsKTVR2ZXJzaW9uID0gMywKY19yZWJ1aWxkVGltZSA9IGZhbHNlLApjX3Nob3J0VGltZSA9IGZhbHNlLApkZXB0aFQgPSB7fSwKZmFtaWx5ID0ge30sCm1UID0gewpweXRob24gPSB7CmZuID0gIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC91dGlsaXRpZXMvbGludXgtcmhlbDgtcHBjNjRsZS9Db3JlL3B5dGhvbi8zLjEwLjgubHVhIiwKZnVsbE5hbWUgPSAicHl0aG9uLzMuMTAuOCIsCmxvYWRPcmRlciA9IDEsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAicHl0aG9uLzMuMTAuOCIsCndWID0gIjAwMDAwMDAwMy4wMDAwMDAwMTAuMDAwMDAwMDA4Lip6
+++ export _ModuleTable001_
+++ _ModuleTable002_=ZmluYWwiLAp9LAp9LAptcGF0aEEgPSB7CiIvcHJvamVjdHMvcHBjNjRsZS1wd3I5LXJoZWw4L21vZHVsZWZpbGVzL2xtb2QvY29tcGlsZXJzIiwgIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC91dGlsaXRpZXMvbGludXgtcmhlbDgtcHBjNjRsZS9Db3JlIiwKfSwKc3lzdGVtQmFzZU1QQVRIID0gIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC9jb21waWxlcnM6L3Byb2plY3RzL3BwYzY0bGUtcHdyOS1yaGVsOC9tb2R1bGVmaWxlcy9sbW9kL3V0aWxpdGllcy9saW51eC1yaGVsOC1wcGM2NGxlL0NvcmUiLAp9Cg==
+++ export _ModuleTable002_
+++ _ModuleTable_Sz_=2
+++ export _ModuleTable_Sz_
++ SCREAM_MACHINE=weaver
+ [[ 0 == 1 ]]
+ [[ 0 == 1 ]]
+ [[ 0 == 1 ]]
++ whoami
+ [[ e3sm-jenkins == \e\3\s\m\-\j\e\n\k\i\n\s ]]
+ git config --local user.email jenkins@ignore.com
+ git config --local user.name 'Jenkins Jenkins'
+ declare -i fails=0
+ BASELINES_DIR=AUTO
+ TAS_ARGS='--baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m $machine'
+ [[ weaver == \p\m\-\g\p\u ]]
+ set +e
+ '[' -n 3069 ']'
+ is_at_run=1
+ SA_FAILURES_DETAILS=
+ '[' 1 -eq 1 ']'
++ ./scripts/gather-all-data './scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m $machine' -l -m weaver
Traceback (most recent call last):
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6238/scream/components/eamxx/./scripts/gather-all-data", line 31, in 
    from machines_specs import get_all_supported_machines
ImportError: cannot import name 'get_all_supported_machines' from 'machines_specs' (/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6238/scream/components/eamxx/scripts/machines_specs.py)
+ this_output=
+ [[ 1 != 0 ]]
+ fails=0+1
+ sa_fail=1
+ [[ 1 == 1 ]]
++ echo ''
++ grep -m1 -A 100000 'Build type '
+ errors=
+ SA_FAILURES_DETAILS+=
+ [[ 1 == 0 ]]
+ [[ weaver == \m\a\p\p\y ]]
+ set +x
######################################################
FAILS DETECTED:
  SCREAM STANDALONE TESTING FAILED!
######################################################

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins6591627154387378612.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

SCREAM_PullRequest_Autotester_Mappy # 5978 FAILED (click to see last 100 lines of console output)


+ [[ 1 != 0 ]]
+ fails=0+1
+ sa_fail=1
+ [[ 1 == 1 ]]
++ echo ''
++ grep -m1 -A 100000 'Build type '
+ errors=
+ SA_FAILURES_DETAILS+=
+ [[ 1 == 0 ]]
+ [[ mappy == \m\a\p\p\y ]]
+ [[ 1 == 1 ]]
+ ./scripts/scripts-tests -f -m mappy
Traceback (most recent call last):
  File "/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5978/scream/components/eamxx/./scripts/scripts-tests", line 17, in 
    from machines_specs import is_machine_supported, is_cuda_machine
ImportError: cannot import name 'is_cuda_machine' from 'machines_specs' (/home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5978/scream/components/eamxx/scripts/machines_specs.py)
+ [[ 1 != 0 ]]
+ fails=1+1
+ scripts_fail=1
+ ./scripts/cime-nml-tests
test_append (__main__.TestBuildnml)
Test that var+=value syntax behaves as expected ... ok
test_atmchanges_are_lost_with_hack_xml (__main__.TestBuildnml)
Test that atmchanges are lost if SCREAM_HACK_XML=TRUE ... ok
test_atmchanges_are_preserved (__main__.TestBuildnml)
Test that atmchanges are not lost when eamxx setup is called ... ok
test_atmchanges_are_preserved_testmod (__main__.TestBuildnml)
Test that atmchanges via testmod are preserved ... ok
test_atmchanges_for_atm_procs_add (__main__.TestBuildnml)
Test atmchanges that add atm procs ... ok
test_atmchanges_for_atm_procs_add_group (__main__.TestBuildnml)
Test atmchanges that add atm proc groups ... ok
test_atmchanges_for_atm_procs_add_invalid (__main__.TestBuildnml)
Test atmchanges that add atm procs ... ok
test_atmchanges_for_atm_procs_remove (__main__.TestBuildnml)
Test atmchanges that remove atm procs ... ok
test_atmchanges_on_all_matches (__main__.TestBuildnml)
Test that atmchange works with ANY ... ok
test_atmchanges_on_all_matches_plus_spec (__main__.TestBuildnml)
Test atmchange with ANY followed by an atmchange of one of them ... ok
test_atmchanges_on_arrays (__main__.TestBuildnml)
Test that atmchange works for array data ... ok
test_atmchanges_with_namespace (__main__.TestBuildnml)
Test that atmchange works when using 'namespace' syntax foo::bar ... ok
test_buffer_unchanged_with_bad_change_syntax (__main__.TestBuildnml)
Test atmchange does not change buffer if syntax was wrong ... ok
test_doctests (__main__.TestBuildnml)
Run doctests for all eamxx/cime_config python files and nml-related files in scripts ... ok
test_invalid_xml_option (__main__.TestBuildnml)
Test atmchange errors out with invalid param names ... ok
test_nml_defaults_append (__main__.TestBuildnml)
Test that the append attribute for array-type params in namelist defaults works as expected ... ok
test_pylint (__main__.TestBuildnml)
Run pylint on all eamxx/cime_config python files and nml-related files in scripts ... ok
test_reset_atmchanges_are_lost (__main__.TestBuildnml)
Test that atmchanges are lost when resetting ... ok
test_xmlchange_propagates_to_atmconfig (__main__.TestBuildnml)
Test that xmlchanges impact atm config files ... ok

Ran 19 tests in 234.341s
OK


[[ 0 != 0 ]]


[[ -z '' ]]


[[ 1 == 1 ]]


[[ 0 == 1 ]]


[[ 0 == 1 ]]


echo 'SCREAM v1 tests were skipped, since the Github label '''AT: Skip v1 Testing''' was found.\n'

SCREAM v1 tests were skipped, since the Github label 'AT: Skip v1 Testing' was found.\n


set +x

######################################################

FAILS DETECTED:

SCREAM STANDALONE TESTING FAILED!
SCREAM SCRIPTS TESTING FAILED!

######################################################

Build step 'Execute shell' marked build as failure

$ ssh-agent -k

unset SSH_AUTH_SOCK;

unset SSH_AGENT_PID;

echo Agent pid 2771224 killed;

[ssh-agent] Stopped.

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le


cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs
squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel
[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins12529794982979751705.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

E3SM-Bot · 2024-10-28T20:44:09Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6239
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`c986aa1`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5979
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`c986aa1`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: bartgol

E3SM-Bot · 2024-10-28T20:56:17Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6239
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`c986aa1`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5979
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`c986aa1`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

SCREAM_PullRequest_Autotester_Weaver # 6239 FAILED (click to see last 100 lines of console output)


+++ PKG_CONFIG_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib/pkgconfig
+++ export PKG_CONFIG_PATH
+++ PYTHON_BIN=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/bin
+++ export PYTHON_BIN
+++ PYTHON_INC=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/include
+++ export PYTHON_INC
+++ PYTHON_LIB=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib
+++ export PYTHON_LIB
+++ PYTHON_ROOT=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe
+++ export PYTHON_ROOT
+++ PYTHON_VERSION=3.10.8
+++ export PYTHON_VERSION
+++ _LMFILES_=/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/utilities/linux-rhel8-ppc64le/Core/python/3.10.8.lua
+++ export _LMFILES_
+++ _ModuleTable001_=X01vZHVsZVRhYmxlXyA9IHsKTVR2ZXJzaW9uID0gMywKY19yZWJ1aWxkVGltZSA9IGZhbHNlLApjX3Nob3J0VGltZSA9IGZhbHNlLApkZXB0aFQgPSB7fSwKZmFtaWx5ID0ge30sCm1UID0gewpweXRob24gPSB7CmZuID0gIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC91dGlsaXRpZXMvbGludXgtcmhlbDgtcHBjNjRsZS9Db3JlL3B5dGhvbi8zLjEwLjgubHVhIiwKZnVsbE5hbWUgPSAicHl0aG9uLzMuMTAuOCIsCmxvYWRPcmRlciA9IDEsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAicHl0aG9uLzMuMTAuOCIsCndWID0gIjAwMDAwMDAwMy4wMDAwMDAwMTAuMDAwMDAwMDA4Lip6
+++ export _ModuleTable001_
+++ _ModuleTable002_=ZmluYWwiLAp9LAp9LAptcGF0aEEgPSB7CiIvcHJvamVjdHMvcHBjNjRsZS1wd3I5LXJoZWw4L21vZHVsZWZpbGVzL2xtb2QvY29tcGlsZXJzIiwgIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC91dGlsaXRpZXMvbGludXgtcmhlbDgtcHBjNjRsZS9Db3JlIiwKfSwKc3lzdGVtQmFzZU1QQVRIID0gIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC9jb21waWxlcnM6L3Byb2plY3RzL3BwYzY0bGUtcHdyOS1yaGVsOC9tb2R1bGVmaWxlcy9sbW9kL3V0aWxpdGllcy9saW51eC1yaGVsOC1wcGM2NGxlL0NvcmUiLAp9Cg==
+++ export _ModuleTable002_
+++ _ModuleTable_Sz_=2
+++ export _ModuleTable_Sz_
++ SCREAM_MACHINE=weaver
+ [[ 0 == 1 ]]
+ [[ 0 == 1 ]]
+ [[ 0 == 1 ]]
++ whoami
+ [[ e3sm-jenkins == \e\3\s\m\-\j\e\n\k\i\n\s ]]
+ git config --local user.email jenkins@ignore.com
+ git config --local user.name 'Jenkins Jenkins'
+ declare -i fails=0
+ BASELINES_DIR=AUTO
+ TAS_ARGS='--baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m $machine'
+ [[ weaver == \p\m\-\g\p\u ]]
+ set +e
+ '[' -n 3069 ']'
+ is_at_run=1
+ SA_FAILURES_DETAILS=
+ '[' 1 -eq 1 ']'
++ ./scripts/gather-all-data './scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m $machine' -l -m weaver
***Forced exclusive execution
<>
<>
+ this_output='Job <80395> is submitted to queue .
Note: no value passed for --make-parallel-level. Using the default for this machine: 160
Note: no value passed for --ctest-parallel-level. Using the default for this machine: 4
Traceback (most recent call last):
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx/./scripts/test-all-scream", line 168, in 
    _main_func(__doc__)
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx/./scripts/test-all-scream", line 157, in _main_func
    tas = TestAllScream(**vars(parse_command_line(sys.argv, description)))
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx/scripts/test_all_scream.py", line 155, in __init__
    if self._machine.uses_gpu()():
TypeError: '\''bool'\'' object is not callable
Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx
weaver failed'
+ [[ 1 != 0 ]]
+ fails=0+1
+ sa_fail=1
+ [[ 1 == 1 ]]
++ echo 'Job <80395> is submitted to queue .
Note: no value passed for --make-parallel-level. Using the default for this machine: 160
Note: no value passed for --ctest-parallel-level. Using the default for this machine: 4
Traceback (most recent call last):
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx/./scripts/test-all-scream", line 168, in 
    _main_func(__doc__)
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx/./scripts/test-all-scream", line 157, in _main_func
    tas = TestAllScream(**vars(parse_command_line(sys.argv, description)))
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx/scripts/test_all_scream.py", line 155, in __init__
    if self._machine.uses_gpu()():
TypeError: '\''bool'\'' object is not callable
Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6239/scream/components/eamxx
weaver failed'
++ grep -m1 -A 100000 'Build type '
+ errors=
+ SA_FAILURES_DETAILS+=
+ [[ 1 == 0 ]]
+ [[ weaver == \m\a\p\p\y ]]
+ set +x
######################################################
FAILS DETECTED:
  SCREAM STANDALONE TESTING FAILED!
######################################################

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins3801776894301804424.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

SCREAM_PullRequest_Autotester_Mappy # 5979 FAILED (click to see last 100 lines of console output)


COMMAND: python3 -m pylint --disable C --disable R utils.py
FROM_DIR: /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5979/scream/components/eamxx/scripts
SHOULD HAVE WORKED
OUTPUT: ************* Module utils
utils.py:7:0: W0611: Unused stat imported as statlib (unused-import)

Your code has been rated at 9.94/10 (previous run: 10.00/10, -0.06)

ERRPUT:

Ran 33 tests in 40.360s
FAILED (failures=12, skipped=5)

Warning: repo is not clean: M foo

[[ 1 != 0 ]]
fails=1+1
scripts_fail=1
./scripts/cime-nml-tests

test_append (main.TestBuildnml)

Test that var+=value syntax behaves as expected ... ok

test_atmchanges_are_lost_with_hack_xml (main.TestBuildnml)

Test that atmchanges are lost if SCREAM_HACK_XML=TRUE ... ok

test_atmchanges_are_preserved (main.TestBuildnml)

Test that atmchanges are not lost when eamxx setup is called ... ok

test_atmchanges_are_preserved_testmod (main.TestBuildnml)

Test that atmchanges via testmod are preserved ... ok

test_atmchanges_for_atm_procs_add (main.TestBuildnml)

Test atmchanges that add atm procs ... ok

test_atmchanges_for_atm_procs_add_group (main.TestBuildnml)

Test atmchanges that add atm proc groups ... ok

test_atmchanges_for_atm_procs_add_invalid (main.TestBuildnml)

Test atmchanges that add atm procs ... ok

test_atmchanges_for_atm_procs_remove (main.TestBuildnml)

Test atmchanges that remove atm procs ... ok

test_atmchanges_on_all_matches (main.TestBuildnml)

Test that atmchange works with ANY ... ok

test_atmchanges_on_all_matches_plus_spec (main.TestBuildnml)

Test atmchange with ANY followed by an atmchange of one of them ... ok

test_atmchanges_on_arrays (main.TestBuildnml)

Test that atmchange works for array data ... ok

test_atmchanges_with_namespace (main.TestBuildnml)

Test that atmchange works when using 'namespace' syntax foo::bar ... ok

test_buffer_unchanged_with_bad_change_syntax (main.TestBuildnml)

Test atmchange does not change buffer if syntax was wrong ... ok

test_doctests (main.TestBuildnml)

Run doctests for all eamxx/cime_config python files and nml-related files in scripts ... ok

test_invalid_xml_option (main.TestBuildnml)

Test atmchange errors out with invalid param names ... ok

test_nml_defaults_append (main.TestBuildnml)

Test that the append attribute for array-type params in namelist defaults works as expected ... ok

test_pylint (main.TestBuildnml)

Run pylint on all eamxx/cime_config python files and nml-related files in scripts ... ok

test_reset_atmchanges_are_lost (main.TestBuildnml)

Test that atmchanges are lost when resetting ... ok

test_xmlchange_propagates_to_atmconfig (main.TestBuildnml)

Test that xmlchanges impact atm config files ... ok


Ran 19 tests in 232.639s
OK


[[ 0 != 0 ]]


[[ -z '' ]]


[[ 1 == 1 ]]


[[ 0 == 1 ]]


[[ 0 == 1 ]]


echo 'SCREAM v1 tests were skipped, since the Github label '''AT: Skip v1 Testing''' was found.\n'

SCREAM v1 tests were skipped, since the Github label 'AT: Skip v1 Testing' was found.\n


set +x

######################################################

FAILS DETECTED:

SCREAM STANDALONE TESTING FAILED!
SCREAM SCRIPTS TESTING FAILED!

######################################################

Build step 'Execute shell' marked build as failure

$ ssh-agent -k

unset SSH_AUTH_SOCK;

unset SSH_AGENT_PID;

echo Agent pid 645385 killed;

[ssh-agent] Stopped.

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le


cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs
squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel
[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins14883949836942929222.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

E3SM-Bot · 2024-10-28T21:13:09Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6240
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`577bfd4`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5980
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`577bfd4`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: bartgol

E3SM-Bot · 2024-10-28T21:25:52Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: 1 or more Jobs FAILED

Note: Testing will normally be attempted again in approx. 2 Hrs. If a change to the PR source branch occurs, the testing will be attempted again on next available autotester run.

Pull Request Auto Testing has FAILED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6240
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`577bfd4`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5980
Status: FAILED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`577bfd4`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`65dca4e`
TEST_REPO_ALIAS	SCREAM

SCREAM_PullRequest_Autotester_Weaver # 6240 FAILED (click to see last 100 lines of console output)


+++ PKG_CONFIG_PATH=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib/pkgconfig
+++ export PKG_CONFIG_PATH
+++ PYTHON_BIN=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/bin
+++ export PYTHON_BIN
+++ PYTHON_INC=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/include
+++ export PYTHON_INC
+++ PYTHON_LIB=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe/lib
+++ export PYTHON_LIB
+++ PYTHON_ROOT=/projects/ppc64le-pwr9-rhel8/utilities/python/3.10.8/gcc/8.3.1/base/qmix2fe
+++ export PYTHON_ROOT
+++ PYTHON_VERSION=3.10.8
+++ export PYTHON_VERSION
+++ _LMFILES_=/projects/ppc64le-pwr9-rhel8/modulefiles/lmod/utilities/linux-rhel8-ppc64le/Core/python/3.10.8.lua
+++ export _LMFILES_
+++ _ModuleTable001_=X01vZHVsZVRhYmxlXyA9IHsKTVR2ZXJzaW9uID0gMywKY19yZWJ1aWxkVGltZSA9IGZhbHNlLApjX3Nob3J0VGltZSA9IGZhbHNlLApkZXB0aFQgPSB7fSwKZmFtaWx5ID0ge30sCm1UID0gewpweXRob24gPSB7CmZuID0gIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC91dGlsaXRpZXMvbGludXgtcmhlbDgtcHBjNjRsZS9Db3JlL3B5dGhvbi8zLjEwLjgubHVhIiwKZnVsbE5hbWUgPSAicHl0aG9uLzMuMTAuOCIsCmxvYWRPcmRlciA9IDEsCnByb3BUID0ge30sCnN0YWNrRGVwdGggPSAwLApzdGF0dXMgPSAiYWN0aXZlIiwKdXNlck5hbWUgPSAicHl0aG9uLzMuMTAuOCIsCndWID0gIjAwMDAwMDAwMy4wMDAwMDAwMTAuMDAwMDAwMDA4Lip6
+++ export _ModuleTable001_
+++ _ModuleTable002_=ZmluYWwiLAp9LAp9LAptcGF0aEEgPSB7CiIvcHJvamVjdHMvcHBjNjRsZS1wd3I5LXJoZWw4L21vZHVsZWZpbGVzL2xtb2QvY29tcGlsZXJzIiwgIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC91dGlsaXRpZXMvbGludXgtcmhlbDgtcHBjNjRsZS9Db3JlIiwKfSwKc3lzdGVtQmFzZU1QQVRIID0gIi9wcm9qZWN0cy9wcGM2NGxlLXB3cjktcmhlbDgvbW9kdWxlZmlsZXMvbG1vZC9jb21waWxlcnM6L3Byb2plY3RzL3BwYzY0bGUtcHdyOS1yaGVsOC9tb2R1bGVmaWxlcy9sbW9kL3V0aWxpdGllcy9saW51eC1yaGVsOC1wcGM2NGxlL0NvcmUiLAp9Cg==
+++ export _ModuleTable002_
+++ _ModuleTable_Sz_=2
+++ export _ModuleTable_Sz_
++ SCREAM_MACHINE=weaver
+ [[ 0 == 1 ]]
+ [[ 0 == 1 ]]
+ [[ 0 == 1 ]]
++ whoami
+ [[ e3sm-jenkins == \e\3\s\m\-\j\e\n\k\i\n\s ]]
+ git config --local user.email jenkins@ignore.com
+ git config --local user.name 'Jenkins Jenkins'
+ declare -i fails=0
+ BASELINES_DIR=AUTO
+ TAS_ARGS='--baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m $machine'
+ [[ weaver == \p\m\-\g\p\u ]]
+ set +e
+ '[' -n 3069 ']'
+ is_at_run=1
+ SA_FAILURES_DETAILS=
+ '[' 1 -eq 1 ']'
++ ./scripts/gather-all-data './scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m $machine' -l -m weaver
***Forced exclusive execution
<>
<>
+ this_output='Job <80397> is submitted to queue .
Note: no value passed for --make-parallel-level. Using the default for this machine: 160
Note: no value passed for --ctest-parallel-level. Using the default for this machine: 4
Traceback (most recent call last):
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx/./scripts/test-all-scream", line 168, in 
    _main_func(__doc__)
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx/./scripts/test-all-scream", line 157, in _main_func
    tas = TestAllScream(**vars(parse_command_line(sys.argv, description)))
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx/scripts/test_all_scream.py", line 155, in __init__
    if self._machine.uses_gpu()():
TypeError: '\''bool'\'' object is not callable
Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx
weaver failed'
+ [[ 1 != 0 ]]
+ fails=0+1
+ sa_fail=1
+ [[ 1 == 1 ]]
++ echo 'Job <80397> is submitted to queue .
Note: no value passed for --make-parallel-level. Using the default for this machine: 160
Note: no value passed for --ctest-parallel-level. Using the default for this machine: 4
Traceback (most recent call last):
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx/./scripts/test-all-scream", line 168, in 
    _main_func(__doc__)
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx/./scripts/test-all-scream", line 157, in _main_func
    tas = TestAllScream(**vars(parse_command_line(sys.argv, description)))
  File "/home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx/scripts/test_all_scream.py", line 155, in __init__
    if self._machine.uses_gpu()():
TypeError: '\''bool'\'' object is not callable
Starting analysis on weaver with cmd: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
RUN: cd /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx && source /etc/profile.d/modules.sh && module purge && module load cmake/3.25.1 git/2.39.1 python/3.10.8 py-netcdf4/1.5.8 gcc/11.3.0 cuda/11.8.0 openmpi netcdf-c netcdf-fortran parallel-netcdf netlib-lapack && export HDF5_USE_FILE_LOCKING=FALSE && true && bsub -I -q rhel8 -n 4 -gpu num=4 ./scripts/test-all-scream --baseline-dir AUTO $compiler -p -c EKAT_DISABLE_TPL_WARNINGS=ON -m weaver
FROM: /home/e3sm-jenkins/weaver/workspace/SCREAM_PullRequest_Autotester_Weaver/6240/scream/components/eamxx
weaver failed'
++ grep -m1 -A 100000 'Build type '
+ errors=
+ SA_FAILURES_DETAILS+=
+ [[ 1 == 0 ]]
+ [[ weaver == \m\a\p\p\y ]]
+ set +x
######################################################
FAILS DETECTED:
  SCREAM STANDALONE TESTING FAILED!
######################################################

Build step 'Execute shell' marked build as failure

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le
cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh

[SCREAM_PullRequest_Autotester_Weaver] $ /bin/bash -le /tmp/jenkins8256802785838011859.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

SCREAM_PullRequest_Autotester_Mappy # 5980 FAILED (click to see last 100 lines of console output)


COMMAND: python3 -m pylint --disable C --disable R utils.py
FROM_DIR: /home/e3sm-jenkins/jenkins-ws/workspace/SCREAM_PullRequest_Autotester_Mappy/5980/scream/components/eamxx/scripts
SHOULD HAVE WORKED
OUTPUT: ************* Module utils
utils.py:7:0: W0611: Unused stat imported as statlib (unused-import)

Your code has been rated at 9.94/10 (previous run: 9.94/10, +0.00)

ERRPUT:

Ran 33 tests in 40.408s
FAILED (failures=12, skipped=5)

Warning: repo is not clean: M foo

[[ 1 != 0 ]]
fails=1+1
scripts_fail=1
./scripts/cime-nml-tests

test_append (main.TestBuildnml)

Test that var+=value syntax behaves as expected ... ok

test_atmchanges_are_lost_with_hack_xml (main.TestBuildnml)

Test that atmchanges are lost if SCREAM_HACK_XML=TRUE ... ok

test_atmchanges_are_preserved (main.TestBuildnml)

Test that atmchanges are not lost when eamxx setup is called ... ok

test_atmchanges_are_preserved_testmod (main.TestBuildnml)

Test that atmchanges via testmod are preserved ... ok

test_atmchanges_for_atm_procs_add (main.TestBuildnml)

Test atmchanges that add atm procs ... ok

test_atmchanges_for_atm_procs_add_group (main.TestBuildnml)

Test atmchanges that add atm proc groups ... ok

test_atmchanges_for_atm_procs_add_invalid (main.TestBuildnml)

Test atmchanges that add atm procs ... ok

test_atmchanges_for_atm_procs_remove (main.TestBuildnml)

Test atmchanges that remove atm procs ... ok

test_atmchanges_on_all_matches (main.TestBuildnml)

Test that atmchange works with ANY ... ok

test_atmchanges_on_all_matches_plus_spec (main.TestBuildnml)

Test atmchange with ANY followed by an atmchange of one of them ... ok

test_atmchanges_on_arrays (main.TestBuildnml)

Test that atmchange works for array data ... ok

test_atmchanges_with_namespace (main.TestBuildnml)

Test that atmchange works when using 'namespace' syntax foo::bar ... ok

test_buffer_unchanged_with_bad_change_syntax (main.TestBuildnml)

Test atmchange does not change buffer if syntax was wrong ... ok

test_doctests (main.TestBuildnml)

Run doctests for all eamxx/cime_config python files and nml-related files in scripts ... ok

test_invalid_xml_option (main.TestBuildnml)

Test atmchange errors out with invalid param names ... ok

test_nml_defaults_append (main.TestBuildnml)

Test that the append attribute for array-type params in namelist defaults works as expected ... ok

test_pylint (main.TestBuildnml)

Run pylint on all eamxx/cime_config python files and nml-related files in scripts ... ok

test_reset_atmchanges_are_lost (main.TestBuildnml)

Test that atmchanges are lost when resetting ... ok

test_xmlchange_propagates_to_atmconfig (main.TestBuildnml)

Test that xmlchanges impact atm config files ... ok


Ran 19 tests in 232.819s
OK


[[ 0 != 0 ]]


[[ -z '' ]]


[[ 1 == 1 ]]


[[ 0 == 1 ]]


[[ 0 == 1 ]]


echo 'SCREAM v1 tests were skipped, since the Github label '''AT: Skip v1 Testing''' was found.\n'

SCREAM v1 tests were skipped, since the Github label 'AT: Skip v1 Testing' was found.\n


set +x

######################################################

FAILS DETECTED:

SCREAM STANDALONE TESTING FAILED!
SCREAM SCRIPTS TESTING FAILED!

######################################################

Build step 'Execute shell' marked build as failure

$ ssh-agent -k

unset SSH_AUTH_SOCK;

unset SSH_AGENT_PID;

echo Agent pid 959606 killed;

[ssh-agent] Stopped.

Performing Post build task...

Match found for : : True

Logical operation result is TRUE

Running script  : #!/bin/bash -le


cd $WORKSPACE/${BUILD_ID}/
./scream/components/eamxx/scripts/jenkins/jenkins_cleanup.sh
We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs
squeue -o"%.7i %u %40j" | grep e3sm-jenkins | grep test-launcher | awk '{ print $1 }' | xargs -r scancel
[SCREAM_PullRequest_Autotester_Mappy] $ /bin/bash -le /tmp/jenkins13051416721543926644.sh

POST BUILD TASK : SUCCESS

END OF POST BUILD TASK : 0

Sending e-mails to: lbertag@sandia.gov

Finished: FAILURE

* Make machines derived types of a Machine class * Add mach properties as member of class, rather than free functions

It will never be used, but is needed for scripts-tests

E3SM-Bot · 2024-10-29T18:45:40Z

Status Flag 'Pull Request AutoTester' - Testing Jenkins Projects:

Pull Request Auto Testing STARTING (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6244
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`58c8f18`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`ce3bc7f`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5984
Status: STARTED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`58c8f18`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`ce3bc7f`
TEST_REPO_ALIAS	SCREAM

Using Repos:

Repo: SCREAM (E3SM-Project/scream)

Pull Request Author: bartgol

E3SM-Bot · 2024-10-29T19:46:50Z

Status Flag 'Pull Request AutoTester' - Jenkins Testing: all Jobs PASSED

Pull Request Auto Testing has PASSED (click to expand)

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Build Num: 6244
Status: PASSED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`58c8f18`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`ce3bc7f`
TEST_REPO_ALIAS	SCREAM

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Build Num: 5984
Status: PASSED

Jenkins Parameters

Parameter Name	Value
PR_LABELS	AT: AUTOMERGE;scripts;AT: Skip v1 Testing
PULLREQUESTNUM	3069
SCREAM_SOURCE_REPO	https://github.com/E3SM-Project/scream
SCREAM_SOURCE_SHA	`58c8f18`
SCREAM_TARGET_BRANCH	master
SCREAM_TARGET_REPO	https://github.com/E3SM-Project/scream
SCREAM_TARGET_SHA	`ce3bc7f`
TEST_REPO_ALIAS	SCREAM

E3SM-Bot · 2024-10-29T19:47:07Z

Status Flag 'Pre-Merge Inspection' - - This Pull Request Requires Inspection... The code must be inspected by a member of the Team before Testing/Merging
THE LAST COMMIT TO THIS PULL REQUEST HAS NOT BEEN REVIEWED YET!

E3SM-Bot · 2024-10-29T19:47:14Z

All Jobs Finished; status = PASSED, target_sha=ce3bc7fbc2f0394c023dd116ed69ce8390eb37e0, However Inspection must be performed before merge can occur...

bartgol · 2024-10-29T20:03:02Z

I'm going to merge manually cause AT is swamped lately, and I have other PRs to follow up with.

bartgol added AT: AUTOMERGE scripts CI: skip eamxx-v1 Skip eamxx CIME testing for this PR labels Oct 28, 2024

bartgol requested a review from jgfouca October 28, 2024 18:23

bartgol self-assigned this Oct 28, 2024

jgfouca previously approved these changes Oct 28, 2024

View reviewed changes

bartgol dismissed jgfouca’s stale review via c986aa1 October 28, 2024 20:36

bartgol force-pushed the bartgol/eamxx/machine-specs-change branch from e83d47d to c986aa1 Compare October 28, 2024 20:36

bartgol added the AT: WIP label Oct 28, 2024

EAMxx: remove semi-unused util

84cfd9b

bartgol force-pushed the bartgol/eamxx/machine-specs-change branch from 577bfd4 to 2bf6f25 Compare October 29, 2024 05:46

EAMxx: refactor machine_specs.py file

d39fa2f

* Make machines derived types of a Machine class * Add mach properties as member of class, rather than free functions

bartgol force-pushed the bartgol/eamxx/machine-specs-change branch from 2bf6f25 to c99882a Compare October 29, 2024 15:26

bartgol added 2 commits October 29, 2024 10:05

EAMxx: fix scripts to use new machines specs format

2b9c627

EAMxx: fix ghci-snl mach file

0099446

bartgol force-pushed the bartgol/eamxx/machine-specs-change branch from c99882a to 0099446 Compare October 29, 2024 16:06

EAMxx: add setup file for ghci-snl-cpu for jenkins jobs

58c8f18

It will never be used, but is needed for scripts-tests

bartgol removed the AT: WIP label Oct 29, 2024

bartgol requested a review from jgfouca October 29, 2024 18:12

jgfouca approved these changes Oct 29, 2024

View reviewed changes

bartgol merged commit b3b462e into master Oct 29, 2024

bartgol deleted the bartgol/eamxx/machine-specs-change branch October 29, 2024 20:03

This was referenced Oct 30, 2024

EAMxx: fix pm machines for standalone #3071

Closed

Revert "EAMxx: refactor machine_specs.py file" #3072

Closed

EAMxx: refactor machine_specs.py file #3069

EAMxx: refactor machine_specs.py file #3069

Uh oh!

Conversation

bartgol commented Oct 28, 2024

Uh oh!

jgfouca left a comment

Choose a reason for hiding this comment

Uh oh!

E3SM-Bot commented Oct 28, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 28, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

Uh oh!

E3SM-Bot commented Oct 28, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 28, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

Uh oh!

E3SM-Bot commented Oct 28, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 28, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

We're having issues with some test-launcher job hanging forever. So let's make sure we clean all penting test-launcher jobs

Uh oh!

E3SM-Bot commented Oct 29, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Using Repos:

Uh oh!

E3SM-Bot commented Oct 29, 2024

Build Information

Test Name: SCREAM_PullRequest_Autotester_Weaver

Jenkins Parameters

Build Information

Test Name: SCREAM_PullRequest_Autotester_Mappy

Jenkins Parameters

Uh oh!