Skip to content

2025 Software Engineering meeting notes

Ryan Knox edited this page Sep 22, 2025 · 204 revisions

September 22, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

  • CISL: Tuesday 07 October
  • NERSC: Wednesday 17 September

Upcoming meetings and events 🗓️

Integrated (or waiting)

Testing

Hold

Review

Latest issues and discussions of note

Issues


September 15, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Testing

Review

Latest issues and discussions of note

Discussions

Issues

  • Adrianna: Running simulations in which FATES adopts some CLM parameters (e.g. fff)
    • Running stomatal conductance with BTRAN calculated in a similar manner to CLM
  • Jessie: reviewed TRENDY results with NorESM-FATES with Rosie and Chetel and talking about next steps in calibration
  • Charlie: shared initial ILAMB benchmarks from TRENDY
    • HLM-FATES showing spatial biases in the tropics biomass
    • Jessie: Some of the benchmark performance biases could be related to coarser resolution compared to other models
    • Will: share this at CLM or FATES modeling meetings

Walk on topics

  • Discussing meeting coordiation with NorESM folks
    • Ryan offered to attend NorESM meetings.
    • Jessie to discuss with Rosie

September 08, 2025

Wins and Whimsy 🎉

  • Jessie is back!

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Stuck

  • L2FR and c-only Spinups: Bharat reported back that he's not seeing the results he's expecting. Anthony and Ryan working to help determine why. Possibly due to a seperate issue?
  • E3SM - TOTNBP : Greg and Ryan to have a working meeting this week. Plan is to create an issue and intergrate this if they can't come up with a fix this week since it only affects the first model-timestep after restart and does not propogate (i.e. all other timesteps are b4b).

Review

New

Latest issues and discussions of note

CLM-FATES 1-at-a-time diagram (Adrianna)


September 01, 2025

Cancelled due to Federal Holiday


August 25, 2025

Wins and Whimsy 🎉

  • Charlie: TRENDY results are being processed, seeing boreal cold bias, possibly due to low productivity Rosie was seeing
  • Ryan: Getting FTorch working and

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • E3SM All-Hands: 25-29 August
  • FATES modeling meeting: 28 August, TBD
    • Likely cancel
    • Sam Rabin to present in September. Added to the table.

Integrated

Testing

Stuck

Review

Latest issues and discussions of note

To discuss next week:

  • Rosie: Chetle has nearly finished TRENDY runs
    • Aside: Jessie starting next Monday!
    • Seed issue seems to be mostly worked out now; working on timestepping issue.
    • Charlie: NorESM TRENDY boreal region comparison to ELM-FATES TRENDY runs?
      • Rosie: NorESM is a little more productive with new calibrations. SLATOP seems very sensitive.
    • Charlie: suggest using alternate initialization to fill area: assume full canopy (fates_recruit_init_density with negative number )

August 18, 2025

Wins and Whimsy 🎉

  • Charlie: TRENDY results submitted
  • Jennifer: Alan is going to be picking up some of Jessie's previous work

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • E3SM All-Hands: 25-29 August
  • FATES modeling meeting: 28 August, TBD
    • Charlie: Share TRENDY simulation results?

Integrated

Testing

Stuck

Latest issues and discussions of note

To discuss next week:

  • CTSM team to schedule meeting to discuss next steps for CLM6 fates supported compsets
  • Rosie: NBP not hitting zero?
    • Charlie/Adrianna: try adjusting seed rain

August 11, 2025

Wins and Whimsy 🎉

  • Ryan: 500 pull requests closed!
  • Charlie: TRENDY simulations complete
  • Greg: Alternate attempt at fortran unit testing working well (so far)

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 14 August, TBD
    • Adam invite update?
    • Ryan: Reach out to Dennis about JAX?
      • Charlie: Carl Steefel on paper as well.
    • Charlie will cancel meeting

Testing

Stuck

Review

Future

  • Development of CTSM-FATES nutrients
    • Ryan: met with Sam Levis. It looks like the updates things should be straightforward, as only one demand scheme in ctsm compared to e3sm.

Latest issues and discussions of note

  • Rosie: Attempting to keep boreal forest from dying when seed rain is off
    • Should the carbon starvation scalar be smaller? Rosie running some tests.
  • Rosie: More snow with fates on than with clm. Will reach out to Adrianna about relevant parameters.
    • Charlie: potentially topographic issue given differences seen in Russian lowlands?
    • Rosie: suspicion is that snow burial is different between the two models.
  • Rosie: 2deg PPE kickoff today
  • Charlie: TRENDY results
    • "Control" case still showing low frequency variation over time. Possibly due to landuse secondarylands harvesting threshold? Charlie setting up a no logging test case.
    • Working on converting results to TRENDY format

Machine learning update (Ryan)

  • deferred

August 04, 2025

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Review

Testing

Latest issues and discussions of note

  • Ryan to get back to discussing doalb with Matvey now that he's back.
  • Adrianna: Discuss CLM compsets items at Thursday meeting
  • Adrianna: CLM vs FATES vcmax parameters discussion
    • FATES is higher than CLM, but levels off with increasing temperature
    • Rosie: Martijn Slot (NGEET) has a paper that has looked at this
  • Adrianna: Little change in GPP with fates_rad_leaf_rholvis increase?
    • Marcos: related to leaf temperature?
    • Ryan: stronger SLA response?
    • Rosie: less light getting through to the soil?
  • Rosie: FYI mini-NorESM coupled concentration PPE upcoming

Fire model update

  • deferred

July 28, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Testing

New

Latest issues and discussions of note

  • No new issues or discussions
  • Starting one-at-a-time calibration paper

Fire model update

  • Related: NGEET landuse meeting last week: Xiuyi Wu using FATES at Tanguro to engage with edge-effects code

NBP /= delta TOTECOSYSC during TRENDY spinup discussion

  • No long-term systematic trend in NBP seen during spin up
  • NPP-based NBP not matching GPP-AR based NBP very slightly different; potentially a time-stepping issue?
  • Hypothesis: model is conserving carbon, but diagnostic output is missing a term (or double counting one)
    • No obvious single candidate
  • Doesn't seem to be an area difference
  • Charlie is using Rosie's previous calibration cases
  • TL;DR hold off on integrating NBP pull requests
  • Additionally: seeing lots of CWD carbon, little soil carbon.
    • FATES is not the only model like this, but this points to nocomp calibration necessary

July 21, 2025

Wins and Whimsy 🎉

  • Ryan: apprecation for colleagues

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 31 July, TBD
    • Marcos to check in with Danyang soon.
    • Ryan and Marcos are
    • Marcos: Yixin Ma has ED2 paper pubished recently
  • CLM meeting: 22 July, Sean Swenson, spatially-explicit PFTs

Integrated

Updates

Ready for Review

Latest issues and discussions of note

  • Progress review shows that we are on track.

Fire model update

  • No new discussion outside of forest edge tracking

Walk-on topics

  • Ryan: nutrient development branch?
    • Will: concerned about divergence of branches. Notes the Sam Levis will be working on bringing FATES nutrients to CLM in the near future.

July 14, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

New

Updated

Latest issues and discussions of note

  • Deferred, no new updates. NBP is next relavent item.
  • Continent specific allometries
    • Comparison to GEDI: patchy differences
      • Using crown area weighted height as comparison metric
      • Jessie using newer product in which aggregation is already handled
      • Marcos: check to see what GEDI uses for height
        • Recommends using rh-98 as opposed to rh-95
      • Charlie: create new diagnostic output for better comparison?
        • Related: May need similar new output for TRENDY comparison
    • FATES continental to pantropical PFT comparison: subtle differences

Fire model update

  • Diagnostic edge forest PR is close to done
  • Still need to look at scientific results
  • Review request: Charlie and Marcos

Walk-on topics

  • Jessie: Spatially-explicit PFT Parameters (Adrianna's email)
    • Sean Swenson working on this using FATES
    • Goal: Much more finely resolved spatial variation
    • Implementation detail still TBD
      • Invite Sean to the FATES meeting for a presentation? Discuss in the email thread.
    • Ryan: do we want the e-factor to be temporally varying as well?
      • Related: Elyas discussion
  • Ryan: NESAP proposal with Damian Rousson (CLaSS group lead) to use fiats for FATES photosynthesis emulation

July 7, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

New

Updated

  • Deferred, no new updates. NBP is next relavent item.

Latest issues and discussions of note


June 30, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Merged Recently

New

  • Unit/functional test improvements to enable CTSM SystemTests (#1426)
    • wget downloading from drop box currently and functionality is working, but we really should install git LFS
      • ctsm uses LFS for images and testing files only
      • Charlie: put these in ctsm?
        • Adrianna: keeping tests and necessary files located with the repo is preferred. Reduces workflow update complication.
    • Our "grandfathered" plan doesn't have a free git LFS allocation. Greg to check if we can just install it or if we need to add money to the budget.
    • Ryan: maybe we could use this to hold parameter netcdf files :thinking_face
    • Plan B: load the file to a "testing" directory on the CESM input data svn repo
  • Updates to hydraulic failure mortality (#1427): imposes consistency between hydro and non-hydro run modes
    • Condenses two parameters into a new single parameter
    • Ask Chonggang or Jenny for review
    • This should accompany an update to the technical documentation
    • This shouldn't affect SP mode, but will likely affect no-comp

Updated

  • Deferred, no new updates. NBP is next relavent item.

Latest issues and discussions of note

Solar diffuse radiation in ELM and CLM

  • Adrianna: default CLM-DATM allows model to determine diffuse or direct, but for TRENDY we need to run both explicitly
    • Charlie: Does this capability exist in ELM?
      • Reach out to Xiaojuan Yang who has been doing TRENDY runs with ELM
  • Adrianna: calibration algorithm is in the works. Was written in tensorflow, but changing to scipy.
    • Issue: Want to be able to hold certain paramater values static during investigation which turns out to be very difficult to do tensorflow.

Fire model update

  • Edge forest branch up-to-date with latest fates tag
    • Purely diagnostic output currently
    • Working on unit testing
    • Sam to draft a pull request

June 23, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Testing

Updates

New

  • Parameter File Tool repo: drafted
    • Concern: decentralization will require duplication of code (testing or shared utilities) among test
    • Consensus: Don't separate out the tools into separate repositories. Condense landusedata and other fates tools into the same tool repository.

Latest issues and discussions of note

  • No new issues
  • (Charlie) Tool issue forthcoming

Fire model update

  • Edge area diagnostics added. New testing.
  • Timeline: Merge this into main branch soon?
    • Will include a feature switch
  • More updates

Walk-on Topics

  • (Ryan) Trimming code update to include more terms
    • Will not impact sp mode
  • (Adrianna) SP mode calibration simulations running
  • (Charlie) TRENDY forcing file update?
    • Adrianna: waiting a week to find issues in the file

June 16, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 3 July, Jenny Kowalczyck
  • Handover/Offboarding meeting planning
    • No comp calibration: Jessie to look at the week of June 24
    • Phenology updates: Greg and Ryan to coordinate
    • Party: Thursday June 26

Integrated

Under Review

New

  • SP mode tag freeze
    • Related: Charlie is tentatively planning on runngin TRENDY. Coordination?
      • Adrianna is running TRENDY for bigleaf. She'll share the driver data and other common scripts, etc.
        • Driver data is identical
      • Q: what resolution? 0.5 deg? Still TBD.
  • CESM3 answer changing freeze has shifted to November

Moss model integration discussion

General idea: Moss has some maximum photosynthetic rate that is reduced by multiplicative factors representing light and moisture availability. Moss layer can build up over time and contributes to fuel. We'd like to have at least two moss PFTs that have different "preferences" regarding shade. Stretch goals include (a) nitrogen limitation, (b) effects of moss on tree regeneration.

Major questions:

  • How to handle water (interception, limitation)? BTRAN doesn't really work because it's all about roots, which mosses don't have. Will check if LiBry can offer anything here.
  • How to handle fraction area coverage: Assume 100%? Treat like grass? 100% assumption complicates comparisons with observations, which are mostly just % cover (not biomass).

Followup

Hui Tang's work?

Latest issues and discussions of note

  • No major issues to discuss
  • No updates

Walk-on Topics

  • Marcos: simplifying the hydraulic mortality parameters to a single parameter
    • The formulation between fates hydro on is different from hydro off; Is this what we want?
      • Off: step function, not linear.

June 9, 2025

Wins and Whimsy 🎉

  • Acknowledging efforts of the calibration team

Machine status and notices 🖥️

  • CISL: Monday 9 June
  • NERSC: Wednesday 18 June

Upcoming meetings and events 🗓️

  • FATES modeling meeting: TBD, Jenny Kowalczyck
    • Other future talks?
      • (Ryan) Nick Smith, Trevor Keenan?
      • Jennifer to check in with Trevor about the GEE-FATES work
      • (Greg) Pierre Gentine presented differentiable land mode at GEWEX ML4LM (advertised by ILMF newlist)
      • Julian Lamour about JB implementation?
  • Marcos: More european FATES users (e.g. Ghent); should we revisit the meeting times for various meetings?
    • (Greg) Rosie's CET meeting still going?
    • (Ryan) Survey FATES users?

Testing

Stuck

Under review

New

Draft

  • No updates

Latest issues and discussions of note

  • Roundoff error too large when running land use and ne30 grid (#1417)
  • Potential bug in logging model
    • Jessie: can make PR that fixes harvest tag, but history variable isn't updating (hio_m7_si_scpf)
      • lmort_direct doesn't seemed to be passed to history correctly
      • Potentially due to LoggingMortality_frac
      • Check in with landuse folks to see if m7 is reporting non zero for expected logging
      • Jessie to make a draft PR to handle the harvest tag initialization issue. Add in fix to lmort_direct (as needed).

Walk-on Topics


June 2, 2025

Canceled


May 26, 2025

Canceled due to Holiday


May 19, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

  • CISL: Tuesday 3 June (regular)
  • NERSC: Wednesday 21 May (regular)

Upcoming meetings and events 🗓️

  • NGEE-Tropics Annual Meeting: Wed 21 May
  • FATES modeling meeting: 05 June, Jenny Kowalczyck
    • Send out cancellation notice for 22 May

Testing

  • Initializing itype as spval for fates patches (CTSM#2935): Ryan testing, next ctsm tag (ctsm5.3.045)
    • One of our sp mode tests we call the dry deposition scheme, which uses itypes, causing test failure
    • Charlie: which traits?
      • Ryan: not sure, Wesley table?
    • Rosie: NorESM has an update to directly associate dry dep pfts to fates pfts. Matvey will push that back to ctsm at some point in the future
      • Ryan: Create issue to track this and note NorESM update
  • use trim_limit as floor of trimming (#1395): Approved. In testing queue. Charlie to review one minor question.

On Hold

Stuck

  • No updates

Latest issues and discussions of note

  • deferred

Walk-on Topics


May 12, 2025

Wins and Whimsy 🎉

  • #1252 is in!
  • Rosie and Sam R were able to meet IRL last week.

Machine status and notices 🖥️

  • CISL: Tuesday 3 June (regular)
  • NERSC: Wednesday 21 May (regular)

Upcoming meetings and events 🗓️

  • NGEE-Tropics Annual Meeting: Wed 21 May
    • Changed to one day, virtual
  • FATES modeling meeting: 22 May, TBD
    • Originally slated to be cancled due to NGEET annual meeting. Reinstate?
    • Consensus: leave as canceled

Integrated

On Hold

Testing

Reviews

Prioritization and CLM6 freeze

  • On track. Three required pull requests complete.
  • Reviewed #817 with Rosie. Agreed that we can close this as this is working in NorESM and CTSM without #817.

Latest issues and discussions of note

  • Adrianna: CRUJRA versus GSWP3 comparison
    • GPP is higher with the former than the latter (was already high with GSWP3)
  • Charlie: Used Rosie's parameter file and re-ran some land use cases. C3 grasses is failing (again).
    • Charlie is ok with the c3 being overproductive giving that he's enabling grazing.
      • Rosie recalls that she was seeing overproductive c3 in tibet. She may have tweaked parameters to suppress this.
    • Charlie thinks that he'll need to iterate on this a bit.

Walk-on Topics

  • Rosie: FATES crashing with 2 deg simulations, but not 1 deg sims. Haven't run with this resolution before.
    • Matvey thought it may be related to bcleaf being zero?
      • Ryan was uncertain about this.
      • FYI, Matvey is away this week.

May 05, 2025

Wins and Whimsy 🎉

  • E3SM API 39
  • Adrianna: personally defined PFTs working in nocomp-fbg mode
    • Potential presentation at FATES modeling meeting

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 8 May, Qing Zhu
  • NGEE-Tropics Annual Meeting: 20-22 May
  • Jennifer: MRV talk tomorrow. Where to advertise?
    • Consensus is that its ok for Jennifer to advertise on the FATES modeling meeting list

Integrated

On Hold

Testing

Prioritization

  • Ryan: Phenology change priotization relative to the CLM6-FATES code freeze?
    • Marcos: The science updates should come in after the code freeze.
  • Facilitate crops in SP mode (#817)
    • Adrianna: This should work.

Latest issues and discussions of note

  • Fuel consumed not zeroed when no fire (#1400)
    • Adrianna: this will impact diagnostics, but does not actually impact the internal spitfire calculations.
      • Should be a simple PR fix, but Xiulin noted there are other spitfire variables that have similar issues. Adrianna asked for list of these to wrap into one PR fix.
  • deferred

April 28, 2025

Wins and Whimsy 🎉

  • Ryan: spending hands-on time with OLMT

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Testing

Reviews

Latest issues and discussions of note

Code freeze coordination preview discussion

  • Code freeze release date: late summer 2025
  • Currently in code "chill"
    • B4B changes and parameter file updates for calibration
  • Will to send out a meeting invite
  • Adrianna: no update
  • Jessie and Rosie are out

Walk on topics


April 21, 2025

Wins and Whimsy 🎉

  • Successful ESS-PI and ESS-CIWG meetings

ESS-PI meeting recap

  • Ryan: Debjani Seehee (sp?) biogeochemical cycling work (lack of nutrient mineralize death spirals)
    • Jennifer: her U.S. digital soil maps are great
  • Jessica: Chongang showed results of stem respiration turned on with fates
  • Greg: Root phenology breakout presentation about decoupling root and leaf phenology
  • Jennifer: seperate disturbance timescales for above and belowground?
  • Ryan: anyone talking with Ben Sulman? Maybe invite him to talk.
    • Greg: He gave a lightning version of his ELM-PFLOTRAN alquimia talk

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Testing

Reviews

New

Latest issues and discussions of note

  • Jessie: tropical run with Rosie's parameter file with continent and pft specific allometries
  • Ryan: BCI calibration using OLMT on perlmutter

Walk on topics


April 14, 2025

Canceled due to ESS-PI meeting


March 31, 2025

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Testing

Reviews

  • Prescribed Fire (#1360)
    • Ryan: is there another way that we could capture these prescribed parameters?
      • Charlie: we could put it on the landuse file or make a specific prescribed fire file
        • Consensus is that this might be a good idea as prescribed fire is site/region specific
        • Greg: this would require new/updated infrastucture. What does Xiulin's timeline look like; can she wait?
    • Marcos: combine upper/lower along a fire dimension
    • Ryan: Worthwhile to invite Xiulin speak on this? Consensus is yes. Charlie will reach out to her and Lara.

New

Latest issues and discussions of note

  • Rosie: Working on hand tuning.
  • Adrianna: currently working on other deliverables not related to global calibration

Walk on topics

  • Adrianna: slamax, slatop being the same ok?
    • Marcos: this means there will be no plasticity.
      • Charlie: Typically for grasses/shrubs
  • Rosie: SLA unit conversion sheet and paper results comparison
    • Marcos: qualitatively the numbers look correct relative to his recent TRY analysis
      • Be mindful of where in the canopy the measurement was made, which can skew results.
    • Jennifer: recommending making a synthesis table of all the SLA/LMA results that group has

March 24, 2025

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • FATES modeling meeting: TBD
    • Qing Zhu moved to later date
    • April 10 Eastern regional DVGM overlap.
    • Greg to cancel this week.

Integrated

Testing

  • restart fixes for two-stream (#1321): Ryan running final tests
    • FATES two-stream restart fixes (ctsm#2949): associated ctsm pull request
    • Running into testing issues on izumi. We troubleshot this during standup today. Issue appeared to be license server needing a restart.
    • Ryan: clean up misleading text in future PR. Make comment
    • Charlie: make two-stream the default?
      • Ryan: Conduct a performance test. Greg made an issue #136?
  • NCL max (#1315): smoke tests run, but results need review

Reviews

New

Latest issues and discussions of note

  • Error calculating carbon flux due to fire mortality (#1365): Charlie to review and respond
  • Reconcile parameter and scales driving leaf phenology and mortality (#1363)
    • TL;DR: Difference in timescales for hydro mort and enviro mort could result in deciduous pfts dying in conditions that they should be protected against
      • From an ideal, simplified case deciduous should be nearly perfectly sheilded from hydraulic failure. Not so for evergreens that can "take more risk."
    • Ryan: would it be hard to kill deciduous plants?
    • Rosie: Hydraulic disassociation from the soil?
    • Marcos: calibration results for drought deciduous pfts?
      • Rosie seeing that they are dying, but not sure about the mortality type
    • Charlie:
    • Marcos: change deciduosness and see how this fairs
    • Aside: Marcos also seeing a lot of termination mortality. Likely unrelated.
  • deferred due to time

FATES specific surface dataset discussion

  • deferred until next week (missing to many folks)

March 17, 2025

Machine status and notices 🖥️

  • CISL: none planned
  • NERSC: 26 March, perlmutter

Upcoming meetings and events 🗓️

New

Next

Updated

In-Progress

Latest issues and discussions of note

  • Rosie: no new update since Thursday modeling meeting updates. Kicking off new tests. Working on dry deposition as well.
  • Adrianna: getting ready to kick off another "one-at-a-time" calibration run using new fnps parameter
  • Jessie: Kasey (ORNL) different allometries for pfts depending on regional (i.e. continent)
    • Implementation idea: bounds on where seeds for specific pfts can not recruit. Potential ForestGEO collab.
    • Adrianna: this seems like it would benefit GPP calibration as well (seeing region balance shift of GPP for tropical evergreen trees, Asian vs Amazon)
    • Rosie: related paper: https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2024EF005225

Walk-on topics

  • Rosie: fates-specific surface dataset (to facilitate the above region specific pft discussion)
    • Charlie: move LAI data out of surface dataset and let fates use directly (similar to land use data)

March 10, 2025

Machine status and notices 🖥️

  • CISL: none planned
  • NERSC: 26 March, perlmutter

Upcoming meetings and events 🗓️

Integrated

Updated

New

Latest issues and discussions of note

XML parameter file discussion

  • Pros:
    • CIME makes use of python XML base functionality
    • FOX as existing HLM fortran
    • fortran code on fates-side that reads in parameters is complicated (since we avoid HLM IO), would simplify any necessary maintenance
    • allows us to expand the features that we could control in the parameter file (e.g. metadata) Cons:
    • netcdf provides dimensionality fail-safes that we currently "get for free"
      • we'd have to take on this functionality ourselves
    • We'd need to pull FoX into FATES to make available to all HLMs
  • Questions
    • parameter ensembles?
      • xarray allows for modification of netcdf emsembles easily
    • Would the developer's experience in add parameters be simpler (i.e. RegisterParam)
  • ED2 (via Mike Dietz) implemented XML fortran

Walk-on topic


March 3, 2025

Wins and Whimsy 🎉

  • API38 integrated and tagged (still waiting on e3sm side)

Machine status and notices 🖥️

  • CISL: none planned
  • NERSC: 26 March, perlmutter

Upcoming meetings and events 🗓️

Integrated

Updates

New

Latest issues and discussions of note

E3SM and LMWG report back

  • E3SM: focusing on V3
    • Utilizing E3SM Diags, the model diagnostics package more, in order to report performance progress of FATES. Can ask for tutorial from Jill or Xylar.
      • Includes benchmarking as well as diagnostics (includes ILAMB)
      • Related: NorESM looking at utilizing cupid.
    • Ryan: GPU push
      • E3SM is not concerned with FATES converting to C++. There currently exists multiple ways to integrate existing fortran code with C+
  • LMWG
    • FATES crop model work seen as necessary for full CLM adoption
      • Concerns about fates CPU performance cost
  • Ryan: centralized work tracking and data sharing repository?
    • Initially attempted to centralize, but diverged due to different focus.
  • Rosie: no-comp GPP with Medlyn in amazon issue discussion
    • Marcos: driest parts of the amazon seems to diverge the most

February 24, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

  • CISL: none planned
  • NERSC: 19 March, perlmutter

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 13 March, project report back
    • Greg to send out reply-all to previous notice about this weeks usual meeting being canceled
    • Marcos: suggested to move Steven's presentation to April 24 to encourage attendance (avoid scheduleing conflicts with Eastern DVGM meeting)
    • Greg to send out notice for API 38 update. Bring this up during

Integrated

Update

New

Latest issues and discussions of note

Walk-on topic


February 17, 2025

Canceled due to Federal Holiday


February 10, 2025

Wins and Whimsy 🎉

  • Adrianna has been given expanded fates repo priviledges
  • New github issue templates

Machine status and notices 🖥️

  • CISL: 11-12 February, derecho
  • NERSC: 19 February

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 13 February, TBD
    • Consensus: cancel, Greg to send out notice
    • Rosie has reached out to Tom Buckley

Integrated

Update

New

Latest issues and discussions of note

Multi-layer canopy planning

  • Ryan: stakeholders?
    • Gordon
    • Gautam
    • Adrianna and Danica: grant funded work, connect Sam L's ctsm branch to FATES. Working on site-level data collection for validation.
      • Timeline: through to 2028
      • Includes NCAR NEON stuff as well
  • goal: FATES changes to be model agnostic
  • action: Ryan and Adrianna to meet to discuss
  • Adrianna: once SP bug fixed (via escomp/ctsm#2952), will rerun calibration
    • three paper ideas based on this work
  • Rosie: new post-doc to help with FATES calibration
    • Adrianna to share calibration script location

Walk-on topic

  • Rosie: Matvey thinks that Leung dust scheme (new scheme) might have been built on top of Meier2022
    • Adrianna: Zender is the old dust scheme
      • We should check in with Erik about Leung

February 03, 2025

Wins and Whimsy 🎉

  • Land use fixes integrated

Machine status and notices 🖥️

  • UCAR HPC: izumi experiencing issues since Friday
  • CISL: 11-12 February, derecho
  • NERSC: 19 February

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 13 February, TBD
    • Rosie to reach out to Tom Buckley
    • Ryan: project coordination meeting update?
      • Jennifer suggested doing this later as a report back from the CESM-LMWG and E3SM all hands
    • Charlie will be out next week

Integrated

Update

New

Latest issues and discussions of note

  • no updates

Walk-on topic

  • Rosie: Land use tool needs to wor for unstructed grids. Rosie has someone to work on this.

Janurary 27, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

  • CISL: 11-12 February
  • NERSC: 27-31 January, Full site power down

Upcoming meetings and events 🗓️

  • FATES modeling meeting: TBD
    • FATES tool poll results
      • modify_params had highest uptake, batchpatch, consistent with Ryan's expectations
      • immediate take away: don't change anything, look
    • office hours: Greg to send out notice
  • Mingjie and Jessie wind mortality meeting this Wednesday 11.30 - others welcome

Integrated

  • Crown depth checks (#1314)
    • Marcos: should we add more alllometry checks?
      • Greg: definitely worthwhile to add more checks for user conveience.
        • One option would be to move convienence checks (i.e. not things that could crash the model) upstream to fates tooling that changes the parameter file.
    • Charlie: sapwood allometry?

Update

New

Latest issues and discussions of note

  • Jessica: ran CLM calibration parameter file in ELM. At preliminary review, it looks good.
  • Adrianna: rerunning following htop issue fix (Adrianna to make formal issue).

Walk-on topic

  • Charlie: land use spin up
    • Default decomp value in ELM is very agressive, Charlie adjusted and spin up works much better
    • Might be due to of the decomp method "scheme"
    • Default value in CLM is more reasonable relative to updated value
  • Rosie: Meier2022
    • ELM
    • Ryan: making the code more "defensive"
      • Initializing fates code with "nan"
      • Don't allocate if not used
      • Adrianna: API that doesn't allow HLM to have access to data structures
      • Greg: look for API update issue/discussion

January 20, 2025

Canceled due to Federal Holiday


January 13, 2025

Wins and Whimsy 🎉

  • CTSM temp branch merged into master
  • ctsm5.0.18 has history time being on the middle of time bounds
    • Marcos: will this be reflected in e3sm?
      • Greg will reach out to e3sm folks
  • Rosie: New FATES post-doc hire. Will be working on dwarf shrub parameterization.

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

  • FATES modeling meeting: 16 January, Annemarie Eckes-Shephard
    • Ryan to conduct informal poll on using patches.

Integrated

Update

New

Latest issues and discussions of note

Synthetic patches for functional testing update (Adrianna)

  • insert_cohort not preserving sorted order inherently - deferred
  • deferred

Walk-on topic

  • Rosie: https://github.com/ESCOMP/CTSM/issues/2932
    • Boundary conditions are different between clm6 and fates
    • Displacement height needs to be fixed, biasing SP results. Is Meier2022 the default? Check in with Adrianna.
    • Charlie: ELM using ZengWang? Rosie: yes
    • Ryan: create quick PR to make sure ZengWang is default if fates is on? Greg to address.
    • Jessie will reach out to Adrianna for latest parameter file and create a new smoke test

January 6, 2025

Wins and Whimsy 🎉

Machine status and notices 🖥️

Upcoming meetings and events 🗓️

Integrated

Update

Latest issues and discussions of note

  • FDI calculation (#1298)
    • Xuilin, NGEE-tropics phase 3 has a bunch of work planned (Lara)
    • Adrianna to bring this to the CA meeting
      • Jennifer will give Lara a heads up about discussing this at a future meeting
  • fire calculations regardless of event (#1299)
    • Adrianna: do we want to avoid calculating values when there is no fire?
      • Sam: not doing so will improve computation. Maybe improve history output.
      • Sam: some of the fire outputs were weighted by burned area, but not all outputs.
      • Rosie: you might want to know the potential effects regardless of fire active or not (are you looking "upstream" or "downstream") .
  • PVT run FAIL (CTSM#2919)

Synthetic (aka "dummy") patches for functional testing (Adrianna)

  • Adrianna developing "dummy" patches for use with funtional and unit tests
  • Idealized biomes with simplistic, well-defined values
  • Motivated by future work to conduct with Danica as well as creating unit tests for cohort sorting, patch insertion, etc.
  • no new updates due to break

Walk-on topic

  • Rosie: NorESM working on repo to keep recipes for simulations being run. Maybe preview next week.

Clone this wiki locally