Add option for CRUJRA2024 add some compsets for Clm60 for it as well as a corresponding compset for Clm5

[slevis-lmwg]

Description of changes

Change the default datm input from GSWP3v1 to CRUJRA2024 for Clm6.
Add a CRUJRA2024 compset for clm5.

See #1895 for definition of DONE.

Specific notes

Contributors other than yourself (I hope I didn't forget any):
@wwieder @adrifoster @swensosc @djk2120 @ekluzek @olyson

CTSM Issues Fixed (include github issue #):
Resolves #1895

Are answers expected to change (and if so in what way)?
No. We will make a separate answer-changing PR to address Clm6 tests that do not specify the datm input, so that they get CRUJRA2024 instead of GSWP3v1.

Any User Interface Changes (namelist or namelist defaults changes)?
Adding Crujra to compset names.
Adding 2 new tests that explicitly include Crujra in their compset names.
Clm60 tests that do not include a datm option in their compset will default to Crujra in a later PR.

Does this create a need to change or add documentation? Did you do so?
It does, and I did not, yet.

Testing performed, if any:
See relevant posts below.

[slevis-lmwg]

First attempt at testing:
./create_test ERP_P128x2_Ld30.f45_f45_mg37.I2000Clm60FatesSpCrujraRsGs.derecho_intel.clm-FatesColdSatPhen

[slevis-lmwg]

Second set of tests on derecho:

OK make black & lint (the latter gives two warnings)
PASS python
PASS ./build-namelist_test.pl
OK ./run_sys_tests -s aux_clm -c ctsm5.3.021 --skip-generate
OK? ./run_sys_tests -s aux_cdeps -c /glade/campaign/cesm/cesmdata/cseg/cesm_baselines/cdeps1.0.55 --skip-generate

Checked the last two suites with these commands:

./cs.status.fails | grep -v PASS | grep -v NLCOM | grep -v '21: DIF'
./cs.status.fails | grep -v NLCOMP

In aux_cdeps, this test fails here but also in vanilla ctsm5.3.021:

SMS_D_Ld3.f10_f10_ais8gris4_mg37.DATAMODELTEST.derecho_gnu
ERROR: Invalid compset name, DATAMODELTEST, all stub components generated

[slevis-lmwg]

3rd round to test the "clm5" changes

PASS ./build-namelist_test.pl
PASS ./create_test ERP_P128x2_Ld30.f45_f45_mg37.I1850Clm50BgcCropCrujra.derecho_intel.clm-default

[slevis-lmwg]

TODOs

• @wwieder suggests making t232 the default grid with the introduction of the CRUJRA compsets in this PR if it's "dead simple"):
  Erik suggests we use t232 just for the new CRUJRA compset tests for now, because we don't have all the grid aliases for the grids we need for CTSM testing; @slevis-lmwg checked the testlist, and we already have 10 ne30pg3_t232 tests, which may cover our needs, and I will confirm with Erik
• Go over with @ekluzek
• Update to latest on master here and in cdeps
• Submit tests

[ekluzek]

@slevis-lmwg and I met and we went over the things to do and there's a conversation for them.

Since, we aren't doing the answer changing part here -- this could be put onto b4b-dev. What do you think about that @slevis-lmwg?

[slevis-lmwg]

About the last commit:
I already see a cdeps1.0.69 tag with diffs that probably do not matter much, but I suspect that I would need to rerun all testing if we decided to update to this latest cdeps tag.

[slevis-lmwg]

From meeting with @ekluzek

• mesh file needs time stamp, which requires new cdeps PR; change the name to:
  mesh_0.5x0.5_CRUJRAv2.5mask_cdf5_c20240916.nc
• while fixing that, remove /inputs directory from path to the CRUJRA data in datm/cime_config/stream_definition_datm.xml
• in ctsm test_list, bring back the original default tests that will ensure b4b
• change clm5 to clm6 in CRUJRA SSP tests
• make compsets compatible with above updates
• rerun all tests that I ran before
• update .gitmodules to cdeps1.0.70 (if/when JimE makes a new tag with my PR)

[slevis-lmwg]

derecho testing

PASS black, lint, python, build-namelist_test.pl
OK ./run_sys_tests -s aux_cdeps -c /glade/campaign/cesm/cesmdata/cseg/cesm_baselines/cdeps1.0.68 -g /glade/campaign/cesm/cesmdata/cseg/cesm_baselines/cdeps1.0.70
OK ./run_sys_tests -s aux_clm -c ctsm5.3.030 -g ctsm5.3.031
OK ./run_sys_tests -s ctsm_sci -c ctsm_sci-ctsm5.3.021 -g ctsm_sci-ctsm5.3.031

izumi testing
OK ./run_sys_tests -s aux_clm -c ctsm5.3.030 -g ctsm5.3.031

• ./rimport-ed the data again
• copied from /project/tss to /inputdata and submitted:
  PASS ./create_test SMS_D_Mmpi-serial_Ld5.5x5_amazon.I2000Clm60FatesCrujraRs.izumi_nag.clm-FatesCold -c /fs/cgd/csm/ccsm_baselines/ctsm5.3.030 -g /fs/cgd/csm/ccsm_baselines/ctsm5.3.031
  TURNS OUT IT'S LOOKING FOR THE mesh in /inputdata and the rest in /project/tss. I have confirmed the same about tests that use GSWP3, so this seems fine.
• chmod a+r -R ctsm5.3.031

[slevis-lmwg]

@ekluzek this is ready once again for your review.

[ekluzek]

I request some changes. But, they are easy. I was thinking we needed to do more in a particular area, but was able to back away from that.

[slevis-lmwg]

tests

derecho

PASS python, black, lint, build-namelist_test.pl
OK ./run_sys_tests -s aux_cdeps -c /glade/campaign/cesm/cesmdata/cseg/cesm_baselines/cdeps1.0.70 --skip-generate
OK ./run_sys_tests -s ctsm_sci -c ctsm_sci-ctsm5.3.021 -g ctsm_sci-ctsm5.3.032
OK ./run_sys_tests -s aux_clm -c ctsm5.3.031 -g ctsm5.3.032

izumi
OK ./run_sys_tests -s aux_clm -c ctsm5.3.031 -g ctsm5.3.032

• change permissions in the new izumi baseline
• @samsrabin's request for me to add documentation to this file (corresponding checkboxes in modify subset_data for CRUJRA with a more user-interactive solution #2960 and Update single point docs (and improve subset_data etc. erroring) #3002):
  https://github.com/ESCOMP/CTSM/pull/3002/files#diff-9778946e91b1c8dc68aac80ee047e8169b8ad67a42f887f3307f7f2f69585e14

[slevis-lmwg]

Tests are in progress again.
@ekluzek pls check whether you find this PR approvable this time around.