Notes on building the stack for Fujitsu A64FX

[trz42]

The stack is being builded since summer 2024. Recently (April 2025) we have taken a shared bot instance on Deucalion into production. We'll use this issue to coordinate the building of the stack.

---

Short summary of current status

2025-04-11: In total 271 modules have been built with the toolchains foss/2023a and foss/2023b.

Remember some TODOs

• Rebuild SitePackage.lua with changes done in add Lmod hook that prints warning for SciPy-bundle on NVIDIA Grace #1022 (in that PR building for a64fx failed)

System toolchain & miscellaneous improvements

• {2023.06}[system,a64fx] circumvent fusemount issue, improve module use, and add some packages #1025

[trz42]

Comment for installation of toolchain foss/2023a and all packages built with it.

To avoid re-building software within the 2023a stack, we have to be careful to use from-commitwhile building:

SciPy-bundle-2023.07-gfbf-2023a
R-bundle-CRAN-2023.12-foss-2023a
R-bundle-Bioconductor-3.18-foss-2023a-R-4.3.2

• if these apps are already ingested, we need to figure out if we have to rebuild them

Apps from EB 4.8.2 2023a easystack

• ALREADY in /cvmfs: add GCCcore/12.3.0 (grace PR: {2023.06}[2023a,grace] GCCcore 12.3.0 #979; sapphirerapids PR: {2023.06}[2023a,sapphirerapids] foss 2023a #925)
• ALREADY in /cvmfs: add foss/2023a (grace PR: {2023.06}[2023a,grace] foss 2023a, Rust 1.70.0 #983; sapphirerapids PR: {2023.06}[2023a,sapphirerapids] foss 2023a #925)
• MOST apps are in /cvmfs
  • remaining apps except SciPy-bundle rebuild
    • split up into several:
      • first Cython and TensorFlow dependencies: {2023.06}[2023a,a64fx] apps originally built with EB 4.8.2 #1028
      • all remaining apps except TensorFlow: {2023.06}[2023a,a64fx] second part of apps originally built with EB 4.8.2 #1033
      • TensorFlow: {2023.06}[2023a,a64fx] add TensorFlow 2.13 #1034 (par=2)
        • first build interactively to figure out what eb parameters let it build successfully
          • 27 extensions need to be built: grpcio (8/27) requires quite a bit of time (1h33 (par=2) - 1h36 (par=8) in different runs)
    • grace PRs
      • {2023.06}[2023a,grace] Apps from EB 4.8.2 2023a easystack #985
      • {2023.06}[2023a,grace] Remaining apps from EB 4.8.2 2023a easystack #986
    • sapphirerapids PR: {2023.06}[2023a,sapphirerapids] Remaining apps for 2023a with EB 4.8.2 #929
  • check if SciPy-bundle 2023.07 needs to be rebuilt -> separate PR
    • depends on Cython-3.0.8-GCCcore-12.3.0.eb
    • {2023.06}[2023a,a64fx] rebuild SciPy-bundle 2023.07 #1027
      • fakeroot is currently not configured for the build account => need to follow up later
  • Boost-1.82.0 is already in the stack, only the source URL had changed, so no need to do anything with it
  • What about Boost.Python? -> it doesn't seem to be built via EB 4.8.2

Apps from EB 4.9.0 2023a easystack

• {2023.06}[2023a,a64fx] first part of apps originally built with EB 4.9.0 #1038
  • grace PR: {2023.06}[2023a,grace] Apps from EB 4.9.0 2023a easystack #990
  • sapphirerapids PR: {2023.06}[2023a,sapphirerapids] Batch of EB 4.9.0 2023a apps #932
• {2023.06}[2023a,a64fx] add remaining apps originally built with EB 4.9.0 #1040
  • grace PR: {2023.06}[2023a,grace] Further apps from EB 4.9.0 2023a easystack #991 + {2023.06}[2023a,grace] Remaining apps from EB 4.9.0 2023a easystack #995
  • sapphirerapids PR: {2023.06}[2023a,sapphirerapids] Add remaining EB 490 2023a apps #934
    • added from-commit to libxc-6.2.2
    • added from-commit to ParMETIS-4.0.3

[trz42]

Comment for installation of toolchain foss/2023b and all packages built with it.

Need to be careful when building the following packages because rebuilding doesn't work on Deucalion currently:

• scikit-build-core-0.9.3-GCCcore-13.2.0.eb (see {2023.06}[2023b] Rebuild scikit-build-core to include additional extension #957)

Apps from EB 4.9.0 2023b easystack

• add foss/2023b (grace PR: {2023.06}[2023b,grace] foss/2023b #982, sapphirerapids PR: {2023.06}[2023b,sapphirerapids] foss 2023b #926)
• remaining apps originally built with EB 4.9.0 (grace PR: {2023.06}[2023b,grace] Remaining apps originally built with EB 4.9.0 #978, sapphirerapids PR: {2023.06}[2023b,sapphirerapids] Remaining EB 4.9.0 2023b apps #931)

Apps from EB 4.9.1 2023b easystack

• apps originally built with EB 4.9.1 (grace PR: {2023.06}[2023b,grace] Apps originally built with EB 4.9.1 #987, sapphirerapids PR: {2023.06}[2023b,sapphirerapids] Add 2023b easystack for EB 4.9.1 #936)
  • for scikit-build-core-0.9.3-GCCcore-13.2.0.eb we used a new from-commit to avoid a need to rebuild it (see {2023.06}[2023b] Rebuild scikit-build-core to include additional extension #957)

Apps from EB 4.9.2 2023b easystack

• apps originally built with EB 4.9.2 (grace PR: {2023.06}[2023b,grace] apps originally built with EB 4.9.2 + changes to bot/build.sh and eessi_container.sh #989, sapphirerapids PR: {2023.06}[2023b,sapphirerapids] Add EB 4.9.2 easystack for 2023b #939)

Apps from EB 4.9.3 2023b easystack

• apps originally built with EB 4.9.3 (grace PR: {2023.06}[2023b,grace] apps originally built with EB 4.9.3 #992, sapphirerapids PR: {2023.06}[2023b,sapphirerapids] Add EB 4.9.3 easystack for 2023b #946)

Apps from EB 4.9.4 2023b easystack

• a couple of apps built with EB 4.9.4 (grace PR: {2023.06}[2023b,grace] a couple of apps built with EB 4.9.4 #993, sapphirerapids PR: {2023.06}[2023b,sapphirerapids] EB 4.9.4 easystack for 2023b #947)
• a few more apps built with EB 4.9.4 (grace PR: {2023.06}[system,2023b,grace] a few remaining apps for the system and 2023b toolchains #996, no sapphirerapids PR)