Tokenization, encoders and latents at different HEALpix levels #2869

Describe the task. Describe the task. It can be a feature, a set of experiments, documentation, etc.

Currently the healpix level is hardcoded and shared between streams. We would like to enable potentially different HEALpix levels during training. This could be simply at the tokenization level or going deeper having different streams being encoded separately and even multi-resolution latents.

Hedgedoc URL, if you are keeping notes, plots, logs in hedgedoc.

No response

URL to the design document

No response

Area

• datasets, data readers, data preparation and transfer
• model
• science
• infrastructure and engineering
• evaluation, export and visualization
• documentation
• performance