Skip to content

Conversation

@bcdarwin
Copy link
Member

@bcdarwin bcdarwin commented Jan 12, 2025

The following packages need to be updated upstream to the Zarr 3.x. API:

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@github-actions github-actions bot added 6.topic: python Python is a high-level, general-purpose programming language. 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 10.rebuild-linux: 101-500 This PR causes between 101 and 500 packages to rebuild on Linux. labels Jan 12, 2025
@nix-owners nix-owners bot requested a review from doronbehar January 12, 2025 18:00
@ofborg ofborg bot added the 2.status: merge conflict This PR has merge conflicts with the target branch label Feb 7, 2025
@ofborg ofborg bot removed the 2.status: merge conflict This PR has merge conflicts with the target branch label Feb 13, 2025
@bcdarwin bcdarwin changed the title python312Packages.zarr: 2.18.3 -> 3.0.0 python312Packages.zarr: 2.18.3 -> 3.0.2 Feb 13, 2025
@dotlambda
Copy link
Member

  • python312Packages.multiscale-spatial-image

I can't find an upstream issue for that. Mind opening one?

@doronbehar
Copy link
Contributor

doronbehar commented Feb 24, 2025

  • python312Packages.multiscale-spatial-image

I can't find an upstream issue for that. Mind opening one?

Done, also for tifffile, and updated the top comment of the PR. Also, I pushed a few more commits related to the main topic of the PR. I also added there reproject which is another direct dependency of zarr.

@doronbehar doronbehar changed the title python312Packages.zarr: 2.18.3 -> 3.0.2 python312Packages.zarr: 2.18.3 -> 3.0.4 Feb 25, 2025
@doronbehar
Copy link
Contributor

doronbehar commented Feb 25, 2025

After working a bit with the patch here and with zarr v3 directly, I noticed that many features of it are missing in comparison to version 2.x. Even if the dependencies mentioned in the PR's top comment will adapt to v3, I think we should still have a zarr2 attribute and perform a gradual transition. Do you think @dotlambda maybe we should at the moment create a zarr3 (and zarr2) attribute(s) and later on handle the dependencies? In a similar fashion to what we did with Numpy.. It would be nice to let Nixpkgs users be able to use zarr3 if they want to without maintaining a fork. I anticipate that the dependent packages will take time to adapt anyway, also possibly due to missing features.

@doronbehar
Copy link
Contributor

Due to:

And due to the fact non of the upstream issues in dependent projects have had any progress, I decided to decouple the numcodecs update done here, to a separate PR:

I also rebased this PR to fix the natural merge conflict due to #396376 .

@doronbehar doronbehar changed the title python312Packages.zarr: 2.18.3 -> 3.0.4 python312Packages.zarr: 2.18.7 -> 3.0.4 Apr 16, 2025
@doronbehar doronbehar changed the title python312Packages.zarr: 2.18.7 -> 3.0.4 python312Packages.zarr: 2.18.7 -> 3.1.0 Jul 17, 2025
@doronbehar
Copy link
Contributor

A few updates:

  • We have now zarr 3.1.0
  • Only 2 dependent packages are waiting for upstream to support zarr 3.x - top comment of PR was updated accordingly.
  • I added numcodecs_0_15 and zarr_2 derivations, that should be useful if someone insists not to update to zarr 3.x, by using an overlay - please give me feedback on the idea if you can.
  • Along with the above, I'm considering to mark as broken the 2 dependent packages that don't support yet zarr 3.x, depending on the zarr version, and hence people will be able to build them with the same overlay that downgrades both numcodecs_0_15 and zarr_2. What do you think?

@bcdarwin
Copy link
Member Author

It looks like these PRs are active and will likely be merged before the next NixOS release cycle, so I'd be fine with merging.

If we do proceed, I'm not sure how much effort/mostly-duplicated code we should put into supporting Zarr 2 stuff in tree though.

@doronbehar
Copy link
Contributor

It looks like these PRs are active and will likely be merged before the next NixOS release cycle, so I'd be fine with merging.

OK, I see you are the maintainer also of ome-zarr and multiscale-spatial-image - so if this is fine with you I committed these changes and I'm marking this PR as ready for review.

@doronbehar doronbehar marked this pull request as ready for review July 18, 2025 15:58
@doronbehar doronbehar requested a review from dotlambda July 18, 2025 15:58
@bcdarwin
Copy link
Member Author

bcdarwin commented Aug 7, 2025

Multiscale-spatial-image stuff fully fixed (modulo potentially squashing).

ome-zarr will also make a release soon. If not, patching may or may not be tedious but we could also temporarily bump to an unstable version, and then remove the pinned zarr/numcodecs stuff.

@bcdarwin bcdarwin force-pushed the python3-zarr-v3 branch 2 times, most recently from fb73ee1 to 8c294eb Compare August 7, 2025 18:14
@doronbehar
Copy link
Contributor

I think we can wait to the weekend for ome/ome-zarr-py#463 too - it won't be a big deal a few more days after 7 months this PR was open :).

@bcdarwin
Copy link
Member Author

Updated to the ome-zarr release candidate and dropped the pinned versions of zarr and numcodecs.

@doronbehar
Copy link
Contributor

Should be good to go after a Nixpkgs-review. I'm loaded at the moment.

@nix-owners nix-owners bot requested a review from samuela August 13, 2025 17:18
@bcdarwin
Copy link
Member Author

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 373248
Commit: 002a7b2aa2e52f41ecf4ba51ac2ca95ab843dba7


x86_64-linux

⏩ 6 packages marked as broken and skipped:
  • picosnitch
  • picosnitch.dist
  • skytemple
  • skytemple.dist
  • tartube
  • tartube.dist
❌ 11 packages failed to build:
  • python312Packages.halide (python312Packages.halide.lib)
  • python312Packages.pvextractor
  • python312Packages.pvextractor.dist
  • python312Packages.spectral-cube
  • python312Packages.spectral-cube.dist
  • python313Packages.halide (python313Packages.halide.lib)
  • python313Packages.pvextractor
  • python313Packages.pvextractor.dist
  • python313Packages.spectral-cube
  • python313Packages.spectral-cube.dist
  • tests.devShellTools.nixos
✅ 684 packages built:
  • aider-chat-full
  • aider-chat-full.dist
  • aider-chat-with-help
  • aider-chat-with-help.dist
  • apkleaks
  • apkleaks.dist
  • backgroundremover
  • backgroundremover.dist
  • beets (beetsPackages.beets, beetsPackages.beets-stable)
  • beets-unstable (beetsPackages.beets-unstable)
  • beets-unstable.dist (beetsPackages.beets-unstable.dist)
  • beets-unstable.doc (beetsPackages.beets-unstable.doc)
  • beets-unstable.man (beetsPackages.beets-unstable.man)
  • beets.dist (beetsPackages.beets-stable.dist, beetsPackages.beets.dist)
  • beets.doc (beetsPackages.beets-stable.doc, beetsPackages.beets.doc)
  • beets.man (beetsPackages.beets-stable.man, beetsPackages.beets.man)
  • checkov
  • checkov.dist
  • contact
  • contact.dist
  • cve-bin-tool
  • cve-bin-tool.dist
  • das
  • das.dist
  • deeptools
  • deeptools.dist
  • deface
  • deface.dist
  • docling (python313Packages.docling)
  • docling-serve (python313Packages.docling-serve)
  • docling-serve.dist (python313Packages.docling-serve.dist)
  • docling.dist (python313Packages.docling.dist)
  • easyocr (python313Packages.easyocr)
  • easyocr.dist (python313Packages.easyocr.dist)
  • exo
  • exo.dist
  • flattenReferencesGraph
  • flattenReferencesGraph.dist
  • home-assistant-component-tests.dremel_3d_printer
  • home-assistant-component-tests.environment_canada
  • hp2p
  • hydrus
  • hydrus.doc
  • immich-machine-learning
  • immich-machine-learning.dist
  • intensity-normalization (python313Packages.intensity-normalization)
  • intensity-normalization.dist (python313Packages.intensity-normalization.dist)
  • jadx
  • multiqc
  • multiqc.dist
  • napari (python312Packages.napari)
  • napari.dist (python312Packages.napari.dist)
  • newelle
  • ome_zarr (python313Packages.ome-zarr)
  • ome_zarr.dist (python313Packages.ome-zarr.dist)
  • owocr
  • owocr.dist
  • pianotrans
  • pianotrans.dist
  • pitivi
  • prowler
  • prowler.dist
  • python312Packages.albumentations
  • python312Packages.albumentations.dist
  • python312Packages.ale-py
  • python312Packages.ale-py.dist
  • python312Packages.anndata
  • python312Packages.anndata.dist
  • python312Packages.aplpy
  • python312Packages.aplpy.dist
  • python312Packages.arviz
  • python312Packages.arviz.dist
  • python312Packages.ax-platform
  • python312Packages.ax-platform.dist
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.baselines
  • python312Packages.baselines.dist
  • python312Packages.batchgenerators
  • python312Packages.batchgenerators.dist
  • python312Packages.brax
  • python312Packages.brax.dist
  • python312Packages.bsuite
  • python312Packages.bsuite.dist
  • python312Packages.chart-studio
  • python312Packages.chart-studio.dist
  • python312Packages.compressai
  • python312Packages.compressai.dist
  • python312Packages.corner
  • python312Packages.corner.dist
  • python312Packages.dalle-mini
  • python312Packages.dalle-mini.dist
  • python312Packages.dash
  • python312Packages.dash-bootstrap-components
  • python312Packages.dash-bootstrap-components.dist
  • python312Packages.dash-bootstrap-templates
  • python312Packages.dash-bootstrap-templates.dist
  • python312Packages.dash.dist
  • python312Packages.dask-image
  • python312Packages.dask-image.dist
  • python312Packages.dm-sonnet
  • python312Packages.dm-sonnet.dist
  • python312Packages.docling
  • python312Packages.docling-jobkit
  • python312Packages.docling-jobkit.dist
  • python312Packages.docling-serve
  • python312Packages.docling-serve.dist
  • python312Packages.docling.dist
  • python312Packages.dremel3dpy
  • python312Packages.dremel3dpy.dist
  • python312Packages.easyocr
  • python312Packages.easyocr.dist
  • python312Packages.energyflow
  • python312Packages.energyflow.dist
  • python312Packages.env-canada
  • python312Packages.env-canada.dist
  • python312Packages.experiment-utilities
  • python312Packages.experiment-utilities.dist
  • python312Packages.explorerscript
  • python312Packages.explorerscript.dist
  • python312Packages.fastai
  • python312Packages.fastai.dist
  • python312Packages.fastmri
  • python312Packages.fastmri.dist
  • python312Packages.fmpy
  • python312Packages.fmpy.dist
  • python312Packages.gdsfactory
  • python312Packages.gdsfactory.dist
  • python312Packages.glymur
  • python312Packages.glymur.dist
  • python312Packages.gradio
  • python312Packages.gradio.dist
  • python312Packages.gym
  • python312Packages.gym.dist
  • python312Packages.gymnasium
  • python312Packages.gymnasium.dist
  • python312Packages.handout
  • python312Packages.handout.dist
  • python312Packages.hvplot
  • python312Packages.hvplot.dist
  • python312Packages.igraph
  • python312Packages.igraph.dist
  • python312Packages.imagecorruptions
  • python312Packages.imagecorruptions.dist
  • python312Packages.imageio
  • python312Packages.imageio.dist
  • python312Packages.insightface
  • python312Packages.insightface.dist
  • python312Packages.intake
  • python312Packages.intake.dist
  • python312Packages.intensity-normalization
  • python312Packages.intensity-normalization.dist
  • python312Packages.iplotx
  • python312Packages.iplotx.dist
  • python312Packages.itables
  • python312Packages.itables.dist
  • python312Packages.k-diffusion
  • python312Packages.k-diffusion.dist
  • python312Packages.kmapper
  • python312Packages.kmapper.dist
  • python312Packages.kokoro
  • python312Packages.kokoro.dist
  • python312Packages.legacy-api-wrap
  • python312Packages.legacy-api-wrap.dist
  • python312Packages.leidenalg
  • python312Packages.leidenalg.dist
  • python312Packages.librosa
  • python312Packages.librosa.dist
  • python312Packages.lida
  • python312Packages.lida.dist
  • python312Packages.lime
  • python312Packages.lime.dist
  • python312Packages.llama-cloud-services
  • python312Packages.llama-cloud-services.dist
  • python312Packages.llama-index
  • python312Packages.llama-index-agent-openai
  • python312Packages.llama-index-agent-openai.dist
  • python312Packages.llama-index-cli
  • python312Packages.llama-index-cli.dist
  • python312Packages.llama-index-core
  • python312Packages.llama-index-core.dist
  • python312Packages.llama-index-embeddings-gemini
  • python312Packages.llama-index-embeddings-gemini.dist
  • python312Packages.llama-index-embeddings-google
  • python312Packages.llama-index-embeddings-google.dist
  • python312Packages.llama-index-embeddings-huggingface
  • python312Packages.llama-index-embeddings-huggingface.dist
  • python312Packages.llama-index-embeddings-ollama
  • python312Packages.llama-index-embeddings-ollama.dist
  • python312Packages.llama-index-embeddings-openai
  • python312Packages.llama-index-embeddings-openai.dist
  • python312Packages.llama-index-graph-stores-nebula
  • python312Packages.llama-index-graph-stores-nebula.dist
  • python312Packages.llama-index-graph-stores-neo4j
  • python312Packages.llama-index-graph-stores-neo4j.dist
  • python312Packages.llama-index-graph-stores-neptune
  • python312Packages.llama-index-graph-stores-neptune.dist
  • python312Packages.llama-index-indices-managed-llama-cloud
  • python312Packages.llama-index-indices-managed-llama-cloud.dist
  • python312Packages.llama-index-legacy
  • python312Packages.llama-index-legacy.dist
  • python312Packages.llama-index-llms-ollama
  • python312Packages.llama-index-llms-ollama.dist
  • python312Packages.llama-index-llms-openai
  • python312Packages.llama-index-llms-openai-like
  • python312Packages.llama-index-llms-openai-like.dist
  • python312Packages.llama-index-llms-openai.dist
  • python312Packages.llama-index-multi-modal-llms-openai
  • python312Packages.llama-index-multi-modal-llms-openai.dist
  • python312Packages.llama-index-program-openai
  • python312Packages.llama-index-program-openai.dist
  • python312Packages.llama-index-question-gen-openai
  • python312Packages.llama-index-question-gen-openai.dist
  • python312Packages.llama-index-readers-database
  • python312Packages.llama-index-readers-database.dist
  • python312Packages.llama-index-readers-file
  • python312Packages.llama-index-readers-file.dist
  • python312Packages.llama-index-readers-json
  • python312Packages.llama-index-readers-json.dist
  • python312Packages.llama-index-readers-llama-parse
  • python312Packages.llama-index-readers-llama-parse.dist
  • python312Packages.llama-index-readers-s3
  • python312Packages.llama-index-readers-s3.dist
  • python312Packages.llama-index-readers-twitter
  • python312Packages.llama-index-readers-twitter.dist
  • python312Packages.llama-index-readers-txtai
  • python312Packages.llama-index-readers-txtai.dist
  • python312Packages.llama-index-readers-weather
  • python312Packages.llama-index-readers-weather.dist
  • python312Packages.llama-index-vector-stores-chroma
  • python312Packages.llama-index-vector-stores-chroma.dist
  • python312Packages.llama-index-vector-stores-google
  • python312Packages.llama-index-vector-stores-google.dist
  • python312Packages.llama-index-vector-stores-postgres
  • python312Packages.llama-index-vector-stores-postgres.dist
  • python312Packages.llama-index-vector-stores-qdrant
  • python312Packages.llama-index-vector-stores-qdrant.dist
  • python312Packages.llama-index.dist
  • python312Packages.llama-parse
  • python312Packages.llama-parse.dist
  • python312Packages.meshtastic
  • python312Packages.meshtastic.dist
  • python312Packages.minari
  • python312Packages.minari.dist
  • python312Packages.mmcv
  • python312Packages.mmcv.dist
  • python312Packages.moviepy
  • python312Packages.moviepy.dist
  • python312Packages.multiscale-spatial-image
  • python312Packages.multiscale-spatial-image.dist
  • python312Packages.mung
  • python312Packages.mung.dist
  • python312Packages.muscima
  • python312Packages.muscima.dist
  • python312Packages.napari-svg
  • python312Packages.napari-svg.dist
  • python312Packages.neurokit2
  • python312Packages.neurokit2.dist
  • python312Packages.niaarm
  • python312Packages.niaarm.dist
  • python312Packages.niworkflows
  • python312Packages.niworkflows.dist
  • python312Packages.numcodecs
  • python312Packages.numcodecs.dist
  • python312Packages.nutpie
  • python312Packages.nutpie.dist
  • python312Packages.odc-geo
  • python312Packages.odc-geo.dist
  • python312Packages.odc-loader
  • python312Packages.odc-loader.dist
  • python312Packages.odc-stac
  • python312Packages.odc-stac.dist
  • python312Packages.ome-zarr
  • python312Packages.ome-zarr.dist
  • python312Packages.omrdatasettools
  • python312Packages.omrdatasettools.dist
  • python312Packages.open-clip-torch
  • python312Packages.open-clip-torch.dist
  • python312Packages.optuna
  • python312Packages.optuna-dashboard
  • python312Packages.optuna-dashboard.dist
  • python312Packages.optuna.dist
  • python312Packages.paddleocr
  • python312Packages.paddleocr.dist
  • python312Packages.pettingzoo
  • python312Packages.pettingzoo.dist
  • python312Packages.piano-transcription-inference
  • python312Packages.piano-transcription-inference.dist
  • python312Packages.pims
  • python312Packages.pims.dist
  • python312Packages.plopp
  • python312Packages.plopp.dist
  • python312Packages.plotly
  • python312Packages.plotly.dist
  • python312Packages.plotpy
  • python312Packages.plotpy.dist
  • python312Packages.psd-tools
  • python312Packages.psd-tools.dist
  • python312Packages.pyannote-audio
  • python312Packages.pyannote-audio.dist
  • python312Packages.pyannote-pipeline
  • python312Packages.pyannote-pipeline.dist
  • python312Packages.pymatgen
  • python312Packages.pymatgen.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
  • python312Packages.pyrender
  • python312Packages.pyrender.dist
  • python312Packages.rawpy
  • python312Packages.rawpy.dist
  • python312Packages.reflex
  • python312Packages.reflex-chakra
  • python312Packages.reflex-chakra.dist
  • python312Packages.reflex.dist
  • python312Packages.rembg
  • python312Packages.rembg.dist
  • python312Packages.reproject
  • python312Packages.reproject.dist
  • python312Packages.resampy
  • python312Packages.resampy.dist
  • python312Packages.scikit-image
  • python312Packages.scikit-image.dist
  • python312Packages.scikit-tda
  • python312Packages.scikit-tda.dist
  • python312Packages.shimmy
  • python312Packages.shimmy.dist
  • python312Packages.skrl
  • python312Packages.skrl.dist
  • python312Packages.skytemple-dtef
  • python312Packages.skytemple-dtef.dist
  • python312Packages.skytemple-files
  • python312Packages.skytemple-files.dist
  • python312Packages.skytemple-ssb-debugger
  • python312Packages.skytemple-ssb-debugger.dist
  • python312Packages.slicedimage
  • python312Packages.slicedimage.dist
  • python312Packages.smolagents
  • python312Packages.smolagents.dist
  • python312Packages.spacy
  • python312Packages.spacy-curated-transformers
  • python312Packages.spacy-curated-transformers.dist
  • python312Packages.spacy-loggers
  • python312Packages.spacy-loggers.dist
  • python312Packages.spacy-lookups-data
  • python312Packages.spacy-lookups-data.dist
  • python312Packages.spacy-transformers
  • python312Packages.spacy-transformers.dist
  • python312Packages.spacy.dist
  • python312Packages.spatial-image
  • python312Packages.spatial-image.dist
  • python312Packages.stable-baselines3
  • python312Packages.stable-baselines3.dist
  • python312Packages.stytra
  • python312Packages.stytra.dist
  • python312Packages.sumo
  • python312Packages.sumo.dist
  • python312Packages.swcgeom
  • python312Packages.swcgeom.dist
  • python312Packages.synergy
  • python312Packages.synergy.dist
  • python312Packages.tensorflow-datasets
  • python312Packages.tensorflow-datasets.dist
  • python312Packages.test-tube
  • python312Packages.test-tube.dist
  • python312Packages.textacy
  • python312Packages.textacy.dist
  • python312Packages.textnets
  • python312Packages.textnets.dist
  • python312Packages.tianshou
  • python312Packages.tianshou.dist
  • python312Packages.tifffile
  • python312Packages.tifffile.dist
  • python312Packages.tinygrad
  • python312Packages.tinygrad.dist
  • python312Packages.torch-audiomentations
  • python312Packages.torch-audiomentations.dist
  • python312Packages.torchcrepe
  • python312Packages.torchcrepe.dist
  • python312Packages.torcheval
  • python312Packages.torcheval.dist
  • python312Packages.torchlibrosa
  • python312Packages.torchlibrosa.dist
  • python312Packages.txtai
  • python312Packages.txtai.dist
  • python312Packages.viser
  • python312Packages.viser.dist
  • python312Packages.wandb
  • python312Packages.wandb.dist
  • python312Packages.webdataset
  • python312Packages.webdataset.dist
  • python312Packages.whisperx
  • python312Packages.whisperx.dist
  • python312Packages.xarray-dataclass
  • python312Packages.xarray-dataclass.dist
  • python312Packages.zarr
  • python312Packages.zarr.dist
  • python313Packages.albumentations
  • python313Packages.albumentations.dist
  • python313Packages.anndata
  • python313Packages.anndata.dist
  • python313Packages.aplpy
  • python313Packages.aplpy.dist
  • python313Packages.ax-platform
  • python313Packages.ax-platform.dist
  • python313Packages.bsuite
  • python313Packages.bsuite.dist
  • python313Packages.chart-studio
  • python313Packages.chart-studio.dist
  • python313Packages.compressai
  • python313Packages.compressai.dist
  • python313Packages.dash
  • python313Packages.dash-bootstrap-components
  • python313Packages.dash-bootstrap-components.dist
  • python313Packages.dash-bootstrap-templates
  • python313Packages.dash-bootstrap-templates.dist
  • python313Packages.dash.dist
  • python313Packages.dask-image
  • python313Packages.dask-image.dist
  • python313Packages.docling-jobkit
  • python313Packages.docling-jobkit.dist
  • python313Packages.dremel3dpy
  • python313Packages.dremel3dpy.dist
  • python313Packages.env-canada
  • python313Packages.env-canada.dist
  • python313Packages.experiment-utilities
  • python313Packages.experiment-utilities.dist
  • python313Packages.explorerscript
  • python313Packages.explorerscript.dist
  • python313Packages.fastai
  • python313Packages.fastai.dist
  • python313Packages.fastmri
  • python313Packages.fastmri.dist
  • python313Packages.fmpy
  • python313Packages.fmpy.dist
  • python313Packages.gdsfactory
  • python313Packages.gdsfactory.dist
  • python313Packages.glymur
  • python313Packages.glymur.dist
  • python313Packages.gradio
  • python313Packages.gradio.dist
  • python313Packages.gym
  • python313Packages.gym.dist
  • python313Packages.handout
  • python313Packages.handout.dist
  • python313Packages.hvplot
  • python313Packages.hvplot.dist
  • python313Packages.igraph
  • python313Packages.igraph.dist
  • python313Packages.imagecorruptions
  • python313Packages.imagecorruptions.dist
  • python313Packages.imageio
  • python313Packages.imageio.dist
  • python313Packages.insightface
  • python313Packages.insightface.dist
  • python313Packages.intake
  • python313Packages.intake.dist
  • python313Packages.iplotx
  • python313Packages.iplotx.dist
  • python313Packages.itables
  • python313Packages.itables.dist
  • python313Packages.k-diffusion
  • python313Packages.k-diffusion.dist
  • python313Packages.kmapper
  • python313Packages.kmapper.dist
  • python313Packages.kokoro
  • python313Packages.kokoro.dist
  • python313Packages.legacy-api-wrap
  • python313Packages.legacy-api-wrap.dist
  • python313Packages.leidenalg
  • python313Packages.leidenalg.dist
  • python313Packages.librosa
  • python313Packages.librosa.dist
  • python313Packages.lida
  • python313Packages.lida.dist
  • python313Packages.lime
  • python313Packages.lime.dist
  • python313Packages.llama-cloud-services
  • python313Packages.llama-cloud-services.dist
  • python313Packages.llama-index
  • python313Packages.llama-index-agent-openai
  • python313Packages.llama-index-agent-openai.dist
  • python313Packages.llama-index-cli
  • python313Packages.llama-index-cli.dist
  • python313Packages.llama-index-core
  • python313Packages.llama-index-core.dist
  • python313Packages.llama-index-embeddings-gemini
  • python313Packages.llama-index-embeddings-gemini.dist
  • python313Packages.llama-index-embeddings-google
  • python313Packages.llama-index-embeddings-google.dist
  • python313Packages.llama-index-embeddings-huggingface
  • python313Packages.llama-index-embeddings-huggingface.dist
  • python313Packages.llama-index-embeddings-ollama
  • python313Packages.llama-index-embeddings-ollama.dist
  • python313Packages.llama-index-embeddings-openai
  • python313Packages.llama-index-embeddings-openai.dist
  • python313Packages.llama-index-graph-stores-neo4j
  • python313Packages.llama-index-graph-stores-neo4j.dist
  • python313Packages.llama-index-graph-stores-neptune
  • python313Packages.llama-index-graph-stores-neptune.dist
  • python313Packages.llama-index-indices-managed-llama-cloud
  • python313Packages.llama-index-indices-managed-llama-cloud.dist
  • python313Packages.llama-index-legacy
  • python313Packages.llama-index-legacy.dist
  • python313Packages.llama-index-llms-ollama
  • python313Packages.llama-index-llms-ollama.dist
  • python313Packages.llama-index-llms-openai
  • python313Packages.llama-index-llms-openai-like
  • python313Packages.llama-index-llms-openai-like.dist
  • python313Packages.llama-index-llms-openai.dist
  • python313Packages.llama-index-multi-modal-llms-openai
  • python313Packages.llama-index-multi-modal-llms-openai.dist
  • python313Packages.llama-index-program-openai
  • python313Packages.llama-index-program-openai.dist
  • python313Packages.llama-index-question-gen-openai
  • python313Packages.llama-index-question-gen-openai.dist
  • python313Packages.llama-index-readers-database
  • python313Packages.llama-index-readers-database.dist
  • python313Packages.llama-index-readers-file
  • python313Packages.llama-index-readers-file.dist
  • python313Packages.llama-index-readers-json
  • python313Packages.llama-index-readers-json.dist
  • python313Packages.llama-index-readers-llama-parse
  • python313Packages.llama-index-readers-llama-parse.dist
  • python313Packages.llama-index-readers-s3
  • python313Packages.llama-index-readers-s3.dist
  • python313Packages.llama-index-readers-twitter
  • python313Packages.llama-index-readers-twitter.dist
  • python313Packages.llama-index-readers-txtai
  • python313Packages.llama-index-readers-txtai.dist
  • python313Packages.llama-index-readers-weather
  • python313Packages.llama-index-readers-weather.dist
  • python313Packages.llama-index-vector-stores-chroma
  • python313Packages.llama-index-vector-stores-chroma.dist
  • python313Packages.llama-index-vector-stores-google
  • python313Packages.llama-index-vector-stores-google.dist
  • python313Packages.llama-index-vector-stores-postgres
  • python313Packages.llama-index-vector-stores-postgres.dist
  • python313Packages.llama-index-vector-stores-qdrant
  • python313Packages.llama-index-vector-stores-qdrant.dist
  • python313Packages.llama-index.dist
  • python313Packages.llama-parse
  • python313Packages.llama-parse.dist
  • python313Packages.meshtastic
  • python313Packages.meshtastic.dist
  • python313Packages.mmcv
  • python313Packages.mmcv.dist
  • python313Packages.moviepy
  • python313Packages.moviepy.dist
  • python313Packages.multiscale-spatial-image
  • python313Packages.multiscale-spatial-image.dist
  • python313Packages.mung
  • python313Packages.mung.dist
  • python313Packages.muscima
  • python313Packages.muscima.dist
  • python313Packages.napari-svg
  • python313Packages.napari-svg.dist
  • python313Packages.neurokit2
  • python313Packages.neurokit2.dist
  • python313Packages.niaarm
  • python313Packages.niaarm.dist
  • python313Packages.numcodecs
  • python313Packages.numcodecs.dist
  • python313Packages.odc-geo
  • python313Packages.odc-geo.dist
  • python313Packages.odc-loader
  • python313Packages.odc-loader.dist
  • python313Packages.odc-stac
  • python313Packages.odc-stac.dist
  • python313Packages.omrdatasettools
  • python313Packages.omrdatasettools.dist
  • python313Packages.open-clip-torch
  • python313Packages.open-clip-torch.dist
  • python313Packages.optuna
  • python313Packages.optuna-dashboard
  • python313Packages.optuna-dashboard.dist
  • python313Packages.optuna.dist
  • python313Packages.paddleocr
  • python313Packages.paddleocr.dist
  • python313Packages.piano-transcription-inference
  • python313Packages.piano-transcription-inference.dist
  • python313Packages.pims
  • python313Packages.pims.dist
  • python313Packages.plopp
  • python313Packages.plopp.dist
  • python313Packages.plotly
  • python313Packages.plotly.dist
  • python313Packages.plotpy
  • python313Packages.plotpy.dist
  • python313Packages.psd-tools
  • python313Packages.psd-tools.dist
  • python313Packages.pyannote-audio
  • python313Packages.pyannote-audio.dist
  • python313Packages.pyannote-pipeline
  • python313Packages.pyannote-pipeline.dist
  • python313Packages.pyrender
  • python313Packages.pyrender.dist
  • python313Packages.rawpy
  • python313Packages.rawpy.dist
  • python313Packages.reflex
  • python313Packages.reflex-chakra
  • python313Packages.reflex-chakra.dist
  • python313Packages.reflex.dist
  • python313Packages.rembg
  • python313Packages.rembg.dist
  • python313Packages.reproject
  • python313Packages.reproject.dist
  • python313Packages.resampy
  • python313Packages.resampy.dist
  • python313Packages.scikit-image
  • python313Packages.scikit-image.dist
  • python313Packages.scikit-tda
  • python313Packages.scikit-tda.dist
  • python313Packages.skytemple-dtef
  • python313Packages.skytemple-dtef.dist
  • python313Packages.skytemple-files
  • python313Packages.skytemple-files.dist
  • python313Packages.skytemple-ssb-debugger
  • python313Packages.skytemple-ssb-debugger.dist
  • python313Packages.slicedimage
  • python313Packages.slicedimage.dist
  • python313Packages.smolagents
  • python313Packages.smolagents.dist
  • python313Packages.spacy
  • python313Packages.spacy-curated-transformers
  • python313Packages.spacy-curated-transformers.dist
  • python313Packages.spacy-loggers
  • python313Packages.spacy-loggers.dist
  • python313Packages.spacy-lookups-data
  • python313Packages.spacy-lookups-data.dist
  • python313Packages.spacy-transformers
  • python313Packages.spacy-transformers.dist
  • python313Packages.spacy.dist
  • python313Packages.spatial-image
  • python313Packages.spatial-image.dist
  • python313Packages.stytra
  • python313Packages.stytra.dist
  • python313Packages.swcgeom
  • python313Packages.swcgeom.dist
  • python313Packages.synergy
  • python313Packages.synergy.dist
  • python313Packages.textacy
  • python313Packages.textacy.dist
  • python313Packages.tifffile
  • python313Packages.tifffile.dist
  • python313Packages.tinygrad
  • python313Packages.tinygrad.dist
  • python313Packages.torch-audiomentations
  • python313Packages.torch-audiomentations.dist
  • python313Packages.torchcrepe
  • python313Packages.torchcrepe.dist
  • python313Packages.torcheval
  • python313Packages.torcheval.dist
  • python313Packages.torchlibrosa
  • python313Packages.torchlibrosa.dist
  • python313Packages.txtai
  • python313Packages.txtai.dist
  • python313Packages.wandb
  • python313Packages.wandb.dist
  • python313Packages.webdataset
  • python313Packages.webdataset.dist
  • whisperx (python313Packages.whisperx)
  • whisperx.dist (python313Packages.whisperx.dist)
  • python313Packages.xarray-dataclass
  • python313Packages.xarray-dataclass.dist
  • python313Packages.zarr
  • python313Packages.zarr.dist
  • quark-engine
  • quark-engine.dist
  • rclip
  • rclip.dist
  • rembg
  • rembg.dist
  • rimsort
  • serenityos-emoji-font
  • streamcontroller
  • supergee
  • tartube-yt-dlp
  • tartube-yt-dlp.dist
  • theharvester
  • theharvester.dist
  • waypaper
  • waypaper.dist
  • whisper-ctranslate2
  • whisper-ctranslate2.dist

Error logs: `x86_64-linux`
python312Packages.halide
	344 - correctness_target_query (Skipped)
	345 - correctness_tiled_matmul (Skipped)
	381 - correctness_vectorized_gpu_allocation (Skipped)
	478 - error_five_d_gpu_buffer (Skipped)
	592 - generator_aot_define_extern_opencl (Skipped)
	593 - generator_aotcpp_define_extern_opencl (Skipped)
	606 - generator_aot_gpu_object_lifetime (Skipped)
	607 - generator_aotcpp_gpu_object_lifetime (Skipped)
	608 - generator_aot_gpu_only (Skipped)
	609 - generator_aotcpp_gpu_only (Skipped)
	610 - generator_aot_gpu_texture (Skipped)
	611 - generator_aotcpp_gpu_texture (Skipped)
	619 - generator_aot_metal_completion_handler_override (Skipped)
	620 - generator_aotcpp_metal_completion_handler_override (Skipped)
	627 - generator_aot_opencl_runtime (Skipped)
	628 - generator_aotcpp_opencl_runtime (Skipped)

The following tests FAILED:
315 - correctness_simd_op_check_x86 (ILLEGAL) correctness
Errors while running CTest

python312Packages.spectral-cube
            raise TypeError('Complex type not supported')
    if max_label < 1:
        max_label = input.max()
  return _nd_image.find_objects(input, max_label)

E TypeError: 'numpy.bool' object cannot be interpreted as an integer

/nix/store/pgimvp2sb89y91c69vp33whkaa481r8r-python3.12-scipy-1.16.0/lib/python3.12/site-packages/scipy/ndimage/_measurements.py:308: TypeError
=========================== short test summary info ============================
FAILED spectral_cube/tests/test_spectral_cube.py::test_smooth_update_function_parallel - AssertionError: assert '' == 'Update Funct...nction Call\n'

  • Update Function Call
  • Update Function Call
  • Update Function Call
  • Update Function Call
  • Update Function Call
  • Update Function Call
    FAILED spectral_cube/tests/test_spectral_cube.py::test_minimal_subcube[False] - TypeError: 'numpy.bool' object cannot be interpreted as an integer
    = 2 failed, 975 passed, 183 skipped, 551 deselected, 9 xfailed in 256.46s (0:04:16) =
python313Packages.spectral-cube
            raise TypeError('Complex type not supported')
    if max_label < 1:
        max_label = input.max()
  return _nd_image.find_objects(input, max_label)

E TypeError: 'numpy.bool' object cannot be interpreted as an integer

/nix/store/ii5bnvgqqyd3hlqdg63a7ik16v7qi3ri-python3.13-scipy-1.16.0/lib/python3.13/site-packages/scipy/ndimage/_measurements.py:308: TypeError
=========================== short test summary info ============================
FAILED spectral_cube/tests/test_spectral_cube.py::test_smooth_update_function_parallel - AssertionError: assert '' == 'Update Funct...nction Call\n'

  • Update Function Call
  • Update Function Call
  • Update Function Call
  • Update Function Call
  • Update Function Call
  • Update Function Call
    FAILED spectral_cube/tests/test_spectral_cube.py::test_minimal_subcube[False] - TypeError: 'numpy.bool' object cannot be interpreted as an integer
    = 2 failed, 975 passed, 183 skipped, 551 deselected, 9 xfailed in 288.67s (0:04:48) =
tests.devShellTools.nixos
docker # Creating layer 6 from paths: ['/nix/store/y8fm34v0jphjgp5h21w068h6p3f8hc05-attr-2.5.2']
docker # Creating layer 7 from paths: ['/nix/store/fkw48vh7ivlvlmhp4j30hy2gvg00jgin-gcc-14.3.0-lib']
docker # Creating layer 8 from paths: ['/nix/store/7fini49zkfwf439iqxvm7nzz2v6aclrn-acl-2.3.2']
docker # Creating layer 9 from paths: ['/nix/store/j9sc6w3yxdz5nli6sq7da7zdq149faj5-gmp-with-cxx-6.3.0']
docker # Creating layer 10 from paths: ['/nix/store/qkn51kys93mngwvxkjzcfbwr6rysj2a3-glibc-2.40-66-bin']
docker # Creating layer 11 from paths: ['/nix/store/ahrvr02jq29g2fads1g6vl7qf2npy77y-gmp-6.3.0']
docker # Creating layer 12 from paths: ['/nix/store/gkwbw9nzbkbz298njbn3577zmrnglbbi-bash-5.3p0']
docker # Creating layer 13 from paths: ['/nix/store/97jdzvwjgwy2g4xcijimadl0vpj6laqh-zlib-1.3.1']
docker # Creating layer 14 from paths: ['/nix/store/ih779chzzag1nm91fgnrndml4mghm3la-coreutils-9.7']
docker # Creating layer 15 from paths: ['/nix/store/v0sk2zdlpakiz0xqf6fn9vm2lfl7wg8r-linux-headers-6.14.7']
docker # Creating layer 16 from paths: ['/nix/store/74qjr01q87nwfl0dbsr1s45p8crw3q1f-glibc-2.40-66-dev']
docker # Creating layer 17 from paths: ['/nix/store/vcb1zshk30mw57lib3wsqf1cxp8y4gk2-mpfr-4.2.2']
docker # Creating layer 18 from paths: ['/nix/store/7bgq9cg5ak81wf8ci849649z4qxkqlf7-pcre2-10.44']
docker # Creating layer 19 from paths: ['/nix/store/qgfz23gwqb8w1xjb72d3hcffsywjs1gx-binutils-2.44-lib']
docker # Creating layer 20 from paths: ['/nix/store/phjcyak0sl3id21f0xx8sf5rgf8x5bql-expand-response-params']
docker # Creating layer 21 from paths: ['/nix/store/4kark163478mlnx42k2gakrji1z43z9m-ncurses-6.5']
timeout reached; test terminating...
kill machine (pid 9)
qemu-system-x86_64: terminating on signal 15 from pid 6 (/nix/store/9yh9ak97gn659bk4d3n411fx6c0ng7s2-python3-3.13.5/bin/python3.13)
Terminated                 /nix/store/6dbpbjanrajj2ry9i2wqxdvb9lb8rw9n-nixos-test-driver-docker-tools-nix-shell/bin/nixos-test-driver -o $out

@bcdarwin
Copy link
Member Author

nixpkgs-review result

Looks like spectral-cube and pvextract are already broken on master; halide seems to have failed with an illegal instruction on my machine (and the build might be flaky on master as well?); and the devShellTools test seems to have timed out on my underpowered build?

@doronbehar
Copy link
Contributor

I managed to build locally halide with this PR (rebased upon latest master). I admit I haven't checked tests.devShellTools.nixos which is sourced in nixpkgs/nixos/tests/docker-tools-nix-shell.nix - because I hardly believe this PR will have an effect on it.

Hence, I'm merging 🎉.

@doronbehar doronbehar merged commit 7ef1b41 into NixOS:master Aug 14, 2025
24 checks passed
@bcdarwin bcdarwin deleted the python3-zarr-v3 branch August 14, 2025 13:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.topic: python Python is a high-level, general-purpose programming language. 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 10.rebuild-linux: 101-500 This PR causes between 101 and 500 packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants