Splink install failing due to splink_datasets PermissionError

[ADBond]

Another colleague in ONS and I have been struggling to import splink into a dataproc serverless instance. We're both essentially using the basic google recommended container image from a dockerfile and just adding Splink to the list of dependencies to install.

The problem doesn't seem to occur with Splink version 2.x but does with 3.x and 4, and there isn't a problem using Splink on a single VM inside Google Cloud Platform.

The error that returns is:

File "/opt/miniconda3/lib/python3.12/site-packages/splink/__init__.py", line 5, in <module> from splink.internals.datasets import splink_datasets
File "/opt/miniconda3/lib/python3.12/site-packages/splink/internals/datasets/__init__.py", line 270, in <module> class _SplinkDataSets(metaclass=_SplinkDataSetsMeta, datasets=_datasets):
File "/opt/miniconda3/lib/python3.12/site-packages/splink/internals/datasets/__init__.py", line 152, in __new__ cls.cache_dir.mkdir(exist_ok=True)
File "/opt/miniconda3/lib/python3.12/pathlib.py", line 1311, in mkdir os.mkdir(self, mode)
PermissionError: [Errno 13] Permission denied: '/opt/miniconda3/lib/python3.12/site packages/splink/internals/datasets/__splinkdata_cache__'

Originally posted by @WillHoylesONS in #2340

[ADBond]

Closed by #2357, but see also #2369.