You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In many datascience project, fsspec and object_store crate settings are used here and there. I found myself writing a conversion method to convert the settings keys from one to the other and mostly it's pretty easy to do.
Something I miss from adlfs is the use_emulator shortcut for Azure Blob Storage which should result in setting the connection_string to DefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://127.0.0.1:10000/devstoreaccount1;QueueEndpoint=http://127.0.0.1:10001/devstoreaccount1;TableEndpoint=http://127.0.0.1:10002/devstoreaccount1; ( the default connection string of the azure storage emulator)
I think this one should be easy to add and make our lives a little easier :) would also do a PR
The text was updated successfully, but these errors were encountered:
aersam
changed the title
Add use_emulator setting to better align with object_store create
Add use_emulator setting to better align with object_store crate
Nov 3, 2023
Hi there
In many datascience project, fsspec and object_store crate settings are used here and there. I found myself writing a conversion method to convert the settings keys from one to the other and mostly it's pretty easy to do.
See https://docs.rs/object_store/latest/object_store/azure/enum.AzureConfigKey.html#variants
Something I miss from adlfs is the
use_emulator
shortcut for Azure Blob Storage which should result in setting the connection_string toDefaultEndpointsProtocol=http;AccountName=devstoreaccount1;AccountKey=Eby8vdM02xNOcqFlqUwJPLlmEtlCDXJ1OUzFT50uSRZ6IFsuFq2UVErCz4I6tq/K1SZFPTOtr/KBHBeksoGMGw==;BlobEndpoint=http://127.0.0.1:10000/devstoreaccount1;QueueEndpoint=http://127.0.0.1:10001/devstoreaccount1;TableEndpoint=http://127.0.0.1:10002/devstoreaccount1;
( the default connection string of the azure storage emulator)I think this one should be easy to add and make our lives a little easier :) would also do a PR
The text was updated successfully, but these errors were encountered: