forked from erdc/getdatatestbed
-
Notifications
You must be signed in to change notification settings - Fork 4
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Problem: Downloading can be slow
downloading data takes a lot of time if not on local network, this download time should be minimized. Data on the server also change from time to time (as bugs in processing are found or new, better processing algorithms are employed) so this should be updated from time to time. users likely work with short datasets and particular types of data.
proposed solution: Create Local data cache
create a local cache where data can be locally stored (efficiently).
options or things to consider
- using a conf file to determine the location of this cache
- update data from server on occasion (set to default but user update-able)
- maybe use pickle instead of lots of netCDF files, this could save space and time
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request