You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The Analysis_timeseries.py shelves files don't follow best practice. As it stands, they currently fully re-written regularly. It would be better to use the shelve sync function to update on disk.
It's not a huge issue as there is not a lot of data to write most of the time, but it could become more significant on days where jasmin is slow, or when we're looking ar very large shelve files (hundreds or thousands of years).
It would also be nice to hear your thoughts on shelve files in general, @valeriupredoi. They're so easy to use, but have some risks. We could reduce some of their volatility by for instance requesting a specific pickle protocol to reduce uncertainty.
The text was updated successfully, but these errors were encountered:
The Analysis_timeseries.py shelves files don't follow best practice. As it stands, they currently fully re-written regularly. It would be better to use the shelve sync function to update on disk.
It's not a huge issue as there is not a lot of data to write most of the time, but it could become more significant on days where jasmin is slow, or when we're looking ar very large shelve files (hundreds or thousands of years).
It would also be nice to hear your thoughts on shelve files in general, @valeriupredoi. They're so easy to use, but have some risks. We could reduce some of their volatility by for instance requesting a specific pickle protocol to reduce uncertainty.
The text was updated successfully, but these errors were encountered: