Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ESAC D1_CP_STA-DWP_PSD has runtime error #43

Open
jbfaden opened this issue Nov 6, 2024 · 3 comments
Open

ESAC D1_CP_STA-DWP_PSD has runtime error #43

jbfaden opened this issue Nov 6, 2024 · 3 comments

Comments

@jbfaden
Copy link
Collaborator

jbfaden commented Nov 6, 2024

Jonathan points out

https://csatools.esac.esa.int/HapiServer/hapi/data?dataset=D1_CP_STA-DWP_PSD&start=2007-09-27T09:00Z&stop=2007-09-28T09:00Z

results in a runtime error.

wget -O D1_CP_ST.cef "https://csa.esac.esa.int/csa-sl-tap/data?RETRIEVAL_TYPE=product&RETRIEVAL_ACCESS=streamed&DATASET_ID=D1_CP_STA-DWP_PSD&START_DATE=2007-09-27T09:00:00Z&END_DATE=2007-09-28T09:00:00Z"
@jbfaden
Copy link
Collaborator Author

jbfaden commented Nov 6, 2024

Somehow the info thinks there will only be four parameters, but the data contains six parameters. Here are some useful URLS:

Used to create the info:

wget -O - "https://csa.esac.esa.int/csa-sl-tap/data?retrieval_type=HEADER&DATASET_ID=D1_CP_STA-DWP_PSD&FORCEPACK=false"

Info read while debugging:

wget -O - 'http://localhost:8080/HapiServer/hapi/info?dataset=D1_CP_STA-DWP_PSD'

Data read while debugging:

wget -O - 'http://localhost:8080/HapiServer/hapi/data?dataset=D1_CP_STA-DWP_PSD&start=2007-09-27T09:00Z&stop=2007-09-28T09:00Z'

Data read from TAP server:

wget -O D1_CP_ST.cef "https://csa.esac.esa.int/csa-sl-tap/data?RETRIEVAL_TYPE=product&RETRIEVAL_ACCESS=streamed&DATASET_ID=D1_CP_STA-DWP_PSD&START_DATE=2007-09-27T09:00:00Z&END_DATE=2007-09-28T09:00:00Z"

@jbfaden
Copy link
Collaborator Author

jbfaden commented Nov 6, 2024

I found what I think is the bug, where the each of the six parameters is counted in the HapiRecord, though two of them are non-time-varying. I need to see why other datasets like this worked, if they did work.

Also, I'm unable to see how the DEPEND_1 connection is made. In the HEADER request, I don't see anything that declares the connection.

@jbfaden
Copy link
Collaborator Author

jbfaden commented Nov 6, 2024

There's another case which is now broken, I think. This is D1_SP_HIA, which had code which would repeat "Half_interval" though it is non-time-varying.

jbfaden added a commit that referenced this issue Nov 6, 2024
D1_CP_STA-DWP_PSD spectrogram showed the number of columns in the HapiRecord
was miscounted.
jbfaden added a commit that referenced this issue Nov 6, 2024
need to be counted when it is one-element long, as with .../hapi/data?id=D1_SP_HIA&start=2007-09-28T23:59:00.000Z&stop=2007-09-29T07:01:00.000Z&parameters=time_tags,Half_interval'
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant