GWI_W_411 Exotable - empty data, new fields appearing

[bpbond]

Somewhat similar question to #231

Two issues. First, the GWI_W Exotable data files continue to be full of NANs -- there's no data.

Second, new fields are popping up in them that are erroring the pipeline:

! Some data file entries are missing in the design table!
Compass_GWI_W_411 ExoTable TSS_MgL, Compass_GWI_W_411 ExoTable ORP_mv,
Compass_GWI_W_411 ExoTable TDS_mg_L, Compass_GWI_W_411 ExoTable Vertical_Position_m, 
Compass_GWI_W_411 ExoTable Turbidity_FNU, Compass_GWI_W_411 ExoTable Turbidity_Raw

We can add these entries easily enough, so that the fields are ignored and dropped, but do we know what's going on here @wilsonsj100 @roylrich ?

[wilsonsj100]

Hey there Ben, The COMPASS GWI does NOT have an EXO, so those files should not be there. We use the CBNERR sonde for that site that is located close by for data.

…

-Steph

________________________________ From: Ben Bond-Lamberty ***@***.***> Sent: Friday, January 24, 2025 11:04 AM To: COMPASS-DOE/sensor-data-pipeline ***@***.***> Cc: Wilson, Stephanie ***@***.***>; Mention ***@***.***> Subject: [COMPASS-DOE/sensor-data-pipeline] GWI_W_411 Exotable - empty data, new fields appearing (Issue #233) External Email - Exercise Caution Somewhat similar question to #231<#231> Two issues. First, the GW_W Exotable data files continue to be full of NANs -- there's no data. Second, new fields are popping up in them that are erroring the pipeline: ! Some data file entries are missing in the design table! Compass_GWI_W_411 ExoTable TSS_MgL, Compass_GWI_W_411 ExoTable ORP_mv, Compass_GWI_W_411 ExoTable TDS_mg_L, Compass_GWI_W_411 ExoTable Vertical_Position_m, Compass_GWI_W_411 ExoTable Turbidity_FNU, Compass_GWI_W_411 ExoTable Turbidity_Raw We can add these entries easily enough, so that the fields are ignored and dropped, but do we know what's going on here @wilsonsj100<https://github.com/wilsonsj100> @roylrich<https://github.com/roylrich> ? — Reply to this email directly, view it on GitHub<#233>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/A5E7565A55JJYYDP2UBHPED2MJQANAVCNFSM6AAAAABVZ7U22GVHI2DSMVQWIX3LMV43ASLTON2WKOZSHAYDSNZZHEYDIMY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[bpbond]

Hahahaha well THAT's simple. OK, thank you very much!

[roylrich]

The gcw exotable is really the gcrew marsh outlet exotable which is on a different logger. We should turn this flag off as well. Sent from my T-Mobile 5G Device Get Outlook for Android<https://aka.ms/AAb9ysg>

…

________________________________ From: Ben Bond-Lamberty ***@***.***> Sent: Friday, January 24, 2025 11:04:22 AM To: COMPASS-DOE/sensor-data-pipeline ***@***.***> Cc: Rich, Roy ***@***.***>; Mention ***@***.***> Subject: [COMPASS-DOE/sensor-data-pipeline] GWI_W_411 Exotable - empty data, new fields appearing (Issue #233) External Email - Exercise Caution Somewhat similar question to #231<#231> Two issues. First, the GW_W Exotable data files continue to be full of NANs -- there's no data. Second, new fields are popping up in them that are erroring the pipeline: ! Some data file entries are missing in the design table! Compass_GWI_W_411 ExoTable TSS_MgL, Compass_GWI_W_411 ExoTable ORP_mv, Compass_GWI_W_411 ExoTable TDS_mg_L, Compass_GWI_W_411 ExoTable Vertical_Position_m, Compass_GWI_W_411 ExoTable Turbidity_FNU, Compass_GWI_W_411 ExoTable Turbidity_Raw We can add these entries easily enough, so that the fields are ignored and dropped, but do we know what's going on here @wilsonsj100<https://github.com/wilsonsj100> @roylrich<https://github.com/roylrich> ? — Reply to this email directly, view it on GitHub<#233>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AFIDRBTLBZZZBRMWDDCKXDT2MJQANAVCNFSM6AAAAABVZ7U22GVHI2DSMVQWIX3LMV43ASLTON2WKOZSHAYDSNZZHEYDIMY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[wilsonsj100]

[like] Wilson, Stephanie reacted to your message:

…

________________________________ From: Ben Bond-Lamberty ***@***.***> Sent: Friday, January 24, 2025 4:08:17 PM To: COMPASS-DOE/sensor-data-pipeline ***@***.***> Cc: Wilson, Stephanie ***@***.***>; Mention ***@***.***> Subject: Re: [COMPASS-DOE/sensor-data-pipeline] GWI_W_411 Exotable - empty data, new fields appearing (Issue #233) External Email - Exercise Caution Hahahaha well THAT's simple. OK, thank you very much! — Reply to this email directly, view it on GitHub<#233 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/A5E756ZQNSDTUJPAO4J56TD2MJQPDAVCNFSM6AAAAABVZ7U22GVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMJSHA4DKMJTGY>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[bpbond]

Reopening and assigning to @roylrich as a reminder to fix in the future :)

[stephpenn1]

3-25-2025

@roylrich will do a full Exo table investigation a la #236