Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix EIA-923 Allocation Error #314

Open
grgmiller opened this issue Nov 29, 2023 · 0 comments
Open

Fix EIA-923 Allocation Error #314

grgmiller opened this issue Nov 29, 2023 · 0 comments
Labels
bug Something isn't working dependencies Issues related to packages OGE depends on emissions Accuracy/completeness of emission mass data generation data accuracy/completeness of generation data

Comments

@grgmiller
Copy link
Collaborator

When running the 2021 data pipeline with our new data validation checks, the following warning is raised:

2023-06-09 17:39:24,002 [WARNING] oge.validation:78 Allocated EIA-923 doesn't match input data for plants:
2023-06-09 17:39:24,002 [WARNING] oge.validation:79 Percentage Difference:
2023-06-09 17:39:24,004 [WARNING] oge.validation:80 
              net_generation_mwh  fuel_consumed_mmbtu  fuel_consumed_for_electricity_mmbtu
plant_id_eia                                                                              
1206                   -0.001076            -0.002514                            -0.002514
1316                    0.023964             0.000000                             0.000000
52148                  -0.000151            -0.000023                            -0.000111
54224                  -0.000207            -0.000113                            -0.000161
54967                  -1.000000            -1.000000                            -1.000000
58256                   0.411966             0.000000                             0.000000
59260                  -0.475486            -0.475496                            -0.475496
59825                  -1.000000            -1.000000                            -1.000000
63098                  -1.000000            -1.000000                            -1.000000
2023-06-09 17:39:24,004 [WARNING] oge.validation:81 EIA-923 Input Totals:
2023-06-09 17:39:24,006 [WARNING] oge.validation:82 
              net_generation_mwh  fuel_consumed_mmbtu  fuel_consumed_for_electricity_mmbtu
plant_id_eia                                                                              
1206                   56313.000             493763.0                             493763.0
1316                    2003.000              32704.0                              32704.0
52148                  10585.000             779330.0                              62793.0
54224                  72122.771            1329124.0                             409850.0
54967                      1.960                 24.0                                 24.0
58256                    585.000               7304.0                               7304.0
59260                   1760.000              28873.0                              28873.0
59825                   9539.000              84354.0                              84354.0
63098                      1.000                  6.0                                  6.0
2023-06-09 17:39:24,006 [WARNING] oge.validation:85 Allocated Totals:
2023-06-09 17:39:24,008 [WARNING] oge.validation:86 
              net_generation_mwh  fuel_consumed_mmbtu  fuel_consumed_for_electricity_mmbtu
plant_id_eia                                                                              
1206                56252.431817         4.925215e+05                        492521.524247
1316                 2051.000000         3.270400e+04                         32704.000000
52148               10583.399000         7.793120e+05                         62786.000000
54224               72107.811000         1.328974e+06                        409784.000000
54967                   0.000000         0.000000e+00                             0.000000
58256                 826.000000         7.304000e+03                          7304.000000
59260                 923.144000         1.514400e+04                         15144.000000
59825                   0.000000         0.000000e+00                             0.000000
63098                   0.000000         0.000000e+00                             0.000000

Some of these might be due to rounding errors, but there are several plants where a large portion of fuel generation (or all fuel/generation) is disappearing somewhere in the allocation process.

It may be worth updating our dependencies first to see if/how this issue changes. It is possible this may be a bug somewhere in the pudl code.

@grgmiller grgmiller added bug Something isn't working dependencies Issues related to packages OGE depends on emissions Accuracy/completeness of emission mass data generation data accuracy/completeness of generation data labels Nov 29, 2023
@grgmiller grgmiller added this to the 2022 Data Release milestone Nov 29, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working dependencies Issues related to packages OGE depends on emissions Accuracy/completeness of emission mass data generation data accuracy/completeness of generation data
Projects
None yet
Development

No branches or pull requests

1 participant