pudl.transform.eia860 module¶
Module to perform data cleaning functions on EIA860 data tables.
-
pudl.transform.eia860.
boiler_generator_assn
(eia860_dfs, eia860_transformed_dfs)[source]¶ Pulls and transforms the boilder generator association table.
- Parameters
eia860_dfs (dict) – Each entry in this dictionary of DataFrame objects corresponds to a page from the EIA860 form, as reported in the Excel spreadsheets they distribute.
eia860_transformed_dfs (dict) – A dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Returns
eia860_transformed_dfs, a dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Return type
-
pudl.transform.eia860.
generators
(eia860_dfs, eia860_transformed_dfs)[source]¶ Pulls and transforms the generators table.
There are three tabs that the generator records come from (proposed, existing, and retired). We pull each tab into one dataframe and include an
operational_status
to indicate which tab the record came from.- Parameters
eia860_dfs (dict) – Each entry in this dictionary of DataFrame objects corresponds to a page from the EIA860 form, as reported in the Excel spreadsheets they distribute.
eia860_transformed_dfs (dict) – A dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to a normalized DataFrame of values from that page (values)
- Returns
eia860_transformed_dfs, a dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Return type
-
pudl.transform.eia860.
ownership
(eia860_dfs, eia860_transformed_dfs)[source]¶ Pulls and transforms the ownership table.
- Parameters
eia860_dfs (dict) – Each entry in this dictionary of DataFrame objects corresponds to a page from the EIA860 form, as reported in the Excel spreadsheets they distribute
eia860_transformed_dfs (dict) – A dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Returns
eia860_transformed_dfs, a dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Return type
-
pudl.transform.eia860.
plants
(eia860_dfs, eia860_transformed_dfs)[source]¶ Pulls and transforms the plants table.
Much of the static plant information is reported repeatedly, and scattered across several different pages of EIA 923. The data frame which this function uses is assembled from those many different pages, and passed in via the same dictionary of dataframes that all the other ingest functions use for uniformity.
- Parameters
eia860_dfs (dict) – Each entry in this dictionary of DataFrame objects corresponds to a page from the EIA860 form, as reported in the Excel spreadsheets they distribute.
eia860_transformed_dfs (dict) – A dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Returns
eia860_transformed_dfs, a dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Return type
-
pudl.transform.eia860.
transform
(eia860_raw_dfs, eia860_tables=('boiler_generator_assn_eia860', 'utilities_eia860', 'plants_eia860', 'generators_eia860', 'ownership_eia860'))[source]¶ Transforms EIA 860 DataFrames.
- Parameters
- Returns
A dictionary of DataFrame objects in which pages from EIA860 form (keys) corresponds to a normalized DataFrame of values from that page (values)
- Return type
-
pudl.transform.eia860.
utilities
(eia860_dfs, eia860_transformed_dfs)[source]¶ Pulls and transforms the utilities table.
- Parameters
eia860_dfs (dict) – Each entry in this dictionary of DataFrame objects corresponds to a page from the EIA860 form, as reported in the Excel spreadsheets they distribute.
eia860_transformed_dfs (dict) – A dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Returns
eia860_transformed_dfs, a dictionary of DataFrame objects in which pages from EIA860 form (keys) correspond to normalized DataFrames of values from that page (values)
- Return type