pudl.extract.eia860#

Retrieve data from EIA Form 860 spreadsheets for analysis.

This modules pulls data from EIA’s published Excel spreadsheets.

This code is for use analyzing EIA Form 860 data.

Module Contents#

Classes#

Extractor

Extractor for the excel dataset EIA860.

Functions#

extract_eia860(context)

Extract raw EIA data from excel sheets into dataframes.

Attributes#

logger

raw_table_names

pudl.extract.eia860.logger[source]#
class pudl.extract.eia860.Extractor(*args, **kwargs)[source]#

Bases: pudl.extract.excel.GenericExtractor

Extractor for the excel dataset EIA860.

process_raw(df, page, **partition)[source]#

Apply necessary pre-processing to the dataframe.

  • Rename columns based on our compiled spreadsheet metadata

  • Add report_year if it is missing

  • Add a flag indicating if record came from EIA 860, or EIA 860M

  • Fix any generator_id values with leading zeroes.

static get_dtypes(page, **partition)[source]#

Returns dtypes for plant id columns.

pudl.extract.eia860.raw_table_names = ('raw_boiler_cooling_eia860', 'raw_boiler_generator_assn_eia860', 'raw_boiler_info_eia860',...[source]#
pudl.extract.eia860.extract_eia860(context)[source]#

Extract raw EIA data from excel sheets into dataframes.

Parameters:

context – dagster keyword that provides access to resources and config.

Returns:

A tuple of extracted EIA dataframes.