pudl.etl.static_assets

Dagster assets of static data tables.

Module Contents

Functions

_read_static_encoding_tables(→ dict[str, pandas.DataFrame])	Build dataframes of static tables from a data source for use as foreign keys.
static_pudl_tables(context)	Read static tables compiled as part of PUDL and not from any agency dataset.
static_eia_tables()	Create static EIA tables.
static_ferc1_tables()	Compile static tables for FERC1 for foriegn key constaints.

Attributes

logger

pudl.etl.static_assets.logger

pudl.etl.static_assets._read_static_encoding_tables(etl_group: Literal[static_eia, static_ferc1]) → dict[str, pandas.DataFrame]

Build dataframes of static tables from a data source for use as foreign keys.

There are many values specified within the data that are essentially constant, but which we need to store for data validation purposes, for use as foreign keys. E.g. the list of valid EIA fuel type codes, or the possible state and country codes indicating a coal delivery’s location of origin. For now these values are primarily stored in a large collection of lists, dictionaries, and dataframes which are specified in the pudl.metadata subpackage. This function uses those data structures to populate a bunch of small infrastructural tables within the PUDL DB.

Parameters:

etl_group – name of static table etl group.

Returns:

a dictionary with table names as keys and dataframes as values for all tables labeled as static tables in their resource etl_group

pudl.etl.static_assets.static_pudl_tables(context)

Read static tables compiled as part of PUDL and not from any agency dataset.

pudl.etl.static_assets.static_eia_tables()

Create static EIA tables.

pudl.etl.static_assets.static_ferc1_tables()

Compile static tables for FERC1 for foriegn key constaints.

This function grabs static encoded tables via _read_static_encoding_tables() as well as two static tables that are non-encoded tables (ferc_accounts).