pudl.resources#

Collection of Dagster resources for PUDL.

Module Contents#

Classes#

RuntimeSettings

Encodes runtime settings for the ferc_to_sqlite graphs.

Functions#

dataset_settings(→ pudl.settings.DatasetsSettings)

Dagster resource for parameterizing PUDL ETL assets.

ferc_to_sqlite_settings(...)

Dagster resource for parameterizing the ferc_to_sqlite graph.

datastore(→ pudl.workspace.datastore.Datastore)

Dagster resource to interact with Zenodo archives.
class pudl.resources.RuntimeSettings[source]#

Bases: dagster.ConfigurableResource

Encodes runtime settings for the ferc_to_sqlite graphs.

clobber: bool = False[source]#
xbrl_num_workers: None | int[source]#
xbrl_batch_size: int = 50[source]#
pudl.resources.dataset_settings(init_context) → pudl.settings.DatasetsSettings[source]#

Dagster resource for parameterizing PUDL ETL assets.

This resource allows us to specify the years we want to process for each datasource in the Dagit UI.

pudl.resources.ferc_to_sqlite_settings(init_context) → pudl.settings.FercToSqliteSettings[source]#

Dagster resource for parameterizing the ferc_to_sqlite graph.

This resource allows us to specify the years we want to process for each datasource in the Dagit UI.

pudl.resources.datastore(init_context) → pudl.workspace.datastore.Datastore[source]#

Dagster resource to interact with Zenodo archives.