`pudl.ferc_to_sqlite`#

Dagster definitions for the FERC to SQLite process.

Submodules#

pudl.ferc_to_sqlite.cli

Package Contents#

Classes#

EtlSettings

Main settings validation class.

Functions#

`dbf2sqlite`(→ None)	Clone the FERC Form 1 Visual FoxPro databases into SQLite.
`xbrl2sqlite`(→ None)	Clone the FERC Form 1 XBRL Database to SQLite.
`datastore`(→ pudl.workspace.datastore.Datastore)	Dagster resource to interact with Zenodo archives.
`ferc_to_sqlite_settings`(...)	Dagster resource for parameterizing the `ferc_to_sqlite` graph.
`ferc_to_sqlite`()	Clone the FERC FoxPro databases and XBRL filings into SQLite.
`ferc_to_sqlite_dbf_only`()	Clone the FERC FoxPro databases into SQLite.
`ferc_to_sqlite_xbrl_only`()	Clone the FERC XBRL databases into SQLite.

Attributes#

`logger`
`default_resources_defs`
`ferc_to_sqlite_full`
`ferc_to_sqlite_fast_settings`
`ferc_to_sqlite_fast`
`defs`	A collection of dagster assets, resources, IO managers, and jobs for the FERC to

pudl.ferc_to_sqlite.dbf2sqlite(context) → None[source]#: Clone the FERC Form 1 Visual FoxPro databases into SQLite.

pudl.ferc_to_sqlite.xbrl2sqlite(context) → None[source]#: Clone the FERC Form 1 XBRL Database to SQLite.

pudl.ferc_to_sqlite.datastore(init_context) → pudl.workspace.datastore.Datastore[source]#: Dagster resource to interact with Zenodo archives.

pudl.ferc_to_sqlite.ferc_to_sqlite_settings(init_context) → pudl.settings.FercToSqliteSettings[source]#

Dagster resource for parameterizing the ferc_to_sqlite graph.

This resource allows us to specify the years we want to process for each datasource in the Dagit UI.

class pudl.ferc_to_sqlite.EtlSettings(_case_sensitive: bool | None = None, _env_prefix: str | None = None, _env_file: pydantic_settings.sources.DotenvType | None = ENV_FILE_SENTINEL, _env_file_encoding: str | None = None, _env_nested_delimiter: str | None = None, _secrets_dir: str | pathlib.Path | None = None, **values: Any)[source]#

Bases: pydantic_settings.BaseSettings