pudl.ferc_to_sqlite#

Dagster definitions for the FERC to SQLite process.

Submodules#

Package Contents#

Classes#

EtlSettings

Main settings validation class.

Functions#

dbf2sqlite(→ None)

Clone the FERC Form 1 Visual FoxPro databases into SQLite.

xbrl2sqlite(→ None)

Clone the FERC Form 1 XBRL Databsae to SQLite.

datastore(→ pudl.workspace.datastore.Datastore)

Dagster resource to interact with Zenodo archives.

ferc_to_sqlite_settings(...)

Dagster resource for parameterizing the ferc_to_sqlite graph.

ferc_to_sqlite()

Clone the FERC Form 1 FoxPro database and XBRL filings into SQLite.

Attributes#

logger

default_resources_defs

ferc_to_sqlite_full

pkg_source

ferc_to_sqlite_fast_settings

ferc_to_sqlite_fast

defs

A collection of dagster assets, resources, IO managers, and jobs for the FERC to

pudl.ferc_to_sqlite.dbf2sqlite(context) None[source]#

Clone the FERC Form 1 Visual FoxPro databases into SQLite.

pudl.ferc_to_sqlite.xbrl2sqlite(context) None[source]#

Clone the FERC Form 1 XBRL Databsae to SQLite.

pudl.ferc_to_sqlite.datastore(init_context) pudl.workspace.datastore.Datastore[source]#

Dagster resource to interact with Zenodo archives.

pudl.ferc_to_sqlite.ferc_to_sqlite_settings(init_context) pudl.settings.FercToSqliteSettings[source]#

Dagster resource for parameterizing the ferc_to_sqlite graph.

This resource allows us to specify the years we want to process for each datasource in the Dagit UI.

class pudl.ferc_to_sqlite.EtlSettings[source]#

Bases: pydantic.BaseSettings

Main settings validation class.

ferc_to_sqlite_settings: FercToSqliteSettings#
datasets: DatasetsSettings#
name: str#
title: str#
description: str#
version: str#
pudl_in: str#
pudl_out: str#
classmethod from_yaml(path: str) EtlSettings#

Create an EtlSettings instance from a yaml_file path.

Parameters:

path – path to a yaml file.

Returns:

An ETL settings object.

pudl.ferc_to_sqlite.logger[source]#
pudl.ferc_to_sqlite.ferc_to_sqlite()[source]#

Clone the FERC Form 1 FoxPro database and XBRL filings into SQLite.

pudl.ferc_to_sqlite.default_resources_defs[source]#
pudl.ferc_to_sqlite.ferc_to_sqlite_full[source]#
pudl.ferc_to_sqlite.pkg_source[source]#
pudl.ferc_to_sqlite.ferc_to_sqlite_fast_settings[source]#
pudl.ferc_to_sqlite.ferc_to_sqlite_fast[source]#
pudl.ferc_to_sqlite.defs: dagster.Definitions[source]#

A collection of dagster assets, resources, IO managers, and jobs for the FERC to SQLite ETL.