pudl.etl.cli

A command line interface (CLI) to the main PUDL ETL functionality.

Module Contents

Functions

pudl_etl_job_factory(→ collections.abc.Callable[[], ...)

Factory for parameterizing a reconstructable pudl_etl job.

pudl_etl(etl_settings_yml, dagster_workers, ...)

Use Dagster to run the PUDL ETL, as specified by the file ETL_SETTINGS_YML.

Attributes

logger

pudl.etl.cli.logger[source]
pudl.etl.cli.pudl_etl_job_factory(logfile: str | None = None, loglevel: str = 'INFO', process_epacems: bool = True) → collections.abc.Callable[[], dagster.JobDefinition][source]

Factory for parameterizing a reconstructable pudl_etl job.

Parameters:

  • loglevel – The log level for the job’s execution.

  • logfile – Path to a log file for the job’s execution.

  • process_epacems – Include EPA CEMS assets in the job execution.

Returns:

The job definition to be executed.

pudl.etl.cli.pudl_etl(etl_settings_yml: pathlib.Path, dagster_workers: int, gcs_cache_path: str, logfile: pathlib.Path, loglevel: str)[source]

Use Dagster to run the PUDL ETL, as specified by the file ETL_SETTINGS_YML.