pudl.etl.cli
#
A command line interface (CLI) to the main PUDL ETL functionality.
Module Contents#
Functions#
|
Factory for parameterizing a reconstructable pudl_etl job. |
|
Use Dagster to run the PUDL ETL, as specified by the file ETL_SETTINGS_YML. |
Attributes#
- pudl.etl.cli.pudl_etl_job_factory(logfile: str | None = None, loglevel: str = 'INFO', process_epacems: bool = True) collections.abc.Callable[[], dagster.JobDefinition] [source]#
Factory for parameterizing a reconstructable pudl_etl job.
- Parameters:
loglevel – The log level for the job’s execution.
logfile – Path to a log file for the job’s execution.
process_epacems – Include EPA CEMS assets in the job execution.
- Returns:
The job definition to be executed.
- pudl.etl.cli.pudl_etl(etl_settings_yml: pathlib.Path, dagster_workers: int, epacems_workers: int, gcs_cache_path: str, logfile: pathlib.Path, loglevel: str)[source]#
Use Dagster to run the PUDL ETL, as specified by the file ETL_SETTINGS_YML.