Development#
- Development Setup
- Running the ETL Pipeline
- Project Management
- Testing PUDL
- Building the Documentation
- Working with the Datastore
- Cloning the FERC Form 1 DB
- Annual Updates
- 1. Obtain Fresh Data
- 2. Map the Structure of the New Data
- 3. Test Data Extraction
- 4. Update Table & Column Transformations
- 5. Update the PUDL DB Schema
- 6. Connect Datasets
- 7. Run the ETL
- 8. Update the Output Routines and Run Full Tests
- 9. Run and Update Data Validations
- 10. Run Additional Standalone Analyses
- 11. Update the Documentation
- PUDL ID Mapping
- Naming Conventions
- Data and ETL Design Guidelines
- Packaging and Dependencies
- Nightly Data Builds
- Infrastructure as Code