Run a Versioned Release#
So the time has come and we would like to release a
stable version of our
data/code out into the world. By the end of this, we’d like for:
The release notes to have a fully dated release and a narrative overview of what’s changed since the last release.
The git tag
vYYYY.MM.DDto identify a specific version.
stableGit branch to refer to the same commit as that tag.
Our data outputs corresponding to that tag on Zenodo,
pudl.catalyst.coop/stablebuckets in GCS/AWS.
Our code corresponding to that tag on PyPI
The conda package to be updated with the newest code
vYYYY.MM.DDdocumentation on ReadTheDocs
Here’s how to do it!#
Tell the rest of the team you’re planning on releasing a new version of the code in #team. Remind them that any changes to the release notes after the next nightly build has passed need to go into a new version. Create a Versioned Release Checklist issue to track your progress.
The night before you plan to release, update the release notes with a paragraph or two explaining what this new release is, and attach a specific date to the release.
Wait for the nightly build to pass with your release notes updates.
If the nightly build passes, push a git tag
vYYYY.MM.DDthat points at the commit which just passed the nightly build. This will kick off another build.
If that build passes, verify the following:
GCS/AWS distribution buckets have the appropriate data
vYYYY.MM.DDpoint at the same Git ref
vYYYY.MM.DDversions have the latest changes in the release notes
PyPI has the most current version of our code
Verify that the Zenodo draft deposition has all the expected data (raw FERC databases, PUDL database, everything the right size. Compare to the files in the GCS/AWS distribution buckets).
Update the Zenodo metadata to include the description from the release notes and update the links to other resources related to the release. Make sure all the metadata fields are complete and accurate.
Publish the Zenodo deposition! Wahoo! You’re now done!
Except… within 24 hours after the PyPI version is updated, we’ll get a PR in the PUDL conda-forge feedstock repo from the @regro-cf-autotick-bot updating our
condapackaging. Review the PR, updating dependencies and CLI entrypoints as needed. The dependencies listed in the
meta.yamlrecipe should be the same as those listed in our
pyproject.toml, and should be pinned to the actual versions appearing in
environments/conda-linux-64.lock.yml. Investigate any superfluous or missing dependencies identified by the
conda-forgeanalysis, and remove/add them as needed to ensure that we are explicitly including all of our direct dependencies in