temporary repo / maybe permanent for CalITP data infrastructure
airflow
contains the local dev setup and source code for Airflow DAGs (ie, ETLs)airflow/dags
contains source code for ETLs, scripts, more.catalogs
contains intake catalogs for semi-static / version data access.jupyterhub
contains the image and commands for setting up ETLs to run
This repository uses black and pre-commit hooks to format code. To install locally, run
pip install pre-commit
& pre-commit install
in the root of the repo.
See airflow/README.md
- Follow the Conventional Commits standard for all commits
- Use Conventional Commit format for PR titles
- Use GitHub's draft status to indicate PRs that are not ready for review/merging
- Do not use GitHub's "update branch" button or merge the
main
branch back into a PR branch to update it. Instead, rebase PR branches to update them and resolve any merge conflicts.