+
Skip to content

ansoncfit/data-infra

 
 

Repository files navigation

data-infra

temporary repo / maybe permanent for CalITP data infrastructure

Repository Structure

  • airflow contains the local dev setup and source code for Airflow DAGs (ie, ETLs)
  • airflow/dags contains source code for ETLs, scripts, more.
  • catalogs contains intake catalogs for semi-static / version data access.
  • jupyterhub contains the image and commands for setting up ETLs to run

pre-commit

This repository uses black and pre-commit hooks to format code. To install locally, run

pip install pre-commit & pre-commit install in the root of the repo.

Running Locally

See airflow/README.md

Contributing

  • Follow the Conventional Commits standard for all commits
  • Use Conventional Commit format for PR titles
  • Use GitHub's draft status to indicate PRs that are not ready for review/merging
  • Do not use GitHub's "update branch" button or merge the main branch back into a PR branch to update it. Instead, rebase PR branches to update them and resolve any merge conflicts.

About

temporary repo / maybe permanent for CalITP data infrastructure

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 94.9%
  • Dockerfile 3.7%
  • Shell 1.4%
点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载