This subfolder is a top-level Dagster pipeline for data ingestion.
First, you need a copy of the environment variables; these should go into
.env
and should match the format of .env.sample.
You should then install the dependencies in requirements.txt, then run:
dagster dev
For production deployment, the /docker subfolder has all of the necessary scripts and instructions.