This page describes the processes and scripts that provide the transfer of image and meta data from the TEM's.
Everything is documented within an apache airflow instance. This DAG program provides both task management and monitoring.
The airflow instance currently runs on cryoem-airflow.slac.stanford.edu. Specifically, it runs as a docker compose stack (mainly because i couldn't get the docker swarn airflow web server working.
In particular, the CIFs file share from the TEM cameras are mounted on cryoem-airflow.slac.stanford.edu and then volume bound onto the airflow workers.
The airflow stack is kept under revision control under github.