please email sanjeev@slac.stanford.edu or cropp@slac.stanford.edu with any problems.

S3df management doesn't like it when heavy compute jobs are run on the interactive cluster (Iana). A solution to this is to run jupyter lab on batch compute on the milano cluster.

Make sure your account is part of FACET or ad:beamphysics before trying to access batch compute. Confused? look here and read the section Accessing AD and FACET Resources.

Jupyter Notebooks via Open OnDemand

VIDEO TUTORIAL

This is the easiest method. 

...

1. login to open ondemand at https://s3df.slac.stanford.edu/ondemand
2. click on the top menu bar and choose interactive apps → Jupyter
3. 
4. Select Custom for Jupyter Image
5. Select Conda Environment
6. Make sure the conda env you pick has jupyterlab installed.  if not: conda install -c conda-forge jupyterlab
7. Customize this text that is shown:

8. Code Block
   export CONDA_PREFIX=<path-to-miniconda3> export PATH=${CONDA_PREFIX}/bin/:$PATH source ${CONDA_PREFIX}/etc/profile.d/conda.sh conda env list conda activate <your-environment-name>

9. Set the path to the conda env setup (CONDA_PREFIX) to run the jupyter notebook. ( conda info | grep "active env location"  can show the path to the current active conda env setup (probably miniforge3). You would need to ssh into iana on s3df, activate a conda env that you made with jupyterlab and then run the command to find its path. ) An example output is /sdf/home/s/sanjeev/miniforge3/
    (an example of setting up a conda env for the first time for jupyter lab is here in the lume impact jupyter example)
10. change <environment> to be the desired conda env path, for example /sdf/home/s/sanjeev/miniforge3/envs/bmad I have a conda env called bmad. Another explanation is here.
11. Click use JupyterLab instead of Jupyter Notebook

12. For run on cluster type select: Batch; s3df; account: FACET; Partition Milano *make sure your account is part of the FACET repo or use ad:beamphysics if your part of that. 

13. Select number of hours and cores (max cores is 120)
14. Configure rest of settings
15. 
16. Launch and connect

...