Copying files to a local machine
Using scp over multiple nodes is painful. This is a small script that does the job:
- Log onto the control server using ssh with remote port forwarding:
ssh smeuren@fastx3.slac.stanford.edu -Y -R 40000:localhost:40000
ssh smeuren@mcclogin -Y -R 40000:localhost:40000
ssh fphysics@facet-srv20 -Y -R 40000:localhost:40000 - Start the script
bash
source $PACKAGE_TOP/anaconda/envs/python3.7env/bin/activate
python3 ./smeuren/remote.py 40000 - Open a different ssh connection to browse the file system, identify file you want to copy
- Call the local script to download this file
python3 local.py 40000 "/u1/facet/matlab/data/2022/2022-12/2022-12-17/ProfMon-CAMR_LI20_307-2022-12-17-180157.mat"