How do I use the DESY ILC grid

ILC VO

Firstly, you need to become a member of the ILC Virtual Organization (VO).

Follow the workflow at https://grid-voms.desy.de:8443/vo/ilc/vomrs which will require several rounds of confirmations and emails.

Somewhat confusingly, there is another ILC VO run by Fermilab located at https://voms.fnal.gov:8443/vomrs/ilc/vomrs.

Setup

This script will setup the LCG grid tools at CERN.

source /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.sh

There is also a script on DESY afs.

source /afs/desy.de/group/grid/UI/GLITE-pro/etc/profile.d/grid_env.sh

The DESY afs script seems to work the best. (I am having trouble running EDG commands with the CERN setup script.)

VOMS Server

It is my understanding that before you do anything, you need to authenticate with a proxy server called a "VOMS server".

voms-proxy-init -verify -debug -voms ilc

This needs to be done at the start of every session.

If you get the message VOMS Server for ilc not known! when trying to run this command, or any other command, then the information about the ILC VOMS server is missing and needs to be installed at your site.

VOMS at DESY

The ilc VOMS file can be found at http://grid.desy.de/etc/vomses/ilc-grid-voms.desy.de and should be added to the list of VOMS configuration data kept in ~/.glite/vomses, or the site's grid administrator can add this information to a central config file.

These commands will download the VOMS file and add the information to the user's config file.

cd ~
mkdir .glite # only needed if .glite does not exist already
cd .glite
wget http://grid.desy.de/etc/vomses/ilc-grid-voms.desy.de # fetch the VOMS file
touch vomses
cat ilc-grid-voms.desy.de >> vomses # add ILC VOMS

Now the voms-proxy-init command should work correctly.

voms-proxy-init -verify -debug -voms ilc

Test Commands

We will use the European Data Grid (EDG) tools as the UI for testing purposes.

If not running from DESY, the EDG commands need to be told about the location of the ILC Request Brokers (RB) for job submission.

In another shell on lxplus, execute the following commands.

source /afs/desy.de/group/grid/UI/GLITE-pro/etc/profile.d/grid_env.sh
cp $EDG_LOCATION/etc/ilc/edg_wl_ui.conf ~

The file ~edg_wl_ui.conf needs to be used in place of "--vo ilc" in the test commands at http://grid.desy.de/ilc/.

Now follow the instructions for submitting a test job at http://grid.desy.de/ilc/ under "Submitting jobs to the Grid".

edg-job-list-match --config-vo ./edg_wl_ui.conf test.jdl

Run a test job.

edg-job-submit --nogui --config-vo ./edg_wl_ui.conf -o test.jid test.jdl

Test job status.

edg-job-status -i test.jid

Get the output.

edg-job-get-output -i test.jid

List files on the mass storage system at DESY.

export LFC_HOST=`lcg-infosites --vo ilc lfc`
lfc-ls -l  /grid