Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Jobs submitted to the general farm of batch systems at SLAC will be scheduled to run according to a cross-queue user-based fairshare priority system.  You can read more about this kind of scheduling  There is more information here www.slac.stanford.edu/comp/unix/package/lsf/currdoc/lsf_admin/index.htm about this kind of scheduling.  The priority of a user's job submitted is dynamically determined based on various factors such as the number of jobs the user has across all the queues in the fairshare, their resource consumption, the number of shares belonging to the user's fairshare group, etc.  The general farm fairshare queue structure can be viewed with the command "/usr/local/bin/bqueues -l short".   This is an example of what the relevant part ofof the output from that command looks like at the time of this writing:

renata@rhel6-64g $ bqueues -l short

QUEUE: short
-- Maximum 21 minutes CPU time [SLAC units]. This is the default queue.

...

SCHEDULING POLICIES: FAIRSHARE BACKFILL
FAIRSHARE_QUEUES: short medium long atlasq atl-analq xlong xxl

USER_SHARES:  [glastdataatlasgrp, 128937875] [glastgrpbabarAll, 4057859] [glastuserscdmsALL, 341872000] [hpsprodgrpexoprodgrp, 6001500] [atlasgrpexousergrp, 34307550] [babarAllgeantgrp, 263323874] [cdmsdataglastdata, 1000854] [exoprodgrpglastgrp, 600366] [exousergrpglastusers, 40025320] [rdgrphpsprodgrp, 3421000] [lcd, 418600] [lcdprodgrp, 1100] [luxlz, 8363500] [rpgrp, 418500] [theorygrp, 10004257] [AllUsers, 2294516086]

SHARE SHARE_INFO_FOR: short/

. 0        
USER/GROUPSHARESPRIORITYSTARTEDRESERVEDCPU_TIMERUN_TIMEADJUST
lcdprodgrp 836 1100278.667000.0 0

0.000

 exoprodgrp  1500 231.000 0 0 0 0exoprodgrp 600 2000.000
geantgrp3874220.46900000.000
luxlz3500212.36300000.000
hpsprodgrp 600 1000200.000000.0 0 0.000       
lcd600lcd 418 139.333000.0 0 0.000       
rdgrp 342rdgrp 342 114.000000.0 0 0.000       
glastdata 854glastdata 1289 13.35200481047.400.000       
glastgrp366glastgrp 405 13.08600143741.500.000
 babarAll      7859babarAll 26332 2.4977054117976.033534250.000       
glastusers25320glastusers 34187 1.5401822086034584.0356533210.000       
atlasgrp 37875atlasgrp 34307 0.53244140263242448.01064378530.000       
rpgrp500rpgrp 418 0.4396203924898.263608610.000       
cdmsALL2000cdmsdata 1000 0.41847205018088.5194655490.000       
exousergrp550exousergrp 400 0.4143604399336.02878010.000       
AllUsers16086AllUsers 22945 0.41421040252849040.0195256380.000
 

theorygrp

      4257theorygrp 1000 0.41391011024314.04983700.000       

USERS: all 

HOSTS: genfells+1 hequfarm+1 dolefarm+1 kisofarm+1 bulletfarm/

Jobs submitted by a user that is not a member of any usergoup will get the priority of the AllUsers group.  Jobs submitted by a user that is a member of a fairshare group may also get the priority of AllUsers if the priority of AllUsers happens to be higher than that of his own group at the time his job is submitted.