Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The RUNLIMIT parameter may not provide enough flexibility for certain types of event processing. The For example, the majority of jobs in our a pipeline should complete on time, but some jobs get hung up and could take longer. We want to avoid having to resubmit longer running jobs that get killed off by the LSF scheduler. One solution is to provide a runtime estimate in addition to the RUNLIMIT. The argument syntax for the runtime estimate is '-We [hour:]minute'. The assumption is that most of your the pipeline jobs will complete within the complete with the runtime estimate. The estimate value will also influence backfill. The scheduler will only terminate a job when it exceeds the RUNLIMIT, but not when it exceeds the estimate. Example of a job with a runtime estimate of 15 minutes and a RUNLIMIT of 1 hour:

...