Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Proposal

Define a new command "pfindpipeline find" which is able to return a list of files or directories. This can then be used with xargs (see experiment 3 above). So to search all log files we could use the command:

No Format
pfindpipeline --taskfind obssim-ST-v7r6p1 --process obssim --logfilelogFile | xargs -i grep cob0343 \{\}

or to delete all obsolete working directories we could use

No Format
pfindpipeline --taskfind obssim-ST-v7r6p1 --process obssim --logfilelogFile | xargs -i grep cob0343 \{\}

pfind arguments (work in progress)

Syntax

Wiki Markup
pipeline find <options> <task-name> <process-name> \[<output> ,<output>...\]

<task-name> --task <name>

The task on which to operate. Could allow wildcards or lists for multiple tasks . Can include version and subtasks, e.g. parent(1.0)/child

<process-name> --process <name>

The process name. Could allow wildcards

--logfile

Produce the list of log files

<output>

An item to output. Defaults to workingDir. See valid items below.

--workingDir

Produce a list of working directories

--latest

Show only "latest" items

--all

All (not only latest)

--obsolete

all - latest

--stream <run-range-list>

List of stream ranges (not yet implemented)

--filter <filter-spec>

Filter the results (e.g. exitcode != 0) (not yet implemented)

Supported output items

Item

workingDir

exitCode

stream

createDate

submitDate

endDate

cpuSecondsUsed

host

exitCode

logFile

jobId

executionNumber

isLatest

streamPath