Page History

...

• Migration scripts, etc., are maintained in the asp_migration github repo.
• Locations of copies of pre-built Fermi software releases at S3DF:  /sdf/data/fermi/a/ground/releases
• s3df-migration slack channel in the Fermi-LAT workspace.
• Get Started on S3DF - Cheat Sheet
• Migrating L1Proc to S3DF
• ASP Installation Instructions
• Using RHEL6 Singularity Container

• Converting Brian's instructions for converting scriptlets to batch jobs (NB: the code block below has been corrected, but not checked. Here's the link to bvan's original slack message):

  1. Convert your scriptlet to a job, include requisite batchOptions
  2. Include #!/usr/bin/env python3  at the top of your file so it's executable with python3 (on the batch nodes). Ensure your code is compatible with python3. You may need to wrap numeric variables with int or float where necessary.
  3. Emulate locals that are already set. Add a  pipeline object that's added to the scriptlet. Only two methods are supported, setVariable, createStream . Include shell variables as python variables by updating locals() . For the most part, you should be able to just add this to the top of your scriptlet definition:

     
     

     Code Block

     #!/usr/bin/env python3 import os class Pipeline: def setVariable(self, key, value): with open(os.environ["PIPELINE_SUMMARY"], "a") as f: f.write("Pipeline.%s: %s\n" %(key, value)) def createStream(self, task, stream, args): with open(os.environ["PIPELINE_SUMMARY"], "a") as f: f.write("PipelineCreateStream.%s.%d: %s\n" %(task, int(stream), args)) pipeline = Pipeline() locals().update({k:v for k,v in os.environ.items() if "." not in k})

...