You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 48 Next »

Week of Nov 6th 2017

  • QA Testing
    • Investigate cause of differences between Lauren's plots from NCSA and those generated at NERSC
      • look at 'conda list' on both NCSA and NERSC (no differences discovered)
      • generate cal_refs as was done at NCSA
      • try gcc 6
  • Data Portal
    • Finish off a first round of Richard's plots
  • Installations
    • SLAC
      • Py3 on SLAC RH6-64 for Joanne to test out
    • NERSC
      • finish testing NERSC's cfitsio installation
      • install phosim 3.7.1 for Cori haswell gcc & intel, KNL gcc & intel

Week of Oct 30th 2017

  • Data Portal
    • Plots
  • DC2 prep
    • QA testing
      • w.2017.41 installation plus branches of obs_lsstSim and pipe_analysis
      • Run visitAnalysis, coaddAnalysis, etc
  • NERSC Workflow work
  • NERSC Project Space
    • Work with Mustafa to get MBII-snapshot backed up
  • NERSC Installations
    • w.2017.? stack installation plus sims - waiting on new sims release using the camera geometry updates
    • Phosim 3.7
      • Testing NERSC cfitsio installation
  • SLAC Installations
    • descsoft w.2017.? stack plus sims installation
  • CCS
    • See if there is any prep work necessary for Tony's visit later in Nov
      • Request Nick set up new box with CentOS7
      • set up user accounts and groups
    • Determine if Mike is still coming out ~Nov 1st
  • Attend SuperCDMS meeting concerning their potential move to NERSC.

Week of Oct 23rd 2017

  • Data Portal
    • Richard's Plots - bad channels (in progress)
    • Look at new Report Labels and determine what the DP still requires from the Reports Table
      LSSTTD-1190 - Getting issue details... STATUS  
    • Make sure we request a restart of Tomcat
  • NERSC Workflow work
    • Try out HTCondor and Pegasus on cori21
    • Take a look at Jim's imsim script
  • NERSC Project Space
    • Set the old project directory to read-only (in progress)
      • claim desc ownership of the whole directory space
    • Clear out all directories where the owners have indicated it is fine to do so
    • Determine the end state of merging old project and projecta areas and handling of www
    • Set up disk quota monitor
    • Coordinate HPSS storage of MBII-snapshots
  • NERSC installations
    • Phosim v3.7
      • Coordinate with NERSC to get cfitsio v3410 installed (in progress)
      • Rebuild using NERSC supplied cfitsio
      • Coordinate with Glenn to set up module files
    • Set up software for DC2 testing
    • v14_0 lsst_distrib + sims 2.4.0
  • SLAC installations
    • Set up same imsim at SLAC as used at NERSC for KNL testing (in progress)
    • v14_0 on RH6-64 public (on hold pending resolution to obs_base testCameraMapper.py unit test failure)
      • camera area
      • descsoft
      • test eotest branch
    • v14_0 on IR-2
  • Document KNL vs Haskell mkl imsim testing at NERSC
    • Initial mkl tests indicate no huge improvement - putting testing on back burner for now
  • CCS - still waiting to hear from Peter, I cannot access their TS3 machine to install and test a new version of the test stand subsystem

Week of Oct 16th 2017

  • Richard's plots in DP
    • Complete Sensor Arrival Time plot
    • Create JSON 
  • NERSC installations
    • Phosim v3.7
      • Try out NERSC supplied FFTW 
      • Request new cfitsio v3410 installation required by Phosim
      • Complete installation of all flavors:  haswell-gcc, haswell-intel, knl-gcc, knl-intel
        • Waiting on cfitsio v3410 before knl-intel will be available
  • NERSC Project Space
    • Notify all users of the need to migrate
    • Handle all help requests - migrating some directories to the new projecta area
    • Install disk quota monitor
    • Check on old project status and prepare to set it to read-only
    • Coordinate backup of nkhandai data to tape with Mustafa
  • Install latest version of teststand subsystem at Harvard there is a machine made available - waiting on response from Peter 
  • Keep an eye out for v14 DMstack

Week of October 9th 2017

  • Continue work on Richard's plots in DP
  • LSSTTD-1165 - Getting issue details... STATUS
    • Released Data Portal 0.5.7
  • Testing imSim built on KNL
    • Continue MKL tests at NERSC once the system recovers from the weekend outage
    • Install the same version of the stack at SLAC to allow similar testing with and without MKL
    • Attempt build of DMstack using the intel compiler at NERSC
  • NERSC Project space
    • Install disk quota monitor
    • Coordinate backup of nkhandai data to tape with Mustafa
    • Prepare to set the old project area as read-only
    • Send mail to all owners of files on the old project space
  • NERSC HPSS SRU overallocation
  • Install latest version of datacat-utilities 0.0.8 at SLAC
  • Install the latest teststand snapshot at Harvard to support use of the monochromator when Peter returns.
    • Contacted Peter - I can't connect to the archon machine to install the test stand snapshot
    • Investigate creating a harvard.groovy (perhaps based on TS8bench or TS7) and possibly create a harvard main routine.
  • Keep an eye out for the v14 DMstack release and prepare to install on IR-2 and NERSC
    • This release will include binary installations.. I'm thinking we may still want to install from source, perhaps that's most useful on IR-2, but we'll see.

Week of October 2nd 2017

  • Release DataPortal 0.5.6 which will include
    • Addition of Grade and Procurement labels for the Sensor Acceptance pages
    • RTM assignment
      LSSTTD-1121 - Getting issue details... STATUS
    • NCR "Ready to close"
      LSSTTD-1144 - Getting issue details... STATUS
  • Implement Richard's plots in the DP starting from some of Tony's examples for trending and Richard's python code.
  • Continue testing KNL performance using galsim and imsim
    • Attempt to compile galsim and possibly all of DMstack with the intel compiler
    • Run longer tests using the MKL libraries on Haswell and KNL
    • Rebuild imsim with MKL, using an updated meas_base
  • Install an initial shared stack in the new software area at NERSC for testing as discussed at last week's "Shared Stack" meeting
  • NERSC Project Space
    • Set up an initial quota monitor at NERSC
    • Re-connect with Mustafa to get the mkhandai 42 TB archived to tape.
  • Investigate an upgrade of the monochromator driver at Harvard and confirm that to achieve what Peter plans to do - to run his ATS work in the lab alongside most of the devices from his TS3 setup.. is possible by running both the teststand and rafts subsystem simultaneously.
    • Install latest SNAPSHOT of test stand at Harvard and investigate creating a harvard.groovy (perhaps based on TS8bench or TS7) and possibly creating a harvard main routine.
  • Keep an eye out for the v14 release of the DMstack and prepare to install at SLAC/IR-2 and NERSC.
    Though this is assigned to Jim, so perhaps I have no need to worry about SLAC:
    LSSTTD-1157 - Getting issue details... STATUS

 

  • No labels