Page History

Snowmass https://snowmass21.org/computational/start

Week of 12 April 2021

•  pgpool
•  deploy redmapper in desc-python:bleed
•  sn-py-dev
•  Point Johann at Scott's data and contact nersc to update ownership
•  Arrange all Work Plan mtgs
•  Coding Guidelines Reboot
•  descqa script update
•  snana performance test
•  CI/PS discussion
•  Portal update DR6-v2 and follow up on coadd images
•  risk registry
•  Log of all past WG convenres and committee members
•  write up NERSC work
•  OC mtg
•  mtg with OM & DOMs
•  updated desc-drp-stack with new parsl branch, ndcctools

Week of 29 March 2021

•  NERSC
  •  continue disk cleanup
  •  deploy pyspark
  •  test desc-python with notebooks
  •  Update jupyter Confluence doc adding restarting Hub and fixing anchors
•  CO
  •  check on SNANA runtimes
  •  reach out to Debbie concerning NERSC onboarding
•  DESC DM
  •  spin up postgres 13 plus pgpool
  •  spin up gen3 workflow with web front end
  •  Upgrade public portal to include DR6 v2
  •  meet with James Perry on Thursday
  •  DESC DM/DA mtg
•  DOM
  •  meet with Manu
  •  Poke to set up June NERSC onboarding session
  •  OC
  •  Mgmt meeting
  •  Leadership mtg
  •  light census query
  •  newsletter query for new members
  •  add new South African institution
  •  update dates for a couple of members
  •  risk registry
  •  learn more google sheets
  •  follow up on Slack workspaces
  •  collect quarterlies
  •  Update DB with Alex's instittion fixes and expand with latex name
•  CC
•  nEXO

Week of 15 March 2021

•  NERSC
  •  Check on Spin Postgres Performance
  •  Deploy Postgres v13
  •  Continue cleaning up CSCRATCH for descdm
  •  Clean up CSCRATCH for desc account
  •  Prepare 2 coadd tracts for public release via portal
  •  Test https://github.com/scanon/container_proxy for use with Shifter
  •  Test https://github.com/scanon/container_proxy with our Shifter & gen3 stuff
  •  Try certbot ranger
  •  Set up new desc-python:pyspark
    •  Coordinate with Stephane to get this set up in a maintainable way
•  CO
•  DESC DM
  •  DESC DM/DA meeting
•  SLAC
•   
•  DOM
  •  DM/DIA meeting on Monday
  •  Set up computing onboarding session
  •   
•  CC
  •  PubBoard Rotation
    •  announce to CC
    •  arrange chat with PubManagers
  •  MC rotation

Week of 8 March 2021

•  NERSC
  •  shifterimg w_2021_08 - w_2021_10 use similar .eups areas and seem to cause some confusion.  Moving my .eups cache helped..  Not sure what to do more generally.  MIght want to do "shifter -E" more generally
    
•  CO
•  DESC DM
•  DOM
•  CC
•  Fermi
•  nEXO

Week of 1 March 2021

Week of  22 Feb 2021

•  NERSC
  •  Update all py envs for GCRCatalogs 1.3.0
  •  Update py envs for pyccl v2.2.0
  •  Handle new user requests in iris
  •  Get Postgres Spin DB going
  •  Confirm with NERSC when the next quarterly reduction might take place
  •  Meet with Rick Kessler concerning SNANA disk and CSCRATCH needs
  •  set up Rick's script for disk use
•  CO
•  DESC DM
  •  Write agenda, attend, run, note take DESC DM/DA meeting
  •  invite PZ folks to next DESC DM/DA meeting
  •  Run 3.1i DR3 through validation notebook
•  CC
  •  Attend monthly CC meeting
  •  Membership and PubBoard rotation work
    •  present status to CC
    •  contact potential nominees
•  DOM
  •  attend mgmt mtg
  •  Get Onboarding email script going
  •  set up empty Trello board
  •  new desc-ops-technical channel
•  Fermi
•  nEXO
  •  address questions running singularity on SDF

Week of 15 February 2021

•  NERSC
  •  Help Bruno migrate DIA data to CSCRATCH and use shifter jobs
  •  Start up initial Postgres Spin app
  •  Announce Cori Outage
  •   
•  CO
  •  Agenda, note take and run DESC DM/DA
  •  Invite Emily to present woes running at NERSC at upcoming DESC DM/DA
  •  Invite Ben & Tom to present at next DM/DA
  •  Attend CSS meeting
  •  Attend SNWG PS meeting where they discuss Gen3 plans
  •  Look at WL Shear Projects in prep for Monday Meeting
  •  dustmaps package
  •  Update desc-stack-weekly for w_2021_07 and w_2021_08, where the new rubin-env is in use.
•  CC
  •  Send emails to potential MC and PubBoard candidates
  •  Deal with rejections and find additional candidates
•  DOM
  •  Attend Leadership Meeting
  •  Attend Mgmt Meeting
  •  Attend Ops Committee Mtg
  •   

Week of 1 February 2021

•  Attend DESC Collab Meeting
  
•  NERSC
  •  Address desc-python issue from user who was initially unable to set up user package alongside desc-python
  •  Update all NERSC Confluence Docs
  •  Bring desc-python repo up to date with desc-python at NERSC to allow IN2P3 to update their install
  •  Handle new user requests
  •  Ferry Bruno's job allocation increase request
  •  Start process of migrating from lsstdesc-portal.nersc.gov to another site and SSL certificate by working with Brian & Tony & NERSC
•  CO
  •  Upgrade CCL for new release in all desc python environments
•  DESC DM
  •  Test gen3 bps at NERSC using CVMFS
  •  Update gen3_workflow to use shifter
  •  Investigate how to use singularity & slurm in gen3_workflow

Week of 25 January 2021

•  NERSC
  •  Postgres Spin deployment
  •  set up cron job for desc-python:bleed
•  DESC DM
  •  DM/DA mtg
  •  gcr-catalogs update desc-python:bleed workflow to allow automated updates
•  CC
  •  respond to various elections
  •  Membership Committe & PubBoard rotations - create nomination list
  •  Prepare Jan DESC newsletter entry
•  CO
  •  Run2.2i DR2 and Run2.2i DR6-v2 releases
    •  reorg butler data to reside under /global/cfs/cdirs/lsst/shared/DC2-prod
    •  reingest raw data for new location of sim
  •  dust off desc-drp-stack image and upgrade for Gen3 current weeklies
    •  Slurm support
•  Fermi
  •  software meeting
•  nEXO

Week of 18 January 2021

•  NERSC
  •  attend NERSC NUG concerning Perlmutter
•  DESC DM
  •  Update DC2 Data portal to handle ANL endpoint
  •  Prepare updated desc-drp-stack docker image for Gen3
•  CC
  •  CC monthly meeting
  •  MC & PubBoard rotation discussion
•  CO
  •  Attend CSS meeting
  •  Fix failing desc-python:bleed builds
  •  Update gcr-catalogs master workflow to update desc-python:bleed
•  Fermi
•  nEXO

Jan

•  Write up Run2.1 & Run3.1 descriptions
  
•  Deal with versioning of DR6

Week of 7 December

•  Ingest Run2.2i @ NERSC
  
•  Get initial web site up adn running
•  DESC Note
•  NERSC
  •  Recheck on user requests
  •  add in description of Fawad's Compute request
•  Fermi
  •  workbook update
•  nEXO
  •  event viewer

Week of 30 November

•  Sprint Week
  •  Update all DESC conda environments with new GCRCatal
•  nEXO data
  

Week of 16 November

•  CO
  •  write agenda, attend, potentially run and note take for CO meeting
  •  set up Zoom #s for Sprint week
•  NERSC
  •  shut down desc-python:bleed scheduled build for now
•  DESCDM
  •  write agenda, announce, and run DESC DM/DA mtg
•  CC
  •  attend SBPC update and note take
  •  Write up DESC newsletter entry
  •   
•  Fermi
•  SLAC
•  nEXO
  •  attend software meeting

Week of 9 November

•  CO
  •  attend CS meeting
  •  Help create lsstdesc-env conda-forge package
•  NERSC
  •  install intake in desc-python:bleed
  •  follow up on CVMFS problems with sqlite3
  •  Run a proper DR6 Gen2 ingest
  •  Create SPIN Postgres
  •  Test SPIN website
•  DESCDM
  •  handle DESC DM/DA meeting
  •  Discuss GCR future with Yao & Joanne
  •  Check on DR6-WFD warps
  •  Look at DR2 object catalogs to regenerate the ones fixed by the finished tract/patch processing
•  CC
  •  announce, attend and run CC meeting
  •  handle OMP amendment voting
  •  handle PM amendement voting
    •  edit draft collaboration announcement
  •  Write up DESC newsletter entry
•  Fermi
•  SLAC
  •  attend ADASS as possible
•  nEXO

Week of 2 November

•  CO
  •  attend CS meeting
•  NERSC
•  DESCDM
  •  DESC DM/DA meeting
•  CC
•  Fermi
•  SLAC
•  nEXO

Week of 26 October

•  CO
  •  Contact James P & George B for CO meeting
  •  Write agenda, attend and note take for CO meeting
  •  Upgrade GCRCatalogs to v1.0.2 for all python environments
  •  Review DC2-analysis tutorials and automate beavis running
•  NERSC
  •  attend GPU webinar
  •  Update desc-stack-weekly for w_2020_44
    •  automate those builds
  •  Follow up on Jupyter issues on Monday
  •  Deal with reported issues with MPI and nbodykit in desc-python env
  •  Help SN group upgrade to GCC 9.3.0
  •   Address question concerning permissions
    
•  DESC DM
  •  Announce, run, write agenda, for DESC DM/DA
  •  Complete initial set of DR2 object catalogs
  •  Copy matched catalogs to shared area at nersc https://github.com/LSSTDESC/desc-help/issues/49
•  CC
  •  Help write up slides, update agenda for DESC-wide Software Policy meeting
  •  Follow up on SBPC DESC-wide meeting
  •  Schedule November CC meeting
  •  ask MC to send out full membership announcement to collab
  •  Prepare and send email to DESC members reminding them to update DB entries
  •  Follow up on SNC
  •  Prepare OpaVote for ratification
  •  Prepare Collaboration-wide comment period for FM amendment
•  SLAC
•  Fermi
•  nEXO

Week of 19 October

•  CO
  •  attend CS meeting
  •  finish Gateways seminars
  •  Continue viewing JupyterCon
•  NERSC
  •  try out Globus Spin app
  •  update user on how to intall nbodykit
  •  Address various desc-help requests
•  DESC DM
  •  announce, write agenda, note take and run DESC DM meeting
  •  Produce object catalogs for all DR2 tracts where reasonable
•  CC
  •  attend, run CC Mtg
  •  Update SRPC page
  •  Announce SP DESC-wide meeting
•  SLAC
•  Fermi
•  nEXO
  •   attend software meeting

Week of 12 October

•  CO
  •  attend PS meeting
  •  attend Gateways
  •  attend JupyterCon
  •  attend Rubin Bootcamp
  •  attend SSim meeting
  •  Update Jupyter at NERSC Confluence page
•  NERSC
•  DESCDM
  •  attend TJP meeting to help present DC2 data availability
  •  write agenda, note take, attend DESC DM/DA
•  CC
  •  Stand up CCNC
  •  Prepare for Oct 19 meeting
  •  OMP ratfication
•  SLAC
•  Fermi
•  nEXO

Week of 5 October

•  CO
  •  Attend JupyterCon tutorials
  •  Attends parts of Snowmass
  •  Q4 update
•  NERSC
  •  Follow up on Humna's questions about trouble using desc-stack during Cori outage
  •  Post NERSC Cori updates to desc-nersc
  •  Check on HPSS storage use
  •  Work out issues connecting to jupyterhub with CSCRATCH unavailable.
  •  descqa website problems
•  DESCDM
  •  Attend ParslFest
  •  Follow up on DR2 WWT data
•  CC
  •  Announce potential CCNC members to CC and gain approval
    •  send invites
  •  Announce CC Oct meeting, update DESC calendar, alert SP team, write agenda
•  SLAC
•  Fermi
•  nEXO
  •  Test SDF for nEXO user using singularity
  •  Set up new nEXO SDF space
  •  Start up build to set up a private docker image including nexo-offline to test with Yee

Week of 28 September

•  CO
  •  Attend CS meeting
  •  Prepare for CO meeting
  •  Attend DIA meeting
•  NERSC
  •  set up data for WWT
  •  check on desc-bleed
  •  set up re-useable Gen2/Gen3 repo at NERSC
  •  refresh small dataset on HPSS
•  DESCDM
  •  Write agenda, announce, note take, attend DESC DM/DA meeting
  •  Back up DR2 calexps just in case
•  CC
  •  Get DESC-wide meeting set up for SRPC and SBPC
  •  Stand up CCNC
  •  Work on scheduling Oct CC Meeting
•  SLAC
•  Fermi
•  nEXO
  •  set up nexo-offline on SDF with Yee

Week of 21 September

•  CO
  •  Attend SSim meeting
•  NERSC
  •  Set up Transfer for WWT
  •  Transfer DC2 Run2.2i to lsstdev
  •  check on desc-bleed
•  DESC DM
  •  Announce, write agenda, attend DESC DM meeting
  •  Grab updated Gen2 calibration flats for Gen3 testing
  •  set up Gen2/Gen3 repo at NERSC
  •  Move on with Gen3 testing at NERSC
•  CC
  •  Sept CC meeting
  •  MRPC Meeting
  •  Provide newsletter update
  •  Announce Software Policy draft
•  SLAC
•  Fermi
•  nEXO
  •  Work with Yee to set up nexo sims on SDF
  •  Software meeting

Week of 14 September

•  CO
  •  write agenda, take notes for CO meeting
    •  announce meeting and invite DMers
      
•  NERSC
  •  Set up transfer for WWT
  •  Update desc-python:bleed and turn automatic installation back on
    
•  DESC DM
  •  write agenda, attend, take notes for Wednesday meeting
  •  Get DR6 WFD annoucement out the door
  •  organize warps and put them on CSCRATCH
  •  fix up dr2 calexps from Run2.2i
  •  regenerate tract2visit sqlite DB
•  CC
  •  set up Sept mtg time
  •  discuss SRP edits
  •  Push on CCNC and SNC meetings
  •  Contact 2019 SNC about survey
    
•  Fermi
•  Slac
•  nEXO
  •  attend Slac computing discussion on Thursday
  •  attend software meeting
  •  respond to issues submitting jobs on GPUs
  •  Work with Yee to set up some modules on SDF
    •  Figure out a good production version using LLNL's install
      

Week of 7 September

•  CO
  •  attend CS meeting
    
•  NERSC
  •   add ceci to desc-python
  •  add ceci to desc-stack
    
•  DESC DM
  •  write agenda, attend, note take for DESC DM meeting
  •  Keep warp copying going
  •  Update scripts to find the warps left to copy and try globus instead
  •  Chat with Tom about warps
  •  Set up tract2visit mapper for DR2
  •  Find uband noPSF config discussions
    
•  CC
  •  Set up Sept CC MTG poll
  •  Push along SNC and CCNC
    
•  SLAC
•  Fermi
•  nEXO
  

Week of 31 August

•  CO
•  NERSC
  •  check on descdm quota
    
•  DESC DM
•  CC
  •  Aug CC meeting notes for collaboration
  •  Get back to meetings committee concerning their question
  •  get MRPC meeting set up
    
•  SLAC
•  Fermi
  
•  nEXO
  •  attend software meeting
  •  Try out GH Actions
    

Week of 17 August

•  CO
  •  https://github.com/LSSTDESC/desc-help/issues/35
    
•  NERSC
  •  help SN set up a conda environment
    •  meet with Bruno and Rick
    •  inquire about TxPipe
      
  •  look at running sn-pipe in tutorial notebooks
    
•  DESC DM
  •  agenda, attend DESC DM/DA meeting
  •  continue pulling over Run2.2i DR6 data from CC
    
  •  Prepare for DR6 release
    •  back up pixel level data
    •  remove unwanted tracts and patches
      
  •  Reach agreement on what is DR6d
  •  Update DC2 calibration headers to adhere to new CALIB_ID format
  •  Y1 warps for DR2
  •  add /usr/bin/time to shifter image for parsl DR2 runs
  •  data transfer to lsst-dev all of Run2.2 and Run3.1
  •  Clean up CSCRATCH
    
•  CC
  •  announce, write agenda, attend Aug Meeting
  •  write up DESC-wide minutes
  •  complete MRPC note and send
  •  Put out one more call for CCNC and SNC members
  •  Questionnaire Survey
    
•  SLAC
  •  glastsys password
  •  performance review
•  Fermi
•  nEXO
  •  attend software meeting
  •  test free github area
  •  look at open source chat tools to replace Slack
    

Week of 3 August

•  CO
  •  attend leadership meeting to update SRM
  •  export Zoom stats
  •  Size of DC2 files
  •  fverify Run3.1i sim files
    
•  NERSC
  •  update sn repo wth NERSC instructions
  •  test GHI
  •  setup new SN min
  •  rsync coadds again, consider cron
    
•  DESC DM
  •  Copy DR6 coadd data to NERSC
•  CC
  •  poll for August meeting
    
•  Fermi
•  nEXO
  •  attend software meeting
  •  add more users to nexo UNIX group
    

Week of 27 July

•  CO
  •  Complete Q3 report
    
•  NERSC
  •  Reorg Run1.2x data to reside on CFS
  •  Back up Run3.0i data on HPSS and remove from CFS
  •  Finish cleaning up my CSCRATCH
  •  Clean up desc's CSCRATCH
  •  Setup automated running of DC2Analysis tutorials at NERSC
  •  add selenium and python-snappy to desc-python https://github.com/LSSTDESC/desc-help/issues/31
    
    •  need to fix up desc-python-bleed
      
•  DESC DM
  •  Upgrade desc-stack-weekly for next DM weekly, which hopefully fixes their conda install issues
  •  Reinstall Run2.2i Gen3 repo using latest DM weekly
    
  •  Update tutorial notebook for Gen3
  •  IPP eups
  •  setup rsync of DR6 WFD coadds
    
  •  Store Run2.2i WFD in HPSS
    •  Y1
    •  Y2
    •  Y3
    •  extract unneeded Y4 and Y5 files
    •  Y4
    •  Y5
      
•  CC
  •  write up June monthly meeting notes
  •  schedule August meeting
    •  send out poll
      
•  SLAC
  
•  Fermi
•  nEXO
  •  Evaluate open source chat options
    

Week of 20 July

•  Attend collaboration meeting
•  Install new desc-python-dev to downgrade pyarrow for desc-pyspark
•  complete Gen3 Run2.2i demo repo
•  Set up desc-stack-weekly-latest for w_2020_27 to be used with Gen3 repo
  
•  Write up notes for others to run notebook examining Gen3 repo 
•  nEXO
  •  respond to Samuele's questoins about CVMFS
  •  respond to Vladimir's data proposal
    

Week of 13 July

•  CO
  •  attend WL meeting
  •  Write up builder nomination letters
  •  Announce, attend, note take CO meeting
    
•  DESC DM
  •  announce, attend, note take DESC DM/DA meeting
    
•  NERSC
  •  set up Run2.2i Gen3 repo
  •  Fix entrypoint for desc-bleed
    
•  CC
•  SLAC
•  Fermi
•  nEXO
  •  attend software meeting
  •  create, test and install new nexo-python docker image at SLAC and announce
    
  •  set up nexo-base cpuonly pytorch container
    •  reproduce success
  •  Update Singularity instructions to include how to submit jobs to bsub ( and slurm)
    

Week of 6 July

•  CO
  •  ask Debbie to speak at next CO meeting
  •  attend first half of DIA meeting
    
•  DESC DM
  •  Write agenda, note take and attend DESC DM / DA
    
•  NERSC
  •  Back up Run3.0 sim data to HPSS
  •  Back up truth catalogs to HPSS
  •  finish setting up dustmaps
  •  add v20 stack-sims image
    
  •  setup Gen3 repo in postgres (started)
    
  •  back up catalogs https://docs.google.com/presentation/d/1GErsSx1zNKtshnfWocCgUPxbmBtTkSuIHKUzAbx9Ae0/edit#slide=id.g73aaf4c5c5_0_3
  •  Copy out July 7th version of metacal DR6a merged tract parquet files
  •  Update desc-python & desc-stack for pyarrow, dask, and distributed: https://github.com/LSSTDESC/desc-help/issues/25
    
•  CC
  •  Write up June meeting notes for DESC
  •  Check on black lives matter Slack channel
  •  follow up on update to OMP
  •  Follow up on updates to Membership Policy
  •  
    
•  Fermi
•  SLAC
•  nEXO
  •  attend Slac computing discussion
  •  attend software meeting
    
  •  Update nexo-base to use py3.7
  •  Update nexo-base to install pytorch cpuonly
  •  Update nexo-base to install pytorch with cudatoolkit == 10.0 for SLAC compatibility
  •  Update singularity doc to include installation at SLAC instructions
  •  Update Singularity instructions to include how to submit jobs to bsub ( and slurm)
    

Week of 29 June

•  CO
  •  Finish up slides for DC2 update for WL and present
  •  Help plan Gen3 sessions at collab meeting
    
•  DESC DM
  •  Announce, write agenda, and note take DESC DM meeting
    
•  NERSC
  •  Count up data sizes of all Run 2.2 and 3.0 FITS
  •  fverify all Run3.0 files, update sqlite tracking db and notify Fabio we are ready to transfer
    
  •  Fix up desc-bleed and make sure build is scheduled and cron job set  up to import into shifter
  •  set up rsync of object catalog area at CC (set up cron job to continue daily updates)
  •  set up rsync of metacal
    
  •  finish setting up dustmaps
  •  add v20 stack-sims image
  •  set up DR2 calexps for descdm
  •  Clean up descim CSCRATCH
  •  Back up truth catalogs to HPSS
    
•  CC
  •  Send Membership Committee Annual report to CC
  •  Follow up on updates to Membership Policy
  •  Check on SBPC draft to make sure it is not publically available.
  •  Follow up with SRPC to make their google doc draft as a draft
    
•  SLAC
•  Fermi
•  nEXO
  •  add more users to GitHub repo
  •  add more users to nexo UNIX group and look into ongoing inconsistent group membership on RHEL6 and centos7
  •  inquire about SLAC backup policies
    

Week of 22 June

•  CO
  •  attend CI interviews
  •  set up desc-stack-sims for v20 - but first perhaps sort out which sims weekly to use with it (22 or 24)
    
  •  set up desc-stack for v20 just create the tag, don't make it the productoin desc-stack
    
•  DESC DM
  •  scrape metacal logs and ?,?_nImage.fits for exposure info
  •  Setup notebook to look at data
    
•  NERSC
  •  clean up descim area
  •  back up truth catalogs
  •  rsync object catalogs and coadd from CC
  •  setup rsync cron job
    
  •  Handle desc-help #22 copying files for Sam
  •  set up cron job for desc-python-bleed
    
•  CC
  •  Write up June meeting minutes for DESC
    
•  SLAC
•  Fermi
•  nEXO
  •  attend software meeting
    

Week of 15 June

•  CO
  •  attend CS meeting
  •  attend DESC-wide meeting
  •  attend DC2 meeting
    
•  DESC DM
  •  setup CI for desc-drp-stack
    •  add test for numba
    •  add pyccl test for desc-stack
      
  •  set up desc-stack weekly images
    
  •  Look at GH actions environment differences: https://github.com/actions/virtual-environments/blob/ubuntu18/20200604.1/images/linux/Ubuntu1804-README.md
  •  merge PR#221 in obs_lsst
  •  Look into adding configs to IPP
  •  Join Snowmass mailing lists and slack channels
  •  add dustmaps packages to desc-stack (and possibly desc-python)
    
•  NERSC
  •  https://github.com/LSSTDESC/desc-help/issues/19
    
•  CC
  •  revise EDI committee member invite
  •  send EDI committee invites
    
  •  Set up June meeting and write agenda
  •  announce EDI committee
    
  •  attend CC meeting
    
  •  Update trello
  •  Retrieve GoogleForm response and send to CC
    
•  SLAC
  •  add DESC computing doc to KIPAC github
    
•  Fermi
•  nEXO
  •  Livermore workshop
  •  Meet with Lisa
  •  Update SLAC wiki page to fix broken links
  •  Try setting up LHC libraries again
  •  Update SLAC wiki page doc
    

note stack-jupyter:prod was pointing to v19_0_0-v3r1 moving to v19_0_0-v6r1

Week of 8 June

•  CO
  •  attend SSim meeting
    
•  DESC DM
  •  Set up and attend DR2 processing meeting
  •  FInish setting up DR2 repo
  •  Meet, set up agenda, note take, to discuss DR2 processing at NERSC
  •  Update Run3.0i Confluence page to include pointers to data and software versions
  •  Validate Run3.0 y1-y3 fits files
  •  Update desc-drp-stack image to include llvmlite 0.30.0
    
•  NERSC
  •  Create ticket to help user with UNIX group membership
    
•  CC
  •  Call Dawson vote for EDI
  •  Announce end of vote for PubBoard
  •  Create poll for June Meeting 
  •  Help draft strike statement
    
•  SLAC
  •  
    
•  Fermi
  •  Cancel software meeting
  •  Rebuild 20-10-04-gr07 to compare lib/<variant> vesus lib structure obtained from Jenkins versus local build
    
•  nEXO
  •  attend sims meeting
  •  add another user to the nexo group
  •  closeout SLAC IT ticket concerning group membership across rhel6 and centos7
  •  Investigate NEST submodule failure - the branch with the commit was deleted
  •  Test Nest update PR 141 and merge and inform Jason Bane of fix
    

Week of 29 May

•  CO
  •  Write up agenda, attend and note take for CO meeting
  •  Attend Leadership meeting
    
  •  Listen in to WL meeting
  •  Reorg DC2 Confluence page: DC2
    
  •  DC2 Hack Day June 5th
    
    •  Go over Confluence Doc
    •  check on desc-dm-dc2 repo and update any areas to use CFS and add in Run2.2i
    •  Check on DC2-Analysis
    •  Transfer DR6 object catalogs to NERSC
      
  •  Provide desc-stack-weekly
    
•  DESC DM
  •  Announce, write agenda, note take DESC DM meeting
  •  set up new desc-drp-stack repo and got new v19-v2 docker image and wrote up doc for Tom
  •  Started setting up new DR2 repo, need to request new quota and figure out how much room DR2 might take up.
    
•  NERSC
  •  Attend Super facility Brown Bag
  •  Transfer registry.sqlite3 file from CC after DR6 calexp transfer
    
•  CC
  •  Post May CC meeting Confluence Page
    
•  SLAC
  •  Attend Virtual Residence when possible: http://www.oscer.ou.edu/virtualresidency2020.php
    
•  Fermi
  •  annouce software meeting
  •  Check on new "externals" directory for M.E.
    
•  nEXO
  •  Attend sims meeting
     
  •  Copy over more chargeSim files to SLAC
  •  Set up Doxygen for Lisa
  •  Provide example running 2 instance of the same service
  •  Test CMake ExternalData_OBJECT_STORES
  •  Announce SLAC FTP site
  •  Provide incident example
  •  send Tony Dockerfile
  •  update Dockerfile for Doxygen
    

Week of 25 May 2020

•  CO
  •  Attend CS meeting
  •  Clean up desc-python doc and yaml files
    
•  DESC DM
  •  Announce, write agenda, note-take DESC DM
    
•  NERSC
  •  Request full copy of DR6 calexps from CC
  •  Follow up on outstanding NERSC account requests
  •  Attend Superfacility Brown Bag - SPIN
  •  Request early access to rancher 2
    
•  CC
  •  Finalize MCPs registration wording
  •  Summarize May meeting minutes for DESC
  •  Provide CC summary for DESC newsletter
    
•  SLAC
•  Fermi
  •  Annouce software meeting
    
•  nEXO
  •  copy chargesim data files to SLAC
  •  Set up doxygen for Lisa
  •  Advertise FTP area and updated CMake files
    

Week of 18 May 2020

•  CO
•  DESC DM
  •  Announce, write agenda, write notes for DESC DM meeting
    
•  NERSC
  •  https://github.com/LSSTDESC/desc-help/issues/17
  •  Add GCRCatalgos master to desc-python-dev
  •  Attend SuperFacility Brown Bag
  •  Attend SIGEUF
  •  Update desc-stack and desc-python with new v0.17.0 GCRCatalogs
  •  Inform DESC user when over Computing allocation
    
•  CC
  •  attend CC meeting (note take on the side)
  •  WRite up DESC summary for meeting
  •  Work out PubBoard rotation
  •  Respond to Membership Committee email concerning annual report
    
  •  Update draft for note to Meetings Committee concerning upcoming registration 
  •  update CC trello
  •  Write up possible update to MCP request on registation form
    
•  SLAC
•  Fermi
  •  announce s/w meeting
    
•  nEXO
  •  Meet with Lisa
  •  Poke Tony about Jenkins builds and web accessible area for doxygen output
  •  Set up new doxygen for Lisa and test it out
    

Week of 11 May 2020

•  CO
  •  Announce, write agenda, and note take for CO Meeting
    
•  DESC DM
  •  Announce, write agenda, and note take DESC DM meeting
  •  Refresh HSC Gen3 example at NERSC
  •  Demonstrate gen2togen3 conversion using DMstack w_2020_19 and Run2.2i data
    
•  NERSC
•   
  •  Continuing move to shared area
    •  copied PhotoZDC2 catalogs: https://github.com/LSSTDESC/gcr-catalogs/issues/424
    •  Copy old and new Buzzard catalogs
    •  descqa/v1
    •  SSim data
  •  Transition WGs to CFS
    •  CL
    •  CS
    •  LSS - created new area and requested current owners move content
    •  PZ
    •  SSim
    •  TJP - removed content as agreed
    •  WL - created new area and in contact with conveners to determine who will handle the data move
  •  Prepare for WG NERSC migration
    •  Announce on desc-announce
    •  Alert all WGs
    •  Back up old and new descqa areas
  •  attend NERSC brown bag series - New Data Management
  •  Inquire about NERSC DB services
•  CC
  •  write up agenda for May 18th meeting, post entry on DESC Calendar
    
  •  attend SBPC DESC-wide meeting
  •  write up draft announcement of SRPC status
    
•  Fermi
  •  announce Fermi Software meeting 
  •  Check for L1 branches
    
•  SLAC
•  nEXO
  •  attend sims meeting
  •  populate new SLAC FTP area
  •  add new user to nexo group at SLAC
  •  add new users to GH organization
    
  •  Update CMake to use new FTP area
    •  test at SLAC
    •  test at LLNL
    •  test on laptop
      

Week of 4 May 2020

•  CO
  •  Alert WG conveners and DC2 analysis czars about upcoming CO discussion concerning validation efforts
  •  Complete Q2 report
  •  attend leadership meeting
  •  attend CS meeting
    
•  DESC DM
  •  Update GitHub workflows for DC2-imsim docker images, to work around disk space issues on GH Actions
  •  Announce, write agenda, attend, note take for DESC DM meeting
    
•  NERSC
  •  Install new gcr-catalogs 0.16.1
  •  Help write up draft CFS directory organization
  •  Test use of desc account in Globus
  •  Move Buzzard-4 into new CFS shared area
  •  attend External User Group meeting
    
•  CC
  •  Set up WhenIsGood poll for next CC meeting
  •  write agenda for next meeting
    
  •  Contact SRPC to determine next steps
    
•  SLAC
  •  Weekly SLAC meeting
    
•  Fermi
  •  announce offline s/w meeting
    
•  nEXO
  •  meet with Lisa
  •  Add nexo-base:current tag and update documentation
    
  •  Attend sims meeting
  •  Look at Fireworks 
    •  https://www.nersc.gov/assets/Uploads/JainNERSCUserDay2.pdf
    •  Debbie's PDF
      

Week of 27 April 2020

•  CO
  •  attend SSims meeting
  •  inquire about missing w_2019_42 sims on CVMFS
    •  https://github.com/airnandez/sw-lsst-eu/issues/3
      
  •  request v19 lsst_distrib be pinned on CVMFS
  •  Test reported issues with ipympl at NERSC and CC
    
  •  Upgrade desc-python to include tabulate, flake8, new sacc, healsparse
  •  Report Missing sims w_2019_42 on CVMFS: https://github.com/airnandez/sw-lsst-eu/issues/4
    
  •  Confirm removal of dev installs on CVMFS: https://github.com/airnandez/sw-lsst-eu/issues/5
  •  Write up quarterly report
    
•  DESC DM
  •  https://jira.lsstcorp.org/browse/DM-24517 Keep an eye on progress
  •  Finish reorg of Y4/Y5 checkpoint files
    •  Check final counts
  •  Copy Y4/Y5 checkpoint files to tape
    
  •  Announce, write agenda, note take and run DESC DM meeting
    
•  NERSC
  •  Transition WG to CFS
    •  CL
    •  CS
    •  LSS
    •  PZ
    •  SSim
    •  TJP
    •  WL
  •  desc-help
    •  https://github.com/LSSTDESC/desc-help/issues/12
      
•  CC
  •  Write up message to Membership Committee
  •  Review scheduled council activities for April/May/June
    
•  Fermi
  •  announce, attend and note take for software meeting
    
  •  Merge astro changes from igrf_updates branch into L1 and test in Jenkins
    
  •  Release GR including new astro
    
•  SLAC
•  nEXO
  •  attend sims meeting
     
  •  set up new area for shared data files
  •  Update Cmake build to down data files
  •  Update CMake to require sniper >= 1.3 
  •  add new nexo user to nexo group at SLAC
    
  •  add new nexo user to nexo group at SLAC
    

Week of 20 Apr 2020

•  CO
  •  announce, run, and note-take CO meeting
  •  Update Zoom infor for all Computing meetings in Calendar and some Confluence pages
    
•  DESC DM
  •  https://jira.lsstcorp.org/browse/DM-24517 Keep an eye on progress
  •  DESC DM meeting
    
•  NERSC
  •  Attend NUG on 4/22
  •  desc-help
    •  https://github.com/LSSTDESC/desc-help/issues/12
  •  Finish reorg of Y4/Y5 checkpoint files
    •  inquire how to handle Grid duplicates
      
•  CC
•  Fermi
  •  announce Fermi software meeting
  •  Help Nicola will additional GR/astro building questions
    
•  SLAC
  
•  nEXO
  •  attend sims meeting
  •  Add new users to GH and provide instructions to apply for accounts at SLAC & LLNL
    
  •  Locate new location for data files at SLAC?
    •  ticket opened
      
  •  Address SNIper filtering to cut down output file size
     
  •  Update Cmake build to down data files
  •  Update CMake to require sniper >= 1.3
    

Week of 13 Apr 2020

•  CO
  •  attend CS meeting
  •  update sacc in desc-python
  •  update gcr-catalogs in desc-python
  •  fix up pip includes in desc-python
    
•  DESC DM
  •  announce, write up agenda, note take DESC DM mtg
    
•  NERSC
  •  crack all y4 y5 files and extract checkpoints
  •  Store y02-missing instance catalogs to HPSS
  •  Store cosmoDC2 to HPSS
    
  •  Store y02-missing instance catalogs to HPSS
  •  Store cosmoDC2 to HPSS
    
•  CC
  •  Look over notes for meetings committee
  •  release April Zoom mtg notes
    
•  Fermi
  •  announce, attend, note take for software meeting
  •  inquire about status of new astro
  •  help Nicola get going with developer tools
    •  Tag GRcontainerSettings to capture 2018 changes on master
    •  Test new Jenkins build
    •  Install miniconda2 and add latest fermi-repoman and scons
    •  Test command line build of GR
      
•  SLAC
  
•  nEXO
  •  attend sims meeting
     
  •  Finish setting up new docker/singularity image and documentation
  •  Update nexo-base image on GH Actions
  •  Continue trying to get nexo builds with LCG libraries to work
    

Week of 6 Apr 2020

•  CO
  •  attend SSims meeting
  •  Attend DC2 meeting
  •  Attend Leadership meeting
  •  test updated desc-python with fast3tree fix
    •  release v0.0.24
  •  update sacc in desc-python
  •  fix up pip includes in desc-python
    
•  DESC DM
•  NERSC
  •  Confirm Y4-Y5 raw transfer was successful and inform Fabio
    •  rollback 11 failed jobs and redo transfer to HPSS
    •  Confirm success
      
  •  Extract Y4 Y5 checkpoint files, organize and push into HPSS
  •  Contact projecta www owners and tell them about projecta transition
  •  Contact WG conveners about NERSC projecta => CFS transition
  •  Start up Science Gateway page: https://confluence.slac.stanford.edu/x/X4Z2E
  •  Checklist projecta => CFS transition: https://github.com/LSSTDESC/desc-help/issues/11
    
•  CC
  •  Write agenda, send reminder and attend monthly CC meeting
  •  write up DESC summary
  •  Help Dominique pinpoint issues cloning DMstack env on CVMFS at CC
    
•  SLAC
  •  Complete Cyber security Training
•  Fermi
  •  Announce, attend, and take notes for Offline S/W meeting
    
•  nEXO
  •   attend sims meeting
  •  Test updated nexo-base docker image removing NEST, going to Py3 and LLNL externals 
  •  setup SLAC with LCG 96python3
    

Week of 30 Mar 2020

•  CO
  •  Write up agenda, run CO meeting
    •  discuss desc-python
      
  •  Announce new Confluence page for DESC envs on desc-leadership
  •  write up adding user packages to desc-python
    •  test nbodykit
      
  •  write up adding user packages to desc-python
    •  test nbodykit
  •  Help CC figure out how to install and maintain desc-python
    
•  DESC DM
  •  Validate Y2-hole FITS files and coordinate transfer to CC
  •  announce, write agenda and run DESC DM mtg
•  NERSC
  •  Meeting with Rollins
  •  Investigate nbody dependencies
  •  Transfer y4-y5 raw files to HPSS
    
  •  finish setting up testdata_ci_desc_gec repo
    •  empty
    •  Run2.2i data
      
•  CC
  •  Set March/April meeing, write agenda
    
•  Fermi
  •  Announce, attend, note take Offline S/W meeting
    
•  SLAC
•  nEXO
  •  attend sims meeting
  •  New nexo-base docker image with NEST and latest sniper
  •  Provided updated externals at SLAC
    •  find fix for ROOT compilation error with gcc 4.8.5 and LZMA
      •  Get SLAC to install lzma-devel
      •  move to LCG externals
        

Week of 23 Mar 2020

•  CO
  •  ask Erin to present at next CO meeting
  •  attend WL meeting and present DC2 update
  •  Write up confluence page listing available DESC environments and POCs
  •  Attend CS meeting
    
•  DESC DM
  •  announce, write agenda and run DESC DM mtg
  •  set up testdata_ci_desc repo with a portion of Run2.2i data
  •  Help coordinate Y4/Y5 transfer from CC with Fabio
  •  Work out updating the SQLite tracking DB for Y4/Y5 and Y2 hole
  •  Help coordinate Y2 hole transfer to CC
  •  Write up wiki describing how to set up a DM Gen2 repo
    
•  NERSC
  •  Ask about jupyter widgets
  •  release new conda-forge based desc-python 
  •  Test new desc-python and adding user packages
    
•  CC
  •  ask meetings committee about data retention
    
  •  plan next April CC meeting
    
•  SLAC
•  Fermi
•  nEXO
  •  attend sim meeting
  •  Merge updates to lightmapsvc
  •  Help new nexo user set up and use docker and latest nexo-offline
    

Week of 16 Mar 2020

•  CO
  •  Prepare slides for Monday's WL meeting
    
•  DESC DM
  •  Attend DM Alg Workshop remotely Tues - Thur 8:45 AM - 2:30 PM PT
  •  Validate Y4-WFD fits files and request transfer to CC
  •  Update DC2 Run2.2i Confluence doc for DR3
    
•  NERSC
  •  Move Y4 WFD checkpoint files to HPSS
  •  Copy Y2 Hole instance catalogs to HPSS
  •  Respond to Rollins questions about use of key/value API within jupyter notebooks
  •  deploy new desc-stack production bersion vased on v19
    
•  CC
  •  Update newsletter Feb/March summary
    
•  SLAC
  •  Complete Annual Security Training
    
•  Fermi
•  nEXO
  •  Attend simulation meeting
  •  Help Ako with Sniper Questions
  •  Update LightMapSvc to fix example algorithm to allow setup once during initialize
  •  Update LightMapSvc to retrieve data from TH2D
  •  Complete LLNL Security Training
    

Week of 9 Mar 2020

•  CO
  •  Announce, write agenda, note take and CO meeting
    
•  DESC DM
  •  Announce, write agenda, run, note take DESC DM meeting
    
•  NERSC
  •  Pull Y2 WFD instance catalogs from tape
    
•  CC
•  SLAC
  •  Attend Data Science Training
    
•  Fermi
•  nEXO
  •  Attend simulation meeting
  •  Chat with Lisa about Confluence, JIRA, GitHub, etc
  •  Open SLAC ticket to help nexo user set default shell to bash
  •  Test git submodules on nexo-offline
    

Week of 2 Mar 2020

•  CO
  •  Finish CI slides
     
  •  Present CI work at DESC seminar
  •  attend CS meeting
  •  update desc-dc2-dm-data repo with DR3 directory
  •  start gcr-catalogs updates for object and meta catalogs
  •  Update desc-help README to provide pointers to other help faciilties
    
•  DESC DM
  •  announce, write up agenda, run, and note take for DESC DM mtg
    
•  NERSC
  •  Clear off Y1 and Y2 chkpoints, freeing 146 TB for y4-wfd transfer from scratch
  •  Prepare subset of DR4 on CSCRATCH for general DESC release 
  •  Request ownership transfer of DR3 drp data
    
  •  Update Confluence doc for NERSC account
  •  Test ability of DR3 drp data on CFS to run on batch - fails, same locking issue as projecta
    
•  CC
•  SLAC
•  Fermi
  •  attend software week sessions
  •  Test Jenkins builds of GR
    •  Report problems with GR builds to Brian
    •  retest Jenkins manual triggering of builds
      
    •  Test binary tarball at SLAC - seems to work
      
•  nEXO
  •  attend software meeting
  •  Inquire about transfer speeds between IHEP and SLAC
  •  Provide skeleton light map service
    

Week of of 24 Feb 2020

•  CO
  •  Prepare slide for Computing Infrastructure Talk at DESC Seminar
  •  attend SSIM meeting
    
•  DESC DM
  •  Attend DC2 meeting
    
•  NERSC
  •  Set up space for DR3 transfer from CC
  •  update desc-stack to resolve: https://github.com/LSSTDESC/desc-help/issues/2
  •  Open NERSC ticket concerning users with trouble starting up jupyter
    
•  CC
  •  Attend and note take for the meeting
  •  Update Trello with CC activities
  •  Write up DESC Summary of Feb mtg
  •  Write up Feb DESC newsletter submission
  •  Fix up CC Confluece area containing Council Minutes - past minutes were spread between 2 separate pages.
    
•  SLAC
•  Fermi
•  nEXO
  •  attend Tuesday software meeting
  •  Inquire at SLAC to use gridFTP for data transfer
  •  Work with SLAC to gain CVMFS access to IHEP filesystem
    

Week of 17 Feb 2020

•  CO
  •  write agenda, note take for CO meeting
    
•  DESC DM
  •  write agenda, run meeting,note take
    
•  NERSC
  •  add graphviz to desc-python
  •  Store Y3-wfd checkpoint files on HPSS
    
•  CC
  •  Start up agenda page
  •  Poll for meeting time
    
  •  Follow up on
    •  PubBoard Rotation
    •  SBPC
      
•  SLAC
•  Fermi
  •  announce, note take for software meeting
    
•  nEXO
  •  help track down memory leak
  •  attend sims meeting
    
  •  install updated external libs at SLAC
  •  update cmake install to handle downloading of ancillary files
    

Week of 10 Feb 2020

•  CO
  •  attend DESC leadership mtg and take notes
  •  announce new desc-help github repo
  •  attend and note take for CS mtg
    
•  DESC DM
•  NERSC
  •  Copy Y4 instance catalogs back off tape to CSCRATCH
  •  Set up 1 TB area for PLASTICC
    •  submit NERSC ticket to sort out how to set quota
      
  •  Refresh NERSC Getting Started Confluence page with new NERSC links
  •  install w_2020_06 in shifter for Michael
  •  address ipyml issue in jupyter
  •  contact NERSC about htar compression
    
•  CC
  •  attend SRPC - CC meeting and take notes
    
•  SLAC
•  nEXO
  •  Look over commit history on nexo-offline branches
  •  add outside collaborator to one nexo repo
    

Week of 3 Feb 2020

•  CO
  •  Generate new stack-sims-cat using w_2019_42 and adding in pyarrow for Bryce & Joanne
  •  Attend SSim mtg
    
•  DESC DM
  •  Gen3 meeting
    
•  NERSC
  •  transfer y02 instCat to hpss
  •  transfer y05 instCat to hpss
  •  transfer y06 instCat to hpss
  •  Request increase to descim CSCRATCH quota
  •  Inquire about new user LSST group membership
  •  Inquire about PI notification concerning users over job allocation
  •  Transfer checkpoint files to HPSS
    •  Y1
    •  Y2
    •  Y3
      
•  CC
  •  set up meeting with SRPC
•  SLAC
  •  Attend group meeting
    
•  Fermi
  •  announce, attend, notetake Software mtg
    
•  nexo
  •  attend software meeting
  •  Write MC filter Alg
    •  PR
  •  Coordinate SLAC adding JuNO path to CVMFS
  •  Meet with Lisa
  •  Add new SNiPER service to read in ROOT TH2 LightMap
    

Week of 27 Jan 2020

•  CO
  •  write up agenda, run, and note take during CO meeting
  •  Set up desc-help repo and explore issue templates
    
•  DESC DM
  •  write up agenda, note take during DESC DM & DA meeting
  •  validate Y3 sim data, update tracking DB and request transfer to CC
    
•  NERSC
  •  Consider moving projecta content to CFS
  •  Look over CFS content from project area
    
•  CC
  •  meet with Yao to discuss to do list
    
•  Fermi
•  nEXO
  •  attend software meeting
    

Week of 20 Jan 2020

•  CO
  •  Set up workflow for gcr-catalogs to create desc-stack:test and desc-python:test
  •  Set up workflow to move desc-stack:prod to desc-stack:old
    
•  DESC DM
  •  Set up mtg with Ben, Tom, Jim, Adrian
  •  Pull out y4 instance catalogs for James P to transfer to Grid
    
•  NERSC
•  CC
  •  Organize, pick up, deliver food for cc-mgmt meeting
  •  Set up mtg with Yao & Eric
    
•  Fermi
  •  announced cancellation of Software mtg this week
    
•  nEXO
  •  Update NEST to latest master in nexo-base:latest
    •  testing failed due to missing valgrind which seems to be required
      

Week of 13 Jan 2020

•  CO
  •  Provide GCRCatalog workflow triggered off master to produce desc-stack and desc-python test envs
  •  Set up new desc-stack repo in LSSTDESC using v19.0.0
  •  Introduce Docker build of desc-python in LSSTDESC
  •  Update desc-dc2-dm-data repo with all Run2.1i and Run2.2i data locations
    
  •  Update desc-dc2-dm-data repo with all Run2.1i and Run2.2i data locations
    
•  DESC DM
  •  Validate straggler y1-wfd and y2-wfd visits, update tracking DB and request transfer
  •  Write up slides, attend WL meeting and provide DESC processing update
    
•  NERSC
  •  Prepare new CFS area for DESC with directories and permissions
    •  Inquire about area ownership: https://nersc.service-now.com/nav_to.do?uri=incident.do?sys_id=7fb44483db1600907d2a300f7c961932%26sysparm_view=ess
      
  •  Refresh Run2.1i CSCRATCH copy
    
  •  Refresh Run1.2i CSCRATCH copy
  •  Address inode issue for descdm CSCRATCH
  •  Start moving agn_ckpts to HPSS
    •  inquire about stalled HPSS jobs: https://nersc.service-now.com/nav_to.do?uri=incident.do?sys_id=586cd487db5600907d2a300f7c961926%26sysparm_view=ess
      
    •  y1-wfd
    •  y2-wfd
  •  Finish moving instance catalogs to HPSS
    •  y02
    •  y05
    •  y06
      
•  DESC CC
  •  Update CC plenary slides
  •  Handle food for CC-Mgmt meeting
  •  Remind desc members to review draft SRP and provide comments
  •  Help plan CC Town Hall  
    •  zoom recording?
      
•  Fermi
  •  Announce, note take and attend weekly software meeting
    
•  nEXO
  •  attend software meeting
  •  Provide fresh externals installation at SLAC for latest nexo-offline
  •  Meet with Samuele to discuss skeleton recon SNiPER alg
  •  Write up draft organization for charge and light reconstruction
    

Week of 6 Jan 2020

•  CO
  •  Write agenda, announce, and notetake for CO meeting
  •  Provide Debbie some advance dates of DESC needs
  •  Q1 report
  •  survey paper validation section
  •  Prepare for Collab Mtg
  •  Follow up on DDF checklist
    
•  DESC DM
•   
  •  Validate y2-wfd and update sqlite tracking db and request transfer to CC
  •  Announce, write agenda, attend and note take for DESC DM meeting
  •  Transfer tract 3828 and 3829 to lsst-dev
    •  and ancillary data including CALIB, ref_cats
      
  •  Free up space in descim CSCRATCH
    •  y4
    •  y3
    •  y1
    •  y2
    •  y5
      
  •  Free up space in projecta
    •  agn-checkpoints for y1-wfd
      
•  NERSC
  •  Refresh RUn1.2p
  •  Refresh Run1.2i
  •  Cron job for CSCRATCH?
•  Collaboration Council
  •  Start preparing CC update for Collaboration Mtg
  •  Help plan TownHall
    
•  Fermi
  •  Announce, attend, and note take offline software meeting
•  nEXO
  •  Attend software meeting
  •  Read, respond, and provide Fermi's Gaudi experience for Vladimir's project overview
    
    

Week of 16 Dec 2019

•  CO
  •  Section 7.2 DC2 survey paper (cross-validation)
  •  Attend Wednesday Leadership Mtg
    
•  DESC DM
  •  Ingest Run2.1i reference catalog using v19.0.0 and obs_lsst dc2/run2.2 branch
    
•  NERSC
  •  Update desc-stack, making sure it pin python 3.7
  •  Finish SPIN implementation for running integration tests using CVMFS installations
  •  Help Anze figure out how to use emacs after loading desc-python
    
•  Fermi
  •  Create any necessary JIRAs for upcoming GR astro update
    
•  nEXO
  •  attend Sunday evening telecon with SNiPER representatives
    

Week of 9 Dec 2019

•  CO
  •  Attend SSim meeting
    
•  DESC DM
  •  write up agenda, run, and note take DESC DM meeting
  •  validate y1-wfd fits and centroids
    •  Request transfer to CC
      
•  NERSC
  •  Attend SPIN Hack day
  •  Attend NUG: https://www.nersc.gov/users/NUG/teleconferences/nug-webinar-dec-12-2019/
    
  •  Test gcr-catalogs uninstall and clean up old catalogs files in desc-python
    •  update desc-python
    •  updated desc-stack
      
•  Fermi
•  nEXO
  •  attend 3 hour (until had to go) workflow meeting
  •  Attend software meeting
    

Week of 2 Dec 2019

•  CO
  •  Announce, write agenda, run, and note take CO meeting
    
•  DESC DM
  •  Announce and write up agenda for DESC DM meeting
  •  Update setup script for IPP pipelines
  •  Update obs_lsst dc2/run2.2 branch for w_2019_47
    
•  NERSC
  •  attend SPIN training Thus and Friday afternoons
    
•  Fermi
  •  announce software meeting
    
•  nEXO
  •  attend software meeting
  •  Read Vladimir's work plan and comment
    

Week of 18 Nov 2019

•  CO
  •  prepare list of current desc-python packages to circulate, investigate CC's conda env, and open GH issue
    
  •  Consult conveners concerning who should offer GCR analysis commentary at next mtg
    
•  DESC DM
  •  Announce, write up agenda, note take and run DESC DM meeting
  •  Provide Tom and Ben an updated dc2-run2.1i docker image with astropy 3.2.3
    
•  NERSC
  •  Deal with Michael's questions about building against CVMFS using recent stacks
    •  Upload and test recent LSSTSQRE docker image into Shifter at NERSC and worked out building
    •  Tested CVMFS at CC
    •  Work with DM to determine how to set ABI flags for scons builds of local packages
      
  •  Dealing with private DM NERSC questions:  Bruno, Humna
  •  Continue to work on mrau's inode use - down from 96% to 69%
    
  •  Move more files to HPSS
  •  Update desc-python-dev to include CLMM and cluster toolkit.
    •  indicated that we need release tags on both before I add this to desc-python
    •  Note the need for GSL and adding gsl-config to PATH
      
•  Fermi
  •  Announce, attend and note take for software meeting
    
•  nEXO
  •  attend software/sims meeting
  •  rebase Brian's PR and merge because no one knows how to use git on nexo
  •  add doxyfile for Tony to test Doxygen generation in Jenkins
    
  •  update nexo-base env to include new NEST master
  •   
    •  Add GitHub actions workflow
       
    •  Release new docker image
      

Week of 11 Nov 2019

•  CO
  •  PR, tag, and create docker image for lsstdesc/dc2-imsim:Run2.2i-production-v1
  •  attend data access meeting
    
•  DESC DM
  •  Attend DM bootcamp Tues - Thur 2-5 PM ET
    
•  NERSC
  •  Deal with projecta inode quota which is currently at 96%
  •  continue moving files to HPSS
    
•  Fermi
  •  announce and note take for offline s/w mtg
    
•  nEXO
  •  NEST PR
    •  test build at SLAC
    •  Open new GH issue for cmake build failure
      

Week of 4 Nov 2019

•  CO
  •  write agenda, announce and note take for CO mtg
  •  Update Nov, Dec, Jan DESC calendar for upcoming holidays 
  •  Prepare new stack-sims-cat docker image for instance catalog generation
    
•  DESC DM
  •  write agenda, announce and note take DESC DM meeting
    
•  NERSC
  •  Install pyCCL 2.0.1 in desc-stack and desc-python
  •  Meet with Debbie to go through NERSC user survey
  •  Continue moving data onto HPSS
    
•  Fermi
  •  announce mtg
    
•  nEXO
  •  attend software meeting and provide update
  •  Help Caio with SLAC install
  •  Deal with doc PR
    

Week of 25 Oct 2019

•  CO
  •  attend Data Access meeting and note take
  •  attend CS meeting
    
  •  write draft DDF checklist
  •  Transfer Grid data from CSCRATCH to projecta space
  •  continue transferring data to HPSS from projecta
  •  Generate new sims docker containers as needed
    •  imSim v0.6.1
      
•  DESC DM
  •  process ALCF, Cori, and Grid validation test data, through makeFpSummary
    
•  NERSC
•  Fermi
  •  announce, attend, and note take for software meeting
    
•  nEXO
  •  Continue answering C++ and git questions
  •  setup external library area at SLAC using same versions as LLNL
  •  attend software meeting
    

Week of 14 Oct 2019

•  CO
  •  Write up Agenda and run and note take for CO mtg
  •  Attend Data Access meeting
  •  Attend SRM milestones meeting
    
•  DESC DM
  •  Edit Parsl DRP planning doc
  •  setup up empty Run2.1.1i repo for testing on CSCRATCH and HPSS
  •  Transfer NCSA Run2.1.1i processing to NERSC
    
•  NERSC
  •  Transfer more data to HPSS
    
•  Fermi
•  nEXO
  •  Handle C++ questions
  •  Start to Investigate strax
    

Week of 7 Oct 2019

•  CO
  •  Attend Grid meeting
  •  Attend CS meeting
    
•  DESC DM
  •  Announce, write up agenda, note take, and run DESC DM meeting
  •  Help Tom out with DM questions
    
•  NERSC
  •  Help Bela to run shifter images in batch
  •  Start transferring more data to HPSS
    
•  Fermi
  •  Announce, attend, and note take for software mtg
    
  •  Handle M.E.'s questions concerning new GR release build
  •  Remove Charlotte's name from the workbook where necessary, per her request
    
•  nEXO
  •  Attend software meeting
  •  Deal with C++ questions
  •  Test ROOT writing performance to address Soud's inquiries