This page is currently use to help plan a software week for March 2020. It will be updated as we firm up plans.
The software week goal is to facilitate communication and collaboration between everyone as we move forward extended support for Fermi. FSSC members will be available at SLAC all week for group discussions and one-on-one meetings. In addition to targeted topics, we encourage attendees with broad or cross-cutting interests to join the various discussions. There will be plenty of work, so we'll need everyone to take part in this transition.
Previous Software Weeks: Fall 2017, Winter 2017, Winter 2018
Dates: The week of March 2
Location: SLAC. Two conference rooms in B53 have been reserved for each day.
- 3/2 - Almanor/Havasu
- 3/3 - Toluca/ Tulara
- 3/4 - Tulara /( working on ?)
- 3/5 - Almanor/Tulara
- 3/6 - Almanor/Havasu
Slack: The #softwareweek channel is available for discussion.
Attendees
We've narrowed the possible weeks to late February and early March 2020 at SLAC. If you are interested in attending, please use the table below to indicate which of the weeks works for you, and we'll try to pick the week that works best for the most people. If you can't attend in person, hopefully we can work out remote attendance.
Name | Week of Feb 17 | Week of Feb 24 | Week of March 2 | Week of March 9 | Comments |
---|---|---|---|---|---|
Liz Hayes | Y | Y | Y | Y | |
Don Horner | Y | Y | Y | Y | Joe says Happy Birthday Tom! |
Alex Reustle | If needed | Y | Y | Y | Happy Birthday Tom! |
Joe Asercion | Y | N | If needed | Y | Will be in Denver 2/27-3/1. Could fly from Denver to San Jose on 3/2 though (but I'd prefer not to) |
Tom Stephens | Y | Y | Y | Y | Feb 17th is President's Day (and the 19th is my birthday ) |
Nicola Omodei | After the 18th | Y | Y | Y | |
Tom Glanzman | Y | Y | Y | Y | |
Richard Dubois | Y | Y | Y | Y | |
Brian Van Klaveren | Y | Y | Y | Y | Later is possibly better. |
Toby Burnett | Y | Y | Y | Y | |
Eric Charles | Y | Y | Y | Y | |
Steve Tether | N | N | Y | Y |
Possible Agenda Items
Below are some possible agenda items or things that could actually be done during the week. Please add some if you would like. Try to include possible participants and what might be discussed or done. We'll organize it into actual sessions later.
SLAC Infrastructure Related
- Move to containers. Maybe done before software week?
- Tom, Brian, Heather, Joanne(?),
- Create the containers and move pipeline to containers to run on Centos7.
- Do the process together and test.
- Change in batch system.
- Have Tom, Brian and ?
- Work on moving to the new batch system.
- Have Tom develop contacts with infrastructure staff.
- Halfpipe & L1 pipeline documentation
- Tom, Michael, and Maria Elena, others?
- Go through current documentation to update (and remove old information).
- Get together to discuss and write document pipeline how-tos and fixes.
- Update re-piping documentation.
- Document database schema.
Dealing with missing datagrams - Causes, handling, what to do if repiping fails?
Data lifecycle from an ISOC perspective
where does the data go?
what do the processing steps do?
how does this interact with the infrastructure?
- Data reprocessing documentation
- Tom, Maria Elena, Nicola
- Nicola knows about FT1 reprocessing. Are the steps documented?
- Document how to do FT2 reprocessing.
- GLASTRelease and Jenkins
- Heather, Alex, Joe, Joanne
- Make sure GR builds with Jenkins.
- Is Heather's knowledge about build and deployment documented?
ISOC tasks
Don, Tom, Steve Tether, ?
Progess on this list: Regular and semi-regular manual ISOC tasks
Update this page: Software Master List
- Fastcopy future support. Will it need to be containerized?
- ASP
- Does anyone besides Jim know how to maintain it?
- Any more documentation that this: ASP How-To Guide?
- Data catalog
- Is Brian the only one who knows how to deal with it?
- Archiver
- Don, Steve Tether, Tom G?
- Archiver doesn't work on CentOS 7. See Archiver vs. CentOS 7.
- Discuss and make necessary changes to get it working.
- Other infrastructure
- Paging
- Spread messaging system?
- Web apps
- Skimmer
- Update this page: SLAC to FSSC transition questions
Fermitools Related
- Fermitools maintenance and development
- Joe, Alex, Don, Tom S, Phillipe, Eric?
- Package ownership (e.g., who to contact about gtobssim).
- Update this page: ScienceTools Package Author Review
- How to use Github, Conda, and Azure pipeline.
- Update this page: 10 Yr Software Transition Dashboard.
What does the C&A group need that isn’t being provided by the FSSC (and vice-versa).
Develop a Fermitools "how to collaborate" presentation for the collaboration?
Fermitools/Fermipy interface
Alex, Joe, Mattia, Phillipe
Discuss and work on improving interface between Fermitools and Fermipy.
Modularizing the Fermtiools?
- Bug fixes
- Get together to go through and maybe fix reported Fermitools bugs/issues.
- Eric, Joe, Alex, Tom S
Fermitools testing
Don, Phillipe, Giacomo, Joe
C&A group role?
- Jupyter notebooks for analysis threads
- Pointlike
- How long will Toby support it? What should we do after that?
- Switch to CMake instead of SCons?
- Fit convergence issues. See Jean's 12/2/19 C&A presentation.
Python 3 migration
Azure Pipeline maintenance and development
Joe, Tom, Alex?, Don?
Training on design/development of the pipeline
Other possible topics
- Adding capabilities to the FSSC data server
- The FSSC data server is being moved to new, better hardware.
- New filtering?
- Allow all sky searches?
- New data sets?
- Staffing
- Who is even there anymore and what is their availability?
- It's hard for FSSC personnel to take over on infrastructure that we don't use regularly.
- How much can we rely on collaboration people?
- Where can external folk inject the most help?
- Can we create a list of who to contact for various infrastructure issue?