Oct 10 2008Sep 26 2008- Database cleanup status
- Pipeline 1.3.1 release planned for next week
- Pipeline performance continues to be good
- Contingency ISOC planning
- Especially as it may impact web tools
- xrootd tape backup plans
- New tape group mappings
- /glast/MC -> glastMC
- /glast/Data/Flight -> glastflight
- /glast/* -> glast
- Files to be backed up
- Cron job now writing list to ~glast/backupfiles/level1backupfiles.txt (7128 files)
No Format |
---|
select filesizebytes,path
from datasetgroup g
join verdataset d on (d.datasetgroup = g.datasetgroup)
join datasetversion dv on (d.latestversion=dv.datasetversion)
join verdatasetlocation l on (dv.masterlocation = l.datasetlocation)
join run r on (r.runid=l.runmin)
where g.datasetlogicalfolder=39684091 and l.datasetsite='SLAC_XROOT'
and (l1procstatus in ('Complete' , 'Incomplete') or sysdate-lastModified>'7 00:00:00')
and datasetdatatype in ('DIGI', 'RECON', 'MERIT', 'SVAC', 'GCR')
order by datasetdatatype, runmin;
|
- Wilko leaves Oct 6, back Nov 5. Has been working with Tofigh, so Tofigh can help provide emergency support.
Sep 5, 2008- Pipeline release plans
- Reprocessing readiness
- xrootd update
- Miscellaneous
- Apps being moved from tomcat07 (glastlnx09) to tomcat06 (glastlnx13).
- This will cause some nagios messages until nagios monitoring is updated
- This is to free memory on glastlnx09 for astro server database
- confluence 2.9 is now set up for testing at http://confluence-new.slac.stanford.edu
- jira-new coming soon
8/8/08- Infrastructure Shifts
- Recent/Upcoming release plans
- Nagios overview - Emmanuel
Aug 1, 2008Now that the rush to get things ready for LEO is subsiding we should go over what things didn't get done before, and what needs to be improved, cleaned up, etc. - Near term plans for
- Pipeline
- Data catalog
- Linemode download manager
- Ability to delete files from data catalog
- Ability to purge old versions of (L1) files
- In both cases data catalog will mark files to be deleted, then crawler will actually delete the files (from xrootd)
- Skimmer
- Upgrade web front-end to use v6 backend
- Understand issues with skimming real data
- Miscellaneous improvements
- Xrootd
Jul 17, 2008- Reprocessing discussion
- Line-mode datacat – new features
- Infrastructure shifts discussion
Jun 20, 2008Jun 13, 2008- Final decisions about infrastructure shifts
- Request from Ian/Arash for oracle outage
- Updates
- AOB
May 30, 2008- Run Quality Update
- Database/Performance issues after pipeline upgrade
- AOB
May 23, 2008- Nagios Overview/Status
- xrootd update
- Run Quality Update
- runQuality object to be added to scriptlet environment
- runQuality.setL1RunStatus(long run, String status)
- One of Running, Complete, InComplete, InProgress, Running, Unset
- runQuality.setReviewStatus(long run, String status)
- One of Not ready, Waiting review, (Reviewed, Unset)
- Datacat versions update
- AOB
May 16, 2008May 9, 2008- Data Catalog line-mode client update
- Xrootd Update (New fileserver, new xrootd release, glastlnx22, etc)
- AOB
May 2, 2008- Stress test update
- Pipeline II progress, release plans
- Xrootd Update (New fileserver, new xrootd release, etc)
- AOB
April 18, 2008- Launch update
- Stress test issues
- Run Catalog Discussion
- Questions
- Who registers the run?
- What is the relationship to Bryson's downlink tables
- How do we know if run is complete?
- Are runs assigned a status before the run is complete?
- Is rerunning a top level stream a "reprocessing"
- Can original run status change as a result of reprocessing
- If so do we need a history?
- What should the web interface look like
- Initial Schema proposal
- xrootd status
April 11, 2008- Oracle switchover plans
- xrootd tape achiving status
- AOB
April 4, 2008- Oracle Database Update
- Pipeline II release
- Infrastructure "How-to-fix" documentation
- Expert Shifts
- AOB
March 28, 2008- Oracle Database Update
- Pipeline Update
- Upcoming CCB action requests
- Infrastructure "Expert Shifts"
March 21, 2008- Tomcat servers update
- Oracle
- Oracle server/stress testing update
- Oracle wallet/roles/materialized views discussion
- Data catalog
- Recent CCB action requests
- Upcoming CCB action requests
- Pipeline client rollback fix (1.0.2)
- Pipeline front-end fixes (message viewer etc) (2.5.1)
- Group manager fix to import data from campus MySQL (1.7) and export list of users for xrootd
- Put oracle wallet into production for Pipeline Server (1.0.1), Pipeline Client (1.0.3?), Datacat client (1.1.1)
February 29, 2008- Fallout from yesterday's outage
- Pipeline deadlock update
- xrootd update
- Preparation for opssim2
- Plans for Change Control Board (CCB)
- Oracle passwords
- ASP web display update
February 22, 2008February 15, 2008- Shift Database/Web app
- Using AFS tokens to log in to glast account (postponed to later)
- New Crawler
- OpsSim2 readiness issues
- xroot and old file versions
- Schedule for OS/IP upgrade on glastlnx*
- Effects of elimination of services
February 1, 2008 January 18, 2008 January 11, 2008 |