{section}
{column:width=25%}Meetings are held via teleconference on Fridays, 10:30 Pacific time using the CalTech [EVO |http://evo.caltech.edu]system. We do not use video.
Please avoid an open mike, which may cause echoes. See the evo help. For further information be sure to have a look at the [VRVS Etiquette|http://www-glast.slac.stanford.edu/software/meetings/vrvsetiquette.htm] page.
h2. Previous Years
* [2007|2007]
* [2006|2006]
* [2005|2005]
{column}
{column:width=75%}
h2. Upcoming meetings
We have now switched to a approximately bi-weekly schedule. The next meetings will be on:
h2. October 16 2009
* Data Catalog update
** Adding purge capability to line mode client
* AstroServer update
** Splitting large output files to avoid out-of-memory problems
* XRoot/HPSS update [ds:Testing HPSS Prod2]
h2. September 18 2009
* PROD Oracle outage - 0900 9/24
* AFS token problems in batch
* Disk usage/tape backup
** [Level 1 Usage|ds:Level 1 disk usage - September 2009]
** [Hpss usage|https://confluence.slac.stanford.edu/display/ds/HPSS+Usage]
* Pipeline
** Memory leak progress
*** [Reclaiming Connections|^ConnectionReclaiming.JPG] (image)
*** [Reclaiming Connections|http://glast-ground.slac.stanford.edu/Pipeline-II/logViewer.jsp?task=&severity=800&minDateDate=17%2FSep%2F2009+18%3A13%3A30&minDate=1253236410000&maxDateDate=17%2FSep%2F2009+18%3A13%3A35&maxDate=1253236415000&submit=Filter&dataSourceMode=Dev] (DEV message viewer)
** Feature requests from L1
h2. August 14 2009
* Status of L1 switch/reprocessing/astroserver
** [Dataset definitions|SCIGRPS:LAT Dataset Definitions]
** [Astro Server|http://glast-ground.slac.stanford.edu/DataPortal]
* Pipeline
** Missing foreign keys
** Pipeline web preferences issues
* Security patches - Tomcat servers switching to
** Tomcat 5.5.27
** Java 1.6.0_15
* Tony's vacation
** Ernest expected back on Monday - so use confluence-admin mailing list for confluence/jira problems
h2. July 31 2009
* Plans for release of public data
** L1 switch to new version
** Finalizing [P105 reprocessing|SCIGRPS:P105 (Pass6) Reprocessing Notes]
** Switch to [new version of AstroServer|http://glast-ground.slac.stanford.edu/DataPortalAstroServer/]
** [Names for data products|SCIGRPS:LAT Dataset Definitions]
* AOB
h2. June 26 2009
*Note change of time* 9am pacific time
* Astro server update
* Reprocessing status
** Pass 6 vs Pass 7 and consequences on astro server etc.
* Reprocessing and Run Details discussion
h2. June 12 2009
* [Gliffy demo|SLAC:/2009/06/10/Add Flowcharts, Technical drawings and more with Gliffy Plugin]
* Update on wain020/wain OS upgrade
* Pass 7 related issues
** [Skimmer status|ds:Skimmer 1.7 release]
** Astro server status
** Left over reprocessing issues?
*** [P100-MERIT and P100-FT1 tasks|ds:Remaining issues for P100-MERIT and P100-FT1]
* Pipeline requests
h2. May 29 2009
* Google IO highlights
* Data Catalog contents cleanup
** [New problems page|http://glast-ground.slac.stanford.edu/DataCatalog/problem.jsp]
* Post mortem of u18 problems from yesterday morning
* Status
** Reprocessing
*** [http://glast-ground.slac.stanford.edu/Pipeline-II/task.jsp?task=19821716]
*** [http://ganglia01.slac.stanford.edu:8080/ganglia/glast/?r=hour&s=descending&c=glast-xrootd]
** Xrootd/HPSS
h2. May 8 2009
* Maven2 conversion
** [Project list|JAVA:Moving Glast to maven2]
* Reprocessing readiness/status
** Processing History tables and [web pages|http://glast-ground.slac.stanford.edu/HistoryProcessing/]
** [P100 output|http://glast-ground.slac.stanford.edu/DataCatalog/?folder=51991991]
** Astro server readiness
** [P100 config|SCIGRPS:P100 (Pass7) Reprocessing Notes]
* [SCons installer demo|http://glast-tomcat03.slac.stanford.edu:8080/SConsInstaller/]
* [Speakers bureau web interface demo|http://glast-tomcat03.slac.stanford.edu:8080/SpBureau/]
h2. April 24 2009
* Heads Up - Prod Oracle outage 4/29 - 2pm
* [Astro Server performance update|ds:"New" Astro Server Benchmarking]
* New [glast-ground|http://glast-ground.slac.stanford.edu/] (aka fermi-ground)
* Reprocessing readiness/status
** [New meta-data in data catalog|http://glast-ground.slac.stanford.edu/DataProcessing/run.jsp?runid=262259974]
** [Run History Web Interface|http://glast-tomcat03.slac.stanford.edu:8080/RunQuality/HistoryProcessing.jsp]
** Data type for filtered Merit files
h2. April 17 2009 (special reprocessing meeting)
* Discussion of file naming, file location, and dataCatalog registration
** Pass7 reprocessing notes from Tom [P100 (Pass7) Reprocessing Notes|SCIGRPS:P100 (Pass7) Reprocessing Notes]
h2. April 10 2009
* Status of astro server upgrade
** Planned new features
*** New database using HTM/partitions/new hardware
*** Decide between MySQL and Oracle
*** Handling of new p7 quanitities
*** Handling of new format FT1 and FT2 files
*** Adding availability of LS1 and 1-second FT2 files
*** Using new database hardware/software
*** Post-processing with gtmktime
*** Support for electron+positron files (perhaps)
** Goal is to be ready for end-of-april pass 7 release
** Need to start importing data from reprocessing by end-of-next-week
* Maven2 migration
** Many projects now being switched to [maven2|JAVA:Moving Glast to maven2]/[hudson|http://glast-ground.slac.stanford.edu/hudson/]/netbeans 6.5.1
** New "archetype" makes it easy to start new projects
*** Karen is first guinea pig with "Speakers bureau app"
**** Karen has been making [notes|http://confluence.slac.stanford.edu/display/ds/netbeans+6.5.1+install]
* Crawler update
** Understood problem with
*** New merit header
**** First use of RootObj<Int> - escaping <> was not handled properly
*** Recon files from L1 1.71
**** FileHeader object is actually missing (just a RootObject)
** New crawler release coming
*** Will mark recon files as "HeaderError" but we can then change it to OK
*** Will recrawl all problem merit files
*** Will extract merit version from header
*** Will no longer use glast-rdr-test
* User disk web access
** [u33|http://glast-ground.slac.stanford.edu/Commons/Decorate/u33/]
* Pipeline status
** New [web front-end|http://glast-tomcat03.slac.stanford.edu:8080/Pipeline-II/] which does not use FTP
* Speakers bureau app
* Access to ops products
h2. Mar 13 2009
* Glast (etc) passwords
* Oracle connections on machines up for >200 days
* [Trending database disk usage statistics|http://glast-ground.slac.stanford.edu/Resources/?pattern=Oracle]
* [xrootd upgrade CCB|ds:/2009/03/13/Request to install a new Xrootd production version]
** xrootd outage
* Data Access Issues
** New astro server status
** Outstanding Bugs
*** [LONE-131@jira]
*** [DATASERV-151@jira]
** Standard data sets
** Dealing with soon to arrive "bad" data
** Reprocessing timeline
h2. Feb 13 2009
* Confluence notes
** New "[Confluence Tips and Tricks|SLAC:Confluence Tips and Tricks]", in particular hints on [organizing confluence pages|~tonyj:/2009/02/04/Organizing confluence content using page trees]
*** See for example [Data Handling Space|ds:Fermi Data Handling]
* [Data Processing Stats|http://glast-ground.slac.stanford.edu/Pipeline-II/DataProcessingStats.jsp]
* Disk space update
** [Available disk space|http://glast-ground.slac.stanford.edu/Resources/?initTime1Date=01-Aug-2008&initTime1=1217548800000&initTime2Date=13-Feb-2009&initTime2=1234483200000&name=L1PurgableGB&name=L1TotalGB&name=xrootd_all_freeGB&pattern=&submit=submit+resource]
*** [New page lists "to be deleted" files|http://glast-tomcat03:8080/DataCatalog/datasetPurge.jsp]
* Maven2 and [Hudson|http://glast-ground.slac.stanford.edu/hudson] status/demo
** Documentation
*** [For Developers |https://confluence.slac.stanford.edu/display/JAVA/Moving+Glast+to+maven2]
*** [Generated |https://glast-ground.slac.stanford.edu/docs/maven2/]
* Pipeline Status
* [Party Time|http://blog.wired.com/gadgets/2009/02/unix-lovers-to.html]
h2. Jan 30 2009
* Status of Pipeline upgrade
** Latest version of pipeline server now in DEV
** Latest version of pipeline front-end on [tomcat03|http://glast-tomcat03.slac.stanford.edu:8080/Pipeline-II]
*** [Status|Pipeline Front-End version 2.9 Status]
* Confluence upgrade
* Astro server upgrade
* xrootd update
h2. Jan 16 2009
* Pipeline - new features demo
* Database password change warning
* [Binary flash demo|http://www.slac.stanford.edu/~dflath/Binary.html]
* Status/Updates/AOB
h2. Dec 12 2008
* [Processing Time Plot|^Processing time.pdf]
* [Pipeline plans and priorities|Pipeline plans December 2008]
\- [ISOC:Future improvements to the Pipeline and to L1Proc]
* Shutdown plans
* Status updates
* AOB
h2. Nov 21 2008
* Highlights from
** [ADASS|ADASS recap]
** [ACAT|ACAT 2008 Highlights]
* Status reports/updates
** Release Manager II
** Resource Tracking
** Pipeline Release
*** Improvements to RunQuality plugin (for Warren)
*** Enhanced ability to send vars/file to batch jobs? (for Tom)
** Pipeline Front-End
*** Remove use of anonymous FTP for file/log access
** Cleanup of data products
*** !plot-0.png|thumbnail!
** xrootd issues
** Data catalog improvements
*** Download manager release
*** Astro server release
*** Merit Skimmer release
** Leap Second fixes
** Google Sky interface
** Confluence/JIRA release
** Group Manager release
h2. Oct 31 2008
* Outages update
* xroot update
** [New disks available|^xroot.png]
** Problem with xroot root client discovered
* Oracle update
* [Pipeline releases|/2008/10/30/CCB Request for Pipeline Upgrade]
* Planning for next week
** End of daylight savings
** Absence of Dan, Richard, Tony
* [Partitioned Tables in Oracle]
h2. Oct 24 2008
* Upcoming outages
* Leap seconds planning
** There will be an new leap second at end of 2008
** Rob wants a list of all applications effected and whether we need to do anything to fix/test them
*** We have a Java class for correct translation from MET->UTC
*** "Lat clocks" [http://glast-ground.slac.stanford.edu/LatOps/]
*** Astro server
*** Anything else where we need to worry about this?
* [Astro Server|http://glast-ground.slac.stanford.edu/DataPortalAstro]
* Disk/Oracle space
** I plan to turn on purging of L1 files older than 2 weeks(?) today
Some plots from: [http://glast-tomcat03.slac.stanford.edu:8080/xrootdiskspace-web/index.jsp]
!XRoot Space.png|thumbnail! !XRoot Servers.png|thumbnail! !L1 Space.png|thumbnail!
h2. Oct 10 2008
* Database [cleanup status|~turri:Oracle Disk Status]
** Removal of old housekeeping trending
** Demo of new [resource trending tool|http://glast-tomcat03.slac.stanford.edu:8080/xrootdiskspace-web/]?
* [Accessing oracle using wallet from perl|Password-less login using Perl DBI and Oracle Wallet]
** Access permissions on wallet
* Changing default for [Run Quality flags|GRQ-10@jira]
* xrootd Issues
** Crawler problems
** Other issues
h2. Sep 26 2008
* [Database cleanup status|https://confluence.slac.stanford.edu/display/~turri/Oracle+Disk+Cleanup]
* Pipeline 1.3.1 release planned for next week
** Only fixes two bugs: [PII-369@JIRA] and [GRQ-10@JIRA]
** Dan back next week
* Pipeline performance continues to be good
!plot-6.png|thumbnail! !EmChartBean.gif|thumbnail!
* Contingency ISOC planning
** Especially as it may impact web tools
* xrootd tape backup plans
** New tape group mappings
*** /glast/MC \-> glastMC
*** /glast/Data/Flight \-> glastflight
*** /glast/\* \-> glast
** Files to be backed up
*** Cron job now writing list to \~glast/backupfiles/level1backupfiles.txt (7128 files)
{noformat}select filesizebytes,path
from datasetgroup g
join verdataset d on (d.datasetgroup = g.datasetgroup)
join datasetversion dv on (d.latestversion=dv.datasetversion)
join verdatasetlocation l on (dv.masterlocation = l.datasetlocation)
join run r on (r.runid=l.runmin)
where g.datasetlogicalfolder=39684091 and l.datasetsite='SLAC_XROOT'
and (l1procstatus in ('Complete' , 'Incomplete') or sysdate-lastModified>'7 00:00:00')
and datasetdatatype in ('DIGI', 'RECON', 'MERIT', 'SVAC', 'GCR')
order by datasetdatatype, runmin;
{noformat}
** Wilko leaves Oct 6, back Nov 5. Has been working with Tofigh, so Tofigh can help provide emergency support.
h2. Sep 5, 2008
* Pipeline release plans
** Plan to have everything in DEV by today (most is already there), release to PROD on Monday
** [Pipeline Server|https://jira.slac.stanford.edu/browse/PII?report=com.atlassian.jira.plugin.system.project:roadmap-panel], [Pipeline Front-End|https://jira.slac.stanford.edu/browse/PFE?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
** Ready state issues?
* [Reprocessing readiness|https://confluence.slac.stanford.edu/display/DC2/Milestones%2C+To-do+List%2C+External+Issues%2C+Known+Limitations%2C+Open+Questions]
* xrootd update
* Miscellaneous
** Apps being moved from tomcat07 (glastlnx09) to tomcat06 (glastlnx13).
*** This will cause some nagios messages until nagios monitoring is updated
*** This is to free memory on glastlnx09 for [astro server|http://glast-ground.slac.stanford.edu/DataPortalAstro/] database
** confluence 2.9 is now set up for testing at [http://confluence-new.slac.stanford.edu]
** jira-new coming soon
h2. 8/8/08
* Infrastructure Shifts
* Recent/Upcoming release plans
** [Shift Schedule|http://glast-ground.slac.stanford.edu/ShiftSchedule/]
** [Pipeline Server|https://jira.slac.stanford.edu/browse/PII?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
** Data Portal
*** [FITS Skimmer|http://glast-tomcat03.slac.stanford.edu:8080/DataPortalFitsSkimmer/]
*** [Data Portal History|http://glast-tomcat03.slac.stanford.edu:8080/DataPortalHistory/]
*** Merit Skimmer
*** Data Catalog
*** Astro Server
**** Require releases of org-glast-dataportal-model, org-glast-datacat-client, org-glast-datahandling-common
* Nagios overview - Emmanuel
h2. Aug 1, 2008
Now that the rush to get things ready for LEO is subsiding we should go over what things didn't get done before, and what needs to be improved, cleaned up, etc.
* Near term plans for
** Pipeline
*** [Roadmap|https://jira.slac.stanford.edu/browse/PII?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
*** [Front-end|https://jira.slac.stanford.edu/browse/PFE?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
** Data catalog
*** [Linemode download manager|Command Line Download Manager]
*** Ability to delete files from data catalog
*** Ability to purge old versions of (L1) files
**** In both cases data catalog will mark files to be deleted, then crawler will actually delete the files (from xrootd)
** Skimmer
*** Upgrade web front-end to use v6 backend
*** Understand issues with skimming real data
*** Miscellaneous improvements
** Xrootd
*** [Access to xrootd files|Xrootd Preload Library]
*** Plans for backing up files
h2. Jul 17, 2008
* Reprocessing discussion
** [Database tables|http://confluence.slac.stanford.edu/display/DC2/runCatalog]
** [Web interface|http://glast-tomcat03.slac.stanford.edu:8080/RunQuality/HistoryProcessing.jsp]
** Pipeline interface
* [Line-mode datacat|Data Catalog Users Guide] \- new features
** [Line-mode download manager|Command Line Download Manager]
* Infrastructure shifts discussion
h2. Jun 20, 2008
* Plan for next week
* New "[how to login|http://glast-isoc.slac.stanford.edu/pages/fr_isoc_home02/glast_logins.htm]" page from Mark
* AOB
h2. Jun 13, 2008
* Final decisions about infrastructure shifts
* Request from Ian/Arash for oracle outage
* Updates
** Pipeline status
** [Run Quality|http://glast-ground.slac.stanford.edu/RunQuality]
** xrootd
** Data Access
* AOB
h2. May 30, 2008
* Run Quality Update
* Database/Performance issues after pipeline upgrade
* AOB
h2. May 23, 2008
* [Nagios Overview/Status|^nagios.pdf]
* xrootd update
* [Run Quality Update|http://glast-ground.slac.stanford.edu/RunQuality]
** runQuality object to be added to scriptlet environment
*** runQuality.setL1RunStatus(long run, String status)
**** One of Running, Complete, InComplete, InProgress, Running, Unset
*** runQuality.setReviewStatus(long run, String status)
**** One of Not ready, Waiting review, (Reviewed, Unset)
* Datacat versions update
* AOB
h2. May 16, 2008
* [How to Fix|SASHOW2FIX:How to Fix - Home] Status Update
* [Xrootd release schedule|/2008/05/14/Request to install a new Xrootd production version] etc
* Demo/Discussion of [Run Quality Web Interface|http://glast-tomcat03.slac.stanford.edu:8080/RunQuality/]
* Shift Signup ([demo|http://glast-ground.slac.stanford.edu/ShiftSchedule/]/infrastructure shifts)
* AOB
h2. May 9, 2008
* Data Catalog line-mode client update
* Xrootd Update (New fileserver, new xrootd release, glastlnx22, etc)
* AOB
h2. May 2, 2008
* Stress test update
* Pipeline II progress, release plans
* Xrootd Update (New fileserver, new xrootd release, etc)
* AOB
h2. April 18, 2008
* Launch update
* Stress test issues
* Run Catalog Discussion
** Questions
*** Who registers the run?
*** What is the relationship to Bryson's downlink tables
*** How do we know if run is complete?
**** Are runs assigned a status before the run is complete?
*** Is rerunning a top level stream a "reprocessing"
*** Can original run status change as a result of reprocessing
**** If so do we need a history?
*** What should the web interface look like
** [Initial Schema proposal|Run catalog schema]
* xrootd status
h2. April 11, 2008
* Oracle switchover plans
* xrootd tape achiving status
* AOB
h3. April 4, 2008
* Oracle Database Update
** Status
** [Failover|Oracle failover]
* [Pipeline II release|/2008/03/27/CCB request for Pipeline II update]
* Infrastructure "How-to-fix" documentation
* Expert Shifts
* AOB
h3. March 28, 2008
* Oracle Database Update
** Schedule
** [Stress Testing Results|^stress.png]
* Pipeline [Update|/2008/03/27/CCB request for Pipeline II update]
* Upcoming CCB action requests
* Infrastructure "Expert Shifts"
h3. March 21, 2008
* [Tomcat servers update|SASHOW2FIX:Tomcat]
** Automount problems
* Oracle
** Oracle server/stress testing [update|^plot-54.png]
*** [KABOOM|^hs_err_pid14203.log]
** Oracle [wallet|Creating oracle wallets]/roles/materialized views discussion
* Data catalog
** Line mode client
** [File versioning|^l1versions.pdf]
* Recent [CCB action requests|SAS:SAS-SO CCB Actions]
* Upcoming CCB action requests
** Pipeline client rollback fix (1.0.2)
** Pipeline front-end fixes (message viewer etc) (2.5.1)
** Group manager fix to import data from campus MySQL (1.7) and export list of users for xrootd
** Put oracle wallet into production for Pipeline Server (1.0.1), Pipeline Client (1.0.3?), Datacat client (1.1.1)
h3. February 29, 2008
* Fallout from yesterday's outage
* Pipeline deadlock update
* xrootd update
* Preparation for opssim2
* Plans for [Change Control Board|SAS:SAS-SO CCB] (CCB)
** [Preliminary project list|DH projects and CCB]
* Oracle passwords
* ASP web display update
h3. February 22, 2008
* Stress testing progress/problems
* Data cleanup progress
* [ASP web display plans|http://glast-tomcat03:8080/ASPDataViewer]
h3. February 15, 2008
* Shift Database/Web app
* Using AFS tokens to log in to glast account (postponed to later)
* New Crawler
* OpsSim2 readiness issues
** xroot and old file versions
* Schedule for OS/IP upgrade on glastlnx\*
* Effects of [elimination of services|https://www-internal.slac.stanford.edu/hr/forms/discontinued-services-02-2008.pdf]
h3. February 1, 2008
* Oracle
** [Meltdown recap|January 29-30 Oracle meltdown]
** [Using oracle roles|~karen:oracle roles]
* Portal demo
h3. January 18, 2008
* New Releases
** [Data Catalog line mode client|https://confluence.slac.stanford.edu/display/ds/Release+Notes+-+Glast+Data+Catalog+backend+-+Version+1.0]
** [Tomcat server monitoring|http://glast-ground.slac.stanford.edu/ServerMonitoring]
** [Cross Trending|http://glast-ground.slac.stanford.edu/CrossTrending/]
* xrootd status/issues
* [Disk space usage for Pipeline tasks|DC2:Disk space usage for Pipeline tasks]
* [Oracle/MySQL passwords again|oracle account documentation]
** Ian [Note 1|Oracle Passwords, Note 1 (Proxy logins)], [2|Oracle Passwords, Note 2 (Oracle wallet)]
* [Data Handling To Do list|Web Applications Status and To-Do List]
* AOB
h3. January 11, 2008
* [GPL Tools Release|DC2:GPLtools Edit history]
* Pipeline Release Plans/Priorities ([Server|https://jira.slac.stanford.edu/secure/ReleaseNote.jspa?projectId=10360&styleName=Html&version=11212], [Front End|https://jira.slac.stanford.edu/secure/ReleaseNote.jspa?projectId=10150&styleName=Html&version=11174])
* [Pipeline Disk Usage|DC2:Disk space usage for Pipeline tasks]
* AOB
{column}
{section}
{column:width=25%}Meetings are held via teleconference on Fridays, 10:30 Pacific time using the CalTech [EVO |http://evo.caltech.edu]system. We do not use video.
Please avoid an open mike, which may cause echoes. See the evo help. For further information be sure to have a look at the [VRVS Etiquette|http://www-glast.slac.stanford.edu/software/meetings/vrvsetiquette.htm] page.
h2. Previous Years
* [2007|2007]
* [2006|2006]
* [2005|2005]
{column}
{column:width=75%}
h2. Upcoming meetings
We have now switched to a approximately bi-weekly schedule. The next meetings will be on:
h2. October 16 2009
* Data Catalog update
** Adding purge capability to line mode client
* AstroServer update
** Splitting large output files to avoid out-of-memory problems
* XRoot/HPSS update [ds:Testing HPSS Prod2]
h2. September 18 2009
* PROD Oracle outage - 0900 9/24
* AFS token problems in batch
* Disk usage/tape backup
** [Level 1 Usage|ds:Level 1 disk usage - September 2009]
** [Hpss usage|https://confluence.slac.stanford.edu/display/ds/HPSS+Usage]
* Pipeline
** Memory leak progress
*** [Reclaiming Connections|^ConnectionReclaiming.JPG] (image)
*** [Reclaiming Connections|http://glast-ground.slac.stanford.edu/Pipeline-II/logViewer.jsp?task=&severity=800&minDateDate=17%2FSep%2F2009+18%3A13%3A30&minDate=1253236410000&maxDateDate=17%2FSep%2F2009+18%3A13%3A35&maxDate=1253236415000&submit=Filter&dataSourceMode=Dev] (DEV message viewer)
** Feature requests from L1
h2. August 14 2009
* Status of L1 switch/reprocessing/astroserver
** [Dataset definitions|SCIGRPS:LAT Dataset Definitions]
** [Astro Server|http://glast-ground.slac.stanford.edu/DataPortal]
* Pipeline
** Missing foreign keys
** Pipeline web preferences issues
* Security patches - Tomcat servers switching to
** Tomcat 5.5.27
** Java 1.6.0_15
* Tony's vacation
** Ernest expected back on Monday - so use confluence-admin mailing list for confluence/jira problems
h2. July 31 2009
* Plans for release of public data
** L1 switch to new version
** Finalizing [P105 reprocessing|SCIGRPS:P105 (Pass6) Reprocessing Notes]
** Switch to [new version of AstroServer|http://glast-ground.slac.stanford.edu/DataPortalAstroServer/]
** [Names for data products|SCIGRPS:LAT Dataset Definitions]
* AOB
h2. June 26 2009
*Note change of time* 9am pacific time
* Astro server update
* Reprocessing status
** Pass 6 vs Pass 7 and consequences on astro server etc.
* Reprocessing and Run Details discussion
h2. June 12 2009
* [Gliffy demo|SLAC:/2009/06/10/Add Flowcharts, Technical drawings and more with Gliffy Plugin]
* Update on wain020/wain OS upgrade
* Pass 7 related issues
** [Skimmer status|ds:Skimmer 1.7 release]
** Astro server status
** Left over reprocessing issues?
*** [P100-MERIT and P100-FT1 tasks|ds:Remaining issues for P100-MERIT and P100-FT1]
* Pipeline requests
h2. May 29 2009
* Google IO highlights
* Data Catalog contents cleanup
** [New problems page|http://glast-ground.slac.stanford.edu/DataCatalog/problem.jsp]
* Post mortem of u18 problems from yesterday morning
* Status
** Reprocessing
*** [http://glast-ground.slac.stanford.edu/Pipeline-II/task.jsp?task=19821716]
*** [http://ganglia01.slac.stanford.edu:8080/ganglia/glast/?r=hour&s=descending&c=glast-xrootd]
** Xrootd/HPSS
h2. May 8 2009
* Maven2 conversion
** [Project list|JAVA:Moving Glast to maven2]
* Reprocessing readiness/status
** Processing History tables and [web pages|http://glast-ground.slac.stanford.edu/HistoryProcessing/]
** [P100 output|http://glast-ground.slac.stanford.edu/DataCatalog/?folder=51991991]
** Astro server readiness
** [P100 config|SCIGRPS:P100 (Pass7) Reprocessing Notes]
* [SCons installer demo|http://glast-tomcat03.slac.stanford.edu:8080/SConsInstaller/]
* [Speakers bureau web interface demo|http://glast-tomcat03.slac.stanford.edu:8080/SpBureau/]
h2. April 24 2009
* Heads Up - Prod Oracle outage 4/29 - 2pm
* [Astro Server performance update|ds:"New" Astro Server Benchmarking]
* New [glast-ground|http://glast-ground.slac.stanford.edu/] (aka fermi-ground)
* Reprocessing readiness/status
** [New meta-data in data catalog|http://glast-ground.slac.stanford.edu/DataProcessing/run.jsp?runid=262259974]
** [Run History Web Interface|http://glast-tomcat03.slac.stanford.edu:8080/RunQuality/HistoryProcessing.jsp]
** Data type for filtered Merit files
h2. April 17 2009 (special reprocessing meeting)
* Discussion of file naming, file location, and dataCatalog registration
** Pass7 reprocessing notes from Tom [P100 (Pass7) Reprocessing Notes|SCIGRPS:P100 (Pass7) Reprocessing Notes]
h2. April 10 2009
* Status of astro server upgrade
** Planned new features
*** New database using HTM/partitions/new hardware
*** Decide between MySQL and Oracle
*** Handling of new p7 quanitities
*** Handling of new format FT1 and FT2 files
*** Adding availability of LS1 and 1-second FT2 files
*** Using new database hardware/software
*** Post-processing with gtmktime
*** Support for electron+positron files (perhaps)
** Goal is to be ready for end-of-april pass 7 release
** Need to start importing data from reprocessing by end-of-next-week
* Maven2 migration
** Many projects now being switched to [maven2|JAVA:Moving Glast to maven2]/[hudson|http://glast-ground.slac.stanford.edu/hudson/]/netbeans 6.5.1
** New "archetype" makes it easy to start new projects
*** Karen is first guinea pig with "Speakers bureau app"
**** Karen has been making [notes|http://confluence.slac.stanford.edu/display/ds/netbeans+6.5.1+install]
* Crawler update
** Understood problem with
*** New merit header
**** First use of RootObj<Int> - escaping <> was not handled properly
*** Recon files from L1 1.71
**** FileHeader object is actually missing (just a RootObject)
** New crawler release coming
*** Will mark recon files as "HeaderError" but we can then change it to OK
*** Will recrawl all problem merit files
*** Will extract merit version from header
*** Will no longer use glast-rdr-test
* User disk web access
** [u33|http://glast-ground.slac.stanford.edu/Commons/Decorate/u33/]
* Pipeline status
** New [web front-end|http://glast-tomcat03.slac.stanford.edu:8080/Pipeline-II/] which does not use FTP
* Speakers bureau app
* Access to ops products
h2. Mar 13 2009
* Glast (etc) passwords
* Oracle connections on machines up for >200 days
* [Trending database disk usage statistics|http://glast-ground.slac.stanford.edu/Resources/?pattern=Oracle]
* [xrootd upgrade CCB|ds:/2009/03/13/Request to install a new Xrootd production version]
** xrootd outage
* Data Access Issues
** New astro server status
** Outstanding Bugs
*** [LONE-131@jira]
*** [DATASERV-151@jira]
** Standard data sets
** Dealing with soon to arrive "bad" data
** Reprocessing timeline
h2. Feb 13 2009
* Confluence notes
** New "[Confluence Tips and Tricks|SLAC:Confluence Tips and Tricks]", in particular hints on [organizing confluence pages|~tonyj:/2009/02/04/Organizing confluence content using page trees]
*** See for example [Data Handling Space|ds:Fermi Data Handling]
* [Data Processing Stats|http://glast-ground.slac.stanford.edu/Pipeline-II/DataProcessingStats.jsp]
* Disk space update
** [Available disk space|http://glast-ground.slac.stanford.edu/Resources/?initTime1Date=01-Aug-2008&initTime1=1217548800000&initTime2Date=13-Feb-2009&initTime2=1234483200000&name=L1PurgableGB&name=L1TotalGB&name=xrootd_all_freeGB&pattern=&submit=submit+resource]
*** [New page lists "to be deleted" files|http://glast-tomcat03:8080/DataCatalog/datasetPurge.jsp]
* Maven2 and [Hudson|http://glast-ground.slac.stanford.edu/hudson] status/demo
** Documentation
*** [For Developers |https://confluence.slac.stanford.edu/display/JAVA/Moving+Glast+to+maven2]
*** [Generated |https://glast-ground.slac.stanford.edu/docs/maven2/]
* Pipeline Status
* [Party Time|http://blog.wired.com/gadgets/2009/02/unix-lovers-to.html]
h2. Jan 30 2009
* Status of Pipeline upgrade
** Latest version of pipeline server now in DEV
** Latest version of pipeline front-end on [tomcat03|http://glast-tomcat03.slac.stanford.edu:8080/Pipeline-II]
*** [Status|Pipeline Front-End version 2.9 Status]
* Confluence upgrade
* Astro server upgrade
* xrootd update
h2. Jan 16 2009
* Pipeline - new features demo
* Database password change warning
* [Binary flash demo|http://www.slac.stanford.edu/~dflath/Binary.html]
* Status/Updates/AOB
h2. Dec 12 2008
* [Processing Time Plot|^Processing time.pdf]
* [Pipeline plans and priorities|Pipeline plans December 2008]
\- [ISOC:Future improvements to the Pipeline and to L1Proc]
* Shutdown plans
* Status updates
* AOB
h2. Nov 21 2008
* Highlights from
** [ADASS|ADASS recap]
** [ACAT|ACAT 2008 Highlights]
* Status reports/updates
** Release Manager II
** Resource Tracking
** Pipeline Release
*** Improvements to RunQuality plugin (for Warren)
*** Enhanced ability to send vars/file to batch jobs? (for Tom)
** Pipeline Front-End
*** Remove use of anonymous FTP for file/log access
** Cleanup of data products
*** !plot-0.png|thumbnail!
** xrootd issues
** Data catalog improvements
*** Download manager release
*** Astro server release
*** Merit Skimmer release
** Leap Second fixes
** Google Sky interface
** Confluence/JIRA release
** Group Manager release
h2. Oct 31 2008
* Outages update
* xroot update
** [New disks available|^xroot.png]
** Problem with xroot root client discovered
* Oracle update
* [Pipeline releases|/2008/10/30/CCB Request for Pipeline Upgrade]
* Planning for next week
** End of daylight savings
** Absence of Dan, Richard, Tony
* [Partitioned Tables in Oracle]
h2. Oct 24 2008
* Upcoming outages
* Leap seconds planning
** There will be an new leap second at end of 2008
** Rob wants a list of all applications effected and whether we need to do anything to fix/test them
*** We have a Java class for correct translation from MET->UTC
*** "Lat clocks" [http://glast-ground.slac.stanford.edu/LatOps/]
*** Astro server
*** Anything else where we need to worry about this?
* [Astro Server|http://glast-ground.slac.stanford.edu/DataPortalAstro]
* Disk/Oracle space
** I plan to turn on purging of L1 files older than 2 weeks(?) today
Some plots from: [http://glast-tomcat03.slac.stanford.edu:8080/xrootdiskspace-web/index.jsp]
!XRoot Space.png|thumbnail! !XRoot Servers.png|thumbnail! !L1 Space.png|thumbnail!
h2. Oct 10 2008
* Database [cleanup status|~turri:Oracle Disk Status]
** Removal of old housekeeping trending
** Demo of new [resource trending tool|http://glast-tomcat03.slac.stanford.edu:8080/xrootdiskspace-web/]?
* [Accessing oracle using wallet from perl|Password-less login using Perl DBI and Oracle Wallet]
** Access permissions on wallet
* Changing default for [Run Quality flags|GRQ-10@jira]
* xrootd Issues
** Crawler problems
** Other issues
h2. Sep 26 2008
* [Database cleanup status|https://confluence.slac.stanford.edu/display/~turri/Oracle+Disk+Cleanup]
* Pipeline 1.3.1 release planned for next week
** Only fixes two bugs: [PII-369@JIRA] and [GRQ-10@JIRA]
** Dan back next week
* Pipeline performance continues to be good
!plot-6.png|thumbnail! !EmChartBean.gif|thumbnail!
* Contingency ISOC planning
** Especially as it may impact web tools
* xrootd tape backup plans
** New tape group mappings
*** /glast/MC \-> glastMC
*** /glast/Data/Flight \-> glastflight
*** /glast/\* \-> glast
** Files to be backed up
*** Cron job now writing list to \~glast/backupfiles/level1backupfiles.txt (7128 files)
{noformat}select filesizebytes,path
from datasetgroup g
join verdataset d on (d.datasetgroup = g.datasetgroup)
join datasetversion dv on (d.latestversion=dv.datasetversion)
join verdatasetlocation l on (dv.masterlocation = l.datasetlocation)
join run r on (r.runid=l.runmin)
where g.datasetlogicalfolder=39684091 and l.datasetsite='SLAC_XROOT'
and (l1procstatus in ('Complete' , 'Incomplete') or sysdate-lastModified>'7 00:00:00')
and datasetdatatype in ('DIGI', 'RECON', 'MERIT', 'SVAC', 'GCR')
order by datasetdatatype, runmin;
{noformat}
** Wilko leaves Oct 6, back Nov 5. Has been working with Tofigh, so Tofigh can help provide emergency support.
h2. Sep 5, 2008
* Pipeline release plans
** Plan to have everything in DEV by today (most is already there), release to PROD on Monday
** [Pipeline Server|https://jira.slac.stanford.edu/browse/PII?report=com.atlassian.jira.plugin.system.project:roadmap-panel], [Pipeline Front-End|https://jira.slac.stanford.edu/browse/PFE?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
** Ready state issues?
* [Reprocessing readiness|https://confluence.slac.stanford.edu/display/DC2/Milestones%2C+To-do+List%2C+External+Issues%2C+Known+Limitations%2C+Open+Questions]
* xrootd update
* Miscellaneous
** Apps being moved from tomcat07 (glastlnx09) to tomcat06 (glastlnx13).
*** This will cause some nagios messages until nagios monitoring is updated
*** This is to free memory on glastlnx09 for [astro server|http://glast-ground.slac.stanford.edu/DataPortalAstro/] database
** confluence 2.9 is now set up for testing at [http://confluence-new.slac.stanford.edu]
** jira-new coming soon
h2. 8/8/08
* Infrastructure Shifts
* Recent/Upcoming release plans
** [Shift Schedule|http://glast-ground.slac.stanford.edu/ShiftSchedule/]
** [Pipeline Server|https://jira.slac.stanford.edu/browse/PII?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
** Data Portal
*** [FITS Skimmer|http://glast-tomcat03.slac.stanford.edu:8080/DataPortalFitsSkimmer/]
*** [Data Portal History|http://glast-tomcat03.slac.stanford.edu:8080/DataPortalHistory/]
*** Merit Skimmer
*** Data Catalog
*** Astro Server
**** Require releases of org-glast-dataportal-model, org-glast-datacat-client, org-glast-datahandling-common
* Nagios overview - Emmanuel
h2. Aug 1, 2008
Now that the rush to get things ready for LEO is subsiding we should go over what things didn't get done before, and what needs to be improved, cleaned up, etc.
* Near term plans for
** Pipeline
*** [Roadmap|https://jira.slac.stanford.edu/browse/PII?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
*** [Front-end|https://jira.slac.stanford.edu/browse/PFE?report=com.atlassian.jira.plugin.system.project:roadmap-panel]
** Data catalog
*** [Linemode download manager|Command Line Download Manager]
*** Ability to delete files from data catalog
*** Ability to purge old versions of (L1) files
**** In both cases data catalog will mark files to be deleted, then crawler will actually delete the files (from xrootd)
** Skimmer
*** Upgrade web front-end to use v6 backend
*** Understand issues with skimming real data
*** Miscellaneous improvements
** Xrootd
*** [Access to xrootd files|Xrootd Preload Library]
*** Plans for backing up files
h2. Jul 17, 2008
* Reprocessing discussion
** [Database tables|http://confluence.slac.stanford.edu/display/DC2/runCatalog]
** [Web interface|http://glast-tomcat03.slac.stanford.edu:8080/RunQuality/HistoryProcessing.jsp]
** Pipeline interface
* [Line-mode datacat|Data Catalog Users Guide] \- new features
** [Line-mode download manager|Command Line Download Manager]
* Infrastructure shifts discussion
h2. Jun 20, 2008
* Plan for next week
* New "[how to login|http://glast-isoc.slac.stanford.edu/pages/fr_isoc_home02/glast_logins.htm]" page from Mark
* AOB
h2. Jun 13, 2008
* Final decisions about infrastructure shifts
* Request from Ian/Arash for oracle outage
* Updates
** Pipeline status
** [Run Quality|http://glast-ground.slac.stanford.edu/RunQuality]
** xrootd
** Data Access
* AOB
h2. May 30, 2008
* Run Quality Update
* Database/Performance issues after pipeline upgrade
* AOB
h2. May 23, 2008
* [Nagios Overview/Status|^nagios.pdf]
* xrootd update
* [Run Quality Update|http://glast-ground.slac.stanford.edu/RunQuality]
** runQuality object to be added to scriptlet environment
*** runQuality.setL1RunStatus(long run, String status)
**** One of Running, Complete, InComplete, InProgress, Running, Unset
*** runQuality.setReviewStatus(long run, String status)
**** One of Not ready, Waiting review, (Reviewed, Unset)
* Datacat versions update
* AOB
h2. May 16, 2008
* [How to Fix|SASHOW2FIX:How to Fix - Home] Status Update
* [Xrootd release schedule|/2008/05/14/Request to install a new Xrootd production version] etc
* Demo/Discussion of [Run Quality Web Interface|http://glast-tomcat03.slac.stanford.edu:8080/RunQuality/]
* Shift Signup ([demo|http://glast-ground.slac.stanford.edu/ShiftSchedule/]/infrastructure shifts)
* AOB
h2. May 9, 2008
* Data Catalog line-mode client update
* Xrootd Update (New fileserver, new xrootd release, glastlnx22, etc)
* AOB
h2. May 2, 2008
* Stress test update
* Pipeline II progress, release plans
* Xrootd Update (New fileserver, new xrootd release, etc)
* AOB
h2. April 18, 2008
* Launch update
* Stress test issues
* Run Catalog Discussion
** Questions
*** Who registers the run?
*** What is the relationship to Bryson's downlink tables
*** How do we know if run is complete?
**** Are runs assigned a status before the run is complete?
*** Is rerunning a top level stream a "reprocessing"
*** Can original run status change as a result of reprocessing
**** If so do we need a history?
*** What should the web interface look like
** [Initial Schema proposal|Run catalog schema]
* xrootd status
h2. April 11, 2008
* Oracle switchover plans
* xrootd tape achiving status
* AOB
h3. April 4, 2008
* Oracle Database Update
** Status
** [Failover|Oracle failover]
* [Pipeline II release|/2008/03/27/CCB request for Pipeline II update]
* Infrastructure "How-to-fix" documentation
* Expert Shifts
* AOB
h3. March 28, 2008
* Oracle Database Update
** Schedule
** [Stress Testing Results|^stress.png]
* Pipeline [Update|/2008/03/27/CCB request for Pipeline II update]
* Upcoming CCB action requests
* Infrastructure "Expert Shifts"
h3. March 21, 2008
* [Tomcat servers update|SASHOW2FIX:Tomcat]
** Automount problems
* Oracle
** Oracle server/stress testing [update|^plot-54.png]
*** [KABOOM|^hs_err_pid14203.log]
** Oracle [wallet|Creating oracle wallets]/roles/materialized views discussion
* Data catalog
** Line mode client
** [File versioning|^l1versions.pdf]
* Recent [CCB action requests|SAS:SAS-SO CCB Actions]
* Upcoming CCB action requests
** Pipeline client rollback fix (1.0.2)
** Pipeline front-end fixes (message viewer etc) (2.5.1)
** Group manager fix to import data from campus MySQL (1.7) and export list of users for xrootd
** Put oracle wallet into production for Pipeline Server (1.0.1), Pipeline Client (1.0.3?), Datacat client (1.1.1)
h3. February 29, 2008
* Fallout from yesterday's outage
* Pipeline deadlock update
* xrootd update
* Preparation for opssim2
* Plans for [Change Control Board|SAS:SAS-SO CCB] (CCB)
** [Preliminary project list|DH projects and CCB]
* Oracle passwords
* ASP web display update
h3. February 22, 2008
* Stress testing progress/problems
* Data cleanup progress
* [ASP web display plans|http://glast-tomcat03:8080/ASPDataViewer]
h3. February 15, 2008
* Shift Database/Web app
* Using AFS tokens to log in to glast account (postponed to later)
* New Crawler
* OpsSim2 readiness issues
** xroot and old file versions
* Schedule for OS/IP upgrade on glastlnx\*
* Effects of [elimination of services|https://www-internal.slac.stanford.edu/hr/forms/discontinued-services-02-2008.pdf]
h3. February 1, 2008
* Oracle
** [Meltdown recap|January 29-30 Oracle meltdown]
** [Using oracle roles|~karen:oracle roles]
* Portal demo
h3. January 18, 2008
* New Releases
** [Data Catalog line mode client|https://confluence.slac.stanford.edu/display/ds/Release+Notes+-+Glast+Data+Catalog+backend+-+Version+1.0]
** [Tomcat server monitoring|http://glast-ground.slac.stanford.edu/ServerMonitoring]
** [Cross Trending|http://glast-ground.slac.stanford.edu/CrossTrending/]
* xrootd status/issues
* [Disk space usage for Pipeline tasks|DC2:Disk space usage for Pipeline tasks]
* [Oracle/MySQL passwords again|oracle account documentation]
** Ian [Note 1|Oracle Passwords, Note 1 (Proxy logins)], [2|Oracle Passwords, Note 2 (Oracle wallet)]
* [Data Handling To Do list|Web Applications Status and To-Do List]
* AOB
h3. January 11, 2008
* [GPL Tools Release|DC2:GPLtools Edit history]
* Pipeline Release Plans/Priorities ([Server|https://jira.slac.stanford.edu/secure/ReleaseNote.jspa?projectId=10360&styleName=Html&version=11212], [Front End|https://jira.slac.stanford.edu/secure/ReleaseNote.jspa?projectId=10150&styleName=Html&version=11174])
* [Pipeline Disk Usage|DC2:Disk space usage for Pipeline tasks]
* AOB
{column}
{section}