Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 4.0

Goal

The goal is to develop a strategy to migrate all existing Glast projects from Maven1 to Maven2 is as unobtrusive a way as possible. The reasons to switch to maven2 are

  • Support for maven1 is fading away
  • Netbeans6, due to be released before end-of-year, has support for maven2 built-in (but not maven1)
  • Maven2 has many improvements, including simpler dependency management

We will not be able to move all projects over-night, so we need a strategy for which order to move projects, and how projects which have moved can continue to co-exist with projects which have not moved. We will need to provide clear instructions to developers to allow them to move their projects.

We should start with some simple projects, like org-glast-groupmanager.

Requirements

  • We need to maintain the features we have in maven1, including
    • Ability to check projects out and build them in Netbeans
    • Ability to deploy projects using the built-in netbeans tomcat server (Netbeans deploy)
    • Ability to use in-place deploy so that JSP pages can be edited and the effects seen immediately without the need to redeploy
    • Ability to deploy projects from netbeans to the development (tomcat03) and production (tomcat*) tomcat servers.
  • Ability for cruise-control to build projects. This should not be too hard since cruise-control has support for maven2
  • Ability to deploy snapshots and releases to a central Glast maven2 repository
  • Ability to deploy sites to http://glast-ground.slac.stanford.edu/docsImage Removed

Possible additional features

  • Right now there is a lot of boiler-plate code which has to be copied into each new Glast project. For freehep Mark set things up so their was a master project which other projects inherited from so that we didn't have to repeat the same information in each sub-project. A maven "archetype" for Glast projects might also be a good way to achieve this.
  • Now that we have 12 tomcat servers it is difficult to remember which server each application should be deploy to. It would be nice to be able to do something like mvn -Dmode=prod tomcat:deploy and have the application automatically deploy to the correct location. This would require some type of custom maven plugin which would talk to the glastgen database.

For Developers

Developing Projects

Parent Repository

All projects have to specify in the pom file the repositories where to find the parent. So the following code is required in every project:

...


    <repositories>
        <repository>
            <id>glast-maven2</id>
            <name>GLAST Maven 2 central repository</name>
            <url>http://glast-ground.slac.stanford.edu/maven2</url>
        </repository>
        <repository>
            <id>glast-maven2-snapshots</id>
            <name>GLAST Maven2 central SNAPSHOTS repository</name>
            <url>http://glast-ground.slac.stanford.edu/maven2/SNAPSHOTS</url>
        </repository>
    </repositories>

JAR

Parent

A jar project should inherit from org-glast-maven-jar-project; so in your pom add:

...


    <parent>
        <groupId>glast</groupId>
        <artifactId>org-glast-maven-jar-project</artifactId>
        <version>1.2</version>
    </parent>

WAR

Parent

A jar project should inherit from org-glast-maven-war-project; so in your pom add:

...


    <parent>
        <groupId>glast</groupId>
        <artifactId>org-glast-maven-war-project</artifactId>
        <version>1.2</version>
    </parent>

Final Name

The final name of the war file is to be set in the pom file as:

...


    <build>
        <finalName>ServerMapping</finalName>
    </build>

This name is the name of the produced war file and it must be identical to the Application's context. It is also used by the Maven Tomcat Deploy plugin to find the production deployment server.

SCM Plugin

CVS repositories cannot be inherited by the parent pom, so each project will have to add the following lines to their pom file:

...


    <scm>
        <connection>scm:cvs:pserver:anoncvs@glast-java.slac.stanford.edu:/cvs/java:${artifactId}</connection>
        <developerConnection>scm:cvs:ext:@glast-java.slac.stanford.edu:/cvs/java:${artifactId}</developerConnection>
        <url>http://www-glast.stanford.edu/cgi-bin/viewcvs/${artifactId}/?root=java</url>
    </scm>

Tomcat manager authentification

To be able to deploy to a tomcat server it is necessary to provide the manager's username and password. This can be done in a file called settings.xml located in your HOME\.m2 directory.

For GLAST you have to add the glastServer server element as shown below:

...


<?xml version="1.0" encoding="UTF-8"?>
<settings>
   <servers>
     <server>
       <id>glastServer</id>
       <username>glast</username>
       <password>GammaRay</password>
     </server>
   </servers>
</settings>

of this page is to keep track of our progress in ensuring that we will be able to support and maintain Fermi Data Handling code for the next decade.

The plan is to make sure that all projects have been:

  • identified as active or inactive
  • migrated to maven2
  • converted to using SRS code base or generalize and turn into an SRS project
  • added to SRS Hudson (and removed from Glast Hudson)

Once all the projects have been added to Hudson we have to make sure that:

  • Each automated build will publish SNAPSHOT artifacts to the appropriate repository
  • The documentation and javadoc are automatically built and deployed to the appropriate site directory
  • It is possible to release the projects in Hudson

Eventually all Fermi web appilcations, servers, scripts etc currently in production must be replace with the converted code.

Applications

The following we applications are either old or not linked to a specific project

Application

Comment

LatOps

Obsolete we application. It is still on tomcat11 to get documentation off of it. Not linked from glast-ground.

maven2

Fermi Maven2 repository

docs

Maven generated documentation. It points to /nfs/slac/g/glast/ground/docs/

workbook

Redirects to new workbook location: http://www.slac.stanford.edu/exp/glast/wb/prod/

DataPortalWiredBeta

Test version of DataPortalWired

DataPortalFitsSkimmer

To be removed

DataPortalGateway

Maybe we don't need it anymore

Installer

Will become Obsolete

Projects moved to SRS

The following projects have been generalized.

Project Name

Was

Comments

Contact

Application

org-srs-base-application

org-glast-base-application

 

max

 

org-srs-base-application-gui

org-glast-base-application

 

max

 

org-srs-batch-allocations

 

Genral application for batch share. Lined in from Pipeline

chee

 

org-srs-commons-web

org-glast-commons-web

 

max

Commons

org-srs-datacat-client

org-glast-datacat-client

 

brian

 

org-srs-datacat-server

org-glast-datacat-server

This is the Crawler

tony

 

org-srs-datacat-sp

org-glast-datacat-sp

 

brian

 

org-srs-datacatalog-web

org-glast-datacatalog-web

Is this in production for Fermi?

brian

DataCatalog

org-srs-datahandling-common

org-glast-datahandling-common

 

brian

 

org-srs-datainfo

was a part of org-glast-base-application

 

max

 

org-srs-decorator

was a part of org-glast-base-web

 

max

Decorator

org-srs-groupmanager

org-glast-groupmanager

 

karen

GroupManager

org-srs-jobcontrol

org-glast-jobcontrol

An instance of this is running for test.  Production is still glast.

tony

 

org-srs-pipeline-client

org-glast-pipeline-client

 

tony/brian

 

org-srs-pipeline-server

org-glast-pipeline-server

 

tony/brian

 

org-srs-pipeline-web

org-glast-pipeline-web

 

tony/brian

 

org-srs-pipeline-sp

 

New Package, this was pulled out of org-srs-pipeline-server for easier maintenace.

tony/brian

 

org-srs-servermapping

org-glast-servermapping

 

max

 

org-srs-servermonitoring-web

org-glast-servermon-web

 

max

 

org-srs-shiftschedule-web

org-glast-shiftschedule-web

Is this in production for Fermi?

chee

 

org-srs-tomcat-deploy-maven-plugin

List of Modules in javacvs

Module Name

Converted

org-glast-maven-project

(tick)

org-glast-maven-jar-project

(tick)

org-glast-maven-jar-archetype

(tick)

org-glast-maven-war-project

(tick)

org-glast-tomcat-deploy-maven-plugin

 

max

 

org-srs-web-base (tick)

org-glast-base-web (tick)

 

max

 

org-srs-resources-web

Contains part of org-glast-resources

 

chee

 

org-srs-image-handler-web

 

 

max

ImageHandler

org-srs-portal-web

 

 

max

ROOT

org-srs-cas

Replaces org-glast-cas-server

 

max

cas-srs

org-srs-downloadmanager

Replaces org-glast-downloadmanager

 

max

DownloadManager

Converted Projects

Project Name

Comments

Contact

Application

org-glast-base-application dataportal-model

Tag library needed by data portal web applications

brian

  (tick)

org-glast-servermapping -dataportal-portal

Still needed, part of data portal (Fermi specific)

tony

DataPortal (tick)

org-glast-groupmanager dataportal-astro

Part of astro server. Already done?

brian

DataPortalAstroServer (tick)

org-glast-dataportal-astro-model

This is part of the astro server. Isn't it already converted?

brian

  (tick)

org-glast-datahandling-common dataportal-simpleskimmer

Unnecessary dependence on aidatld(?). Still used, part of data portal

tony

DataPortalSimpleSkimmer (tick)

org-glast-datamonitoring-web dataportal-history

Still needed, part of data portal (Fermi specific)

tony

DataPortalHistory (error)

org-glast-installer-gui dataqualitymonitoring

 

max

  (error)

org-glast-dataqualitymonitoring-releasemanager web

 

(error) max

TomcatConfigurationBuilder

(error)

DataQualityMonitoring

org-glast-eventdisplay

auxiliary project for org-glast-dataportal-astro wired

dima

(error)  

org-glast-isoc-cfgwebbrowser dataportal-wired

builds and deploys webstart version of wired

dima

DataPortalWired (error)

org-glast-reportsgroupmanager-web

(error)

datacatalog-web

updater

Need to complete transition to UM tables

chee

  (error)

org-glast-isoc-common

 

steve

 

org-glast-maven-project

 

max

  (error)

org-glast-maven-war-resources project

(error)  

oracle max

(error)  

org-glast-dataportal-history maven-jar-project

 

max

  (error)

org-glast-isoc-logging reports-web

Depends on SNAPSHOT version of jas-plotter on a branch. 

max

Reports (error)

org-glast-runquality -web

 

karen

RunQuality

org-glast-telemetry-trending

 

max

  (error)

org-glast-telemetry-trending-web

 

max

TelemetryTrending (error)

org-glast-dataportal-model -resources

Inherits from org-srs-resources-web and has
Xrootd resources plots and tables. 

chee

Resources (error)

org-glast-isoc-mpwebview logging

 

steve,jim

ISOCLogging (error)

org-glast-asdc-sourceviewer dataprocessing-web

 

max

DataProcessing (error)

org-glast-dataportal-portal systemtests-web

 

max

SystemTests (error)

org-glast-jobcontrol -telemetry-apidstats

 

jim

APIDStats (error)

org-glast-servermonlatba-web

 

dan k

LATBA

org-glast-fcwebview

 

jim

FCWebView (error)

org-glast-asp-skimmer isoc-cfgwebbrowser

 

jim

WebConfigBrowser (error)

org-glast-dataportal-simpleskimmer isoc-mpwebview

 

jim

MPWebView (error)

org-glast-telemetry-latcatalogrtdisplay-web

 

jim

TelemetryTableWebUI (error)

org-glast-telemetry-shiftschedulemonitor-web

 

jim

TelemetryMonitor (error)

org-glast-asp-sourceviewer historyprocessing

 

karen

HistoryProcessing (error)

org-glast-dataportal-skimmer-fits speakersbureau-web

 

karen

SpBureau (error)

org-glast-logging releasemanager

Contains both new rm2 and old releasemanager application

karen

rm2 (error)

org-glast-skeleton-portlet latcatalog-web

 

roberto

LatSourceCatalog (error)

org-glast-aspdataviewer-web

 

roberto

ASPDataViewer

org-glast-elog-base

Base library for OpsLog

tony

  (error)

org-glast-dataportal-wired elog-web

Ops Log web application

tony

elog,Entries (error)

org-glast-maven-jar-archetype countdown-clock

Generates this page... http://glast-ground.slac.stanford.edu/CountdownClock/ 

tony

CountdownClock (error)

org-glast-skimmer-web glossary

Produces this: http://glast-ground.slac.stanford.edu/glossary/

max

glossary (error)

org-glast-dataportal-xroot-gateway

(error)

installer-gui 

 

tony

SConsInstaller

Projects to convert

Module Name

Comments

Contact

Application

org-glast-cas-server

Backend of login server. Still needed unless we are switching to crowd

max

cas

Not to be converted

Module Name

Comments

Contact

Application

tomcat

Doesnt need to be converted

tony

 

TomcatConfigurationBuilder

Netbeans project

tony

 

oracle

Doesnt need converting

tony

 

org-glast-monitor

Standalong monitoring (http://glastlnx20.slac.stanford.edu:5080). Can be left where it is

tony

 

Obsolete Projects

We might consider either moving them from cvs or disabling them

Module Name

Comments

Contact

Application

org-glast-downloadmanager

 

 

 

org-silicondetecor-web

Not Needed Anymore

karen 

SiliconDetectorWeb

org-glast-dataflow-web

 

 

 

org-glast-util-grep

 

 

 

org-glast-calibrationtrending-web

 

 

CalibrationTrending

org-glast-calibrationtrending

 

 

 

org-glast-logging

 

 

 

org-glast-clock

Produces the clock applet on https://glast-ground.slac.stanford.edu/LatOps/. I think we should declare the whole of LatOps obsolete.

tony

 

org-glast-groupmanager-example

 

 

 

org-glast-confluence

Obsolete (replaced by crowd). Still contains some potentially useful code so should not be lost forever.

 

 

org-glast-dataserver-web

 

 

 

org-glast-dataserver-portal

 

 

 

org-glast-dataportal-xroot-gateway

Obsolete (folded into data catalog)

 

 

org-glast-skimmer-web

 

 

 

org-glast-dataportal-skimmer-fits

Obsolete (although still running, should be removed from data portal)

 

 

org-glast-asp-skimmer

 

roberto

 

org-glast-visitor-web

 

 

 

org-glast-sourcemonitoring

(error)

org-glast-dataprocessing-web

(error)

org-glast-maven-plugin-parent

(error)

org-glast-sourcemonitoring-web

(error)

org-glast-batch

(error)

org-glast-dataqualitymonitoring

(error)

org-glast-systemtests-web

(error)

org-glast-calibrationtrending

(error)

org-glast-dataqualitymonitoring-web

(error)

org-glast-telemetry-apidstats

(error)

org-glast-calibrationtrending-web

(error)

org-glast-dataserver-portal

(error)

org-glast-maven-web-project jar-archetype

 

 

  (error)

org-glast-telemetrymaven-monitor-web war-archetype

 

 

  (error)

org-glast-cas-client-example -maven-aida-project

Replaced by org-srs-maven-aida-project

 

  (error)

org-glast-dataserver-base-web

Replaced by org-srs-web-base

 

  (error)

org-glast-tomcat-deploy-maven-xmlbeans-plugin

Replaced by org-srs-tomcat-deploy-maven-plugin

 

  (error)

org-glast-telemetry-rtdisplay-web -shiftschedule-web

Replaced by org-srs-shiftschedule-web

ShiftSchedule

  (error)

org-glast-cas-server servermon-web

Replaced by org-srs-servermonitoring-web

ServerMonitoring

  (error)

org-glast-downloadmanager -servermapping

Replaced by org-srs-servermapping

ServerMapping

  (error)

org-glast-mc-requests -pipeline-web

Replaced by org-srs-pipeline-web

Pipeline-II

  (error)

org-glast-telemetry-trending

(error)

-pipeline-server

Replaced by org-srs-pipeline-server

 

 

org-glast-pipeline-client

Replaced by org-glast-clock pipeline-client

 

  (error)

org-glast-elog-base jobcontrol

Replaced by org-srs-jobcontrol

 

  (error)

org-glast-monitor -datahandling-common

Replaced by org-srs-datahandling-common

 

  (error)

org-glast-telemetry-trending-web -datacatalog-web

Replaced by org-srs-datacatalog-web

 

  (error)

org-glast-common -datacat-sp

Replaced by org-srs-datacat-sp

 

  (error)

org-glast-elog-web -datacat-server

Replaced by org-srs-datacat-server

 

  (error)

org-glast-pipelinedatacat-client

Replaced by org-srs-datacat-client

 

  (error)

org-glast-telemetrycommons-trends web

(error)

Replaced by org-glastsrs-commons-web

 

(error)  

org-glast-fastmonitoring base-application

Use now org-srs-base-application or org-srs-base-application-gui

 

  (error)

org-glast-pipeline-core tld-timeline

Used to be standalone application but now it is in MPWebView

jim, steve

  (error)

org-glast-cas-tld-timeline client-example

first Matt's example using ageci

tony

  (error)

org-glast-confluence fcmonitor

 

bryson (question)

  (error)

org-glast-fastmonitoring-web fcwebview-portlet

 

max

  (error)

org-glast-pipeline-log portlet

 

max

  (error)

org-glast-countdown-clock portlet-base

 

max

 

org.glast.portlet

 

max

  (error)

org-glast-fcmonitor portlets

 

max

  (error)

org-glast-pipeline-server skeleton-portlet

 

max

  (error)

org-glast-trendable-db portal-theme

 

max

  (error)

org-glast-datacat-client grbmonitoring-web

 

roberto

  (error)

org-glast-fcwebview -asdc-sourceviewer

 

roberto

  (error)

org-glast-pipeline-web -asp-sourceviewer

 

roberto

 

datacatalog-web

 

tony

 

org-glast-datamonitoring

 

max

  (error)

org-glast-util-grep web-base-application

 

max

  (error)

org-glast-datacat-server datamonitoring-web

 

max

  (error)

org-glast-fcwebview-portlet trendable-db

 

max

  (error)

org-glast-pipeline-xml log

 

tony

  (error)

org-glast-visitor-web pipeline-xml

 

tony

  (error)

org-glast-datacat-sp pipeline-core

 

tony

  (error)

org-glast-glossary batch

 

tony

  (error)

org-glast-portal-theme telemetry-trends

 

max

  (error)

org-glast-web-base-application sourcemonitoring

 

max

  (error)

org-glast-datacatalogsourcemonitoring-web

 

max

(error)  

org-glast-grbmonitoringmaven-web-project

 

max

  (error)

org-glast-portlet fastmonitoring

 

max

  (error)

org-silicondetecorglast-fastmonitoring-web

 

max

(error)  

org-glast-dataflow-web maven-plugin-parent

 

matt

  (error)

org-glast-portlet-base -maven-xmlbeans-plugin

 

matt

 

org-glast

 

matt

  (error)

org.glast.portlet test

 

matt

  (error)

org-glast-groupmanager-example hello

 

matt

  (error)

org-glast-portlets profile

 

matt

  (error)

org.glast.test -glast-common

 

matt

  (error)

org-glast-datamonitoring -runquality-web

 

karen

  (error)

org-glast-hello -historyprocessing-web

 

karen

  (error)

org-glast-profile mc-requests

(error)  

tomcat karen

(error)