Page History
...
- Data Trending
- Given the volume of data a database table only approach might be insufficient. We might have to consider a hybrid solution that involves reading data straight from tuple files (less efficient that reading from a db)
| Jira Issues | ||
|---|---|---|
|
Portal
...
- Create Jira
...
- space
- Get portal working, at least for items like data processing page, grb summary etc
- Generate RSS feeds from LogWatcher, Ops Log, JIRA, Confluence etc to display on portal page
Cross Trending
- Create Jira space
Source Monitoring Jira
| Jira Issues | ||
|---|---|---|
|
Data Processing
Scope
Display ASP data products for a pool of sources.
Status
This is the second implementation of this application. We have developed a set of databases to keep a list of sources and to ingest data to be trended at different frequencies. The sources database can be loaded from xml files used by ASP. Scripts are available to ingest the data from the pipeline at the end of ASP processing.
This is still a preliminary version of the application and needs feedback to better define its scope and use.
To-Do List
- Improve the application's UI
- User preferences
Data Processing
Scope
This application should provide a quick and intuitive look at the status of data processing from the moment it is being Fast Copied through the various processing steps that lead to the final data products.
Status
A preliminary version of the application has been used during the October Test and it worked pretty well.
- Downlink-RunId database tables have been created
- with these tables it is possible to extract which run numbers are contained in each downlink
- The progress mechanism has been defined as the number of completed sub tasks for a given process.
- When new sub tasks are forked off the overall progress might go backwards
To-Do List
- Remove duplication between data processing page and other apps
- One possibility is to hide queries in functions
GCN/GRB Web front end
Scope
Tabular overview of most recent Noticies and possibility to browse GRB/Noticies.
Status
- Databases have been designed.
Portal
The portal is the icing on the cake. It will be targeted and developed at the very end.
Scope
Provide a rich and highly customizable environment for viewing data from all the above (and below) applications.
Status
We have developed three portlets to prove that we can extract data from external applications. These portlets can provide tables (from Logging and Fast Copy) and pots (from TelemetryTrending).
To-Do List
Do the rest.
Cross Trending/Reports
Scope
This application should give users the possibility to fetch histograms and data trends from all the above applications and to create scatter plots, overlays or tables of data.
It should also be possible to load simple user-written jsp pages as reports. Users can create a list of favorite reports to be processed at different frequencies (say last 24 hours, last week, last month etc.)
A user would write reports in the form of jsp pages with some special tags to embed plots, text, links, etc.
These pages will be registered with the applications.
The application would provide a tabulated lists of all the available reports and a way to generate them on some time period.
Status
A toy version is available for the cross trending part. The Reports are still in the discussion phase.
To-Do List
- Write database tables to store report jsp pages
- Define tags API to embed plots in jsp apges
Data Portal
- Add links to log messages (pending refactoring and improvement on logger)
| Jira Issues | ||
|---|---|---|
|
GCN/GRB Web front end
- Create Jira space
- Integrate with Source Monitoring applicationGet portal working, at least for items like data processing page, grb summary etc Generate RSS feeds from LogWatcher, Ops Log, JIRA, Confluence etc to display on portal page