You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 81 Next »

This list contains the action items for the IEPM-BW group and is to be used to determine the tasks and progress of IEPM-BW members. Members are expected to keep their tasks up-to-date and current.

An archive of the task list, as standing after our group meeting, is also kept for reference.Key

Key

Item is

Description

underscored

Awaits something; provide a description of the cause and also provide the date from which it has been waiting at the end of the task description

strikesthru'd

Task is complete or has been dropped; if dropped, provide a reason. Also provide a complete date after the task, or 'dropped' if appropiate

bold

Task is currently being worked on or is actively being discussed

The general format of each task shall be represented as such:

  1. Project 1 - <Task Manager>
    1. Task 1 - <Person(s) responsible>
      1. Minor task 1 - <Person(s) responsible>
      2. Minor task 2 - <Person(s) responsible> - [DROPPED due to lack of interest]
    2. Task 2 - <Person(s) responsible>
  2. Project 2 - <Task Manager>
    1. Task 1 - <Person(s) responsible> [DONE 20060901]
    2. Task 2 - <Person(s) responsible> [AWAITING email contact back from Bob Smith]

Completed items must only be striked through rather than removed. These items will then be removed after each face-to-face meeting when the archive is updated.

Action Items

Terapaths Netflow (see http://iepmbw.bnl.gov/netflow/index.html) - Yee

  1. Get security requirements from SLAC/John H (Yee will talk to Gary 11/14/06) - Yee
  2. Presentation/Front-End - Yee
    1. Reimplement spider and pie charts for SVG - Shahryar, Yee
      1. Get account at BNL - Shahryar
      2. Implement pie chart class in SVG - Shahryar, Yee
        1. Fix colour of slices
        2. Add another graph (in and out)
        3. Fix web display of graph (honour incoming picture size)
        4. Add legend (which points to the slice)
      3. Implement spider class in SVG/Template format (awaits ICFA/SCIC report) - Shahryar, Yee
      4. Tidy up legends for pie and spider charts (awaits ICFA/SCIC report) - Shahryar, Yee

    2. Fix labels on time series plots - Yee [DONE 20061019]

  3. Processing Back-End (awaits traceanal 11/21/06) - Yee, Akbar
    1. Factorise out TopN code in JKFlow.pm (to do 11/14/06) - Akbar
    2. Refactorise JKFlow code for QoS analysis (restructure file structure and possibly QoS analysis) - Akbar
    3. Technical Documentation - Akbar
  4. Conflicts between netflow and iepm-bw on same host at BNL
    1. Add extra memory - BNL

    2. Change analysis to daily and see if problem persists (crontab changed 12/5/06, now look to see if problem persists) [Done 1/10/06 did not help] - Jerrod

    3. Netflow & iepm-bw appear to conflict, iepm-bw shut down while diagnose problem, maybe a RAID problem - Yee
    4. Serialize transfers for RRD (now reprocessing) - Yee
  5. Testing and Installation - Yee, Akbar
    1. Installation problems on 64-bit AFS machines - Akbar
      1. installs fine on 64-bit (non-AFS) and 32-bit AFS machines
      2. GCC libraries?
    2. Finalise installation script - Akbar, Yee
      1. Add patching - need distribution mechanism for tarball storage - Yee, Akbar

      2. Test perl prefix installations - Akbar, Yee [done 20060905]

    3. Add UI/cgi code to installation - Akbar, Yee

Transport services evaluation with Microsoft - Yee, Les

  1. Get latest privates from Microsoft
    1. Decide what is needed for stage 2
    2. Install Vista/Longhorn (Stalled: Windows Longhorn does not install 20070109, does not recognise drivers) - Yee
    3. Conference Feb 7th at Redmond - Yee

NDT server [Network Diagnostic Tool] at SLAC (see http://nettest5:7123) - Yee

  1. Installed on nettest5 NDT Install Yee [DONE 20060831]

  2. Talk security into allowing public access (currently available from offsite) - Yee
  3. PerfSONAR MA? - Yee

PingER

  1. PingER Visualization, Shahryar
    1. Allow identification of nodes in top left hand corner (was done 8/3/06, but has come back 8/7/06, re-reported 11/15/06, awaits ICFA/SCIC 1/10/07) : Shahryar
    2. Plot multi metrics (e.g. RTT & loss, agreed 6/7/06): Shahryar
    3. Zoom has a bug if one shows links from SLAC to World (reported 11/15/06) : Shahryar
  2. PingER2 improvements
    1. Provide multiple sources for beacons file: Warren
    2. Add diagnostic for missing beacons.txt: Warren
    3. Add diagnostic for failed lookup: Warren
    4. Add FAQs on missing beacons and failed lookup - Les

  3. Add analyze-allyears.pl to monthly crontabs [Done 1/10/07] - Jerrod

  4. Review beacons (make sure SLAC, S. Africa, Bolivia, Sao Paolo, NIIT, ICT, CERN can see all Beacons, there are some beacons e.g. lnfnet.lnf.infn.it that are pingable from SLAC but not other places):  Jerrod
  5. Convert offsite.nodes to a Guthrie database: Jerrod
    1. Add contact names etc. (Done,  currently populating list 10/15/06 - Jerrod)
    2. Enable entering the Group (Jerrod is working on 7/28/06, no update 10/16/06): Jerrod
  6. Add minimum router buffer size calculations to output - Yee, ???

Redesign and Implement Guthrie to cover both IEPM and PingER

IEPM-BW

  1. Work with DESY, FZK, NIIT, NCP to get monitoring hosts up  (Jerrod will read Connie' documentation and see if he can accomplish this, adding to the documentation as he goes along, reading/understanding documentation ) - Jerrod
  2. Make RAL a remote node## Have account but cannot ssh to it (sent email to Tasker 9/8/06, await PingER to run) - Les

  3. Toolspecs for Thrulay multi stream (Les will supply windows/streams for CERN) [Done 1/10/07] - Jerrod, Connie

  4. Get architecture of remote nodes and create a web page - Jerrod
    1. Write script to use ssh to get the configurations of IEPM monitor and remote hosts (in progress 4/26/06, will revisit Sep '06, possible project ) - Jerrod
      1. Report on anomalous values - Jerrod
      2. Add Nagios/Ganglia?
  5. Student project to make automate installation for scripts for IEPM-BW remote and monitoring sites (need to write a project specification) -  Les,  Yee
  6. Prepare table of canonical events and how various algorithms react - Adnan

  7. Build case studies of email event (see [Anomaly+Case+Studies]) [Done 1/10/07]  - Adnan

  8. Put together architecture document that explains how the scheduling, analysis stuff works - Connie

    1. Document how to add probes (follow on from mthrulay) [Done 1/10/07] - Connie

Traceroute Graphing - Yee, Akbar

  1. Extend documentation on wiki IEPM Topology Analysis Repository - Akbar, Yee
  2. Add color to Graphviz edges - Akbar
  3. Add end node even if it does not respond - Akbar
  4. Provide example of how to allow integration into Non-IEPM-BW data sets (ie NMWG) - Akbar, Asif, Yee

Traceanal Modularisation - Yee, Asif

  1. Integrate new topology into web server - awaits wan-mon appropoval - Yee
  2. Aethetics - Nauman
    1. Use icons/images rather than tables.
      1. construct image set of all possible outputs.
      2. integrate into visualisation
    2. Compress table to enable visualisation of 24 hours of data across screen.
  3. See how well the traceroute analysis does on monitor.niit.edu.pk - Les

IEPM-BW Ping Visualization - Les, Asif, Nauman

  1. Update Traceanal Modular code to gather and visualize IEPM ping data - Asif [BASE Code DONE 20061116: Rest will be assigned to student at NIIT], see compress traceanal table

  2. Change title for ping table output
  3. Add mouseover help for meanings of colors etc
  4. Look at alerting outages for ping

Alerts and Diagnosis - Les, Yee

  1. Step changes (Brian Tierney LBL is interested in predictions): Waqar, Adnan
    1. Yee is writing a new version of Plateau (11/16/06)
  2. Look at multivariate event detection (collect data for SLAC, BNL, Caltech pathchirp, thrulay,ping) - Adnan
  3. Look at improvements to plateau (Yee plans a rewrite, Akbar interested)
    1. Ability to find step ups - Yee
    2. Extend to allow up & down then compare down with original - Adnan
    3. Allow for small number of samples (e.g. at start) -
  4. Look at other detection algorithms and compare - Akbar
    1. Holt-Winters - Les, Yee
    2. Go back 7 weeks
    3. Check unusual results
    4. Consider other ways to optimize parameters
    5. Neural networks, Bayesian, ARMA/ARIMA ...
  5. Alerting daemon for RRDs; Torrus has nice example - Yee
    1. Understand code and separate for generic usage (integrate into perfsonar)

Install WANMON as IEPM web server - Yee

  1. Change scripts over to use new web server (get candidates, decide which ones to start with)
  2. John Bartelt is working on Internet access - Bartelt

PerfSONAR - Yee, Asif

  1. perfSONAR suite

    1. Install and configure Perfsonar suite [Done 20061206] axis

    2. Document installation proceedure
    3. Try out new release (1.1)
  2. IEPM-BW Web Services via SQLMA (publish iepm-bw performance metrics through perfsonar) - Yee, Asif

    1. Install SQL-MA for snapshot 20060901 - Asif, Yee DONE[20061206] MA-wsdl

    2. Write Ibatis (converts SQL into Java beans) configs for IEPM-BW data - Asif [DONE 20061130]

    3. -Add IEPM Traceroute metrics to Perfsonar MA - Asif [DONE 20070109]

    4. Add IEPM Ping metrics to Perfsonar MA - Asif
    5. Add IEPM iperf/thrulay metrics to Perfsonar MA - Asif
  3. NetRadar (perl perfsonar suite)
    1. Add NMWG classes - Yee
  4. Lookup Service (discovery of perfsonar services) - Asif, Yee
    1. Understand architecture and Multi-LS architecture - Asif
    2. Deploy a LS locally and integrate into multi-LS.
  5. Topology Service - Yee
    1. Add Layer3 information to database - Yee
    2. NMWG/perfSONAR service front end to database - Yee
  6. Java Topology Representation using JUNG - Asif
    1. Ability to plot static NMWG XML files - Asif
    2. Fetch real data from Esnet/I2/GEANT
  7. Hybrid LS-Topology Service - Asif
    1. Build use cases of queries to enable quick analysis of data - Yee, Asif

Presentations/Talks/Visits/Papers/Documentation

  1. Put together the annual ICFA/SCIC network group report - Shahryar

IPv6

  • No labels