Page History

.3201

Action Items

Road map of IMC paper - TULIP (Jan 13 2010)

1. We have to get delay to distance statistics all around the world: Intra Regional and Inter Regional statistics. (by 21 Jan 2010)
2. We'll try extract following information from those statistics: 1) Delay to Distance constant or Alpha value for each region; 2) Adjacent regions with similar value can be classified as a single Tier; 3) Relationship between delay-to-distance correlation and digital divide. (by 21 Jan 2010)
3. Study of TBG whether it requires some configuration or just the training data. (End of Jan 2010)
4. Get results from Shortest Ping, Tulip, SOI regional, CBG and TBG in different region across the globe (End of Jan 2010)
5. Write the first draft of the paper. (Mid of February 2010)

Terapaths Netflow (see http://iepmbw.bnl.gov/netflow/index.html) - Yee

1. Get security requirements from SLAC/John H (Yee will talk to Gary 11/14/06) - Yee
2. Presentation/Front-End - Yee, Ahmad, Shahryar
   1. Reimplement spider and pie charts for SVG - Shahryar, Yee [Shahryar doesn't want to do it]
      1. Implement pie chart class in SVG and PNG - Shahryar, Yee
         1. Fix colour of slices
         2. Add another graph (in and out)
         3. Fix web display of graph (honour incoming picture size)
         4. Add legend (which points to the slice)
      2. Implement spider class in SVG/Template format (awaits ICFA/SCIC report) - Shahryar, Yee
      3. Tidy up legends for pie and spider charts (awaits ICFA/SCIC report) - Shahryar, Yee
3. Processing Back-End (awaits traceanal 11/21/06) - Yee, Akbar## Factorise out TopN code in JKFlow.pm (to do 11/14/06) - Akbar
   1. Refactorise JKFlow code for QoS analysis (restructure file structure and possibly QoS analysis) - Akbar
   2. Technical Documentation - Akbar
4. Testing and Installation - Yee, Ahmad, Akbar
   1. Installation problems on 64-bit AFS machines - Akbar
      1. installs fine on 64-bit (non-AFS) and 32-bit AFS machines
      2. GCC libraries?
   2. Finalise installation script - Akbar, Yee
      1. Add patching - need distribution mechanism for tarball storage - Yee, Akbar
      2. Test perl prefix installations - Akbar, Yee [done 20060905]
   3. Add UI/cgi code to installation - Akbar, Yee

Presentations/Talks/Visits/Papers/Documentation

1. Put together the annual ICFA/SCIC network group report - Fahad

NDT server [Network Diagnostic Tool] at SLAC (see http://nettest5:7123) - Yee

1. Installed on nettest5 NDT Install Yee [DONE 20060831]
2. Talk security into allowing public access (currently available from offsite) - Yee
3. Kernel Status: 2.6.22.1 [20070730]
4. Problems installing openafs (does not compile) - unix-admin suggests to write to openafs list.
5. PerfSONAR MA? - Yee

PingER

1. PingER Visualization, Shahryar
   1. Allow identification of nodes in top left hand corner (was done 8/3/06, but has come back 8/7/06, re-reported 11/15/06, awaits ICFA/SCIC 1/10/07) : Shahryar
   2. Plot multi metrics (e.g. RTT & loss, agreed 6/7/06): Shahryar
   3. Zoom has a bug if one shows links from SLAC to World (reported 11/15/06) : Shahryar
2. PingER2 improvements
   1. Provide multiple sources for beacons file: Warren
   2. Add diagnostic for missing beacons.txt: Warren
   3. Add diagnostic for failed lookup: Warren
   4. Add FAQs on missing beacons and failed lookup - Les
3. Add analyze-allyears.pl to monthly crontabs [Done 1/10/07] - Jerrod
4. Review beacons (make sure SLAC, S. Africa, Bolivia, Sao Paolo, NIIT, ICT, CERN can see all Beacons, there are some beacons e.g. lnfnet.lnf.infn.it that are pingable from SLAC but not other places):  Jerrod
5. Convert offsite.nodes to a Guthrie database: Jerrod
   1. Add contact names etc. (Done,  currently populating list 10/15/06 - Jerrod)
   2. Enable entering the Group (Jerrod is working on 7/28/06, no update 10/16/06): Jerrod
6. Add minimum router buffer size calculations to output - Yee, ???
7. PingER perfSONAR MA - Yee## Writing script to do conversion of pinger flat files into MySQL DB
   1. 1. Likely to use production MySQL Service
   2. Hack analyse-* scripts to use mysql backend

Redesign and Implement Guthrie to cover both IEPM and PingER

IEPM-BW

1. Work with DESY, FZK, NIIT, NCP to get monitoring hosts up  (Jerrod will read Connie' documentation and see if he can accomplish this, adding to the documentation as he goes along, reading/understanding documentation ) - Jerrod
2. Make RAL a remote node## Have account but cannot ssh to it (sent email to Tasker 9/8/06, await PingER to run) - Les
3. Toolspecs for Thrulay multi stream (Les will supply windows/streams for CERN) [Done 1/10/07] - Jerrod, Connie
4. Get architecture of remote nodes and create a web page - Jerrod## Write script to use ssh to get the configurations of IEPM monitor and remote hosts (in progress 4/26/06, will revisit Sep '06, possible project ) - Jerrod### Report on anomalous values - Jerrod
   1. 1. Add Nagios/Ganglia?
5. Student project to make automate installation for scripts for IEPM-BW remote and monitoring sites (need to write a project specification) -  Les,  Yee
6. Prepare table of canonical events and how various algorithms react - Adnan
7. Build case studies of email event (see Anomaly+Case+Studies) [Done 1/10/07]  - Adnan
8. Put together architecture document that explains how the scheduling, analysis stuff works - Connie## Document how to add probes (follow on from mthrulay) [Done 1/10/07] - Connie

Traceroute Graphing - Yee, Akbar

1. Extend documentation on wiki IEPM Topology Analysis Repository - Akbar, Yee
2. Add color to Graphviz edges - Akbar
3. Add end node even if it does not respond - Akbar
4. Provide example of how to allow integration into Non-IEPM-BW data sets (ie NMWG) - Akbar, Asif, Yee

Exhibit Prototype (Traceanal and Ping) Visualisation - Asif, Yee

1. Aethetics - Asif, Nauman (Nauman had contributed nothing to this project)
   1. Use icons/images rather than tables - Asif [DONE 20070730]
   2. Provide clickable popup of a graphviz image of traceroute (with a comparision to the previous traceroute that generated the item)
2. Document architecture
3. See how well the traceroute analysis does on monitor.niit.edu.pk - Les
4. Port for Ping metrics
   1. Alerting techniques for pings? use latency? loss? both? document different states etc.
   2. Use PingER perfSONAR/MA backend
   3. Use IEPM-BW db

Alerts and Diagnosis - Les, Yee

1. Step changes (Brian Tierney LBL is interested in predictions): Waqar, Adnan
   1. Yee is writing a new version of Plateau (11/16/06)
2. Look at multivariate event detection (collect data for SLAC, BNL, Caltech pathchirp, thrulay,ping) - Adnan
3. Look at improvements to plateau (Yee plans a rewrite, Akbar interested)
   1. Ability to find step ups - Yee
   2. Extend to allow up & down then compare down with original - Adnan
   3. Allow for small number of samples (e.g. at start) -
4. Look at other detection algorithms and compare - Akbar
   1. Holt-Winters - Les, Yee
   2. Go back 7 weeks
   3. Check unusual results
   4. Consider other ways to optimize parameters
   5. Neural networks, Bayesian, ARMA/ARIMA ...
5. Alerting daemon for RRDs; Torrus has nice example - Yee
   1. Understand code and separate for generic usage (integrate into perfsonar)

Install WANMON as IEPM web server - Yee

1. Change scripts over to use new web server (get candidates, decide which ones to start with)## John B. will likely want a list of all the scripts that should be diverted to the new server
2. John Bartelt is working on Internet access - Bartelt
3. Will it be possible to run Web services off this host? as a diversion to another host? (like what Tony J. does)

PerfSONAR - Yee, Asif

1. IEPM-BW Web Services via SQLMA (publish iepm-bw performance metrics through perfsonar) - Yee, Asif
   1. Install SQL-MA for snapshot 20060901 - Asif, Yee DONE[20061206] MA-wsdl
   2. Write Ibatis (converts SQL into Java beans) configs for IEPM-BW data - Asif [DONE 20061130]
   3. -Add IEPM Traceroute metrics to Perfsonar MA - Asif [DONE 20070109]
   4. Add IEPM Ping metrics to Perfsonar MA - Asif
   5. Add IEPM iperf/thrulay metrics to Perfsonar MA - Asif
2. perfSONAR-PS - Yee
   1. snmpMA deployed on top of Local Network Monitoring
      1. Can't run because of security, but was successful at JT demo.
      2. ifErrors and ifDiscards
         1. schema to be finalised - Local netmon already supported, just need to write store.xml
   2. Lookup Service
      1. version in svn - need to test with snmpma
   3. Configuration Service
      1. like a lookup service but will hold configuration information that can be looked up. eg beacons list for PingER
   4. Topology Service - Yee
      1. map local netmon to topology service - currently already does NDL exports and graphviz
      2. Java Topology Representation using JUNG - Asif
         1. Ability to plot static NMWG XML files - Asif
         2. Fetch real data from Esnet/I2/GEANT
3. Hybrid LS-Topology Service - Asif
   1. Build use cases of queries to enable quick analysis of data - Yee, Asif

IPv6