Versions Compared

Old Version 2

changes.mady.by.user Les Cottrell

Saved on

compared with

New Version Current

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 4.0

...

  1. PingER web services: ?
    1. PingER & AMP Integration (AMP/NLANR has run out of funding, AMP will shut down 8/31/06. Given the demise of AMP this may need to be changed to integration with PerfSONAR): Asif
      1. Document work with AMP integration (hope to complete 11/18/06): Abdullah
      2. Extend to provide perfSONAR data reading front end: Abdullah, Asif
      3. Install & integrate code at SLAC: Abdullah
      4. Working on password protection: Abdullah
      5. Improve code, make production quality, automate getting data (requested with suggestions 8/20/06, making progress hope to be done in 3-4 days 8/31/06, sent back to SLAC, SLAC responded further formatting etc. improvements needed 9/12/06): Abdullah
      6. Get account (has this been done 11/29/06?): Abdullah
      7. Integrate with pingtable.pl: Abdullah, Jerrod
        1. Create AMP file directory: Jerrod
        2. Set up daily crontab:  Jerrod
        3. Set up analyze-hourly etc: (Done)Jerrod
        4. Add src & dst amp nodes to Guthrie: Jerrod
        5. Think about retrieving older data (find out how long ago there is data for): Jerrod, Adnan
        6. AMP and Pinger data comparison: Abdullah
    2. Smokeping & PingER Integration: Asma (Umar is trying to reach Asma 1/2/07), Asma, Shahryar
      1. Look at how to input PingER data to Smokeping display module (sounds like we have to convert from PingER to RRD format, can this be done in realtime or do we need an RRD database too): Asma
      2. Look at how to to take recent smokeping data and convert to PingER format (in progress 7/19/06, needs pingtable.pl to get all 12 metrics)
      3. Install on pinger2.niit.edu.pk (RRD problem fixed 11/30/06) - Asma
      4. Install at SLAC: Shahryar
        1. Make code available via FTP then Shahryar will download: Asma, Shahryar
        2. Install on test www server: Shahryar, Les
        3. Review code for security and update as neeeded (Shahryar has done and waits Asma updates 2/1/07): Les, Shahryar, Asma
      5. Change from 90 to 120 days - Asma
      6. Look at adding visualization of uptime: Asma
      7. Look at how to dynamically change the config file for Smokeping to accomodate the step interval (maybe time consuming, may affect all users and be cumbersome): Asma
      8. Look at using Smokeping to determine the quality of home links in Pakistan: Asma
      9. Will use as a top level access to PIngER and also as links from Pingtable to display last 45-90 days using smokeping: Asma, Yee
    3. Provide real-time display of PingER data:
      1. Export data to MonALISA from SLAC monitoring site:
      2. Figure how to deal with non regular (non exact 30 min data)
      3. Do for SLAC
        1. Decide on how to extend to other monitoring sites, try with NIIT: Akbar, Umer
        2. Hassan is looking into the code sent by Fawad (next step is to get ML web services client to get data): Akbar, Hassan
    4. Monitoring Hosts:
      1. NTC hosts, they agreed to install PingER2 at their 3 backbone sites (NTC management has changed, NIIT shifted from NTC to PERN, does not look promising): Arshad, Azher
      2. Pakistan hosts
        1. Wiki Markup-NTC is down since Oct 17th (-{_}{-}NTC management has changed, Arshad will contact upper management 12/4/06{-}{_}{_}-)-_ -\[After talking to NTC does not sound likely this will be restored, 1/11/07\]: Azher, Jerrod-
        2. COMSATS do not ping (Azher reports that COMSATS is very unreliable operation of PingER host): Azher
        3. PERN does not ping and reverse traceroute server is down (need to decide whether to give up on this host and remove it from our list of hosts to use for PingER and TULIP): Azher
        4. PERN would like to provide own archive analysis host (Les has sent URL describing tools needed on archive/analysis host, it maybe that iepm-bw would be more useful to them):

Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,FaranImage Removed Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les

  1. Deployment: Faran
    1. Provide a program API: Faran, Shahryar (dropped)
    2. Refine the list in Sites.txt by writing a script that will run TULIP HTTP requests to ping to see which landmarks are not responding (agreed 11/16/06, do we really need it, if so can we reduce its priority): Faran
    3. Provide opotion so that Sites.txt can be modified from TULIP. (agreed 11/16/06, currently the master is kept at SLAC and one has to logon to SLAC to modify it): Faran
    4. Ignore comments in mid line (agreed 11/30/06, is it done 1/31/07): Faran
    5. Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
    6. SLAC account for Faran (Faran need to report if password changed): Faran
  2. Visualization
    1. Make tables sortable (working on 5/25/06, re-agreed 8/3/06, re-requested 8/21/06, done for the RTTs 8/22/06, can we do with buttons for all columns): Faran
    2. Can we add AS's to routes: Yee, Faran
    3. Integrate with Google maps: Faran
    4. When zooming maintain size of dots:  Faran
  3. Landmarks
    1. Get more lanmarks for TULIP:
      1. Sent email Latin America (5/7/06, 11/25/06): Les
        1. Follow up on positive response from CUDI Mexico (reminded 1/12/07, it is there but still await the URL, sent reminder 1/27/07): Les
      2. China (sent email to ctsnet 7/26/06, reminded 12/6/06, 1/27/07): Les
      3. Try and get sites in Africa (Les sent email 11/28/06): Les
      4. COMTEC, Japan (Faran send email reminder 5/25/06, agreed to send another reminder 6/7/06, Umar will check with Farooq 11/16/06): Faran, Farooq
      5. Add traceroute/Looking Glass servers in critical areas, if they have a common format (asked for 11/15/06, Les did a manual look at traceroute.org and found about 20 potential landmarks 11/17/06): Faran
    2. Add NetDiGi route servers (asked for 8/30/06): Faran
    3. Provide tool to geolocate all PingER sites, analyze results to see what landmarks never respond; Faran
    4. Problem Landmarks:
      1. pinger.ntc.net.pk denies accesss (email to Azher & Faran 7/25/06, Azher responded that he is checking 7/27/06, email sent again 8/21/06, Azher knows about will send person to repair 8/22/06) see also above for the PingER node at this site: Faran/Azher
      2. Enable landmarks that only work for IP addresses: Faran
  4. Apply to PingER node database to check the lat/longs are roughly correct (tried with 300-400 sites but cannnot get results due to fragile Internet at NIIT, will interact with Akbar to make tests at SLAC 8/31/06, exchanged emails on list of PingER hosts to locate 9/3/06): Faran
  5. Analysis
    1. Literature search on triangulation, multi-lateration: Faran
    2. Measure landmarks from landmarks: Faran
    3. Document Faran's algorithm, try new algorithm with optimized alpha that does not require destination to be inside triangle: Faran, Umar
    4. Analyse the effect of passing IP addresses to landmarks rather than names: Faran
    5. Compare Faran's algorithm with Bamba's, Octant & simple triangulation, GeoIP tools (in progress 2/1/07)
      1. Contact Bamba to find out if http://planetlab-01.ipv6.lip6.fr:10000/cbg.phpImage Removed works for any sites (email send 4/21/06): Aziz
      2. Confidence estimates
      3. Applied to PingER hosts
      4. Outside triangles, area coverage
      5. Effect/need to vary alpha: Faran
  6. Analysis of Accuracy and applicability
    1. Accuracy vs known locations
    2. Effect of removing, adding landmarks, try for Bolivia:Faran
    3. Comparison with other sets of landmarks & methods (can't do Bamba since it is down), Octant, NetGeo for accuracy coverage etc.
    4. Provide bubble maps of accuracy: Faran
    5. Review difference between Guthrie and TULIP
      1. For US using Octant: Faran
      2. Look at big discrepancies: Faran
      3. Compare with GeoIP: Faran
    6. What area/population is covered by TULIP
    7. Document anomalies  (e.g. root-servers): Faran
    8. Show accuracy by region and country: Faran
    9. Come up with a way to estimate the accuracy/confidence of estimates: Faran
      1. Document in the TULIP web page: Faran

...

  1. Evaluate PCA multivariate method of Crovella: Waqar, Adnan,
    1. Compare PCA results with Holt-Winters/plateau: Adnan
      1. Fetch Data From SLAC, BNL, CALTECH (Pathchirp, Thrulay, Ping): Adnan
      2. Fetch data from CERN
      3. Apply PCA on same data and to get potential alerts: Adnan
      4. Comparison of Run-period results and PCA results: Adnan
      5. Improve event detector: Adnan
      6. Docment findings on PCA: Adnan
  2. Forecasting comparison of Active vs. passive data: Fareena, Adnan
    1. Look at eview implementation of ARIMA (QU has copy): Fareena
      1. Extend to more sites/metrics, see need for Integration & higher orders: Farena, Adnan
      2. Try with longer time base: Fareena
      3. Get time estimates : Fareena
    2. Detailed Graphs description: Fareena
    3. Regularization
    4. Look at moodss (http://jfontain.free.fr/statistics.htm):Image Removed Fareena
    5. Send results/documentation to SLAC (will send 8/31/06): Fareena
    6. Automate procedures
      1. Define project
      2. Put together presentation for workshop (for Sep 2006): Fareena
      3. Gather team
  3. Automatic event isolation: Adnan, Yee
  4. Put together paper for E2E conference Munich Germany in May, due Jan 27th, 2007 (SLAC needs to review paper): Adnan

...

  1. Compress traceanal table - Nouman, Asif
  2. Add node name in RH column
  3. Make nodename clickable to view ping time-series
  4. Add comment or help on how to find the real hostname
  5. Prepare distributable version of traceanal (assign to an NIIT student) - Asif, Yee
  6. Provide ViPER like interface to IEPM data: Fahad, Shahryar
    1. Problem with Google maps
    2. Deploy at NIIT (done 2/1/07, needs cert): Fahad
    3. Get account at SLAC
    4. Need to understand how to get updates from iepm in real-time (try accessing URL from web browser): Fahad, Shahryar

Pathneck (see http://maggie.niit.edu.pk/website/projects/Topological_Analysis.htmlImage Removed) Yee is the lead at the SLAC end: Asif

...

Communications etc.

  1. Projects (see http://www-iepm.slac.stanford.edu/pinger/projects/*)* Image Removed
    1. get accouts for Nouman and Fahad: Asif, Shahryar
  2. Try call via IP video (this will illustrate the improved performance of the network for HEC): Les, Akbar
  3. Visits
    1. The convocation is March 10, 2007
    2. Umar visit February for 2 weeks, will arrive Feb 14, 4:30pm UA931
      1. Set up agenda: Shahryar, Les, Umar
  4. Case study to S. Asia: Shahryar, Les
    1. When did NIIT switch from NTC to PTCL: Shahryar, Azher
    2. Is Micronet still used: Azher
    3. Waht do other Univerties in Pak use: Azher
  5. Proposals
      unmigrated-wiki-markup
    1. -HEC solicitation for International collaborations, due mid-Sept, Farooq PI (submitted 9/17/06, expect result Dec '06) \ [Our proposal was rejected Jan 07\]-
    2. Get reviews of proposal (done for US, trying Pak thru Atta): Arshad, Les
    3. Submit proposal to HEC (due 2/2/07): Arshad, Umar
    4. Develop new proposal with more a Grid Health viewpoint: Yee, Arsha, Les

...