You are viewing an old version of this page. View the current version.

Compare with Current View Page History

Version 1 Current »

Maggie-NS Tasklist

NEXT MEETING: 9:00 AM California, USA Time, Thursday 12th April, 2007, VRVS video, call +1 92 321 9830406 or Arshad 92-51-928-0443

Team members: Abdullah*, Adnan*, Arshad, Asma, Azher, Fahad*, Faran*, Nouman*, Umar*

Akbar*, Asif*, Les*, Shahryar*, Yee

Mailing lists: maggie-niit@ns.niit.edu.pk; backup: maggie-niit@googlegroups.com

Awaits something, also provides start of wait date
Done or drop, remove < 2 months are task done
: Person doing the work
Bold face: task in progress, or for discussion at meeting
Recent progress/discussion. Need student to be assigned. Critical.

Action Items

PingER: Shahryar, Umar Khan, Les

  1. PingER web services: ?
    1. PingER & AMP Integration (AMP/NLANR has run out of funding, AMP will shut down 8/31/06. Given the demise of AMP this may need to be changed to integration with PerfSONAR): Asif
      1. Document work with AMP integration (hope to complete 11/18/06): Abdullah
      2. Extend to provide perfSONAR data reading front end: Abdullah, Asif
      3. Install & integrate code at SLAC: Abdullah
      4. Working on password protection: Abdullah
      5. Improve code, make production quality, automate getting data (requested with suggestions 8/20/06, making progress hope to be done in 3-4 days 8/31/06, sent back to SLAC, SLAC responded further formatting etc. improvements needed 9/12/06, we need to either fnish this up or say Abdullah is not going to do it 3/20/07, Abdullah agreed to complete and send 3/22/07): Abdullah
      6. Get account (has this been done 11/29/06?): Abdullah
      7. Integrate with pingtable.pl: Abdullah, Jerrod
        1. Create AMP file directory: Jerrod
        2. Set up daily crontab:  Jerrod
        3. Set up analyze-hourly etc: (Done)Jerrod
        4. Add src & dst amp nodes to Guthrie: Jerrod
        5. Think about retrieving older data (find out how long ago there is data for): Jerrod, Adnan
        6. AMP and Pinger data comparison: Abdullah
    2. Smokeping & PingER Integration: Asma, Shahryar
      1. Install at SLAC: Shahryar
        1. Make code available via FTP then Shahryar will download: Asma, Shahryar
        2. Install on test www server: Shahryar, Les
        3. Review code for security and update as neeeded (Shahryar has done and waits Asma updates 2/1/07): Les, Shahryar, Asma
      2. Change from 90 to 120 days - Asma
      3. Look at adding visualization of uptime: Asma
      4. Look at how to dynamically change the config file for Smokeping to accomodate the step interval (maybe time consuming, may affect all users and be cumbersome): Asma
      5. Look at using Smokeping to determine the quality of home links in Pakistan: Asma
      6. Will use as a top level access to PingER and also as links from Pingtable to display last 45-90 days using smokeping: Asma, Yee
    3. Provide real time access to cached data
      1. Do for SLAC
        1. Decide on how to extend to other monitoring sites, try with NIIT: Akbar, Umer
        2. Hassan is looking into the code sent by Fawad (next step is to get ML web services client to get data): Akbar, Hassan
    4. Ping-data.pl form only shows beacons.

      1. Document in FAQ [Done 2/20/07]: Les

      2. Need to point $sites_fn to pinger.xml instead of beacons.txt & check if the file is xml or flat (for backward compatibility): Shahryar
      3. Added item to FAQ to cover: Les
    5. Monitoring Hosts:
      1. NTC hosts, they agreed to install PingER2 at their 3 backbone sites (NTC management has changed, NIIT shifted from NTC to PERN, does not look promising): Arshad, Azher
      2. Pakistan hosts

        1. NTC is down since Oct 17th (NTC management has changed, Arshad will contact upper management 12/4/06) [After talking to NTC does not sound likely this will be restored, 1/11/07]: Azher, Jerrod

        2. PERN does not ping and reverse traceroute server is down (need to decide whether to give up on this host and remove it from our list of hosts to use for PingER and TULIP, awaits presentation to PERN/NTC, presentation to PERN made by Les 3/15/07, they are agreeable, need to move forward): Azher
        3. PERN would like to provide own archive analysis host (Les has sent URL describing tools needed on archive/analysis host, it maybe that iepm-bw would be more useful to them, however installing iepm-bw is non-trivial, or revive the real time PingER plots):

Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,Faran Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les

  1. Deployment: Faran
    1. Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
  2. Improve web page

    1. Should the tables at NIIT web site be able to re-size themselves horizontally [The images do not work right in this case]: Faran

  3. Visualization

    1. Make tables sortable (working on 5/25/06, re-agreed 8/3/06, re-requested 8/21/06, done for the RTTs 8/22/06, can we do with buttons for all columns, agreed 2/27/07) [Done 3/22/07]: Faran

    2. Provide documentation (in progress 2/27/07, documented maths of selection 3/20/07, needs updating, agreed to update 3/22/07): Farhan, Faran
    3. Can we add AS's to routes: Yee, Faran
    4. DiscoveryStatistics =>LandMark Analysis one gets SLAC with RTT 0.0 regardless (reported 3/20/07): Faran

    5. If ping fails in Looking Glass Sites it shows as -5.0 RTT, should show as NAN (agreed 3/5/07, re-reported 3/20/07) [Done 3/22/07]: Faran

    6. When one double clicks on a row in Ping Results and the ping fails (e.g. host not responding) nothing shows in the  pop-up window. I think some diagnostic  or something should show (reported 3/20/07): Faran
    7. % complete location window needs information to say pings done but traceroutes still in progress (reported 3/20/07): Faran
    8. When zooming maintain size of dots (should we use Google maps, keep as a wish list item 2/27/07):  Faran
  4. Evaluate whether using traceroute data helps (Suggested by Umar & Les 2/26/07): Faran
  5. Landmarks
    1. Get more lanmarks for TULIP:
      1. China (sent email to ctsnet 7/26/06, reminded 12/6/06, 1/27/07): Les
      2. Try and get sites in Africa (Les sent email 11/28/06): Les
      3. COMTEC, Japan (Faran send email reminder 5/25/06, agreed to send another reminder 6/7/06, Umar will check with Farooq 11/16/06): Faran, Farooq
      4. Add traceroute/Looking Glass servers in critical areas, if they have a common format (asked for 11/15/06, Les did a manual look at traceroute.org and found about 20 potential landmarks 11/17/06, Faran not clear if one can automate 2/27/07, several are automateable, to prove it Les has added 8, Faran will work on): Faran
      5. Working on 2 sites in Palestine: Les

        1. Resolve traceroute: icmp socket: Permission denied (reported 2/27/07) [Fixed 3/10/07]: Les

        2. Gaza Strip host is down, reported 3/21/07: Les

        3. Added Al Quds to landmarks [Done 3/22/07]: Les

      6. Get site in Korea (made contact, test case works, suggest case study on S.E. Asia): Umar
    2. Add NetDiGi route servers (asked for 8/30/06, is able to parse them, will look at adding appropriate hosts 3/22/07): Faran
    3. Brunsvigia appears not to accept names, need to modify TULIP to call with addresses: Faran
  6. Apply to PingER node database to check the lat/longs are roughly correct (tried with 300-400 sites but cannnot get results due to fragile Internet at NIIT, will interact with Akbar to make tests at SLAC 8/31/06, exchanged emails on list of PingER hosts to locate 9/3/06): Faran
  7. Analysis
    1. Literature search on triangulation, multi-lateration: Faran

    2. Measure landmarks from landmarks [Done 2/15/07]: Faran

    3. Optimize alpha by landmark (after have new location algorithm working, will try 1:2 for US, 1:3 for Europe, 2:15 Africa) : Faran
    4. Document Faran's algorithm, try new algorithm that does not require destination to be inside triangle: Faran, Umar
    5. Analyse the effect of passing IP addresses to landmarks rather than names: Faran
    6. Look at impact of increasing number of pings for getting accurate min_RTT: Faran
    7. Compare with GeoIP Tools
    8. For US compare Faran's algorithm with Octant (no longer available 2/27/07), GeoIP & simple triangulation for PingER hosts(in progress 2/1/07)
      1. Confidence estimates
      2. Applied to PingER hosts
      3. Outside triangles, area coverage
      4. Effect/need to vary alpha: Faran
      5. Look at big discrepancies
  8. Analysis of Accuracy and applicability
    1. Accuracy vs known locations (landmarks & PingER hosts): faran
    2. Effect of removing, adding landmarks, try for Bolivia: Faran
    3. Provide bubble maps of accuracy: Faran
    4. What area/population is covered by TULIP
    5. Document anomalies  (e.g. root-servers): Faran
    6. Show accuracy by region and country: Faran
    7. Come up with a way to estimate the accuracy/confidence of estimates: Faran
      1. Document in the TULIP web page: Faran
  9. Find out more about GeoIP Tools

    1. Faran make contact with GeoIP people [Done 3/20/07]: Faran

    2. Find a case where TULIP beats GeoIP Tool [Done 4.68.116.16]:

NETRAT, SLAC Contact: Adnan, Les

  1. Evaluate PCA multivariate method of Crovella: Waqar, Adnan,
    1. Compare PCA results with Holt-Winters/plateau: Adnan
      1. Fetch Data From SLAC, BNL, CALTECH (Pathchirp, Thrulay, Ping): Adnan
      2. Fetch data from CERN
      3. Apply PCA on same data and to get potential alerts: Adnan
      4. Comparison of Run-period results and PCA results: Adnan
      5. Improve event detector: Adnan
      6. Docment findings on PCA: Adnan
  2. Forecasting comparison of Active vs. passive data: Fareena, Adnan
    1. Look at eview implementation of ARIMA (QU has copy): Fareena
      1. Extend to more sites/metrics, see need for Integration & higher orders: Farena, Adnan
      2. Try with longer time base: Fareena
      3. Get time estimates : Fareena
    2. Detailed Graphs description: Fareena

    3. Regularization [Done]

    4. Look at moodss (http://jfontain.free.fr/statistics.htm): Fareena

    5. Send results/documentation to SLAC [Done 3/15/07]: Fareena

    6. Share documentation with COMSATS: Umar
    7. Review write up, and send changes by FAX to +92-51-9280782: Les
    8. Automate procedures
      1. Define project
      2. Put together presentation for workshop (for Sep 2006): Fareena
      3. Gather team
  3. Automatic event isolation: Adnan, Yee
  4. Put together paper for E2E conference Munich Germany in May, due Jan 27th, 2007 (SLAC needs to review paper): Adnan

IEPM

  1. Traceanal
    1. Get desk-side working to SLAC: Nauman, Azher, Umar
    2. Compress traceanal table - Nouman, Asif
    3. Add node name in RH column
    4. Make nodename clickable to view ping time-series
    5. Add comment or help on how to find the real hostname
    6. Prepare distributable version of traceanal (assign to an NIIT student) - Asif, Yee
  2. Re-install at NIIT to enable viz: Fahan
  3. Provide installation package: Tanzeel (QAU), Nauman
  4. Provide ViPER like interface to IEPM data: Fahad, Shahryar
    1. Problem with Google maps, overcome by FTP from remote host: Fahad
    2. Problem with node visibility with FireFox (OK with MSIE 6): Fahad
    3. Deploy at NIIT (done 2/1/07, needs cert): Fahad
    4. Get account at SLAC (Fahad has information 2/15/07); Fahad
    5. Need to understand how to get updates from iepm in real-time (try accessing URL from web browser): Fahad, Shahryar
      1. Formats for ping and traceroute are different (will have to work around): Fahad
      2. Write his own script which will access the data from IEPM-BW database or use Web Service which Asif will develop. So that historic data can be shown on the visualization

PerfSONAR

  1. Provide Google maps interface to PerfSONAR: Shahryar, Qasim (Qasim with us 6 months starting 3/22/07) 

Pathneck (see http://maggie.niit.edu.pk/website/projects/Topological_Analysis.html) Yee is the lead at the SLAC end: Asif

  1. Try and get pathneck working from NIIT, study debug output, work with Ningning <hnn@cs.cmu.edu> (awaits site upgrade): Asif
  2. Update production version at SLAC (12/106): Asif, Yee
  3. Develop and install pathneck reverse server (would like to start at NIIT just to assure code works work with -y option): Les, Asif
    1. Modularize security of traceroute.pl: Asif, Yee
    2. Add in PerfSonar: Asif, Yee
  4. Evaluate and understand how pathneck needs to be configured, the failure modes, the areas of applicability etc. using iepm-resp.slac.stanford.edu: Asif
    1. Provide web site documenting failure modes: Asif
  5. Develop a vizualization
    1. Topology (currently with Touchgraph), color links, mouseover ID router, provide snapshot
    2. Click on link/router to get graph
    3. Incorporate location (e.g. via TULIP)
  6. Investigate integration with traceanal and graphviz: Asif
  7. Integrate topology map with pathneck: Asif
  8. Look at using PerfSONAR router information (do not agree well, need to get more statistics, to enable multiple measures need API to get PerfSONAR data, look perfsonar UI): Asif
  9. Try on Ultralight (problems if < 4 hops): Asif
  10. Problem of 0 results (reported to author but not much happening 4/20/06): Asif
  11. Add position and AS information to router database: Asif

Communications etc.

  1. Get video conferencing working echo cancelling mike is very helpful, NIIT does not appear to need one, if so Brooks has sent details 3/21/07 [Done 3/21/07]: Azher, Adnan, Les, Brooks

  2. Projects (see http://www-iepm.slac.stanford.edu/pinger/projects/)
  3. Paper on event diagnosis (curent status, will hear results 2nd week April for SJC): Adnan
  4. Proposals

    1. HEC solicitation for International collaborations, due mid-Sept, Farooq PI (submitted 9/17/06, expect result Dec '06) [Our proposal was rejected Jan 07]

    2. Get reviews of proposal (done for US, trying Pak thru Atta): Arshad, Les
    3. Submit proposal to HEC (due 2/2/07): Arshad, Umar
    4. Develop new proposal with more a Grid Health viewpoint (Cisco raised issues, await resolution 3/22/07): Yee, Arshad, Les, Cisco
    5. Proposal for perfSONAR (shown to Atta 3/15/07)
      1. Write up (working on Outline,  hope for draft weeken 3/24/07_: Umar

Wiki

  1. Create space for NIIT student reports and populate with initial reports - Yee, Les
  • No labels