Versions Compared

Old Version 152

changes.mady.by.user Unknown User (shahryar2001)

Saved on

compared with

New Version 153

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

NEXT MEETING: 9:00 AM California, USA Time, May 1031, VRVS or Skype video (in Les' directory under Umar), call +1 92 321 9830406 or Arshad 92-51-928-0443 or Umar  9 011 92-333-535-3672 (cell)

Team members: Abdullah*, Adnan*, Ahmad*, Azher, Fahad*, Faran*, Nouman*, Qasim*, Umar*

Akbar*, Arshad, Asif*, Les*, Shahryar*, Yee

Mailing lists: maggie-niit@ns.niit.edu.pk; backup: maggie-niit@googlegroups.com

...

  1. PingER web services: ?
    1. PingER & AMP Integration (AMP/NLANR has run out of funding, AMP will shut down 8/31/06. Given the demise of AMP this may need to be changed to integration with PerfSONAR, on the other hand it may be useful for converting from the perfSONAT MP/MA format to PingER): Abdullah
      1. Document work with AMP integration (hope to complete 11/18/06, look at using Perldoc): Abdullah
      2. Extend to provide perfSONAR data reading front end (awaits perfSONAR): Abdullah, Asif
      3. Install & integrate code at SLAC: Abdullah
      4. Working on password protection: Abdullah
      5. Improve code, make production quality, automate getting data (requested with suggestions 8/20/06, making progress hope to be done in 3-4 days 8/31/06, sent back to SLAC, SLAC responded further formatting etc. improvements needed 9/12/06, we need to either finish this up or say Abdullah is not going to do it 3/20/07, Abdullah agreed to complete and send 3/22/07, Abdullah sent code but it needs indenting and some example documentation mail sent to Abdullah 4/4/07, Abdullah will have the code ready  by 5/3/07, code provided 5/10/07): Abdullah, indentation and commenting need work)
        1. Needs to work with -w and strict
        2. Enable user to specify AMP host an option with a sensible default
        3. Comment what hosts work
        4. (has provided 2 files one for local one for dynamic, i.e. go to amp)
        5. Comment what hosts work
        6. Deploy at SLAC
      2. Integrate with pingtable.pl: Abdullah
        1. Create AMP file directory:
        2. Set up daily crontab: Set up analyze-hourly etc: (Done)Jerrod
        3. Add src & dst amp nodes to Guthrie:
        4. AMP and Pinger data comparison: Abdullah
    2. Smokeping & PingER Integration: Shahryar (Asma is no longer working on this)
      1. Install at SLAC: Shahryar
        1. Installation on test www-dev test server : Shahryar, Les
        2. Wiki Markup
          -Needs to set the cron job on a Solaris machine \[Done will use tersk 5/7/07\]: Shahryar, Les-
        3. Carried out detail performance analysis of the code. Tried to make the code run faster, Carried out detail performance analysis of the code. Tried to make the code run faster, by eliminating unecessary instructions. The details of the performance analysis can be found at https://confluence.slac.stanford.edu/display/IEPM/PingER+Smokeping+Integration. We have decide it to run for SLAC only hosts in order to test it for the time being. The results of the analysis shows that it takes 2 hours on average to update all the (536 SLAC to rest of the world RRDs) and will consume approximately 250 MB of disk space.
        4. The generation and presentation of the Smokeping graphs works
      2. Make documentation point to Asma's detailed reference documentation too: Shahryar Done
      3. Look at adding visualization of Look at adding visualization of uptime (Umar will check with Asma about uptime 4/30/07): Shahryar, Asma
      4. Will use as a top level access to PingER and also as links from Pingtable to display last 120 days using smokeping: Shahryar
      5. Can/should we monitor display uptime (communicating with Asma 5/1/07, Asma answered): Umar, Asma, Shahryar
      6. Need to deploy the code on www-wanmon
    3. Provide real time access to cached data (needs assigning as project)
      1. Do for SLAC
        1. Decide on how to extend to other monitoring sites, try with NIIT: Akbar, UmerHassan is looking into the code sent by Fawad (next step is to get ML web services client to get data): Akbar, Hassan
    4. Ping-data.pl form only shows beacons.
      1. Need to point $sites_fn to pinger.xml instead of beacons.txt & check if the file is xml or flat (for backward compatibility): Shahryar
    5. Monitoring Hosts:
      1. Pakistan hosts
      2. sfsmds2.nsnl.net not responding (sent email 4/12/07, started responding but hostname incorrect, tried to fix now not responding 4/29/07 sent email, following discussion with Warren sent suggestion 5/1/07 by email, probably will need rebuild): Les
    6. Case Studies
      1. Case study for E. Asia to be led by Ajou university: Umar
        1. Wiki Markup
          -Send China information to Umar \[Done 5/10/07\]: Les-
        2. Wiki Markup
          -Send Taiwan information to Umar \[Done 5/10/07\]: les-
        3. Invite Taiwan to be a PingER monitoring host (sent email 5/10/07): Les
    2. Monitoring Hosts:
      1. Pakistan hosts

Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,Faran Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les

  1. Deployment: Faran
    1. Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
  2. Visualization
    1. Provide documentation (in progress 2/27/07, documented maths of selection 3/20/07, needs updating, agreed to update 3/22/07, should it be a wiki? - Umar thinks good idea need Faran view 4/30/07, Faran agrees 5/10/07): Farhan, Faran
    2. Can we add AS's to routes: Yee, Faran
    3. DiscoveryStatistics =>LandMark Analysis need to identify which Site number is displayed (i.e. from which window): Faran
    4. Sites.txt
      1. Add diagnostic to Sites.txt to identify bad formatting: Faran
      2. Allow alpha to change (lot of work, many changes, will improve greatly, changes design, Faran focussing on 4/12/07, need progress)
        1. Look at using PingER historical data to optimize alpha (agreed 4/12/07): Faran
        2. Need a way to display alpha used: Faran
      3. Make project to provide a user interface (e.g. edit) to Sites.txt (Adnan may have a student from his presentation, normalizing students to understand their applicability to task 4/30will complete 5/11/07): Faran
    5. When zooming maintain size of dots (Faran will propose to Umar as a student project 4/10/07, he is concerned about the download time, Asif suggests using NASA images for Java platform, will send link 4/12/07):  Faran
    Bugs:
    1. Sort on min-RTT is alphabetic, should be numerical (reported 5/3/12/07, assigned to Rehan 5/10/07):  FaranDouble click on line in Ping Results gives web page with wrong landmark., Rehan
  3. Bugs:
  4. Evaluate whether using traceroute data helps (Suggested by Umar & Les 2/26/07, could add 3 more RTTs to minimize from): Faran
  5. Landmarks
    1. Get more landmarks for TULIP, ideally need at least one landmark in all major developing countries that do not have direct connections to nearby countries.:
      1. China (sent email to ctsnet 7/26/06, reminded 12/6/06, 1/27/07): Les
      2. Try and get sites in Africa (Les sent email 11/28/06): Les
      3. COMTEC, Japan: Faran
        1. Need to add site to Sites.txt (5/2/07): Faran
      4. Add traceroute/Looking Glass servers in critical areas, if they have a common format (asked for 11/15/06, Les did a manual look at traceroute.org and found about 20 potential landmarks 11/17/06, Faran not clear if one can automate 2/27/07, several are automateable, to prove it Les has added 8, Faran will work on, re-requested 3/26/07 with suggestions8, Faran will work on, re-requested 3/26/07 with suggestions, Faran is having problems with blocking aftrer several accesses, will get a list then will try and contact to open up 5/10/07): Faran
      5. Get site in Korea at Ajou universitytrying university (trying to persuade 5/8/07): Umar
      6. Get site at KHU (server available, problems with permissions to open UDP sockets 5/8/07, Les ask Bartelt if there is some configuration setting in the web server 5/10/07): Umar
    2. Add NetDiGi route servers (asked for 8/30/06, is able to parse them, will look at adding appropriate hosts 3/22/07): Faran
  6. Apply to PingER node database to check the lat/longs are roughly correct (tried with 300-400 sites but cannnot get results due to fragile Internet at NIIT, will interact with Akbar to make tests at SLAC 8/31/06, exchanged emails on list of PingER hosts to locate 9/3/06/06, Shahryar sent information on how to access pingtable.pl data): Faran
  7. Analysis
    1. Literature search on triangulation, multi-lateration: Faran
    2. Wiki Markup
      -Measure landmarks from landmarks \[Done 2/15/07\]: Faran-
    3. Optimize alpha by landmark (after have new location algorithm working, will try 1:2 for US, 1:3 for Europe, 2:15 Africa, done at NIIT, need to deploy at SLAC 4/10/07) : Faran
    4. Document Faran's algorithm, try new algorithm that does not require destination to be inside triangle: Faran, Umar
    5. Analyse the effect of passing IP addresses to landmarks rather than names: Faran
    6. Look at impact of increasing number of pings for getting accurate min_RTT (Faran measured for a few sites, Les gave ideas on how to extend and analyze for multiple sites, could be a major project 4/4/07): Faran
    7. Compare with GeoIP Tools
      1. Wiki Markup
        Find a case where TULIP beats GeoIP Tool \[Done 4.68.116.16, probably backbone routers too\]:
    8. For US compare Faran's algorithm with GeoIP & simple triangulation for PingER hosts(in progress 2/1/07)
      1. Confidence estimates
      2. Applied to PingER hosts
      3. Outside triangles, area coverage
      4. Effect/need to vary alpha: Faran
      5. Look at big discrepancies
  8. Analysis of Accuracy and applicability
    1. Accuracy vs known locations (landmarks & PingER hosts): faran
    2. Provide bubble maps of accuracy: Faran
    3. What area/population is covered by TULIP
    4. Show accuracy by region and country: Faran
    5. Come up with a way to estimate the accuracy/confidence of estimates: Faran
      1. Document in the TULIP web page: Faran
  9. Look at publication (helps advance Faran's career and possibly "best project",  will need more analysis)
    1. Find conference: all
    2. Can we get Cisco interested?: Arshad, Faran
    3. Update documentation: Les, Faran
    4. Read paper at http://research.microsoft.com/%7Epadmanab/papers/sigcomm2001.pdf: Faran

...

  1. Netflow presentation (Yee sent project to Ahmad  http://confluence.slac.stanford.edu/display/IEPM/Netflow+Presentation+Frontend): Ahmad/display/IEPM/Netflow+Presentation+Frontend): Ahmad
  2. Akbar making progress in scoreboard and backend, complete 5/13/07).
  3. Ahmad has a n idea about the MSIE browser problem
  4. Ahmad wants Netflow JS scripy documentation from Yee.
  5. Shahryar will send doccy on spider & pie charts
  6. Yee will get account for Ahmad at BNL
  7. Ahmad needs specific project from Yee

NETRAT, SLAC Contact: Adnan, Les, Umar interested

  1. Evaluate PCA multivariate method of Crovella: Waqar, Adnan,
    1. Compare PCA results with Holt-Winters/plateau: Adnan
      1. Fetch Data From SLAC, BNL, CALTECH (Pathchirp, Thrulay, Ping): Adnan
      2. Fetch data from CERN
      3. Apply PCA on same data and to get potential alerts: Adnan
      4. Comparison of Run-period results and PCA results: Adnan
      5. Improve event detector: Adnan
      6. Docment findings on PCA: Adnan
  2. Forecasting comparison of Active vs. passive data: Fareena, Adnan
    1. Look at eview implementation of ARIMA (QU has copy): Fareena
      1. Extend to more sites/metrics, see need for Integration & higher orders: Farena, Adnan
      2. Try with longer time base: Fareena
      3. Get time estimates : Fareena
    2. Detailed Graphs description: Fareena
    3. Wiki Markup
      Regularization \[Done\]
      1. : Fareena
    5. Detailed Graphs descriptionLook at moodss (http://jfontain.free.fr/statistics.htm): Fareena
    6. Wiki Markup
      -Send results/documentation to SLAC Regularization \[Done 3/15/07\]: Fareena-
    7. Share documentation with COMSATS: Umar
    8. Review write up, and send changes by FAX to +92-51-9280782: Les
    9. Automate procedures
      1. Define project
      2. Put together presentation for workshop (for Sep 2006): Fareena
      3. Gather team
  3. Automatic event isolation: Adnan, Yee

IEPM

    2. Look at moodss (http://jfontain.free.fr/statistics.htm): Fareena
    3.  Wiki Markup
      -Send results/documentation to SLAC \[Done 3/15/07\]: Fareena-
    4. Share documentation with COMSATS: Umar
    5. Review write up, and send changes by FAX to +92-51-9280782: Les
    6. Automate procedures 
      1. Define project
      2. Put together presentation for workshop (for Sep 2006): Fareena
      3. Gather team
  2. Automatic event isolation: Adnan, Yee
IEPM
  1. Traceanal 
    1. Get desk-side working to SLAC: Nauman, Azher, Umar
    2. Compress traceanal table by using image instead of HTML table (hope compleye by May 7) - Nouman, Asif
    3. Add node name in RH column
    4. Make nodename clickable to view ping time-series
    5. Add comment or help on how to find the real hostname
    6. Prepare distributable version of traceanal (assign to an NIIT student) - Asif, Yee
  2. Deploy at NIIT
  3. Traceanal 
    1. Get desk-side working to SLAC: Nauman, Azher, Umar
    2. Compress traceanal table by using image instead of HTML table (hope compleye by May 7) - Nouman, Asif
    3. Add node name in RH column
    4. Make nodename clickable to view ping time-series
    5. Add comment or help on how to find the real hostname
    6. Prepare distributable version of traceanal (assign to an NIIT student) - Asif, Yee
  4. Re-install at NIIT to enable viz (he should have appropriate permissions and files from Les 4/10/07): Fahan
  5. Deploy at NIIT (done 2/1/07, needs cert): Fahad 
  6.  Wiki Markup
    -Fahad's account has access to iepm-bw and to v3src/iepmtools \[Done 4/30/07\]: Les-
    7. Need iepmtools (should be able to get now account has access 4/30/07): Fahad
    1. Enter nodes at NIIT (nodes script showed errors with missing perl modulesperl modules): Fahad
    2. Need to enter node iepm-maggie.niit.edu.pk at SLAC (Fahad will send how to Asif): FahadNeed to enter node iepm
    3. Fahad is stuck with uninitialised variables $REPORTSDIR and $WEBPATH in report-nodes. Les sent details of how they are initialised at SLAC
    4. Enable Les to logon to iepm-maggie.niit.edu.pk, ssh lessc@iepm-maggie.niit.edu.pk at SLAC (Fahad will send how to to Asif): Fahad.pk fails: Fahan
    5. Asif & Fahan figure out iof Fahan needs write access to something at SLAC: Fahan, Asif
  7. Provide installation package: Tanzeel (QAU), Nauman 
    1. Lot of co-dependencies
  8. Provide ViPER like interface to IEPM data: Fahad, Shahryar 
    1. Problem with node visibility with FireFox (OK with MSIE 6): Fahad
    2. Need to understand how to get updates from iepm in real-time (try accessing URL from web browser): Fahad, Shahryar 
      1. Formats for ping and traceroute are different (will have to work around): Fahad
      2. Write his own script which will access the data from IEPM-BW database or use Web Service which Asif will develop. So that historic data can be shown on the visualization
...
  1. Provide Google maps interface to PerfSONAR: Shahryar, Qasim (Qasim Bilal with us 6 months starting 3/22/07)
  2.  Wiki Markup
    -Study the perfSONAR NMWG request/response schema \[Done 5/1/07\]: Qasim-[Done 5/1/07\]: Qasim-
  3. Output from some script (mtml.pm?) is unintelligible (e.g. control characters) need help from Asif, Nauman will send snapshot o Asif (5/10/07): Nauman
  4. Execute sample request queries for utilization and metadata from perfSONARUI: Qasim
  5. Needs trace route parsing code from Asif.
  6. Having Java socket error, maybe firewall problem
  7.  Wiki Markup
    *New project description \[Done 5/1/07\]: Asif*
...
  1. Projects (see http://www-iepm.slac.stanford.edu/pinger/projects/)
  2. Azher replacement for PERN, COMSATS, NIIT hosts (Ahmed, Siggiqui, Umar?)
  3. Resolve next graduates/visitors: Arshad, Les 
    1. Get paperwork going
  4. Paper for Nepal (has been accepted): Shahryar 
    1. Register at SLAC: Shahryar
    2. Update to right format and new figures: Shahryar
  5. CHEP 
    1. Poster accepted 5/6/07
    2. Book hotel: Shahryar
    3. Write paper/poster
    Resolve next graduates/visitors: Arshad, Les 
    1. Get paperwork going
  6. Paper on event diagnosis (it has been accepted at San Jose, now need to prepare paper in camera ready form): Adnan 
    1.  Wiki Markup
      -It has been withdrawn \[Done 4/20/07\]: Adnan-
    2. Future plans Needs improving): Adnan 
      1. Get student: Adnan, Umar
    3. Decide if and who will present (Adnan is trying to get travel approval)### Register paper (SLAC willing to pay fee) 
      1. Reformat paper in IEEE format
      2. Address most pertinent comments (no student available, nobody working on)
      3. Do we have another author
      4. Get copyright exemption
      5. Get length of paper and figure out extra pages cost, if any
      6. Submit final paper (by April 20)
      7. Write & present talk (July 1-6)
  7. SOFTEC prize publicity 
    1. Get announcement & photos from SOFTEC
    2. Add to TULIP pages and SLAC network page
    3. Get in SLAC Today
  8. Visit of Rector?
  9. Proposals 
    1. Develop new proposal with more a Grid Health viewpoint (Cisco raised issues, await resolution 3/22/07, talked to people who will supprt, now talking to Cisco. Hope for 100% from HEC, then Cisco chip in 4/12/07): Yee, Arshad, Les, Cisco
    2. Proposal to HEC needs reformatting in PC1 format: Umar
    3. USAID proposal due 6/30/07
    4. Proposal to Cisco on TULIP: Faran
    5. Proposal to Cisco on perfSONAR: Les
    6. World Bank may be able to fund travel
    7. Work with NSF to see if we submit to them: Les 
      1. send NSF 1 page outline of proposal (Les & Yee are creating 4/12/07, done NSF cannot help)
    8. Proposal for perfSONAR for HEC (shown to Atta 3/15/07) 
      1. Write up (working on Outline,  we have draft, been thru several iterations 4/10/07, Les needs to review section 5, Yee needs to read and comment, Ready to go needs Arshad to review 4/30/07): Umar
...