Versions Compared

Old Version 142

changes.mady.by.user Unknown User (shahryar2001)

Saved on

compared with

New Version 143

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. PingER web services: ?
    1. PingER & AMP Integration (AMP/NLANR has run out of funding, AMP will shut down 8/31/06. Given the demise of AMP this may need to be changed to integration with PerfSONAR): Abdullah
      1. Document work with AMP integration (hope to complete 11/18/06): Abdullah
      2. Extend to provide perfSONAR data reading front end: Abdullah, Asif
      3. Install & integrate code at SLAC: Abdullah
      4. Working on password protection: Abdullah
      5. Improve code, make production quality, automate getting data (requested with suggestions 8/20/06, making progress hope to be done in 3-4 days 8/31/06, sent back to SLAC, SLAC responded further formatting etc. improvements needed 9/12/06, we need to either fnish this up or say Abdullah is not going to do it 3/20/07, Abdullah agreed to complete and send 3/22/07, Abdullah sent code but it needs indenting and some example documentation mail sent to Abdullah 4/4/07): Abdullah
        1. Needs to work with -w and strict
        2. Enable user to specify AMP host an option with a sensible default
        3. Comment what hosts work
        4. Deploy at SLAC
      6. Wiki Markup
        -Get account (has this been done 11/29/06, he has a SUID, forms for account have been scanned, sent and given to the Help Desk 4/10/07) \[Done & password changed 4/12/07\]: Abdullah-
      7. Integrate with pingtable.pl: Abdullah, Jerrod
        1. Create AMP file directory: Jerrod
        2. Set up daily crontab:  Jerrod
        3. Set up analyze-hourly etc: (Done)Jerrod
        4. Add src & dst amp nodes to Guthrie: Jerrod
        5. Think about retrieving older data (find out how long ago there is data for): Jerrod, Adnan
        6. AMP and Pinger data comparison: Abdullah
    2. Smokeping & PingER Integration: Shahryar (Asma is no longer working on this)
      1. Install at SLAC: Shahryar
        1. Installation on test www-dev test server : Shahryar, Les
        2. Set up cronjobs (awaits SelectSrcDest.pm running from any pwd, also need to find out how long it takes to run)
        3. Needs to set the cron job on a Solaris machine. Shahryar, Les
        4. Carried out detail performance analysis of the code. Tried to make the code run faster, by eliminating unecessary instructions. The details of the performance analysis can be found at https://confluence.slac.stanford.edu/display/IEPM/PingER+Smokeping+IntegrationImage Removed. We have decide it to run for SLAC only hosts in order to test it for the time being. The results of the analysis shows that it takes 2 hours on average to update all the (536 SLAC to rest of the world RRDs) and will consume approximately 250 MB of disk space.
        5. The generation and presentation of the Smokeping graphs works
      2. Look at adding visualization of uptime: AsmaLook at how to dynamically change the config file for Smokeping to accomodate the step interval (maybe time consuming, may affect all users and be cumbersome): Shahryar, Asma
      3. Will use as a top level access to PingER and also as links from Pingtable to display last 120 days using smokeping: Shahryar
    3. Provide real time access to cached data
      1. Do for SLAC
        1. Decide on how to extend to other monitoring sites, try with NIIT: Akbar, Umer
        2. Hassan is looking into the code sent by Fawad (next step is to get ML web services client to get data): Akbar, Hassan
    4. Ping-data.pl form only shows beacons.
      1. Need to point $sites_fn to pinger.xml instead of beacons.txt & check if the file is xml or flat (for backward compatibility): Shahryar
    5. Monitoring Hosts:
      1. Pakistan hosts
        1. PERN does not ping and reverse traceroute server is down (need to decide whether to give up on this host and remove it from our list of hosts to use for PingER and TULIP, awaits presentation to PERN/NTC, presentation to PERN made by Les 3/15/07, they are agreeable, need to move forward, Azher and Arshad are working the issue with Anwar 3/29/07, 4/7/07): Azher
        2. Wiki Markup
          -Mexico down emailed 4/7/07 \[Fixed 4/9/07\]: Les-
        3. Wiki Markup
          -Brunsvigia stopped responding to ping_data.pl as of 4/3/07, reported by email 4/4/07 and 4/7/07 \[working 4/10/07\]: Les & brunsvigia-

Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,Faran Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les

        1. COMTEC down: Azher

Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,Faran Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les

  1. Deployment: Faran
    1. Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
  2. Visualization
    1. Wiki Markup
      -Make tables sortable (working on 5/25/06, re-agreed 8/3/06, re-requested 8/21/06, done for the RTTs 8/22/06, can we do with buttons for all columns, agreed 2/27/07) \[Done 3/22/07\]: Faran-
    2. Provide documentation (in progress 2/27/07, documented maths of selection 3/20/07, needs updating, agreed to update 3/22/07, should it be a wiki?): Farhan, Faran
    3. Can we add AS's to routes: Yee, Faran
    4. DiscoveryStatistics =>LandMark Analysis need to identify which Site number is displayed (i.e. from which window): Faran
    5. Wiki Markup
      -If ping fails in Looking Glass Sites it shows as \-5.0 RTT, should show as NAN (agreed 3/5/07, re-reported 3/20/07) \[Done 3/22/07\]: Faran-
    6. When one double clicks on a row in Ping Results and the ping fails (e.g. host timeout) wrong host shows up in window (e.g. RNL isntaed of COMTEC
  3. Deployment: Faran
    1. Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
  4. Visualization
    1. Wiki Markup
      -Make tables sortable (working on 5/25/06, re-agreed 8/3/06, re-requested 8/21/06, done for the RTTs 8/22/06, can we do with buttons for all columns, agreed 2/27/07) \[Done 3/22/07\]: Faran-
    2. Provide documentation (in progress 2/27/07, documented maths of selection 3/20/07, needs updating, agreed to update 3/22/07): Farhan, Faran
    3. Can we add AS's to routes: Yee, Faran
    4. DiscoveryStatistics =>LandMark Analysis one gets SLAC with RTT 0.0 regardless (reported 3/20/07): Faran
    5. Wiki Markup
      -If ping fails in Looking Glass Sites it shows as \-5.0 RTT, should show as NAN (agreed 3/5/07, re-reported 3/20/07) \[Done 3/22/07\]: Faran-
    6. When one double clicks on a row in Ping Results and the ping fails (e.g. host not responding) nothing shows in the  pop-up window. I think some diagnostic  or something should show (reported 3/20/07, re-reported 3/9/07 try Umich shows NAN for http://gate01.aglt2.org/cgi-bin/traceroute.pl?function=ping&target=203.99.50.204) : Faran
    7. Sites.txt
      1. Add diagnostic to Sites.txt to identify bad formatting: Faran
      2. Allow alpha to change (lot of work, many changes, will improve greatly, changes design, Faran focussing on 4/12/07)
        1. Change Sites.txt to add extra column for alpha (done at NIIT): Faran
        2. Look at using PingER historical data to optimize alpha (agreed 4/12/07): Faran
      3. Make project to provide a u user interface (e.g. edit) to Sites.txt (Adnan may have a student from his presentation)Make Sites.txt not available from the web (the URL in http://www.slac.stanford.edu/comp/net/wan-mon/tulip/ is no longer an active URL, however the file is still accessible from teh web, need to work with Faran to move it): Les, Faranhave a student from his presentation)
    8. When zooming maintain size of dots (Faran will propose to Umar as a student project 4/10/07, he is concerned about teh the download time, Asif suggests using NASA images for Java platform, will send link 4/12/07):  Faran
  5. Evaluate whether using traceroute data helps (Suggested by Umar & Les 2/26/07): Faran
  6. Landmarks
    1. Get more landmarks for TULIP:
      1. China (sent email to ctsnet 7/26/06, reminded 12/6/06, 1/27/07): Les
      2. Try and get sites in Africa (Les sent email 11/28/06): Les
      3. COMTEC, Japan (Faran send email reminder 5/25/06, agreed to send another reminder 6/7/06, Umar will check with Farooq 11/16/06, Umar sent email reminders, latest 4/7/07, Farooq has been sick and unable to communicate, we need an account there 4/12/07): Faran, Farooq
        1. Account - tuliplandmark - is available at 'ias.comtec.co.jp' Faran will configure the webserver and deploy the scripts for both TULIP and PingER. (Umar will make an attempt to do the same).
      4. Add traceroute/Looking Glass servers in critical areas, if they have a common format (asked for 11/15/06, Les did a manual look at traceroute.org and found about 20 potential landmarks 11/17/06, Faran not clear if one can automate 2/27/07, several are automateable, to prove it Les has added 8, Faran will work on, re-requested 3/26/07 with suggestions): Faran
      5. Get site in Korea (made contact, test case works, suggest case study on S.E. Asia, contacted Prof waiting to hear back 4/12/07): Umar
    2. Add NetDiGi route servers (asked for 8/30/06, is able to parse them, will look at adding appropriate hosts 3/22/07): Faran
    3. Wiki Markup
      -Modify TULIP to resolve names to IP addresses before calling landmarks \[Done 4/10/07\]: Faran-
    4. Brunsvigia appears not to accept names (sent email to S. Africa with what is broken 3/26/07, asked again 4/10/07, RESENT resent 4/30/07): Les
    5. sfsmds2.nsnl.net not responding (sent email 4/12/07, started responding but hostname incorrect, tried to fix now not responding 4/29/07, senr sent email): Les
  7. Apply to PingER node database to check the lat/longs are roughly correct (tried with 300-400 sites but cannnot get results due to fragile Internet at NIIT, will interact with Akbar to make tests at SLAC 8/31/06, exchanged emails on list of PingER hosts to locate 9/3/06): Faran
  8. Analysis
    1. Literature search on triangulation, multi-lateration: Faran
    2. Wiki Markup
      -Measure landmarks from landmarks \[Done 2/15/07\]: Faran-
    3. Optimize alpha by landmark (after have new location algorithm working, will try 1:2 for US, 1:3 for Europe, 2:15 Africa, done at NIIT, need to deploy at SLAC 4/10/07) : Faran
    4. Document Faran's algorithm, try new algorithm that does not require destination to be inside triangle: Faran, Umar
    5. Analyse the effect of passing IP addresses to landmarks rather than names: Faran
    6. Look at impact of increasing number of pings for getting accurate min_RTT (Faran measured for a few sites, Les gave ideas on how to extend and analyze for multiple sites, could be a major project 4/4/07): Faran
    7. Compare with GeoIP Tools
    8. For US compare Faran's algorithm with Octant (no longer available 2/27/07), GeoIP & simple triangulation for PingER hosts(in progress 2/1/07)
      1. Confidence estimates
      2. Applied to PingER hosts
      3. Outside triangles, area coverage
      4. Effect/need to vary alpha: Faran
      5. Look at big discrepancies
  9. Analysis of Accuracy and applicability
    1. Accuracy vs known locations (landmarks & PingER hosts): faran
    2. Effect of removing, adding landmarks, try for Bolivia: Faran
    3. Provide bubble maps of accuracy: Faran
    4. What area/population is covered by TULIP
    5. Document anomalies  (e.g. root-servers): Faran
    6. Show accuracy by region and country: Faran
    7. Come up with a way to estimate the accuracy/confidence of estimates: Faran
      1. Document in the TULIP web page: Faran
  10. Find out more about GeoIP Tools
    1. Wiki Markup
      Find a case where TULIP beats GeoIP Tool \[Done 4.68.116.16, probably backbone routers too\]:

...

  1. Wiki Markup
    -Get video conferencing working echo cancelling mike is very helpful, NIIT does not appear to need one, if so Brooks has sent details 3/21/07 \[Done 3/21/07\]: Azher, Adnan, Les, Brooks-
  2. Projects (see http://www-iepm.slac.stanford.edu/pinger/projects/)
  3. Paper on event diagnosis (it has been accepted at San Jose, now need to prepare paper in camera ready form): Adnan
    1. Has it been withdrawn?: Adnan
    2. Future plans: Adnan
    3. Decide if and who will present (Adnan is trying to get travel approval)### Register paper (SLAC willing to pay fee)
      1. Reformat paper in IEEE format
      2. Address most pertinent comments (no student available, nobody working on)
      3. Do we have another author
      4. Get copyright exemption
      5. Get length of paper and figure out extra pages cost, if any
      6. Submit final paper (by April 20)
      7. Write & present talk (July 1-6)
  4. Get relevant netweek reports to Umar (4/12/07), are they being received: Asif, JohnVisits Arshad will visit SLAC & Berkeley on 28-30 April after Internet2
  5. Proposals
    1. Develop new proposal with more a Grid Health viewpoint (Cisco raised issues, await resolution 3/22/07, talked to people who will supprt, now talking to Cisco. Hope for 100% from HEC, then Cisco chip in 4/12/07): Yee, Arshad, Les, Cisco
    2. Work with NSF to see if we submit to them: Les
      1. send NSF 1 page outline of proposal (Les & Yee are creating 4/12/07)
    3. Proposal for perfSONAR for HEC (shown to Atta 3/15/07)
      1. Write up (working on Outline,  we have draft, been thru several iterations 4/10/07, Les needs to review section 5, Yee needs to read and comment): Umar

...