...
- PingER web services: ?
- PingER & AMP Integration (AMP/NLANR has run out of funding, AMP will shut down 8/31/06. Given the demise of AMP this may need to be changed to integration with PerfSONAR, on the other hand it may be useful for converting from the perfSONAT MP/MA format to PingER): Abdullah
- Document work with AMP integration (hope to complete 11/18/06): Abdullah
- Extend to provide perfSONAR data reading front end (awaits perfSONAR): Abdullah, Asif
- Install & integrate code at SLAC: Abdullah
- Working on password protection: Abdullah
- Improve code, make production quality, automate getting data (requested with suggestions 8/20/06, making progress hope to be done in 3-4 days 8/31/06, sent back to SLAC, SLAC responded further formatting etc. improvements needed 9/12/06, we need to either finish this up or say Abdullah is not going to do it 3/20/07, Abdullah agreed to complete and send 3/22/07, Abdullah sent code but it needs indenting and some example documentation mail sent to Abdullah 4/4/07, Abdullah will have the code ready by 5/3/07): Abdullah
- Needs to work with -w and strict
- Enable user to specify AMP host an option with a sensible default
- Comment what hosts work
- Deploy at SLAC
Wiki Markup -Get account (has this been done 11/29/06, he has a SUID, forms for account have been scanned, sent and given to the Help Desk 4/10/07) \[Done & password changed 4/12/07\]: Abdullah-
- Integrate with pingtable.pl: Abdullah, Jerrod
- Create AMP file directory: Jerrod
- Set up daily crontab: Jerrod
- Set up analyze-hourly etc: (Done)Jerrod
- Add src & dst amp nodes to Guthrie: Jerrod
- Think about retrieving older data (find out how long ago there is data for): Jerrod, Adnan
- AMP and Pinger data comparison: Abdullah
- Smokeping & PingER Integration: Shahryar (Asma is no longer working on this)
- Install at SLAC: Shahryar
- Installation on test www-dev test server : Shahryar, Les
- Set up cronjobs (awaits SelectSrcDest.pm running from any pwd, also need to find out how long it takes to run)
- Needs to set the cron job on a Solaris machine. Shahryar, Les
- Carried out detail performance analysis of the code. Tried to make the code run faster, by eliminating unecessary instructions. The details of the performance analysis can be found at https://confluence.slac.stanford.edu/display/IEPM/PingER+Smokeping+Integration. We have decide it to run for SLAC only hosts in order to test it for the time being. The results of the analysis shows that it takes 2 hours on average to update all the (536 SLAC to rest of the world RRDs) and will consume approximately 250 MB of disk space.
- The generation and presentation of the Smokeping graphs works
- Make documentation point to Asma's detaile reference documentation too: Shahryar
- Look at adding visualization of uptime (Umar will check with Asma about uptime 4/30/07): Shahryar, Asma
- Will use as a top level access to PingER and also as links from Pingtable to display last 120 days using smokeping: Shahryar
- Can/should we monitor display uptime (communicating with Asma 5/1/07): Umar, Asma, Shahryar
- Install at SLAC: Shahryar
- Provide real time access to cached data
- Do for SLAC
- Decide on how to extend to other monitoring sites, try with NIIT: Akbar, Umer
- Hassan is looking into the code sent by Fawad (next step is to get ML web services client to get data): Akbar, Hassan
- Do for SLAC
- Ping-data.pl form only shows beacons.
- Need to point $sites_fn to pinger.xml instead of beacons.txt & check if the file is xml or flat (for backward compatibility): Shahryar
- Monitoring Hosts:
- Pakistan hosts
- COMSATS down web page not responding (Azher not at meeting 4/30/07 has been emailed, emailed again 5/1/07 Umar followed up): Azher
- sfsmds2.nsnl.net not responding (sent email 4/12/07, started responding but hostname incorrect, tried to fix now not responding 4/29/07 sent email, following discussion with Warren sent suggestion 5/1/07 by email): Les
- Pakistan hosts
- PingER & AMP Integration (AMP/NLANR has run out of funding, AMP will shut down 8/31/06. Given the demise of AMP this may need to be changed to integration with PerfSONAR, on the other hand it may be useful for converting from the perfSONAT MP/MA format to PingER): Abdullah
Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,Faran Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les
- Integrate with pingtable.pl: Abdullah
- Create AMP file directory:
- Set up daily crontab:
- Set up analyze-hourly etc: (Done)Jerrod
- Add src & dst amp nodes to Guthrie:
- AMP and Pinger data comparison: Abdullah
- Integrate with pingtable.pl: Abdullah
- Smokeping & PingER Integration: Shahryar (Asma is no longer working on this)
- Install at SLAC: Shahryar
- Installation on test www-dev test server : Shahryar, Les
Wiki Markup -Needs to set the cron job on a Solaris machine \[Done will use tersk 5/7/07\]: Shahryar, Les-
- Carried out detail performance analysis of the code. Tried to make the code run faster, by eliminating unecessary instructions. The details of the performance analysis can be found at https://confluence.slac.stanford.edu/display/IEPM/PingER+Smokeping+Integration. We have decide it to run for SLAC only hosts in order to test it for the time being. The results of the analysis shows that it takes 2 hours on average to update all the (536 SLAC to rest of the world RRDs) and will consume approximately 250 MB of disk space.
- The generation and presentation of the Smokeping graphs works
- Make documentation point to Asma's detailed reference documentation too: Shahryar
- Look at adding visualization of uptime (Umar will check with Asma about uptime 4/30/07): Shahryar, Asma
- Will use as a top level access to PingER and also as links from Pingtable to display last 120 days using smokeping: Shahryar
- Can/should we monitor display uptime (communicating with Asma 5/1/07, Asma answered): Umar, Asma, Shahryar
- Install at SLAC: Shahryar
- Provide real time access to cached data
- Do for SLAC
- Decide on how to extend to other monitoring sites, try with NIIT: Akbar, Umer
- Hassan is looking into the code sent by Fawad (next step is to get ML web services client to get data): Akbar, Hassan
- Do for SLAC
- Ping-data.pl form only shows beacons.
- Need to point $sites_fn to pinger.xml instead of beacons.txt & check if the file is xml or flat (for backward compatibility): Shahryar
- Monitoring Hosts:
- Pakistan hosts
- sfsmds2.nsnl.net not responding (sent email 4/12/07, started responding but hostname incorrect, tried to fix now not responding 4/29/07 sent email, following discussion with Warren sent suggestion 5/1/07 by email, probably will need rebuild): Les
Triangulate position of an unknown host (see http://www.slac.stanford.edu/comp/net/wan-mon/tulip,Faran Faran expects to be able to devote more effort to this following 25th Jan 2007): Faran, Les
- Deployment: Faran
- Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
- Visualization
- Provide documentation (in progress 2/27/07, documented maths of selection 3/20/07, needs updating, agreed to update 3/22/07, should it be a wiki? - Umar thinks good idea need Faran view 4/30/07): Farhan, Faran
- Can we add AS's to routes: Yee, Faran
- DiscoveryStatistics =>LandMark Analysis need to identify which Site number is displayed (i.e. from which window): Faran
- Sites.txt
- Add diagnostic to Sites.txt to identify bad formatting: Faran
- Allow alpha to change (lot of work, many changes, will improve greatly, changes design, Faran focussing on 4/12/07, need progress)
- Look at using PingER historical data to optimize alpha (agreed 4/12/07): Faran
- Need a way to display alpha used: Faran
- Make project to provide a user interface (e.g. edit) to Sites.txt (Adnan may have a student from his presentation, normalizing students to understand their applicability to task 4/30/07)
- When zooming maintain size of dots (Faran will propose to Umar as a student project 4/10/07, he is concerned about the download time, Asif suggests using NASA images for Java platform, will send link 4/12/07): Faran
- Bugs:
- Sort on min-RTT is alphabetic, should be numerical (reported 5/3/07): Faran
- Double click on line in Ping Results gives web page with wrong landmark.
- Evaluate whether using traceroute data helps (Suggested by Umar & Les 2/26/07, could add 3 more RTTs to minimize from): Faran
- Landmarks
- Get more landmarks for TULIP, ideally need at least one landmark in all major developing countries that do not have direct connections to nearby countries.:
- China (sent email to ctsnet 7/26/06, reminded 12/6/06, 1/27/07): Les
- Try and get sites in Africa (Les sent email 11/28/06): Les
- COMTEC, Japan: Faran
- Need to add site to Sites.txt (5/2/07): Faran
- Add traceroute/Looking Glass servers in critical areas, if they have a common format (asked for 11/15/06, Les did a manual look at traceroute.org and found about 20 potential landmarks 11/17/06, Faran not clear if one can automate 2/27/07, several are automateable, to prove it Les has added 8, Faran will work on, re-requested 3/26/07 with suggestions): Faran
- Get site in Korea at Ajou universitytrying to persuade 5/8/07): Umar
- Get site at KHU (server available, problems with permissions to open UDP sockets 5/8/07): Umar
- Add NetDiGi route servers (asked for 8/30/06, is able to parse them, will look at adding appropriate hosts 3/22/07): Faran
- Get more landmarks for TULIP, ideally need at least one landmark in all major developing countries that do not have direct connections to nearby countries.:
- Deployment: Faran
- Look into Mathematics of Singular Vector Decomposition technique. (agreed 11/16/06): Faran
- Visualization
Wiki Markup -Make tables sortable (working on 5/25/06, re-agreed 8/3/06, re-requested 8/21/06, done for the RTTs 8/22/06, can we do with buttons for all columns, agreed 2/27/07) \[Done 3/22/07\]: Faran-
- Provide documentation (in progress 2/27/07, documented maths of selection 3/20/07, needs updating, agreed to update 3/22/07, should it be a wiki? - Umar thinks good idea need Faran view 4/30/07): Farhan, Faran
- Can we add AS's to routes: Yee, Faran
- DiscoveryStatistics =>LandMark Analysis need to identify which Site number is displayed (i.e. from which window): Faran
Wiki Markup -If ping fails in Looking Glass Sites it shows as \-5.0 RTT, should show as NAN (agreed 3/5/07, re-reported 3/20/07) \[Done 3/22/07\]: Faran-
- When one double clicks on a row in Ping Results and the ping fails (e.g. host timeout) wrong host shows up in window (e.g. RNP instead of COMTEC) : Faran
- Sites.txt
- Add diagnostic to Sites.txt to identify bad formatting: Faran
- Allow alpha to change (lot of work, many changes, will improve greatly, changes design, Faran focussing on 4/12/07)
- Look at using PingER historical data to optimize alpha (agreed 4/12/07): Faran
- Need a way to display alpha used: Faran
- Make project to provide a user interface (e.g. edit) to Sites.txt (Adnan may have a student from his presentation, normalizing students to understand their applicability to task 4/30/07)
- When zooming maintain size of dots (Faran will propose to Umar as a student project 4/10/07, he is concerned about the download time, Asif suggests using NASA images for Java platform, will send link 4/12/07): Faran
- Bugs:
- Sort on min-RTT is alphabetic, should be numerical (reported 5/3/07): Faran
- Double click on line in Ping Results gives web page with wrong landmark.
- Evaluate whether using traceroute data helps (Suggested by Umar & Les 2/26/07): Faran
- Landmarks
- Get more landmarks for TULIP:
- China (sent email to ctsnet 7/26/06, reminded 12/6/06, 1/27/07): Les
- Try and get sites in Africa (Les sent email 11/28/06): Les
- COMTEC, Japan: Faran
- Need to add site to Sites.txt (5/2/07): Faran
- Add traceroute/Looking Glass servers in critical areas, if they have a common format (asked for 11/15/06, Les did a manual look at traceroute.org and found about 20 potential landmarks 11/17/06, Faran not clear if one can automate 2/27/07, several are automateable, to prove it Les has added 8, Faran will work on, re-requested 3/26/07 with suggestions): Faran
- Get site in Korea at Ajou university (made contact, test case works, contacted Prof 4/12/07, sent detailed info/welcome email 5/1/07, hope to have web server by May 4th, Arshad may visit): Umar
- Add NetDiGi route servers (asked for 8/30/06, is able to parse them, will look at adding appropriate hosts 3/22/07): Faran
Wiki Markup -Modify TULIP to resolve names to IP addresses before calling landmarks \[Done 4/10/07\]: Faran-
- Brunsvigia appears not to accept names (sent email to S. Africa with what is broken 3/26/07, asked again 4/10/07,resent 4/30/07): Les
- Get more landmarks for TULIP:
- Apply to PingER node database to check the lat/longs are roughly correct (tried with 300-400 sites but cannnot get results due to fragile Internet at NIIT, will interact with Akbar to make tests at SLAC 8/31/06, exchanged emails on list of PingER hosts to locate 9/3/06): Faran
- Analysis
- Literature search on triangulation, multi-lateration: Faran
Wiki Markup -Measure landmarks from landmarks \[Done 2/15/07\]: Faran-
- Optimize alpha by landmark (after have new location algorithm working, will try 1:2 for US, 1:3 for Europe, 2:15 Africa, done at NIIT, need to deploy at SLAC 4/10/07) : Faran
- Document Faran's algorithm, try new algorithm that does not require destination to be inside triangle: Faran, Umar
- Analyse the effect of passing IP addresses to landmarks rather than names: Faran
- Look at impact of increasing number of pings for getting accurate min_RTT (Faran measured for a few sites, Les gave ideas on how to extend and analyze for multiple sites, could be a major project 4/4/07): Faran
- Compare with GeoIP Tools
Wiki Markup Find a case where TULIP beats GeoIP Tool \[Done 4.68.116.16, probably backbone routers too\]:
- For US compare Faran's algorithm with Octant (no longer available 2/27/07), GeoIP & simple triangulation for PingER hosts(in progress 2/1/07)
- Confidence estimates
- Applied to PingER hosts
- Outside triangles, area coverage
- Effect/need to vary alpha: Faran
- Look at big discrepancies
- Analysis of Accuracy and applicability
- Accuracy vs known locations (landmarks & PingER hosts): faranEffect of removing, adding landmarks, try for Bolivia: Faran
- Provide bubble maps of accuracy: Faran
- What area/population is covered by TULIPDocument anomalies (e.g. root-servers): Faran
- Show accuracy by region and country: Faran
- Come up with a way to estimate the accuracy/confidence of estimates: Faran
- Document in the TULIP web page: Faran
- Look at publication (helps advance Faran's career and possibly "best project", will need more analysis)
- Find conference: all
- Can we get Cisco interested?: Arshad, Faran
- Update documentation: Les, Faran
- Read paper at http://research.microsoft.com/%7Epadmanab/papers/sigcomm2001.pdf: Faran
Terapaths Yee
- Netflow presentation (Yee sent project to Ahmad http://confluence.slac.stanford.edu/display/IEPM/Netflow+Presentation+Frontend): Ahmad
...