Time & date
Wednesday September 04, 8:00pm Pacific Standard Time, Thursday September 05 2013 8:00am Pakistan time, Thursday September 11:00am Malaysian time.
This meeting was postponed.
Attendees
Invitees: Anjum+, Kashif, Raja+, Johari+, Nara, Abdullah, Badrul, Hanan, Fidah, Saqib+, Les+, Renan, Bebo
+ Confirmed attendance
- Responded but Unable to attend
Actual attendees:
UM Workshop (see http://pinger.unimas.my/pinger/workshop.php)
- Johari has the list from UM with names and phone numbers, but there are no email addresses. Johari will work on getting these by contacting the individuals. Also he will get their country of origin. Can people from UM and UTM assist please.
- Follow up
- Adib of UUM also interested in porting PingER to support IPv6.
- Anjum reported that SEECS started on this. They were thinking of using the IPv6 address, then using it to get the IPv4 address and rewriting the ping measurement with the IPv4 address, then everything in the analysis stays as it was. An alternative might be to get rid of the IP addresses altogether. Anjum reached out to Adib.
- Hossein Javedani of UTM is interested in anomalous event detection with PingER data. Information on this is available at https://confluence.slac.stanford.edu/display/IEPM/Event+Detection. We have sent him a couple of papers and how to access the PingER data. Hossein and Badrul have been put in contact. Is there an update Badrul?
- Adib of UUM also interested in porting PingER to support IPv6.
Administration
- We do not have a Skype nickname for Rafidah Md Noor <fidah@um.edu.my>. He has not attended calls recently. Do we need to get a Skype nickname for him? - Badrul
- We will add Adib of UUM to the contacts (Johari) and the pinger-my mailing list. Les believes this has been done.
- Badrul will look into inviting RidZuan to join the PingER project team. Badrul will need to send the details to Johari to update http://pinger.unimas.my/pinger/contact.php. - Did anything happen?
- Do we need to add anyone else to the weekly meetings, e.g. Hossein Javedani of UTM (or maybe Saqib or Hanan can cover for him), Ridzuan Bin Daud (or maybe Abdullah or Badrul can cover for him)?
Funding/Proposals
Johari is looking for a Research Assistant for his research grant.
Badrul has received the grant from his proposal. It amounts to 46K RM. It will pay travel for Johari and Adib plus a Malaysian research assistant at UM.
UNIMAS
Johari needs a public DNS for his Raspberry Pie. Anjum suggested Johari move the Raspberry Pie to the data center based on SEECS experiences with Load Balancers. This may also assist with the traceroute problem and make it easier to get a public DNS. Update Johari
The unit has an 8GByte SDK card. Johari plans to clean out older cached measured data at regular intervals. The actual intervals will be based on the fill rate.
Johari is having problems creating an ISO image to simplify distribution. Anjum suggested using DD copy to make the image instead. - Update Johari
UTM
Saqib is starting to look at Pingtable.pl anomalies as a start in a case study for Malaysia and S.E Asia. In particular hosts which are unreliable, hosts with large (>1) values of Directivity, host with large RTTs, hosts with large unreachability or losses etc. Saqib has been busy with thesis so no progress, will be available June 12th on. Les had some questions on the locations of some sites that have impossible values of Directivity. One has been Disabled, any word on Allianze? What about QIUP? Saqib will investigate. Update. Saqib was not at the previous meeting so there was no update. There was no representative for UTM at this meeting either.
Hossein Javedani of UTM was interested in anomaly detection in PingER data. We have sent him a couple of papers and how to access the PingER data. Any update - Hanan, Saqib?
UM
Badrul sent a paper to Saqib yesterday on event correlation. They plan to have a draft out in the next 2-3 weeks..
Abdullah and Badrul met to discuss looking at data mining PingER data for PhD studies.
- MD NOR RIDZUAN BIN DAUD of UM is interested in analytics with Big Data for PingER. Renan has sent documentation and is in contact with Md. Md plans to to look at analytics of clustering correlation in PingER data. he will get the dat from pingtable.pl. he will try a small amount of data first and extend to more data later. See https://confluence.slac.stanford.edu/display/IEPM/PingER+Big+Data+Analytics+proposal
NUST
Raja will be arriving at SLAC around August 21st, 2013. He is in California.
TULIP - Raja
Raja has modified the geolocation technique by adding lower alpha constraint which is used to determine the distance from the landmark within which the target cannot exist. Its like drawing a doughnut using fixed inner alpha and RTT dependent outer alpha. It shows improvement in case of North America (in 2 test cases error reduced from 350Km to around 200Km). He is now trying it for Europe.
He has provided results for 3 targets in each of Europe, N. America and S. Asia and compared errors with a Fixed Alpha (FA), with donuts with Alpha = 1 to define out donut radius and regional alpha to define inner donut radius.
We have contacted perfSONAR to see if we can get more landmarks together with their lat/longs. There is no response, I suspect we will need to put together some code to extract the data we want.
There was interest in TULIP from Mridul Jain <mridul@yahoo-inc.com>and the Senior Architect in Yahoo! R&D Software Dev in Bangalore, India. He pointed to an interesting paper at https://www.usenix.org/legacy/event/nsdi11/tech/full_papers/Wang_Yong.pdf. He wants something to use in production, however I do not think we are ready.
PingER at SLAC
Working to get Dafffodil University in Bangaldesh started with monitoring. They plan to be installed in a week (8/26/2013).
We are also working with MIMOS and Manipal in Malaysia to get monitoring hosts and landmarks.
On 8/27/2013, Bebo, Les and Renan met with Zakaria Maamar of Zayed university of Dubai to get monitoring hosts and landmarks. Zayed university has a campus in Dubai and one in Abu Dhabi. He is not a networker but is happy to help out. He will discuss with the Dean and get approval of upper administration. He expects a positive response. If this fails he will direct us to some private universities. We pointed out he may be interested in Renan's work making PingER data available via Open Link data.
Working with Bangladesh to set up a monitoring site at Jahangirnagar University Dhakar. Letter of invitation has been sent. Les requested an update from Bangladesh 8/13/2013. They responded that they are having a delay getting an IP address.
Adib of UUM reposrt on 8/22/2013 that he has discussed the PingER project with Prof.Suhaidi “the chairman of InterNetWorks Research Lab”; he is interested and ready to support. Now, they are waiting the requirements of UUM computer centre before they can officially join Pinger team.
Renan
- *Renan is currently working on optimizing and measuring timing for converting the data to RDF format.
- He has data for allyearly, allmonthly and last 60days for all 10 metrics.
- Tthe crontabs to upadte the data are running pretty smoothly*
- The pre alpha data is available publicly.
*For the Linked Open Data / RDF which is in pre-alpha days, you can go to http://pingerlod.slac.stanford.edu. As can be seen this page is not ready for prime time. However the demos work as long as one carefully elects what to look at:- Click on Visualizations, there are two choices:
- Multiple Network Metrics: Click on the image: gives a form, choose from Node pinger.slac.stanford.edu pinging to www.ihep.ac.cn, time parameters 2006 2012, metrics throughput, Average RTT Packet loss and display format Plot graph, then click on submit. In a few seconds time series graph should come up. Mouse over to see details of values at each x value (year).
- A mashup of network metrics x university metrics Click on image: gives another form, pinging from pinger.slac.stanford.edu, School metric number of students, time metric years 2006 2012, display format plot graph, click on submit. Longer wait, after about 35 seconds a google map should show up. Click on "Click for help." Area of dots = number of students, darkness of dots = throughput (lighter is better), inscribing circle color gives university type (public, private etc.) Click on circle for information on university etc.
- Click on Visualizations, there are two choices:
Old Items
The Next step in funding is to go for bigger research funding, such as LRGS or eScience. Such proposals must lead to publications in high quality journals. They will need an infrastructure such as the one we are building. We can use the upcoming workshop (1 specific session) to brainstorm and come up with such proposal. We need to do some groundwork before that as well. Johari will take the lead in putting together 1/2 page descriptions of the potential research projects.
- Need to identify a few key areas of research related to PingER Malaysia Initiative and this can be shared/publicized through the website. These might include using the infrastructure and data for: anomaly detection; correlation of performance across multiple routes; and for GeoLocation. Future projects as Les listed in Confluence herehttps://confluence.slac.stanford.edu/display/IEPM/Future+Projects can also be a good start and also Bebo's suggestion.
- Need to synchronize and share research proposals so as not to duplicate research works. how to share? Maybe not through the website, or maybe can create a member only section of the website to share sensitive data such as research proposal?
Anjum mentioned a paper on Evaluation of IP Geolocation Algorithms on PingER and PlanetLab Infrastructures, by Fida Gilani et. al. submitted to IEEE INFOCOM 2011. This could be updated with new data and maybe submitted to a different venue. Anjum forwarded a copy of the paper to Johari, Abdullah and Hanan with copies to the team. The idea is to see whether there is interest at UTM, UM or UNIMAS.
Anjum suggested Saqib, Badrul and Johari put together a paper on user experiences with using the Internet in Malaysia as seen from Malaysian universities. In particular round trip time, losses, jitter, reliability, routing/peering, in particular anomalies, and the impact on VoIP, throughput etc. It would be good to engage someone from MYREN.
Badrul has been looking at anomalies in ping measurements. Les sent some pointers to previous work on anomaly detection in time series. There should be a presentation at the workshop on the plans and progress. There is no progress, the student is on vacation, expected to return August.
Potential projects
Future meeting - Les
Next meeting Wednesday 28 August 2013 8:00pm Pacific Daylight Time, Thursday 29 August 2013 8:00am Pakistan time, Thursday 29 September 2013 11:00 am Malaysian time.
or
Next meeting Wednesday 4 September 2013 8:00pm Pacific Daylight Time, Thursday 5 September 2013 8:00am Pakistan time, Thursday 5 September 2013 11:00 am Malaysian time.