Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Time & date 

Wednesday  Oct 15th Dec 10th,  2014 98:00pm Pacific Standard Time, Thursday Oct 16th Dec 11th 2014 9:00am Pakistan time, Thursday Oct 16th Dec 11th 12:00 noon Malaysian time, Thursday Sep 16thDec 11th, 2014 12:00am Rio Standard Time.

Attendees

...

Anjum+, Hassaan Khaliq, Kashif, Raja,  Johari-,  Samad Riaz, Johari+, Nara, Adnan, Abdullah, Badrul, Ridzuan, Ibrahim, Hanan, Saqib-, Adib, Les+, Renan, Bebo+

+ Confirmed attendance

- Responded but  Unable to attend: 

Actual attendees:

Anjum, Johari, Les, Bebo. Samad got the time mixed up and was too late to attend.

After the last meeting we added Samad at SEECS to the list of invitees.  We have sent him another invite so Les can call Samad on Skype.

Administration

  • The workshop 1-866-740-1260
  • Anjum suggested putting together a paper on metrics provided by PingER for Sigmetrix. The due date is in November. Does someone want to take the lead - Anjum?
  • Anjum and Raja have been working on a paper on Geolocation as developed for TULIP

UUM

The RTTs from SLAC to UUM show plateaux which look like route changes. As of 10/13/2014 pinger.uum.edu.my was not pingable from SLAC. Adib agreed to fix after the meeting.

Renan

Renan and Christiane have analyzed the data in terms of the number of files, volume, missing files, files with no data etc.  They also have the breakdown by year.

UM

Badrul (6/23/2014) is still awaiting hearing from his student (Abdulrahim Haroun Ali who is out of the country) on  the paper on anomalies in PingER measurements  and will update later once the paper ready. For the minute the paper is not ready. No update 8/20/2014, 10/16/2014.

Ridzuan and Ibrahim both requested for additional space. We require an infrastructure update for the cloud because the existing storage space is not enough, given a number of other users. The 5 Tera byte SAS along with some blade servers all have minimum 1Gig interfaces. We are in process of purchasing the switch to support the networking. Once available, we shall be able to provide the capacity for one instance of SLAC data.

UNIMAS

Pinger 2 (Raspberry Pi) has been running successfully since Sept 2nd. See  ePingER project Malaysia for recent plots of data from pinger and pinger2.unimas.my (Raspberry Pi).  

Traceroute server: Status unsolved. The problem is the same on Pinger2. Johari talked to the network administrator at the centre about this issues and he suggested to talk to the security manager to check whether the firewall is blocking the icmp packer from the traceroute command (to do list). No progress 9/17/2014.

Custom iso: He can get as far as the boot screen, but is unable to get to the desktop. They will started work on it  but student is still unable to boot ISO (9/17/2014)
Research: one student currently doing master by research on pinger project. Progress is a bit slow since the student lacks sound technical and programming skill to implement potential solution. Also will supervise another Advanced Project (Master by coursework) this coming Sep 2014. Planning to investigate whether two pinger monitoring host has any differences in term of data collection (pinger and pinger2 nodes in UNIMAS). 
They looked at the potential projects and selected two. Putting together a framework for anomaly detection. Interested to know of any more projects

UTM

After revision the FRGS proposal was submitted to RMC. It is under review, expect feedback at the end of October.

Saqib is updating the case study from time to time. It just need some formatting. He will send it out  in the coming week. This is needed for the workshop.

pinger.fsktm.utm.my can't traceroute.pl or ping_data.pl

Saqib will see if he can modify pinger monitoring hop 6 of the traceroute.pl from UM to UNIMAS. He does have access to the pinger monitor at UM. We will be looking for whether there are any patterns for the big increases in RTT/congestion.

NUST

Dr. Arshad Ali (the Director General of SEECS) and the Rector of NUST visited SLAC. We discussed several issues including a graduate student for 6 months to work on high performance data transfer together with a start up company.

We are unable to gather data from cemb (can't ping), uetaxila (can't ping), pingerisl (can't ping) and upesh (can ping).  Samad responded Cemb will be up in a day (it was successfully completed 10/17/2014). Pingerisl and uetaxila need fresh installation but there is some issue with their access. He will fix them as soon as possible.

PingER at SLAC

The format of GeoIPTools (this provides country city, and lat long information of hosts) changed breaking some of PingER analysis scripts. This has been fixed.

Need to prepare  presentations for Burkina Faso, in particular updating presentations for Africa.

Need to update information for Anjum for the workshop.

Future meeting  - Les

  • , updates from Johari, Anjum, Adib.   It went well there were about 18 attendants mainly students and PhDs. A MYREN technical guy seemed very interested and there has been an exchange of emails.  He is not at the decision level so is probably working with upper management to get approval.  The idea would be that MYREN would install a PingEr monitor at a MYREN hosts and monitor about 20 MYREN hosts at NOCs and other sites. Given the end of year holidays there may be some delay. Joahari will reprompt the  MYREN person in the New Year.
    • There are links to the presentations by Johari and Anjum at PingER Papers and Presentations.
    • Follow up with MYREN.
    • Anjum feels we need to engage the universities then extend to MYREN. Following up with the Malaysia Ministry of education (MoE), to get funding for universities would be a next step. This would come better from Johari than Anjum. Anjum will send Johari details of how this worked in Pakistan (with HEC). 
  • Anjum and Raja have been working on a paper on Geolocation as developed for TULIP. Using an exponential relation between the Directivity (Alpha) and RTT for Pakistan the accuracy is ~ 18Km. Now Raja needs to run for Europe and the US. Meanwhile Raja has got a job and has less time to work on this so it is stalled.
  • Anjum's contract in Malaysia ends in 50 days. It may be extended or he may pursue a Senior lectureship  elsewhere.

UUM

 As of 10/13/2014 pinger.uum.edu.my was not pingable from SLAC. Adib fixed earlier this week. There was an interesting plateau in the RTTs to UUM from SLAC see below (black means the host was no reachable). Apart from the delay the performance in terms of lack of congestion and loss appears to be the same. 

Image Added

The route change seems to be after hop 13 and before hop 16.  See http://www-wanmon.slac.stanford.edu/cgi-wrap/traceroutearchive.cgi?from=www-wanmon.slac.stanford.edu&to=pinger.uum.edu.my&date1=2014_09_14&date2=2014_09_22&date3=2014_09_27

Renan

Maria Luiza Campos of UFRJ reports that there are people at UFRJ taking care of the PingER data analytics project at this moment. Maria is now in LOA Trento Italy for 1 year post doc. Adriana Vivacqua, is now in charge of this subproject at CRDB at UFRJ.  There are 11 people on the team: 4 professors1 post doc, 1 doctoral student, 2 masters students and 3 undergraduates.There is a document in which they describe the project proposal with more details. 

Renan should continue their work as soon as Cristiane Ceia begins her BSc dissertation thesis, in which Renan will be her co-advisor (together with Luiza).

UM

Badrul (6/23/2014) is still awaiting hearing from his student (Abdulrahim Haroun Ali who is out of the country) on  the paper on anomalies in PingER measurements  and will update later once the paper ready. For the minute the paper is not ready. No update 8/20/2014, 10/16/2014, 12/10/2014.

Ridzuan and Ibrahim both requested for additional space. We require an infrastructure update for the cloud because the existing storage space is not enough, given a number of other users. The 5 Tera byte SAS along with some blade servers all have minimum 1Gig interfaces. We are in process of purchasing the switch to support the networking. Once available, we shall be able to provide the capacity for one instance of SLAC data. Anjum will provide this over the coming weekend (by 15 Dec 2014)

UNIMAS

Pinger2 (Raspberry Pi) ran  successfully from Sept 2nd to October 23. We have been unable to gather data since. It still responds to pings. The graphs below show the RTTs from SLAC to www, pinger and raspberry pi at UNIMAS. At first glimpse they are very similar. www & pi are probably closer together (more jitter and lower loss)  in RTT performance  than pinger. To quantify one would need to do a frequency analysis and possibly a Kolmogorov/Smirnov test. 

Image Added

Image Added

Image Added

It might be more instructive to look at the data from pinger and raspberry pi to Malaysia since the distances are shorter and the differences may show up better. For Sep-Oct 2014 when there was data measured from both Oct-Nov the averages for 20 paths was 52+-21ms (from pinger.unimas.my to 20 other Malaysian hosts) and 56+-21ms for raspberry pi to 20 other Malayisn hosts.

Traceroute server: Status unsolved. The problem is the same on Pinger2. Johari talked to the network administrator at the centre about this issues and he suggested to talk to the security manager to check whether the firewall is blocking the icmp packer from the traceroute command (to do list). It is possible/probable that they are blocking the default traceroute UDP ports 33434 - 33465. Johari has superuser privs on the machine and tried the traceroute -I to see if ICMP pings work, and -T -p 80 to see if TCP probes (SYN) to port 80 get  through OK.  They do so the next step is to temprarily unblock UDP ports 33434 - 33465 to see if that fixes it.

Custom iso: He can get as far as the boot screen, but is unable to get to the desktop. They will started work on it  but student is still unable to boot ISO (9/17/2014). The student gave up , Johari needs a new student with more technical knowledge.

Research: there is Advanced Project (Master by coursework student working on the statistics of the data from the raspberry Pi and the production PingEr monitor at UNIMAS to see how much they differ.  

They are also looking at anomaly detection:  http://slac.stanford.edu/pubs/slacpubs/13250/slac-pub-13399.pdf or http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.363.1087 for comparisons of some techniques and http://people.cs.missouri.edu/~calyamp/publications/ontimedetect_mascots10.pdf. Next they will look at performance among correlated routes. There are quite a lot of papers in this are so a literature search is highly recommended.

UTM

After revision the FRGS proposal was submitted to RMC. It was not accepted. We need to update it again in order to fulfill the requirements of the grant.

Saqib has updated the case study and is available in Google drive as a "Shared-PingER" document for review at https://drive.google.com/folderview?id=0B-NEKleLll79ZFNmUnhiVGJ0Nmc&usp=sharing_eid (thanks to Bebo who will notify all of how to access). Further it needs some updates from UNIMAS (on Raspberry  Pi),  UM (on big data) and UUM.

http://pinger.fsksm.utm.my/cgi-bin/traceroute.pl?function=ping works. traceroute problem regarding maximum reachable hops ( i.e. 11 hopes ) is still unresolved.  The traceroute looks as below.

Executing exec(traceroute -m 30 -q 3 134.79.197.197 140)
traceroute to 134.79.197.197 (134.79.197.197), 30 hops max, 140 byte packets
 1  161.139.68.250 (161.139.68.250)  0.974 ms  1.293 ms  1.524 ms
 2  10.110.1.67 (10.110.1.67)  1.135 ms  1.495 ms  1.447 ms
 3  161.139.248.254 (161.139.248.254)  3.468 ms  3.360 ms  3.269 ms
 4  161.139.245.254 (161.139.245.254)  4.889 ms  4.876 ms  4.968 ms
 5  * * *
 6  * * *
 7  203.80.23.153 (203.80.23.153)  17.659 ms  17.623 ms  17.573 ms
 8  203.80.22.137 (203.80.22.137)  16.069 ms  15.098 ms  16.090 ms
 9  203.80.23.242 (203.80.23.242)  12.634 ms  12.791 ms  12.831 ms
10  202.179.249.85 (202.179.249.85)  22.090 ms  21.950 ms  22.124 ms
11  jp-pop-sg-v4.bb.tein3.net (202.179.249.78)  88.761 ms  88.710 ms *
12  * * *
13  * * *
Saqib has root access to  the pinger monitor at UM. However IP address of hop 6 from UM to UNISAM is not pingable. Thus he can't look at  time series of RTT to see if there are good and bad periods.

NUST

We are unable to ping (or get data from)from the following hosts (comments following # sign are updates from Samad)

  • buitms.seecs.edu.pk #The person does not wish to continue working with us.
  • comsatsswl.seecs.edu.pk
  • nuisb.pieas.edu.pk
  • nukhimain.seecs.edu.pk
  • Pinger.comsats.edu.pk #This node is working now.
  • pinger.nca.edu.pk #This node is working now.
  • pinger.uettaxila.edu.pk #The node need fresh installation but Samad has issue in visiting the site that's why it is not working from many days.
  • pingerisl-fjwu.pern.edu.pk #There is a problem in the link to that node that's why it is not working from a long time. i am in contact with the concern person. hope it will be up in a week.
  • pingerkhi.pern.edu.pk
  • pinger.lhr.pern.edu.pk
  • sau.seecs.edu.pk

The following are pingable but there is no data:

  • ns3.pieas.edu.pk
  • pingerusindh.edu.pk #The node is working now.
  • pingerkhi-cpsp.pern.edu.pk
  • www.upesh.edu.pk #Need installation.will be up in a day. The concern person will re install Pinger today according to our commitment. 

PingER at SLAC

The  Burkina Faso workshop was postponed since the government fell, there was civil unrest, the capital's (Ouagadougou) airport closed, there were deaths etc. 

Next meeting:  Wednesday Jan 7th 2015 8:00pm Pacific Standard Time, Thursday Jan 8th  2015  9:00am Pakistan time, Thursday Jan 8th 2015 noon Malaysian time, Thursday  Jan 8th, 2015 02:00am Rio Standard Time.  

Bebo came up with a self funded researcher who is interested in communications. Les needs to review the informationNext meeting: Les is away from Nov 5 - Nov 24 getting back from Africa just in time for Thanksgiving. Wednesday December 10th  2014 9:00pm Pacific Standard Time, Thursday December 11th  2014 9:00am Pakistan time, Thursday December 11th 2014 noon Malaysian time, Thursday  December 11th, 2014 01:00am Rio Standard Time.

Old Items

Traceroute from UM to UNIMAS

...

"I have come up with initial proposed solution model. This model consists of several parts. The upper parts of the Figure below shows the data source, in which PingER data will be convert into RDF format. Then the data pre-processor will take care of converting RDF/XML into N-triples serialization formats using N-triples convertor module. This N-triple file of an RDF graph will be as an input and stores the triples in storage as a key value pair using MapReduce jobs"

Potential projects

See list of Projects

Coordinates of team members:

...