Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Time & date

Wednesday Tuesday October 21,  8:00pm Pacific Standard Time, Thursday Wednesday October 3 2  2013 8:00am Pakistan time, Thursday Wednesday October 3 2 11:00am Malaysian time.

Attendees

Invitees: AnjumAdib,  Anjum+, Kashif, Raja+, Johari+, Nara, Abdullah, Badrul-, Hanan, Fidah, Saqib+, Adib, Les+, Renan+, Bebo+

+ Confirmed attendance

- Responded but  Unable to attend: Badrul unable to attend, son admitted to hospital.

  • Actual attendees:  Anjum, Raja, Saqib, Les, Renan, Bebo

Administration

  • We will add Adib of UUM and Renan to have confirmed that everyone, including Adib and Renan, are on the pinger-my mailing email list. Has  this has been done? - Badrul
  • Ridzuan has not decided whether to join. Can Badrul assist by contact Ridzuan?
  • Do we need to add anyone else to the weekly meetings, e.g. Hossein Javedani of UTM (or maybe Saqib or Hanan can cover for him).
  • Badrul is unable to make it to this time due to lecturing. Unclear if anyone else from UM will cover for him. Can we move to accomodate Badrul? For the attendees at this meeting, we could move to a Tuesday Pacific Time slot. Whether this would help Badrul is unknown. We have moved to a Tuesday (PDT) time slot until we move from daylight to standard time at SLAC. The change from daylight time is coming up on November 3rd. This will make 8pm PDT = 9am Pakistan time,  noon Malaysian time and stay at midnight Brazilian time (they also are coming off daylight saving time). Anjum has a 9:00am lecture on Wednesday and a 10:00am on Thursday and Friday, so we will move again after November 3rd.

Funding/Proposals

Johari is looking for a Research Assistant for 24 months for his research grant. If he has no success he will see if he can do something with NUST. He has an undergraduate who is looking at Geoflow to make better visualizations of PingER. Geoflow will be released end of this year, early next year. Johari is doubtful the student will complete this.

...

We discussed sending undergraduate student to study for a few months (like Renan did) for example at SLAC. It is regarded as a great idea to give exposure etc. but funding will be hard. There are exchange programs with RMIT in Australia and the University of Warwick in the UK. NUST has exchange students. The students have to pay their own travel.

Renan

Renan has just finished  finished the new pingerlod web site. The new thing is that it should be much easier now to modify the info texts. What Renan did was to put the texts into a separate file. It should be able to be easily edit this file without requiring a new war file to be installed on the server. Les has contacted the Apache server administrator to request uploading of the new war file. The admin is in the UK at the moment so there will be a delay. Once we have that we can easily modify the text to go with the web site. Renan needs to document this.Renan is writing his thesis paper. Right now, he is writing a Glossary and Taxonomy of all terms used in the Ontology. Later, he will document the ontology (not only the definition of the terms but also their relationship with each other and their properties). Since The new version has been loaded on the server and some text added to describe how to use the map. However there is a bug that prevents the form executing the map. Renan reports that the bugs should be easy to fix. He has talked to his professor who suggested trying RDF OWLIM, it should have faster responses to queries. Renan will research this.  It will probably mean reloading the PingER data so is a lot of work, hopefully this will improve performance. Before the rebuild he will make the fixes and provide a new WAR for us to load on pingerlod.slac.stanford.edu. He is also working on documentation (he has finished the ontology and has a nice interactive tool for visualizing it, since the ontology is the core of the data model of our semantic solution, this will be very helpful for anyone who uses our system; both , both a developer of the system and a possible user. He will think of a good way to upload this stuff as a documentation for our Wiki on Confluence) and his thesis. Bebo pointed out that to get publicity and for people to know about the data, we will need to add pingerlod to lod.org.

Things he will soon do regarding documentation:

  1. A task/process flow writing all java classes involved on all those batch jobs;
  2. A Javadoc <http://www.oracle.com/technetwork/java/javase/documentation/index-jsp-135444.html> which will explain all classes and how they are used.

UNIMAS

Johari did not attend but sent an update after the meeting.

The Raspberry pi Single Board Computer (SBC)  has been moved has moved the raspberry pie to the UNIMAS Computer Center (CC). He still needs a public DNS for his Raspberry Pie. Johari will follow up with the CC.  Johari believes the traceroute problem is with the Network Address Translation. He will talk to the CC about adding support to the NAT to enable traceroute.It has a public IP address. It is collecting data, the data is available via http://pinger2.unimas.my/cgi-bin/ping_data.pl . The ping server is working at http://pinger2.unimas.my/cgi-bin/traceroute.pl?function=ping but not the traceroute server at http://pinger2.unimas.my/cgi-bin/traceroute.pl (same problem as before). They know (sort of) the problem but haven't got the chance to rectify it (mapping NAT address, need to be done from centre computer centre).

We are now using two monitoring hosts at UNIMAS. This will enable us to look for differences/anomalies possibly due to the use of the raspberry Pie. The first pinger node resides within the faculty network, further away from the pinger2 node which is located at the data centre and closer to the gateway.

A quick comparison of the performance of the two hosts without statistical quantification is available at https://confluence.slac.stanford.edu/display/IEPM/Comparison+of+PinGER+RTTs+from+UNIMAS+monitors+N4+and+RASPBERRY. Johari will prepare a comparison table in term of hardware and software between the nodes, and will put that in the website.  Quantifying the differences and adding more data as it becomes available could be student project.

On the research grant, good news is they  managed to get (persuade/force) someone to register as master by research student for the research grant obtained under the FRGS scheme. Duration max of 18 months, and will update on the kind of work he will be doing with regards to the pinger project,

Johari is having problems creating an ISO image to simplify distribution using Ubuntu. He will try another linux version.

UTM

Saqib has finished his thesis. He is applying for a Postgraduate Research assistant-ship at UTM where he plans to work on PingER. He has asked Les to write a letter of recommendation. Les has sent a letter. Saqib will apply in the next two weeks, then probably another 2 weeks to the decision.

Saqib was with his thesis. Saqib is starting to look at Pingtable.pl anomalies as a start in a case study for Malaysia and S.E Asia. In particular hosts which are unreliable, hosts with large (>1) values of Directivity, host with large RTTs, hosts with  large unreachability or losses etc. Les had some questions on the locations of some sites that have impossible values of Directivity. One has been Disabled, any word on Allianze? What about QIUP? Saqib will investigate. * *Saqib was not on the call so no update. 

Hanan and Saqib met with Hossein Javedani of UTM who was interested in anomaly detection in PingER data. We have sent him a couple of papers and how to access the PingER data. Any update - Hanan, Saqib?

Saqib is preparing a paper on event correlation.

Johari pointed out Saqib is a PhD student. Johari will talk to Hanan about getting a staff member to represent PingER at UTMHossein now plans to join the PingER project before the next meeting.

UM

Abdullah and Badrul met to discuss looking at data mining PingER data for PhD studies., however the PhD student withdrew from the project.

  • Badrul has been Badrul has an undergraduate student (Abdulrahim Haroun Ali) looking at anomalies in ping measurements. Les sent some pointers to previous work on anomaly detection in time series. The student returned September 4th.and the undergraduate student have corresponded concerning how to access the PingER data Sept 25-27. Now it is silent. Badrul is there anything else the student needs, is there an update?
  • MD NOR RIDZUAN BIN DAUD of UM is interested in analytics with Big Data for PingER.  Renan has sent documentation and is in contact with Md. Md plans to to look at analytics of clustering correlation in PingER data. He will get the data from pingtable.pl. He will try a small amount of data first and extend to more data later. Seehttps://confluence.slac.stanford.edu/display/IEPM/PingER+Big+Data+Analytics+proposal.

...

  • .

NUST

TULIP - Raja

Next we need to get the landmarks all working right in reflector.cgi and see if we can get more outside the US.

...

Raja has the Tulip map working, the laundering is working. He has contacted Kashif to try and improve the number of working landmarks in Pakistan. He now has > 200 active landmarks of which 110 are perfSONAR, 40 are PingER.

Next Raja will compare the speed of various ways to perform trilateration for N. America and Europe.

Anjum will check why many Pakistani landmarks are not working and give us an update by next week.

PingER at SLAC 

  • Working to get Daffodil University in Bangaldesh started with monitoring. The traceroute server is running and the ping_data.pl form works but no data is returned. Email sent 9/18/2013so it can be used as TULIP landmark. After some sleuthing (see https://confluence.slac.stanford.edu/display/IEPM/PingER+install+at+Daffodil+university) PingER is also working.
  • Working with Bangladesh to set up a monitoring site at Jahangirnagar University Dhakar. Letter of invitation has been sent. Les requested an update from Bangladesh 8/13/2013. They responded that they are having a delay getting an IP address. M Wahid (of UM) has sent email to Faziul Karim of Jahangirnagar University requesting an update (9/17/2013).
  • We are also working with MIMOS (see https://confluence.slac.stanford.edu/display/IEPM/20130810+Meeting+with+Dickson+Lukose+of+MIMOS) to get hosts and landmarks. They are in the midst of a discussion. Hope to have something to report by September 8th. Sent email reminder reminders 9/17/2013, 9/27/2013.
  • Adib of UUM reported on 8/22/2013 that he has discussed the PingER project with Prof.Suhaidi “the chairman of InterNetWorks Research Lab”; he is interested and ready to support. Now, they are waiting the requirements of UUM computer centre before they can officially join Pinger team. Is there an update, Adib was not on the last call. Sent email reminders 9/7/2013 and 9/17at UUM is waiting on the computer centre director to appoint one staff to be with us during the installation and configuration. They cannot do it without their supervision to avoid any issue in the future. 9/27/2013, sent reminder 10/2/2013.
  • Zakaria of Zayed university in Dubai copied Prof. Wathiq Mansoor of the American University in Dubai. Wathiq responded with interest, Les sent him information (basically http://www-iepm.slac.stanford.edu/pinger/letters/invite-monitor.doc). However the site does not appear to respond to pings. Les has not heard anything back from Wathig after informing him of the ping situation.
Old Items

For the Linked Open Data / RDF which is in pre-alpha days, you can go to http://pingerlod.slac.stanford.edu. As can be seen this page is not ready for prime time. However the demos work as long as one carefully elects what to look at:

...

There was interest in TULIP from Mridul Jain <mridul@yahoo-inc.com>and the Senior Architect in Yahoo! R&D Software Dev in Bangalore, India. He pointed to an interesting paper on Geolocation using CBG and then finding hosts in the area and getting their area codes and using a virtual landmarks making traceroutes. The paper is at https://www.usenix.org/legacy/event/nsdi11/tech/full_papers/Wang_Yong.pdf. He wants something to use in production, however I do not think we are ready.

Potential projects

See list of Projects

Future meeting  - Les

Next meeting Wednesday 16 meeting Tuesday 22 October 2013 8:00pm Pacific Daylight Time, Thursday 17 Wednesday 23 October 2013 8:00am Pakistan time, Thursday17 Wednesday 23 October 2013 11:00 am Malaysian time, Wednesday 23 October 2013 01:00am Rio time.

Coordinates of team members:

See: http://pinger.unimas.my/pinger/contact.php