Versions Compared

Old Version 25

changes.mady.by.user Les Cottrell

Saved on

compared with

New Version Current

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Do we need to add anyone else to the weekly meetings, e.g. Hossein Javedani of UTM. Saqib has tried to contact Hossein 3 times. We will drop this item.
  • Johari proposes that UTM host a PingER workshop in 2014, maybe associated with another conference. Anjum will be in Malaysia then. Saqib will meet  Hanan later today Jan 9th and discuss this. Johari will email Hanan also.
  • Anjum is going to spend a year in Malaysia at UM. He awaits his visa. Dr Hassaan Khaliq will be taking over as the PingER Leader there. Badrul agreed to add Hassaan to the pinger-my list. Hassans Hassaan's coordinates are in  http://pinger.unimas.my/pinger/contact.php. Hassaan will set up a meeting with Arshad, Anjum, Les and Hassaan to go over expectations.

Renan

 

Renan's thesis has around 130 pages. However, almost half of it is about generic stuff about Semantic Web. The other half is specific about PingER LOD project. The Semantic Web generic stuff part should be translated because it is good material for those who want to study and understand more about it. The PingER LOD part should be translated for further documentation about the project we developed at SLAC.  Things Renan needs to do:

  • Start translating his thesis, specifically the PingER LOD part (around 50 pages), which is more interesting to us.
  • Test (free) alternatives for the RDF Repository, he has already started this with Virtuoso. He just needs more time  to test it more and have more solid results.
    •  

      Basically he  would need at least one week to dedicate myself to work only on PingER LOD programming, bug fixes, tests, documentation, and stuff. However, this is currently very hard because of the job he has at his university. IHe says 'I will try my best to find some time, though. Promise!'

       

      Any help from a developer who would be able to engage him/herself to invest some time on the project would be very much appreciated.

  • Paper about Big Data and Social Computing for the conference that will be held at Stanford: He is pretty sure he can argue that we have made  nice contributions for social computing using (big) data handling technologies. he will discuss with his professor at Rio so she can help him with advice. The deadline for the proposal (3 pages, easy) is Jan 15.
  • Provide a short description of PingERLOD for the annual PingER report.

Renan is now working as a systems developer at his university at this moment so he is busy. He has plans to keep in touch with us and producing more work. Currently he is unsure he  will have an outstanding productivity.

...

  • Renan reports that Ridzuan can definitely use PingER LOD data because it is constantly being updated, due to the chronological jobs. The main problem he will face is the slowness caused by the usage of Sesame (RDF Repository). The slowness is clearly shown on more complex queries, especially the ones that retrieve measurement data using many parameters (ex: a query that shows throughput, packet loss, and avg RTT from SLAC to all nodes in Malaysia, monthly, since August).
  • Ridzuan may find it much faster and more support available if he uses pingtable.pl etc.
  • Ridzuan agrees about the slowness. He will use PingER's text files via pingtable.pl  etc. Les mentioned there are several for applications to access PingER data via the web.

Badrul plans for his undergraduate student (Abdulrahim Haroun Ali) to have a draft paper on anomalies in PingER measurements to share for review by the end of semester (January).Badrul has an undergraduate student (Abdulrahim Haroun Ali) looking at such anomalies in ping measurements. They are currently working on it and plan to have a paper by January 2014. They will need help to vet the paper later. Any Progress?

UNIMAS

Raspberry Pi was to be  repaired with duct tape returned to computer center by Monday 9th December. Did this happen?

The UNIMAS monitor appears to have been down for a while.

Johari is working on a tool to enable synchronizing Malaysian monitors so they all have the same HostList (like the BeaconList). One will enter the new hosts into a web page from which is generated the HostList XML that is fed into the pinger.xml configuration file. There will also be weekly updates. Given that Saqib has generated a set of SE Asian hosts for all Malaysian monitors to make measurements to, this means that UM and UNIMAS will need to update their HostLists. So such a tool will be very useful and timely. Progress?

. However the heat of the device disolved the tape glue. Johari will get a replacment under warranty. The conclusion is that the Raspberry Pi is OK for a contrlled environment but not robust enough for rural areas such as the Kelabit Highlands.

The UNIMAS monitor was down over the new year. The problem was that the pinger2.pl file was moved.  It is now working, however it looks like an older version, it does not have the individual ping response just the min/avg/max. This will need investigating.

The tool to enable synchronizing Malaysian monitors is completed. It provides the ability to add, edit and delete nodes. However there are still some errors (wild cards) in the pinger.xml file produced. Johari is working on itJohari has also installed webmin in both nodes and start collecting performance data such as cpu utilization and network utilization which can be compared between the two nodes. need to find way to embed the graph generated by webmin to be displayed in the website for real time monitoring.

The traceroute server at http://pinger2.unimas.my/cgi-bin/traceroute.pl  has the same problem as before. They know (sort of) the problem but haven't got the chance to rectify it (mapping NAT address, needs to be added). There is no progress 12/412/4/2013, 1/8/2013.

Custom iso: tried using remastersys tool to create custom iso, able to generate the custom iso but unable to boot from the iso due to kernel panic. Still troubleshooting the issue and also looking for other tool for creating custom iso No progress 1/8/2013..

Johari has created a shell script to automate the installation of pinger package in Ubuntu/Linux distro. He is using SLAC repo version 2.3 with a virtual box and ubuntu server 13.04 for testing purpose.  Johari has added a page at pinger.unimas.my/pinger website on the usage of a shell script to automate the installation steps for pinger package. It is available at  http://pinger.unimas.my/pinger/install-tutorial.php. If any of you have a go at it, please let Johari know whether it works, or if there is any error that you encounter. This might be good for NUST to try out.  Kashif will look at 12/4/2013. Any progress?. Kashif has tried it and provided feedback to Johari concerning what versions of Linux distribution it supports.Currently it is based on Ubuntu.  Of the 50 Pakistani hosts none are using Ubuntu. Pakistan is using Fedora and CentOS.

Johari has a research student who  is currently finalizing the proposal (it will be submitted next week) finalized a proposal in order to officially apply as Master by research student, target to get him officially by December. Currently he is looking at different correlation technique for the project. It was submitted and they plan to hear of acceptance in early January. He is looking at anomaly detection to provide alarmsfor his masters.  He will start in February. He is currently working on threshold/anomaly detection, and will extend to correlating performance over multiple routes.

UTM

Saqib has finished his thesis. He is applying for a Postgraduate Research assistant-ship at UTM where he plans to work on PingER. He expects to hear the result in December.Hossein Javedani of UTM was interested in anomaly detection in PingER data. We have sent him a couple of papers and how to access the PingER data.  Saqib requested him to join the skype meetings. Waiting for his replyis still waiting to hear the result.

Saqib is working with the IT department in UTM to solve the problems of delays in traceroute.  They have a new ISP.  Now the pinger server is working with single static IP (161.139.68.188) both for intranet and internet.   Previous internet IP 161.139.146.158 is removed.  

...

Saqib emailed a list of Potential PingER remote nodes in S. E Asia. We will need to get all They have been added to the all 3 Malaysian PingER monitors to add them to their HostLists'  HostLists. He has started a case study of Malaysian hosts send seen from Malaysian Monitors.

 UUM

Dec 4, 2013: The director of computer centre has agreed to support this collaboration and already appointed one staff to be with us during the configuration.  Next step, Adib needs to discuss with Prof. Suhaidi to dedicate one PC  OR get  support from Badrul grant to buy one PC for this purpose or have a bake sale and buy a Raspberry Pi.  Adib will do his  best to setup PingER monitoring host at UUM before the end of this year.of this year. Adib was not on the meeting. He provided an update by email: "Still waiting to get PC. But they promise to provide one very soon. it is totally beyond my control." Regarding the meeting, Adib will attend the upcoming meetings once UUM pinger host is up.

NUST

At the Connect Asia Pacific Summit in Bangkok 2 weeks ago and seeing the  project "Mapping the pan Asia Pacific information Superhighway and closing gaps in infrastructure  connectivity" Shahryar found that very much related to the work in the PingER project. So Shahryar sent email to a UN agency for a possible collaboration with them on PingER project.

Anjum believes he can add two more PingER hosts, one at Bahawalpur the other at Sahiwal. These are in central Pakistan towards the Eastern border and so should help with providing TULIP landmarks.TULIP landmarks. However with his impending move he has not had time to follow up. Hassaan will follow up with Anjum.

We were unable to gather data from about 13 monitors in Pakistan. Three have been fixed. They will fix the remainder. The contact for QAU is on leave. New DVDs have been sent to DUHsWe are unable to gather data from about 13 monitors in Pakistan.

TULIP - Raja

We are looking to make the code open source and available via github. We will be discussing possible extensions and potential commercialization.

Raja has found a further ~48 perfSONAR landmarks mainly in Europe and N. America. We now have 228 active unique landmarks. He now checks for new landmarks on a monthly basis. We have also created Taiwan as another region for which we can get good location information. We now work for N. America, Europe, Pakistan and Taiwan.

Raja has made lots of measurements and created cumulative probability distribution functions of how the new TULIP with adapting alpha (in distance = Alpha*100(km/ms)*min_RTT(ms)) according to region and min_RTT compares to databases and Constraint Based Geolocation and Single Ping etc. He has also added information on the impact of landmark density on accuracy.

Raja has put together a paper on TULIP. Next step is to submit itIt has been submitted.

As Raja's work on TULIP begins to go into testing he will be engaging more with Renan and Linked Open Data. Raja has  sent email to Renan and has a list of things from Renan that Raja should look at. This is delayed by finishing off the TULIP paper and the end of year PingER annual report for ICFA.

...

Anjum suggested Saqib,  Badrul and Johari put together a paper on user experiences with using the Internet in Malaysia as seen from Malaysian universities. In particular round trip time, losses, jitter, reliability, routing/peering, in particular anomalies, and the impact on VoIP, throughput etc.  It would be good to engage someone from MYREN.

Potential projects

See list of Projects

Future meeting  - Les

Next meeting Wednesday January 22nd 2014 8:00pm Pacific Standard Time, Thursday January 23rd 2014 9:00am Pakistan time, Thursday January 23rd, 2014 noon Malaysian time, Thursday 23rd January, 2014 02:00am Rio Standard Time.

...