Time & date
Wednesday February March 1926, 2014 9:00pm Pacific Standard Time, Thursday March 20th 27th 2014 9:00am Pakistan time, Thursday March 6th27th, 2014 12:00 noon Malaysian time, Thursday March 6th27th, 2014 1:00am Rio Standard Time.
...
Invitees:
Anjum, Hassaan Khaliq-, Kashif+, Raja+, Johari+, Nara, Abdullah, Badrul, Ridzuan, Ibrahim-, Hanan, Saqib+, Adib, Les+, Renan, Bebo
+ Confirmed attendance
...
Hassaan has been added to the pinger-my email list.
- UUM are interested to host a PingER workshop at UUM in 2014. However, they have two issues, one is the budget (they need to run this workshop on cost recovery basis); second is their commitment to MYIGF which is hosted by UUM (btw 12-13 august). There was no update 3/5/2014. We need an update.
Renan
Renan realized that testing on Virtuoso is going to take longer than he thought because of the big number of triples. He did not have enough time to continue his tests. Any progress?
Renan completed writing the paper on Linked Open data access to PingER data. Bebo 7 less & Les have reviewed and commented. It was submitted to the Stanford conference March 1st, 2014. The deadline for the submission was extended from March 1st to March 15. The notification is May 1st, the final submission is May 9th, conference is May 27-31. Poster submissions are due April 4th, we might submit a poster just in case. The acceptance rate is very low. Information on the conference is at http://www.scienceengineering.org/ase/conference/2014/bigdata/sanjose/website/paper-submission/.
Les will try and set up We (Renan, Bebo, Ibrahim and Les) had a Skype meeting with to introduce Renan and Bebo to go Ibrahim, go over strategy and also to discuss Ibrahim's work (see below).
Les will send another email to Vinicius and Renan to see if we can get the UFRJ host running agai (the web server is not working).
It would be good if somebody else was able to work with Renan to move PingER LOD forward. However we think the performance issue has to be resolved first.
The UFRJ host is successfully running again.
UM
UM appears to be experiencing very high packet losses (>4%). We need help in understanding these. It does not look like simple congestion since the jitter and RTT is staying low. Saqib needs assistance from Badrul as part of his case study of Malaysia. Badrul writes: "UM is now currently changing the new policy regarding the bandwidth and connection. They are upgrading the switch and router to a new router - mostly every weekend they shut down the network. therefore we are now having some difficulty." Saqib has identified what appear to be losses starting at a JARING router in KL. Badrul will run some mtr traceorute/pings to various sites. No update 3/5/2014.
...
Johari has a research student who finalized a proposal in order to officially apply for his masters. He will start in February. He is currently working on threshold/anomaly detection, and will extend to correlating performance over multiple routes. He will share the proposal with Les and others in the next 2 weeks to get reviews.
UTM
No progress 2/19/2014
Saqib received an email official letter regarding the successful selection of research assistant-ship at UTM. However, he is waiting for an official offer letter from research management center.
Saqib submitted an FRGS 2014 proposal for 36 months. Can we share it?
Saqib is working with the IT department in UTM to solve the problems of delays in traceroute. They have a new ISP. Now the pinger server is working with single static IP (161.139.68.188) both for intranet and internet. Previous internet IP 161.139.146.158 is removed. Again given the new historical traceroute facility (see below), it is important to get this working.
...
Saqib has started a case study of Malaysian hosts seen from Malaysian Monitors. The case study is identifying the need for the Malaysian monitors to collect traceroutes to their target hosts daily. SLAC has a script to facilitate this, for routes seen from SLAC, that could be adapted for other sites. The latest copy of the word file was shared with Badrul and Johari. No update 2/5/2014. We need an update.
UUM
Adib was unable to attend the meeting. He provided an update by email: "The PingER monitor will be up soon" . Update requested 3/21/2014.
NUST
The PingER monitor at SEECS/NUST (maggie1) is being rebuilt on a different computer following a crash. There are 2 approaches thta can be tried in parallel:
- Rebuild from scratch. in the initial case Umar took 2-3 weeks. he He wrote documentation, so this will be a test of the documentation. This could be valuable should Malaysia or another site decide to set up an archive. kashif Kashif and Joun are ready to start on this.
- Dump and restore the database. This is much easier. However it requires the database password. Les will contact Umar to see if he can provide the password. Umar canot logon to maggie1 since it is blocked by the firewall.
- Umar & Les provided the root password, the database password can be derived from this. Update requested 3/21/2014.
The BeaconLists at NUST and SLAC are out of sync. Raja will compare the The BeaconLists at NUST and SLAC are out of sync. Raja will compare the two pinger.xml files. It turns out NUST was not using the HostList for the non Beacons and so had an expanded BeaconList which was updated from SEECS. Raja has explained this to NUST and believe it will be easy to synchronize. Update requested 3/21/2014.
Hassaan reports that they have established contact with people in Bahawalpur. The contact person forwarded the request to higher authorities for approval of PingER deployment. Same status 3/5/2014
The installation of PingER at Sahiwal is complete. It just needs the Beacon List. Update requested 3/21/2014
Quest.seecs.edu.
We were gathering data from Pingerisl-air (this is continuing to work), and Quest (stopped working Feb 13)
pk has been restored to a working state
We are We are still unable to gather data from airuniversity, buitms, cae, duhs, kohat, lcwu, pingerfsbd, pingerisl-qau, sau.seecs.edu.pk , uaf.
Monitors Status
...
Duhs They are purchasing new servers in two week time pinger.pern.edu.pk Fixed Feb 19.
Pingerisl-qau Contact person is still on leave. He is now busy in other pending works. Quest.seecs.edu.pk down since February 20th.
sau.seecs.edu.pk for all of January. Contact person is not attending
...
Anjum pointed out that there are working PingER monitors that SLAC appears unable to gather data from. An example is the Comsats host. Les takes this to mean pinger.comsats.edu.pk and will investigate.
At the Connect Asia Pacific Summit in Bangkok in January and seeing the project "Mapping the pan Asia Pacific information Superhighway and closing gaps in infrastructure connectivity" Shahryar found that very much related to the work in the PingER project. So Shahryar sent email to a UN agency for a possible collaboration with them on PingER project. He has heard nothing so he will write a detailed proposal and then should contact them again. No update 2/5/2014, 3/5/2014.
TULIP - Raja
...
Les discovered that SELInux needed to be disabled. it is working now. Are there other such hosts, update requested 3/21/2014?
TULIP - Raja
Raja has added the ability to insert a captured traceroute into VTrace to get its route visualized. Try it at http://www-wanmon.slac.stanford.edu/cgi-wrap/reflector.cgi?function=vtrace. We are looking to add a link to it from the perfSONAR home page.
Raja, Umar and Les are working on a paper on TULIP and its application to Visual Tracerouting to be submitted later this year
We have sent a reminder email to Yahoo giving them an update on TULIP and how it might be extended to meet their needs. They have responded, they appear to be interested. We are trying to interest them in providing landmarks. No update 2/18/2013.
PingER at SLAC
Raja has also re-written the historical traceroute facility that takes nightly traceroutes and allows one to retrieve and compare them. He then extended it to use the reverse traceroute facility to provide histories for NUST, CERN, UM as well as SLAC. When the UNIMAS and UTM traceroutes work, we can include them. See for example http://www-wanmon.
...
...
The PingER monitoring host at ICTP has been restored to a working state. It had run out of file space. We improved pinger2.pl to detect lack of file space. Les is contacting the Jordanian PingER monitor contact to restore it.
Old Items
Linked Open Data
Renan finished the new pingerlod web site. The new thing is that it should be much easier now to modify the info texts. What Renan did was to put the texts into a separate file. The new version has been loaded on the server and some text added to describe how to use the map. However there is a bug that prevents it from executing the map. Renan reports that the bugs should be easy to fix. He has talked to his professor who suggested trying RDF Owlink, it should have faster responeses to queries. Renan will research this. It will probably mean reloading the PingER data so is a lot of work, hopefully this will improve performance. Before the rebuild he will make the fixes and provide a new WAR for us to load on pingerlod.slac.stanford.edu. He is also working on documentation (he
Raja has added 56 more perfSONAR landmarks, most of them are in North America. Currently we have 298 active landmarks (from total of 918).
The Visual traceroute and TULIP have been modified to support IPv6. Also Raja has improved the laundering.
Raja is working on a paper on TULIP implementation and on the Visual traceroute that uses TULIP.
Raja is adding a web page to select a landmark to request it to ping a target.
- Tool for pinging from PlanetLab landmarks http://www-wanmon.slac.stanford.edu/cgi-wrap/reflector.cgi?function=plping
- TULIP landmark list with Ping and Traceroute URLs http://www-wanmon.slac.stanford.edu/cgi-wrap/reflector.cgi?function=landmarks
- TULIP landmark map with Ping and Traceroute URLs http://www.slac.stanford.edu/comp/net/wan-mon/viper/tulipmap.html
We have sent a reminder email to Yahoo giving them an update on TULIP and how it might be extended to meet their needs. They have responded, they appear to be interested. We are trying to interest them in providing landmarks. No update 2/18/2013.
PingER at SLAC
We put together a slide presentation to ICFA in Geneva, to be given by Harvey Newman. It is at: http://www.slac.stanford.edu/xorg/icfa/icfa-net-paper-jan14/ICFASCICPresentation_MonitoringGroupSlides20140205.pptx
Raja has also re-written the historical traceroute facility that takes nightly traceroutes and allows one to retrieve and compare them. He then extended it to use the reverse traceroute facility to provide histories for NUST, CERN, UM as well as SLAC. When the UNIMAS and UTM traceroutes work, we can include them. See for example http://www-wanmon.slac.stanford.edu/cgi-wrap/traceroutearchive.cgi
Three is an empty pinger/xml file at ICTP. Les & Raja are studying. The Pinger hosts at FIU in Florida is now restored. Les is contacting the Jordanian PingER monitor contact to restore it.
Old Items
Linked Open Data
Renan finished the new pingerlod web site. The new thing is that it should be much easier now to modify the info texts. What Renan did was to put the texts into a separate file. The new version has been loaded on the server and some text added to describe how to use the map. However there is a bug that prevents it from executing the map. Renan reports that the bugs should be easy to fix. He has talked to his professor who suggested trying RDF Owlink, it should have faster responeses to queries. Renan will research this. It will probably mean reloading the PingER data so is a lot of work, hopefully this will improve performance. Before the rebuild he will make the fixes and provide a new WAR for us to load on pingerlod.slac.stanford.edu. He is also working on documentation (he has finished the ontology and has a nice interactive tool for visualizing it, since the ontology is the core of the data model of our semantic solution, this will be very helpful for anyone who uses our system, both a developer of the system and a possible user) and his thesis. Bebo pointed out that to get publicity and for people to know about the data, we will need to add pingerlod to lod.org.
...
Renan is using OWLIM as RDF Repository. He is using an evaluation version right now. Renan looked into the price for OWLIM (that excellent RDF Database Management System he told us about). It would cost 1200EUR minimum (~ 1620 USD, according to Google's rate for today) for a one time eternal license. It seems too expensive. No wonder it is so good. Anyhow, he heard about a different free alternative. Just not sure how good it would be for our PingER data. He will try it out and evaluate. He will also get a new evaluation of the free OWLIM lite.
He has also made some modifications on the ontology of the project (under supervision of his professor in Rio) hence he will have to modify the code to load the data accordingly.
Renan has provided a 4 page Appendix on PingERLOD to the ICFA report. This is also available at PingER LOD Overview
Raspberry Pi
of the free OWLIM lite.
He has also made some modifications on the ontology of the project (under supervision of his professor in Rio) hence he will have to modify the code to load the data accordingly.
Renan has provided a 4 page Appendix on PingERLOD to the ICFA report. This is also available at PingER LOD Overview
Raspberry Pi
A quick comparison of the performance of the two hosts (raspberry pi and regular UNIMAS host) without statistical quantification is available at https://confluence.slac.stanford.edu/display/IEPM/A quick comparison of the performance of the two hosts (raspberry pi and regular UNIMAS host) without statistical quantification is available at https://confluence.slac.stanford.edu/display/IEPM/Comparison+of+PinGER+RTTs+from+UNIMAS+monitors+N4+and+RASPBERRY. A page has been created to compare the hardware spec between the pinger.unimas.my node (Intel architecture) and the pinger2.unimas.my node (Raspberry Pi ARM architecture), available from the unimas pinger website at http://pinger.unimas.my/pinger/hardware.php. There is a link to hardware.php in the Comparison+of+PinGER+RTTs+from+UNIMAS+monitors+N4+and+RASPBERRY web page.
Tulip
We are looking at submitting a paper to IMC 2014. April 30, 2014 (see http://conferences2.sigcomm.org/imc/2014/cfp.html) is the submission date. this would discuss how TULIP works and share our experiences. Thus we might focus on: managing the appearance/disappearance of landmarks; the selecting of optimum timeouts for speedup plus any other ideas for speedup; where one could go next (e.g. colocation of landmarks on Yahoo, Google, Hotmail ... sites; impacts of heavy use and scaling (e.g. need for cluster for reflector, multiple landmarks at sites to not overwhelm a given landmark); concerns about network utilization); the relation of accuracy to landmark density (big item). Also more on potential uses such as visual traceroute, identifying proxies. Also maybe a bit more on the actual user interface (results from multiple sources besides TULIP) and implementation (parallel threads, tiering and adding new regions). The paper would assume we have a working TULIP as described in the other paper.
. A page has been created to compare the hardware spec between the pinger.unimas.my node (Intel architecture) and the pinger2.unimas.my node (Raspberry Pi ARM architecture), available from the unimas pinger website at http://pinger.unimas.my/pinger/hardware.php. There is a link to hardware.php in the Comparison+of+PinGER+RTTs+from+UNIMAS+monitors+N4+and+RASPBERRY web page.
NUST
At the Connect Asia Pacific Summit in Bangkok in January and seeing the project "Mapping the pan Asia Pacific information Superhighway and closing gaps in infrastructure connectivity" Shahryar found that very much related to the work in the PingER project. So Shahryar sent email to a UN agency for a possible collaboration with them on PingER project. He has heard nothing so he will write a detailed proposal and then should contact them again. No update 2/5/2014, 3/5/2014.
Tulip
Follow up from workshop
- Hossein Javedani of UTM is interested in anomalous event detection with PingER data. Information on this is available at https://confluence.slac.stanford.edu/display/IEPM/Event+Detection. We have sent him a couple of papers and how to access the PingER data. Hossein and Badrul have been put in contact. Is there an update Badrul?
...