...
Invitees:
Anjum, Hassaan Khaliq+, Kashif+, Raja+, Johari-, Nara, Abdullah, Badrul, Ridzuan+, Ibrahim+, Hanan, Saqib+, Adib, Les+, Renan, Bebo-
+ Confirmed attendance
- Responded but Unable to attend:
Actual attendees:
Hassaan, Kashif, Raja, Abdullah, Ibrahim, Saqib, Les
Administration
Adib has contacted his colleague (Dr. Nordin: chair of ISTT2014) to discuss the possibility of slotting our workshop in to the ISTT2014. The conference will be held in Langkawi between 24-26 Nov. therefore, we need to provide detailed proposal about the whole workshop and Dr. Nordin will discuss our proposal with the organizing committee.The conference is 2 days so the workshop may be squeezed to one day.
Adib received draft for workshop from Johari 4/9/2014.Adib is awaiting the workshop proposal to share with Dr. Nordin.
Hopefully, this will help us to attract good number of participants and get sponsor/support to cover our expenditure. Other option is to conduct the workshop in UUM, we are ready to provide Local Arrangement (lab, local transportation, and food). But there is no funding provided by the school to support the transportation/accommodation of the speakers.
Renan
Renan
...
submitted a Paper before March 15. We are waiting for May 1st to check whether or not we will be accepted. We decided against submitting a poster by April 4th. If we don't get accepted, we could submit the paper (with some adjustments) to another conference, if you know about any other one
Renan believes we should invest more time on Virtuoso. He just cannot work on this at this moment because he knows it will take him some time to correctly migrate the data and perform more experiments; and unfortunately he has no extra time to do this.
UM
Badrul plans for his undergraduate student (Abdulrahim Haroun Ali) to have a draft paper on anomalies in PingER measurements to share for review by the end of semester (January). The student returned to his country and Badrul awaits the paper.
Ridzuan is studying a new version of Apache Hadoop 2.0 which is able to perform processing of big data (both streaming and batch processing). They are suggesting a new framework that will adopt selected new modules in Hadoop 2.0 to detect anomalies in Malaysia internet traffic. They'll come out with a proposal first and will share it when it is ready.
Ibrahim Abaker is planning to work on a topic initially entitled " leveraging pingER big data with a modified pingtable for event-correlation and clustering". Ibrahim has a proposal, see https://confluence.slac.stanford.edu/download/attachments/17162/leveraging%20pingER%20big%20data%20with%20a%20modified%20pingtable%20for%20event-correlation%20and%20clustering.docx. He is currently spending time reading about RDF storage and its retrieval, also he is trying to setup Hadoop clusters for the experiment. He is in email discussion with Renan on which part to work on first. He plans to collaborate with Renan to make the pinger store and process more efficient. Les has sent him documentation of PinGER which is very helpful. Ridzuans' work is more to do with hosting the data and stream data analysis. Ibrahim is looking more at applying MapReduce ( programming model for processing large data sets with a parallel, distributed algorithm on a cluster), reducing the storage needs and providing querying of the data.
UNIMAS
The Raspberry Pi is at the data centre and has a public IP address. The private IP address works but not the public. Johari reports no progress 4/8/2014.
The tool to enable synchronizing Malaysian monitors is completed. It provides the ability to add, edit and delete nodes in the HostList. Raja has tested and after a mod was made to replace a private IP address it is working well. Johari provided information to Saqib on trying it out. Saqib successfully used tool and updated it. Johari will add an account for Badrul to use it. Saqib requested to add sorting the HostList by country, Johari will add this.
The traceroute server at http://pinger2.unimas.my/cgi-bin/traceroute.pl has the same problem as before. They know (sort of) the problem but haven't got the chance to rectify it (mapping NAT address, needs to be added). There is no progress 12/4/2013, 1/8/2013, 1.22.2014, 2/5/2014, 3/26/2014, 4/8/2014. Now that the historical traceroutes are working for UM (see below) there is an extra incentive to get the reverse traceroute working at UTM and UNIMAS
Johari has a research student who finalized a proposal in order to officially apply for his masters. He will start in February. He is currently working on threshold/anomaly detection, and will extend to correlating performance over multiple routes. He will share the proposal with Les and others April.
UTM
Saqib received feedback on the submitted FRGS 2014 proposal ("A Fundamental Active Internet Performance Monitoring Framework for Malaysian Research & Education Network") for 36 months. He will update it and re-submit. He proposes to submit another in ERGS or E-Science grants. He is in discussions with his PhD. superviser to get the requirements and has started on the proposal.
Saqib is seeing some unexplainable results from the traceroute servers at UTM. Basically traceroute from UTM works fine with -I option. Otherwise it stop at hops 10 or 11 unless he uses the -f 6 option. He will document and then we will share with others.
Saqib has started a case study of Malaysian hosts seen from Malaysian Monitors. He needs to add 3 more graphs.
UUM
Regarding the monitoring host in UUM, Adib has assigned one student to prepare the configuration/installation plan including how to secure our host from attack. He has a public IP address. He needs to the DNS registration by Sunday or Monday. He is in the last stage of working with the Computer Center. Adib requested Johari to share the UNIMAS setting so it is easier for the student to follow.
NUST
Kashif has returned. He had a power outage for much of the meeting.
The process of trouble shooting/rebuilding Maggie1 will be pursued by Kashif (now Joun has left).
The BeaconLists at NUST and SLAC are out of sync. Anjum pointed out that due to restrictions imposed at the at the PERN PoPs (limit number of hosts monitored, do not allow monitoring of non Pakistani hosts, do not provide full access permissions to the monitor) they cannot use the standard SLAC based beacon list. Anjum will talk to Arshad. Maybe the PERN PoPs should use a different Beacon list kept at SEECS.
Hassaan reports that they have established contact with people in Bahawalpur. The contact person forwarded the request to higher authorities for approval of PingER deployment. The contact was on leave 4/9/2014
The installation of PingER at Sahiwal is complete. It just needs the Beacon List. It was awaiting Kashif's return.
BUITMS has been fixed. It is working now with the standard BeaconList and HostList.
We are unable to gather data from airuniversity, buitms, cae, duhs, kohat, lcwu, pingerfsbd, pingerisl-qau, sau.seecs.edu.pk , uaf.
Monitors Status
Airuniversity New installation will be install in a week
Buitms Problem in hardware, they are trying to fix it. System Replacement Required
Cae Problem with IP, they are trying to resolve it
Duhs They are purchasing new servers in two week time
Pingerisl-qau Contact person is still on leave. He is now busy in other pending works.
sau.seecs.edu.pk for all of January. Contact person is not attending
Uaf Problem in system, visit approval for Faisalabad University in progress. Approved for 12th Feb
Anjum pointed out that there are working PingER monitors that SLAC appears unable to gather data from.
Raja
Added 92 new perfSONAR landmarks to TULIP DB, 48 of which are geographically unique. This gives us a total of 1010 landmarks, 316 of which are currently enabled for geolocation.
Written a script to find landmarks with incorrect coordinates. So far have identified 2 in North America, still looking for others.
A link to Vtrace from the perfSONAR home page has been added. perfSONAR has updated to a new release. With this there are more perfSONAR landmarks available.
Raja, Umar and Les are working on a paper on TULIP and its application to Visual Tracerouting to be submitted later this year
PingER at SLAC
Les requested an update from Yahoo about TULIP's gelocation. They answered "We are very much interested in getting IP triangulation at internet scale, we will have internal sync-up on how we can leverage this initiative if there is rate limit and get back. Regarding opening up yahoo sites for deploying ping server requires some more time to discuss this with relevant stake holders with in yahoo."
Les sent email to Google as follows: "I would like to bring to your attention that we have developed a geolocation tool using delay based (using RTTs from known ping server landmarks) distance estimates to triangulate the location of an IP host target. The tools is accessible at: http://www-wanmon.slac.stanford.edu/cgi-wrap/reflex.cgi. We have identified that the accuracy of the geolocation is directly related to the landmark density (e.g. # of landmarks/ million sq km). The higher the density the smaller the error. We currently have over 1000 registered landmarks, of which at any given time ~300 are working. The tool not onlyfinds the location of the target, it also gives an estimated error. To the best of our knowledge it is the only freely available delay based measurement geolocation tool publicly available today. A drawback (compared to database methods such as those based on GeoMind) is the time taken to make the measurements. We have worked in this from manydirections including parallelization of the ping requests, caching, tiering to get the rough location (i.e. region of the world) then zooming in using all landmarks in the region. We are putting together a publication on this."
Renan completed writing the paper on Linked Open data access to PingER data. Bebo & Les have reviewed and commented. It was submitted to the Stanford conference March 1st, 2014. The deadline for the submission was extended from March 1st to March 15. The notification is May 1st, the final submission is May 9th, conference is May 27-31. Poster submissions are due April 4th, we might submit a poster just in case. The acceptance rate is very low. Information on the conference is at http://www.scienceengineering.org/ase/conference/2014/bigdata/sanjose/website/paper-submission/.
UM
Badrul plans for his undergraduate student (Abdulrahim Haroun Ali) to have a draft paper on anomalies in PingER measurements to share for review by the end of semester (January). No update 3/5/2014, 3/26/2014.
Ridzuan is studying a new version of Apache Hadoop 2.0 which is able to perform processing of big data (both streaming and batch processing). They are suggesting a new framework that will adopt selected new modules in Hadoop 2.0 to detect anomalies in Malaysia internet traffic. They'll come out with a proposal first and will share it when it is ready.
Ibrahim Abaker is planning to work on a topic initially entitled " leveraging pingER big data with a modified pingtable for event-correlation and clustering". Ibrahim has a proposal, see https://confluence.slac.stanford.edu/download/attachments/17162/leveraging%20pingER%20big%20data%20with%20a%20modified%20pingtable%20for%20event-correlation%20and%20clustering.docx. He is currently spending time reading about RDF storage and its retrieval, alsohe is trying to setup Hadoop clusters for the experiment. He plans soon to discuss with Renan which part to work on first. He plans to collaborate with Renan to make the pinger store and process more efficient.
UNIMAS
The Raspberry Pi is at the data centre and has a public IP address. The private IP address works but not the public. Johari reports no progress 4/8/2014.
The tool to enable synchronizing Malaysian monitors is completed. It provides the ability to add, edit and delete nodes in the HostList. Raja has tested and after a mod was made to replace a private IP address it is working well. Johari provided information to Saqib on trying it out. Saqib successfully used tool and updated it. Johari will add an account for Badrul to use it. Saqib requested to add sorting the HostList by country, Johari will add this.
The traceroute server at http://pinger2.unimas.my/cgi-bin/traceroute.pl has the same problem as before. They know (sort of) the problem but haven't got the chance to rectify it (mapping NAT address, needs to be added). There is no progress 12/4/2013, 1/8/2013, 1.22.2014, 2/5/2014, 3/26/2014, 4/8/2014. Now that the historical traceroutes are working for UM (see below) there is an extra incentive to get the reverse traceroute working at UTM and UNIMAS
Johari has a research student who finalized a proposal in order to officially apply for his masters. He will start in February. He is currently working on threshold/anomaly detection, and will extend to correlating performance over multiple routes. He will share the proposal with Les and others April.
UTM
Saqib submitted an FRGS 2014 proposal ("A Fundamental Active Internet Performance Monitoring Framework for Malaysian Research & Education Network") for 36 months. Proposes to submit another in ERGS or E-Science grants. He is in discussions with his PhD. superviser to get the requirements.
Saqib is seeing some unexplainable results from the traceroute servers at UTM. Basically traceroute from UTM works fine with -I option. Otherwise it stop at hops 10 or 11 unless he uses the -f 6 option
Saqib has started a case study of Malaysian hosts seen from Malaysian Monitors. He has updated the remote host list on UTM Pinger (Malaysian & S.E Asia) and remote host xml tool. In the next two weeks, he will finish the case study of Malaysian hosts seen from Malaysian Monitors.
UTM pinger server is now running with an updated version of pinger.xml file using the tool provided by Dr. Johari. Saqib has updated the data on remote host management page with all S.E Asia nodes. Now UM and UNIMAS can synchronize their host list. The list is available here.
UUM
Regarding the monitoring host in UUM, Adib has assigned one student to prepare the configuration/installation plan including how to secure our host from attack. Adib requested Johari to share the UNIMAS setting so it is easier for the student to follow.
NUST
Kashif has returned.
The process of trouble shooting/rebuilding Maggie1 will be pursued by Kashif (now Joun has left).
BUITMS is apparently working but does not seem to have access internationally. Kashif and Raja are investigating.
The BeaconLists at NUST and SLAC are out of sync. Raja compared the two pinger.xml files. It turns out NUST was not using the HostList for the non Beacons and so Pakistani monitors have an expanded BeaconList which was updated from SEECS. Raja has explained this to NUST and believe it will be easy to synchronize. Kashif asked about the definition of Beacons. Les updated the web page at http://www-iepm.slac.stanford.edu/pinger/beacon.html. Hopefully this helps. However, Anjum pointed out that due to restrictions imposed at the at the PERN PoPs (limit number of hosts monitored, do not allow monitoring of non Pakistani hosts, do not provide full access permissions to the monitor) they cannot use the standard SLAC based beacon list. Anjum will talk to Arshad. Maybe the PERN PoPs should use a different Beacon list kept at SEECS.
Hassaan reports that they have established contact with people in Bahawalpur. The contact person forwarded the request to higher authorities for approval of PingER deployment. Bahawalpur are not responding. When Kashif returns SEECS will try again. Anjum has some contacts from Bahawalpur at UM who may be able to help. He will contact them before Monday.
The installation of PingER at Sahiwal is complete. It just needs the Beacon List. This awaits Kashif's return.
Quest.seecs.edu.pk has been restored to a working state
We are unable to gather data from airuniversity, buitms, cae, duhs, kohat, lcwu, pingerfsbd, pingerisl-qau, sau.seecs.edu.pk , uaf.
Monitors Status
Airuniversity New installation will be install in a week
Buitms Problem in hardware, they are trying to fix it. System Replacement Required
Cae Problem with IP, they are trying to resolve it
Duhs They are purchasing new servers in two week time
Pingerisl-qau Contact person is still on leave. He is now busy in other pending works.
sau.seecs.edu.pk for all of January. Contact person is not attending
Uaf Problem in system, visit approval for Faisalabad University in progress. Approved for 12th Feb
Anjum pointed out that there are working PingER monitors that SLAC appears unable to gather data from.
Raja
Added 92 new perfSONAR landmarks to TULIP DB, 48 of which are geographically unique. This gives us a total of 1010 landmarks, 316 of which are currently enabled of geolocation.
A link to Vtrace from the perfSONAR home page has been added. perfSONAR has updated to a new release. With this there are motre perfSONAR landmarks now available.
Raja, Umar and Les are working on a paper on TULIP and its application to Visual Tracerouting to be submitted later this year
We have sent a reminder email to Yahoo giving them an update on TULIP and how it might be extended to meet their needs. They have responded, they appear to be interested. We are trying to interest them in providing landmarks. No update 2/18/2013, 3/26/2014.
PingER at SLAC
The PingER monitoring hosts at Taiwan, FNAL, UERJ(.br), sprace(.br), and South Africa(.za) have been restored to a working state.
Les contacted the Hong Kong, Rutherford Lab (.uk), Daresbury Lab (.uk), CEFET (.br, UNESP(.br) and ACMESecurity (.br) PingER monitors to try and get them fixed. The Hong Kong contact has retired. The others have not responded.
Old Items
Linked Open Data
...
Anjum suggested Saqib, Badrul and Johari put together a paper on user experiences with using the Internet in Malaysia as seen from Malaysian universities. In particular round trip time, losses, jitter, reliability, routing/peering, in particular anomalies, and the impact on VoIP, throughput etc. It would be good to engage someone from MYREN.
Potential projects
Future meeting - Les
Next meeting Wednesday April 9th 23rd 2014 9:00pm Pacific Standard Time, Thursday April 10th 2014 24th 2014 9:00am Pakistan time, Thursday April 10th24th, 2014 noon Malaysian time, Thursday April 10th24th, 2014 02:00am Rio Standard Time.
...