Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Hassaan Khaliq?, Kashif, Raja,  Samad Riaz (SEECS); Johari?-, Nara, Adnan Khan (UNIMAS); Abdullah, Badrul, Anjum+, Ridzuan, Ibrahim+ (UM); Hanan, Saqib- (UTM); Adib+, Fatima+ (UUM); Fizi Jalil (MYREN);  Thiago, Les+, Bebo (SLAC)

...

  • Membership of pinger-my in https://groups.google.com
  • We are working with Dr Zaidi the new head of SEECS to investigate resources need to continue support of PingER in Pakistan. We communicated first week in August. No word since. Sent a reminder 8/1/2015. We had a rump meeting of Anjum, Hassaan and Les to discuss the way forward. Hassaan is waiting to hear from HEC about the comments on the proposal. 

  • NETAPPS2015: Adib reports "We have received some good number of submissions and the reviewing process have started already. we will have a committee meeting tomorrow at the same time of PINGER group meeting. I will update you afterward."
    • Four papers were submitted related to PingER August 25th

    • Anjum submitted a paper to NETAPPS2015 "Adaptive Geolocation of Internet Hosts". There is no word on acceptance of paper. The evaluation was complete by 23rd September. I think the results should be out soon. 

    • Les, Thiago, Johari, Bebo and Topher White submitted a paper on "Worldwide Internet Performance Measurements Using Lightweight Measurement Platforms". We have heard nothing on acceptance.

    • Saqib submitted a paper "PingER Malaysia-Internet Performance Measuring Project: A Case Study". Saqib has been notified that it has been accepted. Now trying for some funding to attend the workshop.

    • Thiago and the Brazilian team submitted a paper on "Applying Data Warehousing and Big Data Techniques to Analyze Internet Performance'. Adib has kindly come up with a way in which the authors are unlikely to be able to attend, so somebody else will present. This has been accepted. Thiago is working on responding to the reviewer comments and is updating the paper.

  • Bebo has potentially 9 students from Amity University near New Delhi in India interested in coming to SLAC for 3 months starting Feb until May. All expenses paid by them. They can start working remotely on project immediately. We are looking at what they can be involved in:  PingER (e.g. data warehouse project follow on with Brazil, Maris is excited about this), Android port of PingER MA with Topher, Geolocation with Anjum (Anjum is interested),  others on big data, monitoring, high performance throughput etc. However to come to SLAC they will need a US visa and they are still undergraduates so SLAC cannot sponsor them for a visa.  Bebo is contacting the students to see whether any of them already have a BS or equivalent (or higher).  Or whether any have a US visa or knows how to get one without SLAC sponsorship.

     

Geolocation Anjum, 
  • At a previous meeting, we discussed the potential for an undergraduate from UM spending 6 months at SLAC as an intern. SLAC would be very interested, however SLAC cannot sponsor a J1 visa for anyone who does not have the equivalent of a US bachelors degree. Anjum will pass this on and pursue from the UM end.  It does nor appear promising, we will drop it.

  • Need to move meeting 30 minutes earlier in future to accomodate Johari's schedule.

Geolocation Anjum, 
  • Anjum believes the TULIP Geolocation application  can be improved significantly. At least there are few ideas that we can try. For this, either a group of Anjum believes the TULIP Geolocation application  can be improved significantly. At least there are few ideas that we can try. For this, either a group of undergraduate students or an active masters student is required. The resultant work can easily be the thesis of masters level. Who is interested? 

    • Saqib has an MS student interested to work on Geolocation project. He requests an initial  paper on the project.

    • Johari will contact Anjum to learn more of the requirements. Update Johari/Adnan

    • See http://www.slac.stanford.edu/comp/net/tulip/. Basically TULIP uses pings to a target from landmarks at known locations and converts the minimum RTTs to estimate the distances. Then uses the distances with mulitlateration to estimate the location of the target

    • To improve TULIP one needs the right selection of landmarks, i.e. good (working landmarks) at the right locations (not too far from the target), straddling the target, and with a a reasonable estimate of the indirectness (directivity or alpha) of the path from the landmark to the target (so we can reasonably accurately estimate the distance). One also needs a reasonable density of landmarks (e.g. number of targets/100,000sq km)

    • The landmarks come from PingER and perfSONAR sites.  We have a reasonable density in the US, Pakistan and Europe. Currently Anjum is getting better than 20km accuracy for Pakistani targets

    • As the number of landmarks goes up so does the accuracy, but so does the time to make the measurements (pings). 

    • One needs to find the optimal density

    • Anjum proposes to speed up the measurements using a cluster for parallelization and also proposes to improve the adaptation of alpha based region. He regards the adaptive geolocation and parallelization as  MS projects. 

    • He is also interested in geolocation in small proximity (e.g.indoors), e.g. using cell tower signals. This is a new area of research. It is possible that the port of PingER to an Android could  be related to this. This is a PhD project

    • Anjum reports he can supervise the students on Geolocation. He will need to know when the students are ready. We can start with a joint meeting involving Les and the students. Later on, Anjum can have the meeting with students every week while Les can join if he has time.

...

  • Anjum wondered if PingER could detect anomalies related to the recent unrest (protests against the government and DOS attacks against universities (such as UM or UNIMAS) in Malaysia. there were several attacks from the Anonymous group between August 28-31st. Following the meeting Les put out a web page at: Malaysian unrest Aug-Sep 2015. Is there an update?
Intern Anjum
  • We discussed the potential for an undergraduate from UM spending 6 months at SLAC as an intern. SLAC would be very interested, however SLAC cannot sponsor a J1 visa for anyone who does not have the equivalent of a US bachelors degree. Anjum will pass this on and pursue from the UM end.  It does nor appear promising, we will drop it.web page at: Malaysian unrest Aug-Sep 2015. Is there an update?

UFRJ

UUM

  • Adib has  managed to resolve almost all issues blocking UUM pinger from running smoothly including the problematic switch connecting our lab with the computer center, firewall setting,  DNS, ..etc. Therefore, we hope not to have any connectivity problem.
  • They plan to move UUM pinger to UUM computer center, I have talked to the person in charge and we just need to get the director permission to move on. This will help us to resolve the electricity problem as well as to some how guarantee stable connectivity.
  • Looking at the log and data at SLAC it looks to be working since 29th September.

...

Renan reports: "I had a similar experience. HDFS works better with bigger files rather than many small files. What I did was to create a Map-Reduce job to reduce all those thousands of small files into only 17 big files, each of them containing all data for a given year [1998-2014].I didn't use Hadoop MapReduce for this, though. I used a different dataflow distributed engine that also implements map and reduce operators. I am working on providing Thiago these 17 big files. Once he gets the data, he can share them with you and explain how the data on each file are stored".

UNIMAS

Johari has a student starting for 6 months. The student starts the week of September 7th on Raspbery Pi (Raspian) and custom ISO.CUstom ISO for both Ubuntu and Raspbian Wheezy is in progress, student is familiarizing himself with the tools and steps to install Pinger on both platform before creating the custom iso

They are also looking at anomaly detection:  http://slac.stanford.edu/pubs/slacpubs/13250/slac-pub-13399.pdf or http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.363.1087 for comparisons of some techniques and http://people.cs.missouri.edu/~calyamp/publications/ontimedetect_mascots10.pdf. Next they will look at performing end  Sept.

...

Johari will contact Hanan to request someone to support PingER at UTM, now Saqib has left. (6/3/2015/.  Hanan not replying to Johari , Johari will try another route dean to get a replacement for Saqib at UTM 8/12/2015). 9/2/2015 still unable to contact Hanan, Johari will try and contact the Dean. However the Dean is new so Johari wants to gather some information first.

 Saqib

Has a student  interested to work on Hadoop and pinger datastudent  interested to work on Hadoop and pinger data. Les has sent him information on the SLAC Nebula cluster Cloudera/impala/HDFS Pinger Data warehouse dedveloped by Thiago and Co.

Further he has a few more MS students searching for their research topics. We can also utilize them in our pinger project. They are from software engineering, database and network background. 

...

We have been unable to gather data from pingersonar-utm.myren.net.my  since September 11th, 2015 pingersonar-utm.myren.net.my. It is pingable  however there is no response from http://pingersonar-utm.myren.net.my/cgi-bin/traceroute.pl?function=ping&target=www-wanmon.slac.stanford.edu&options=-i%200.2


NUST

Following Following the last meeting, Anjum, Hassaan and Les met to discuss the way forward. 

  • "Adnan currently is unable to find resources for handling the project. Similarly, there is no progress on hiring of a full time RA by NUST HQ. 
  • However, I (Hassaan) checked from HEC about the proposal that I submitted last year. They have informed me that 2 reviewers have asked for revisions while they are waiting for the third review. I am very hopeful about it. If the proposal is accepted then we can easily have a full time RA for the project. I have plans to talk to Dr. Zaidi about hiring an RA on assuming that our proposal will be accepted by HEC. We can then get his salary deducted later from the HEC project. I shall update you very soon in this regard."by HEC. We can then get his salary deducted later from the HEC project. I shall update you very soon in this regard." 
  • Hassaan is  waiting to hear from HEC about the comments on the proposal. 

  • Moreover, he has asked a student to work on the project for the time being. His name is Mian Anas however he will need few weeks to understand the project. 

PingER at SLAC

  • Thiago completed setting up the  PingER data SQL Impala warehouse running on a Nebula/Cloudera cluster using the Hadoop File System (HDFS). Unfortunately it is not currently accessible from outside SLAC. There have been several attempts to provide outside access, but no success yet, we need to engage the subject matter experts. Thiago is now a SLAC associate so he still has an account at SLAC. There was a cyber security alert on the version of java installed with Cloudera. Les has replaced the cloudera version of java which should fix the vulnerability. However the new version has not been tested.

  • The Raspberry Pi at SLAC is still running smoothly since June 11th.

...

Nb daylight saving ends Nov 1 in US. Alos note the meeting has been moved forward by 30 mins to accomodate Johari's schedule.

Next meeting:  Wednesday Nov 4th 2015 87:00pm 30pm Pacific Standard Time, Thursday Nov 5th 2015  9 8:00am 30am Pakistan time, Thursday Nov 5th 2015 noon Malaysian 11:30am  Malaysian time, Thursday Nov 5th  2015 0201:00am 30 am Rio Standard Time.  

Old Items

...