Page History

...

? Individual emails sent

Actual attendees:

Hassaan, Saqib, Aqsa, Johari, Adnan, Anjum, Fatima, Les, Bebo

Administration

• Membership of pinger-my in https://groups.google.com
  • Aqsa Hameed has been added as of Dec 20, 2015. Johari has added her to http://pinger.unimas.my/pinger/contact.php.

• This will most likely be Anjum's last meeting. he He has already resigned from the University of Malaya. IHe He will l be leaving Malaysia on 31st January or 1 February. He will stay for 15 days in Pakistan then travel to Canada.  We will miss him, and wish him all the best in his new startup.

• Huffington Post article on PingER and African Internet performance, see  http://www.huffingtonpost.com/david-tereshchuk/a-giant-leap-in-2016-africa_b_8901556.html

  • Anjum said it would be good for Hassaan to attach this to his proposal.

  • Les will contact SLAC communications to get it in SLAC Today.

• NETAPPS2015 1-3 December 2015 was very successful, five papers were presented in the PingER session 
  
  • Currently, NetApps organizers are  in the process of sending NETAPPS2015 proceedings to be indexed in the major indexing services.

• 9 students from Amity University near New Delhi in India interested in coming to SLAC. Bebo sent reminder recently, response below:

  • Sorry for the delay.  Students are giving end semester exams.  They are busy till dec 20th. They will get back to work as soon as the exams  are done. Once the exam is over we will be setting up  "PingER measurement agent at Amity"

  • Three students have each written a short paper for the 6th International Conference on Cloud System and Big Data Engineering at Amity Jan 14-15, 2016. I have reviewed and made some corrections

    • 443: Analysis and clustering PingER network data

    • 463: Application for the emulation of pinger on Android devices

    • 432: Correlation analysis  on Real Time  Tab Delimited  Network monitoring data

  • Btech computer science students   would be graduating in May 2016.  Their visas can be arranged after May 2016.

• Joao a Brazillian student identified by Renan is interested in a 3 month internship at SLAC similar to those completed  by Renan and Thiago.
  • Have letter of Support for Academic Training from his organization.  Les filled out form for Joao.

Geolocation Geolocation Anjum, 

• This is a proposed project for one of the Indian students.

...

• slac-pinger/pinger created by topherwhite.  PingER project https://github.com/slac-pinger/pinger
• Now we have it we can share with Amity to check it works.
  • Bebo reports that someone from Amity requested to be a member of the Android group.

Saqib

• Saqib has a  5  MS students from the Database team

  • Farah MassoudSara Massoud came up with ideas to improve the info put together by Amity

  • Sabah Massoumil working on Linked Open Data (please excuse spelling)

  • Aqsa Hameed working on big data/analysis of PingER data. The initial idea was to set up a big data/big analysis 

  • Aqsa Hameed has been working with Anjum to look at a project to create a Hadoop/Cloudera PingER warehouse to enable easier, more powerful access to PingER historical data. 

    • Thinking a bit on Aqsa her work appears to be related to the work done by Thiago on PingER warehouse using a cluster/Cloudera/HDFS/Impala earlier this year. In particular see the presentation at NETAPPS2015 (see https://confluence.slac.stanford.edu/download/attachments/123309267/NETAPPS_PRESENTATIONrevLuiza.pptx. Once the paper is published we can also provide her with that (Adib will let us know when this is OK). 

    •  Les emailed the relevant people to put them in contact with one another. It appears there is a lot of overlap between what Aqsa proposed as a Masters project and what Thiago has already done. However Thiago's system was mainly a proof of concept and not in production. We need to look at the next steps: Internet access, auto-updating of information in near realtime, production service, maintainable etc. With this in place one could really mine the data looking for all kinds of interesting correlations, clustering, event impacts, comparisons etc.

      • Given that such a warehouse is available, then the next step would be to automatically create queries that would produce in near real-time the plots we produce manually for the PingER annual reports.

      • Following this publish the data in RDF to tie in with the Southampton RDF web observatory repository (similar to what Renan did as a proof of concept).

      • Since Thiago's warehouse is only available at SLAC,  it may assist to get Aqsa an account at SLAC, alternatively Aqsa will need to set up a repository at here home base.

      • There is some documentation written by Les on the usage of the warehouse at SLAC. It is at: PingER Data Warehouse using Big Data with Cloudera on Nebula.

      • Les will contact Thiago to see if there is other documentation or where to find the programs etc.

      • We need to put together all we know:

        • Paper from Thiago on PingER warehouse presented in Malaysia at NETAPP2015 Thiago M. Da S. Barbosa, Renan F. Souza, Sergio M. S. Da Cruz, Maria L. Campos and R. Les Cottrell. Applying Data Warehousing and Big Data Techniques to Analyze Internet Performance

        • Document on Warehouse

          • PingER Data Warehouse using Big Data with Cloudera on Nebula
            

        • Documents on PingERLOD

          • Possible follow on to PingERLOD project, PingER#PingERLOD
            

          • Linked Open Data Publication Strategies: Application in Networking PPerformance Measurement Data, Renan Souza, Les Cottrell, Bebo White, Maria Campos, Marta Mattoso, poster presented at the BigDataScience - Stanford conference, CA, USA  May 27-31, 2014.
            

        • Reviews/proposals/ from Aqsa/Fatima

          • Survey on Big Data Indexing strategies, Fatima Bintu Adama, Adib Habbal, Suhaidi Hassan, R. Les Cottrell. Bebo White, Ibrahim Abdullahi.
            

          • Saqib will provide Aqsa's

    • Tehseen is working on missing PingER data.

• Saqib has submitted a project with title "A Fundamental Active Internet Performance Monitoring Framework for Pakistan Education & Research Network (PERN) in University of Agriculture, Faisalabad"

  • Project

  Saqib has submitted a project with title "A Fundamental Active Internet Performance Monitoring Framework for Pakistan Education & Research Network (PERN) in University of Agriculture, Faisalabad"

  • Project is accepted.

  • working on a project to develop a node using Raspberry Pi 2 and IoT to measure the air and soil quality.

    • Have 2 RPis and setting up air quality with sensors from market, idea is to distribute on campus.

  • Currently, students are analyzing the project to develop a problem statement for their research project.

• For the GeoLocation Saqib

has 5 students interested in PingER. In particular in Big Data, Data Mining and Geolocation.

• For the GeoLocation Saqib should contact Anjum

• should contact Anjum

• Project on Internet performance has been accepted, but no funding yet.

UUM

Fatima  presented her work at NetApps. Fatima has passed her master oral examination (Viva) with minor correction and she is submitting her final dissertation coming Sunday to UUM school of computing. Indeed, we are very grateful to PingER team members support and help. Currently, Fatima is planning to pursue her PhD and possibly on a topic related to her master dissertation. We need PingER team suggestions and advice before we can decide on the topic. Adib will attend next meeting to further discuss on this.

...

Ibrahim has extracted the  PingER Zip manually. He is reconstructing 11Gb of data, has 15GBytes of data there. He is trying to use SPAR to classify the data. He alsop was looking at RDF. the next step is to use MapReduce to organize and reduce the output of data so can visualize it. He will be using a the same techniques he used for looking at 1996-2006 weather data.  However at the moment he cannot access his  VMs from myren for the last two weeks, even for the myren site, He has emailed  them but till now they have not fixed the issue.  He has updated all his data in their cloud.   No update 1/6/2016

UNIMAS

UTM

Johari has had no response from UTM so far. Not sure whether they still want to be in the project. Last straw, need to contact someone from the network group so that they understand and appreciate the Pinger project. Update 1/6/2016.project. Update 1/6/2016.

Saqib please contact Dr Md Asri Ngadi. Will provide update after talk.

Johari will try and contact Hafizi

Saqib reports:

"Faculty management in the Faculty of Computing-UTM is changed. They ask me to re-locate the PingER server from the faculty server room as students are not allowed for physical access of the server room. Only faculty members are allowed to physically manage the servers in the server room.  Therefore, I asked my supervisor (Dr Md Asri Ngadi/ Prof Hanan) from UTM to take  the responsibility of the server. He is agreed, however, I have to manage the server remotely. Further, he needs an official invitation from your side to fulfill the official requirements. Further, he wants to make this project as a source of an international collaboration and linkages between UTM and SLAC-Stanford."

...

Hassaan reports: "There are total of 48 active nodes for Pakistan out of which 18 nodes are working properly whereas 4 nodes have configuration issues. Lahore college for Woman has changed its data center and they want to know what do have to do with the new one. Faisalabad PERN had some critical issues and burnt their power supply so they also wanted to know what can be done to overcome that damage. FAST University Karachi and Air University, Islamabad are not in a mood to help as they say that they will put the node up, but haven’t done that in past 2 months [I Hassaan would like to discuss this with Dr. Anjum for excluding them from the list]. Last but not the least Quetta HEC regional center wanted to change their static IP to 121.52.157.148."

Les has Disabled the following Pakistani monitors since they have no DNS name and are not responding by IP address.  pinger.numl.edu.pk, pinger.uet.edu.pk, pinger.uob.edu.pk, pinger.usindh.edu.pk. We are still monitoring hosts at the site.

PingER at SLAC

• Working on the following hosts to be able to gather data 

• Pinger is now on a VM. 

Next Meeting

Next meeting:  Wednesday Feb 3 8:00pm Pacific Standard Time, Thursday Feb 4, 2016  9:00am Pakistan time, Thursday Feb 4 2016 12:00noon Malaysian time, Thursday Feb 4 2016 02:00am Rio Standard Time.  

...