Page History

...

Hassaan Khaliq, Muhammad Anas Abrar+ (SEECS); Saqib?, Aqsa (UAF); Johari?, Adnan Khan (UNIMAS);  Badrul,  Ridzuan, Ibrahim (UM); (UTM); Adib?, Fatima (UUM); Fizi Jalil (MYREN);  Les+, Bebo, Joao +(SLAC).

+ Confirmed attendance

...

? Individual emails sent

Actual attendees:

 Aib, Saqib, Joao, Les, Bebo

Administration

• Membership of pinger-my in https://groups.google.com

PingER for Android (see ePingER on Android two methods).

Amity - Java approach (A. Sai Sabitha and Shivnarayan Rajappa)

1. They are using the native java tools, they are not running the pinger2.pl <http://pinger2.pl>  script on android since the native java tools have the following advantages
   1. easier for user, 
   2. no need for prior installation of any software, e.g. load perl interpreter which may require missing skills, especially for a non technical user
   3. doesn't need a rooted phone
   4. only the apk needs to be installed to run

2. They have now updated the underlying ping command to ping -n -c 10 -w 30 -i 1 -s 100 www.google.com <http://www.google.com>  this now allows them to collect 10 pings with 30 pings being the maximum limit. The attached text file (data.rtf) shows a sample situation wherein 11 packets are sent and 10 are received where packet 3 was lost. This was not possible in the previous implementation.

   1. There is a bug in the sequence number reported, they are looking at.

3. They have also tested all the other edge cases and use regex to validate the ping data received before writing it to the text file. If they get an unknown host it fails the regex check therefore is not written into the text file. 

4. Next steps:

   1. Extend extend the Extend the target list by getting the Beacon list from SLAC. It is at http://www-iepm.slac.stanford.edu/pinger/pinger.xml on a regular basis and updating the <BeaconList> section at their site. This was part of pinger2.pl. 

   2. Also they will need a utility to clean out old recorded data (say older than 3 months), since it will be gathered from SLAC (via the proxy) and eventually they may run out memory on the Android.

...

1. They are using the original pinger2.pl script.
   1. This guarantees a better, more complete (logs, checks, updating the Beacon list etc.) match to the existing MAs. 
2. There is a tutorial on the android version. 
3. They are working on getting a public fixed IP

Discussion

To a large extent it depend on how we plan to use this.

...

A next step is to get the data from the phone MA to the archive at SLAC. The current method ping_data.pl requires a public IP address for the phone which may not exist if its is mobile. Getting the MA to put the data to the archive may raise some security issue for the archiver.

UUM

From Adib:

• Adib is blessed with a baby girl (Maryam) on Sunday 18, August. Currently on parental leave.

• Adib enquired about the status of his request to visit SLAC. After the meeting Les followed up with SLAC's international services, they said requests are taking 3-9 months to process.

• Adib asked a student (Jaafrau)  to explore  “Creative visualization of PingER data, including rich interaction;”.  He has come up with a good design, yet the development part needs a lot of work. Adib asked a student (Jaafrau)  to explore  “Creative visualization of PingER data, including rich interaction;”.  He has come up with a good design, yet the development part needs a lot of work. Adib will ask him to upload his interface and share the link. No update 8/24/2016

• Adib has a student from Thailand who is working with Adib at UUM who  may be interested in installaing a PIngER MA in Thailand. Adib will talk next week after exams to see if can get permissions. 8/3/2016: No update yet, as they have a long holiday in Thailand. Will try to contact him.

• Adib has written a case study on the Internet performance in ASEAN countries and its implication on the Socio-Economic Indexes. It has been shared with Dr.Les and Prof. Bebo  who have commented. We are looking for where to publish.

UNIMAS

UAF (Saqib)

There are 4 students:  Aqsa Hameed, Saba Muzamil, Tahseen and Sara Masood. T

• Aqsa has completed her research work on "visualization on pingER data" and now working on to publish a conference paper. Here are few details of the research work.

  • The query results can be exported as CSV file. I use the CSV file of Query results from Impala to draw Line and Bar charts by using Google API.

  • She has created a Data warehouse on pingER data. First we transform the pingER text files into CSV files. Then i upload these CSV files on HDFS and populate Impala Tables and queries.

  • Line and Bar charts are created on a webpage running or executed by localhost server. it can be updated as the query results varies.

• Aqsa and Saba are working together. Their goal is focusing on visualization of PingER historical data using warehouse.  The idea is to develop a warehouse in UAF university and make it publicly available. 

• Aqsa has put together an  abstract of a conference paper and submitted to "The 3rd IEEE/ACM International Conference on Big Data Science, Engineering and Applications (BDSEA 2016)" (http://computing.derby.ac.uk/bdcat2016/).  "Applying Big Data Warehousing and Visualization Techniques on pingER Data",  Aqsa Hameed, Dr. Saqib Ali, Dr. Les Cottrell and Bebo White, submitted to BDSEA 2016. Authors can access it via:   https://easychair.org/conferences/?conf=bdsea2016  

• another student starting in September. Adib will look at directing him to PingER.

• Adib had a meeting with Mr. Chaisit Choosong <chaisitc@gmail.com>, from Rajamangala University of Technology Srivijaya last week. Adib  gave him a brief about PingER project, aim, objectives, and its installation requirements.  He is interested to setup a PingER monitoring node at his site. Adib sent another email to introduce Chaisit to Dr. Les and hopefully, Les has followed up with an email on 8/21/2016 with an invitation and information on how to set up the monitor. Adib  will follow  up.

• Adib has written a case study on the Internet performance in ASEAN countries and its implication on the Socio-Economic Indexes.

  Following Prof. Bebo suggestion to find  one of the IEEE journals that have good exposure in Asia. Adib used IEEE Publication Recommender tool and  got a long list of journals within our article scope. However. They have page limits or # words limit. We do not have many choices; here is a short list of most potential ones:
   
  IEEE Technology and Society Magazine: “the scope of IEEE Technology and Society Magazine overlaps most IEEE Publications since we are concerned with the social implications of technology across the wide range of IEEE fields of interests.” http://ieeexplore.ieee.org/xpl/aboutJournal.jsp?punumber=44
  Editor-in-Chief
  Katina Michael 
  School of Information Systems and Technology 
  University of Wollongong
  NSW 2522 Australia 
   
  IEEE Communications Surveys & Tutorials: http://ieeexplore.ieee.org/xpl/aboutJournal.jsp?punumber=9739
  Editor-in-Chief 
  Ekram Hossain, Ph.D., P.Eng.
  Professor
  Department of Electrical and Computer Engineering
  University of Manitoba

UNIMAS

UAF (Saqib)

There are 4 students:  Aqsa Hameed, Saba Muzamil, Tahseen and Sara Masood. T

• Aqsa has completed her research work on "visualization on pingER data" and now working on to publish a conference paper. Here are few details of the research work.

  • The query results can be exported as CSV file. I use the CSV file of Query results from Impala to draw Line and Bar charts by using Google API.

  • She has created a Data warehouse on pingER data. First we transform the pingER text files into CSV files. Then i upload these CSV files on HDFS and populate Impala Tables and queries.

  • Line and Bar charts are created on a webpage running or executed by localhost server. it can be updated as the query results varies.

• Aqsa and Saba are working together. Their goal is focusing on visualization of PingER historical data using warehouse.  The idea is to develop a warehouse in UAF university and make it publicly available. 

• Aqsa has put together an  abstract of a conference paper and submitted to "The 3rd IEEE/ACM International Conference on Big Data Science, Engineering and Applications (BDSEA 2016)" (http://computing.derby.ac.uk/bdcat2016/).  "Applying Big Data Warehousing and Visualization Techniques on pingER Data",  Aqsa Hameed, Dr. Saqib Ali, Dr. Les Cottrell and Bebo White, submitted to BDSEA 2016. Authors can access it via:   https://easychair.org/conferences/?conf=bdsea2016. Aqsa updated the paper and submitted, the last date for submit is 31st August, 2015. The conference is 6-9 Shanghai.

• Sara Masood - See PingER on Android above

• Saqib will proceed to install Pinger in UAF Pakistan 6/22/2016.There used to be an MA at UAF Les sent the information to Saqib. He has the userid and password, The IP address will change

• Sara Masood - See PingER on Android above

• Saqib will proceed to install Pinger in UAF Pakistan 6/22/2016.There used to be an MA at UAF Les will send the information to Saqib. it is below (update):

  Code Block NODENAME: uaf.seecs.edu.pk IPADDRESS: 121.52.152.22 SITENAME: seecs.edu.pk NICKNAME: PK.UAF.SEECS.EDU.N1 FULLNAME: University of Agriculture, Faisalabad LOCATION: Faisalabad COUNTRY: Pakistan CONTINENT: South Asia LATANDLONG: 31.433741 73.070476 PROJECTTYPE: D PINGSERVER: http://uaf.seecs.edu.pk/cgi-bin/traceroute.pl?function=ping TRACESERVER: http://uaf.seecs.edu.pk/cgi-bin/traceroute.pl? DATASERVER: http://uaf.seecs.edu.pk/cgi-bin/ping_data.pl? URL: http://www.uaf.edu.pk CONTACTS: Ahsan Raza Sattar , COMMENTS: Add by Cottrell 11/5/2012. Host not working as a monitor and not pingable. There is another Monitor in faisalabad, so Disabled by Cottrell 6/26/2014.

MYREN

• pingersonar-usm.myren.net.my was restored to a working state August 4th.  pingersonat-utm.myren.net.my is having problems, email sent to Fitzi.

PingER at SLAC

Joao has provided a cronjob to automatically update the PingER hourly data onin tne FTP space. He has also provided for a client to get new data via the web. Needs documenting.

Also has a 4 node cluster with Cloudera manager for Hadoop, Next step are to get impala working for queries, Data is also accessible via jdbc. Requires SQL  but Joao will provide an application.

He has been scrubbing date looking at the space and time saved. Looking at nanocubes to study visualization, The hope is to speed up the response time. There have been meeting with various professors in Brazil. He plans to continue work when he returns to Brazil. We need to ensure his account at SLAC is preserved.

 Working on the following hosts to be able to gather data

NUST

8/20/2016 Given up after no responses for several months

UM

8/20/2016 Given up.

Next Meeting

Next meeting:  Wednesday Aug 24 9:00pm Pacific Standard Time, Thursday Aug 25, 2016  9:00am Pakistan time, Thursday Aug 25  2016 12:00noon Malaysian time, Thursday Aug 25 2016 02:00am Rio Standard Time.  

Old Items

NUST (Moved here 8/20/2016)

NUST

• Currently it does not respond to ping pingerqta.pern.edu.pk

  • 271cottrell@pinger:~$ping pingerqta.pern.edu.pk
    ping: unknown host pingerqta.pern.edu.pk

  • [cottrell@pinger ~]$ nslookup pingerqta.pern.edu.pk

    272cottrell@pinger:~$nslookup pingerqta.pern.edu.pk
    Server: 134.79.111.111
    Address: 134.79.111.111#53

    ** server can't find pingerqta.pern.edu.pk: NXDOMAIN

• 274cottrell@pinger:~$ping 121.52.157.157
  PING 121.52.157.157 (121.52.157.157) 56(84) bytes of data.
  ^C
  --- 121.52.157.157 ping statistics ---
  6 packets transmitted, 0 received, 100% packet loss, time 5625ms

• http://121.52.157.148, responds with the default Apache web page
• http://121.52.157.148//cgi-bin/ping_data.pl? responds (albeit very slowly) with Get Ping Data from sharedw228.b2bhosting.net  Also there is data. 
  • This is a funny hostname. It comes from the system response to the perl commands:

    • use Net::Domain qw(hostname hostfqdn hostdomain);
      my $hostname = hostfqdn();

• The following needs to reflect the new IP address at 121.52.157.148. It  It is very easy to change the IP address once the Measurement Agent is up and running and responding, in fact the PingER meta data at SLAC was changed in February 2015. However the DNS still points to:

  • Output from: /bin/cat /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 localhost.localdomain localhost 121.52.157.157 pingerqta.pern.edu.pk

   

Also asked for an update on the following 7/30/2016: 

As of 8/19/2016 the following hosts are down and not responsive for >= 1 month. Anas Abrar reports the nodes were contacted many times for identifying their issues. i.e turn on their pinGER Computers but never responded well. Some have already been Disabled, (strikethroughs as proposed at the 6/22/2016 meeting and hearing nothing from Pakistan following the meeting), I will disable the others if I hear nothing. 

• aup.seecs.edu.pk^ #Anas Abrar reports: AUP said that they will look intothe issue in a while everytime I ask them or give them the reminder. Does not ping. No data sinve Nov 2015, Disabled 8/19/2016. Renabled at at request of Abrar 8/21/2016
• cae.seecs.edu.pk^ #Does not ping, No data since Jan 2016, Disabled 8/19/2016, Re-enabled at request of Abrar 8/21/2016.
• maggie1.seecs.edu.pk^ # Ping responds with Time to live exceeded, No data since March 2016, , Disabled 8/19/2016, re-enabled at request of Abrar 8/21/2016
• maggie2.seecs.edu.pk^ #Does not ping. No data since March 2016, Disabled 8/19/2016, re-enabled at request of Abrar 8/21/2016.
• namal.seecs.edu.pk^ #Does not ping, no data since June 2016
• npm.neduet.edu.pk* # Not pingable I no longer gather data from it so state unknown 7/30/2016, no data since Aug 2015, Disabled 6/19/2016.
• pinger.comsats.edu.pl^ #Does not ping, no data since June 2016.
• pinger.iba-suk.edu.pk(30)^ # Pings, ping_data.pl gives  gives page not found from Sukkar Instituute of Business Administration, disabled 8/8/2016 no data for 12 months, disabled 8/8/2016 no data for 12 months. Re-enabled by Cottrell at request of Abrar 8/21/2016.
• pinger.isra.edu.pk^ # Not pingable, No longer gather data from it so state is unknown 7/30/2016, Disabled 8/19/2016, re-enabled at request of Abrar 8/21/2016.

...