Page History

...

• Membership of pinger-my in https://groups.google.com

Bebo

Topher is here for a few days. He and Bebo discussed whether it would be better to use native Android tools rather than loading the perl interpreter and using it.

PingER for Android

Amity - Java approach (A. Sai Sabitha and Shivnarayan Rajappa)

1. They are using the native java tools, they are not running the pinger2.pl <http://pinger2.pl>  script on android since the native java tools have the following advantages
   1. easier for user, 
   2. no need for prior installation of any software, e.g.
   Pro: easier for user, no need to
   1. load perl interpreter which may require missing skills, especially for a non technical user
2. Con: the android version has to mimic pinger2.pl with all its logs, careful checking and specific format

To a large extent it depend on how we plan to use this. If the phones are just MAs in a fixed location then 1 is easier and probably sufficient.  If this is intended to grow into a mobile application for general use then it needs to be 2.

We agreed that Sara Masood at UUM should continue pursuing using the standard pinger2.pl version running under the perl interpreter while Amity will try and put together a native android version.

We also briefly discussed how to get the data from the phone MA to the archive. The current method ping_data.pl requires a public IP address for the phone which mnay not exist if its is mobile. Getting the MA to put the data to the archive may raise some security issue for the archiver.  We did ot come to a conclusion

UUM

From Adib:

• Adib asked a student (Jaafrau)  to explore  “Creative visualization of PingER data, including rich interaction;”.  He has come up with a good design, yet the development part needs a lot of work. Adib will ask him to upload his interface and share the link.

• Adib has a student from Thailand who is working with Adib at UUM who  may be interested in installaing a PIngER MA in Thailand. Adib will talk next week after exams to see if can get permissions. 8/3/2016: No update yet, as they have a long holiday in Thailand. Will try to contact him.

• Adib has written a case study on the Internet performance in ASEAN countries and its implication on the Socio-Economic Indexes. It has been shared with Dr.Les and Prof. Bebo  who have commented. We are looking for where to publish.

UNIMAS

pinger.unimas.my is working again as of ~ June 18th, also the traceroute server is working.

UAF (Saqib)

There are 4 students:  Aqsa Hameed, Saba Muzamil, Tahseen and Sara Masood. T

• Aqsa has completed her research work on "visualization on pingER data" and now working on to publish a conference paper. Here are few details of the research work.

  • The query results can be exported as CSV file. I use the CSV file of Query results from Impala to draw Line and Bar charts by using Google API.

  • She has created a Data warehouse on pingER data. First we transform the pingER text files into CSV files. Then i upload these CSV files on HDFS and populate Impala Tables and queries.

  • Line and Bar charts are created on a webpage running or executed by localhost server. it can be updated as the query results varies.

• Aqsa and Saba are working together. Their goal is focusing on visualization of PingER historical data using warehouse.  The idea is to develop a warehouse in UAF university and make it publicly available. 

• Aqsa has put together an  abstract of a conference paper and submitted to "The 3rd IEEE/ACM International Conference on Big Data Science, Engineering and Applications (BDSEA 2016)" (http://computing.derby.ac.uk/bdcat2016/).  "Applying Big Data Warehousing and Visualization Techniques on pingER Data",  Aqsa Hameed, Dr. Saqib Ali, Dr. Les Cottrell and Bebo White, submitted to BDSEA 2016. Authors can access it via:   https://easychair.org/conferences/?conf=bdsea2016  

1. 1. doesn't need a rooted phone
   2. only the apk needs to be installed to run

2. They have now updated the underlying ping command to ping -n -c 10 -w 30 -i 1 -s 100 www.google.com <http://www.google.com>  this now allows them to collect 10 pings with 30 pings being the maximum limit. The attached text file (data.rtf) shows a sample situation wherein 11 packets are sent and 10 are received where packet 3 was lost. This was not possible in the previous implementation.

3. They have also tested all the other edge cases and use regex to validate the ping data received before writing it to the text file. If we get an unknown host it fails our regex check therefore is not written into the text file. 

4. Next steps:

   1. Extend extend the target list by getting the Beacon list from SLAC. It is at http://www-iepm.slac.stanford.edu/pinger/pinger.xml on a regular basis and updating the <BeaconList> section at their site. This was part of pinger2.pl. 

   2. Also they will need a utility to clean out old recorded data (say older than 3 months), since it will be gathered from SLAC (via the proxy) and eventually they may run out memory on the Android.

UAF Saqib and Sara Masood

1. They are using the original pinger2.pl script.
   1. This guarantees a better, more complete (logs, checks, updating the Beacon list etc.) match to the existing MAs. 
2. There is a tutorial on the android version. 

Discussion

To a large extent it depend on how we plan to use this.

• If the phones are just MAs in a fixed location then simply porting pinger2.pl is easier and probably sufficient.  
• If this is intended to grow into a mobile application for general use then it needs to be the Java implementation.

A next step is to get the data from the phone MA to the archive at SLAC. The current method ping_data.pl requires a public IP address for the phone which may not exist if its is mobile. Getting the MA to put the data to the archive may raise some security issue for the archiver.

UUM

From Adib:

• Adib asked a student (Jaafrau)  to explore  “Creative visualization of PingER data, including rich interaction;”.  He has come up with a good design, yet the development part needs a lot of work. Adib will ask him to upload his interface and share the link.

• Adib has a student from Thailand who is working with Adib at UUM who  may be interested in installaing a PIngER MA in Thailand. Adib will talk next week after exams to see if can get permissions. 8/3/2016: No update yet, as they have a long holiday in Thailand. Will try to contact him.

• Adib has written a case study on the Internet performance in ASEAN countries and its implication on the Socio-Economic Indexes. It has been shared with Dr.Les and Prof. Bebo  who have commented. We are looking for where to publish.

UNIMAS

UAF (Saqib)

There are 4 students:  Aqsa Hameed, Saba Muzamil, Tahseen and Sara Masood. T

• Aqsa has completed her research work on "visualization on pingER data" and now working on to publish a conference paper. Here are few details of the research work.

  • The query results can be exported as CSV file. I use the CSV file of Query results from Impala to draw Line and Bar charts by using Google API.

  • She has created a Data warehouse on pingER data. First we transform the pingER text files into CSV files. Then i upload these CSV files on HDFS and populate Impala Tables and queries.

  • Line and Bar charts are created on a webpage running or executed by localhost server. it can be updated as the query results varies.

• Aqsa and Saba are working together. Their goal is focusing on visualization of PingER historical data using warehouse.  The idea is to develop a warehouse in UAF university and make it publicly available. 

• Aqsa has put together an  abstract of a conference paper and submitted to "The 3rd IEEE/ACM International Conference on Big Data Science, Engineering and Applications (BDSEA 2016)" (http://computing.derby.ac.uk/bdcat2016/).  "Applying Big Data Warehousing and Visualization Techniques on pingER Data",  Aqsa Hameed, Dr. Saqib Ali, Dr. Les Cottrell and Bebo White, submitted to BDSEA 2016. Authors can access it via:   https://easychair.org/conferences/?conf=bdsea2016  

• Sara Masood - See PingER on Android aboveSara Masood - pingER  monitoring host on android . 
• She is using perl-android-apk Interpreter to run perl on android. It includes execution of 3 perl scripts:
  • getdata.pl, ping_data.pl, pinger2.pl

• First step is to install pre-requisite i.e. lynx, perl, XML::Simple, make etc. However, she was having permission denied issue when she executes "make install” command at path usr/local/bin because it’s a read only file system.

  • Perl-android-interpreter application was depreciated so install perl package using GNURoot Debian Application

  •  "Make install" issue is resolved too it create directorys and files required by pinger2 in usr/local/share/pinger

  •  But now when i  execute pinger2.pl <http://pinger2.pl/>  (that will ping host and start getting data) using IP address its generating two errors image is attached. IP address is also updated in pinger.xml

    • First error is," cannot exec DnsV4Cmd.pl, file not found", but DnsV4Cmd.pl  is in PingER directory with execute permission.

    • Second error, "SrcIP could not be determined for DNS 203.124.57.137. Without the results produced by PINGER2 is not usable.".
    • Les suspects the second error is result of the 1st error. maybe using the perl -d debugger would assist.

• Step 2 Is to execute ping _data and cgi-bin, traceroute.pl <http://traceroute.pl/> 

• Step 3: To execute pinger2.pl <http://pinger2.pl/>  that will start gathering data

Step 4: provide step by step document with screenshots on how to set up perl, intslla pinger and so on for Android.

• Saqib will proceed to install Pinger in UAF Pakistan 6/22/2016.There used to be an MA at UAF Les will send the information to Saqib. it is below (update):

  Code Block

  NODENAME: uaf.seecs.edu.pk IPADDRESS: 121.52.152.22 SITENAME: seecs.edu.pk NICKNAME: PK.UAF.SEECS.EDU.N1 FULLNAME: University of Agriculture, Faisalabad LOCATION: Faisalabad COUNTRY: Pakistan CONTINENT: South Asia LATANDLONG: 31.433741 73.070476 PROJECTTYPE: D PINGSERVER: http://uaf.seecs.edu.pk/cgi-bin/traceroute.pl?function=ping D TRACESERVERPINGSERVER: http://uaf.seecs.edu.pk/cgi-bin/traceroute.pl?function=ping DATASERVERTRACESERVER: http://uaf.seecs.edu.pk/cgi-bin/ping_datatraceroute.pl? URL: http://www.uaf.edu.pk CONTACTS: Ahsan Raza Sattar , COMMENTS: Add by Cottrell 11/5/2012. Host not working as a monitor and not pingable. There is another Monitor in faisalabad, so Disabled by Cottrell 6/26/2014.

UTM 

Saqib's old supervisor  agreed to appoint a master student to take of PingER in UTM. Saqib has emailed  3/9/2016, no progress 4/6/2016, no progress 5/18/2016. 

1.     Currently, Pinger server is located in the faculty server room. Recently, faculty has closed the Server room. Now we have to move it to the University Central Server Room. For this we need support from Prof Johari and Prof Abdul Hanan.

2.     For the M.Sc. student in UTM we have to request again to Prof Hanan and Prof Asri and we need support from Prof Johari.

...

• DATASERVER: http://uaf.seecs.edu.pk/cgi-bin/ping_data.pl? URL: http://www.uaf.edu.pk CONTACTS: Ahsan Raza Sattar , COMMENTS: Add by Cottrell 11/5/2012. Host not working as a monitor and not pingable. There is another Monitor in faisalabad, so Disabled by Cottrell 6/26/2014.

UM

MYREN

• pingersonar-usm.myren.net.my is down since June 18th, email sent to Fitzi 8/1/2016.

...