...
Hassaan Khaliq, Muhammad Anas Abrar+ (SEECS); Saqib?, Aqsa (UAF); Johari?, Adnan Khan (UNIMAS); Badrul, Ridzuan, Ibrahim (UM); (UTM); Adib?, Fatima (UUM); Fizi Jalil (MYREN); Les+, Bebo, Joao +(SLAC).
+ Confirmed attendance
...
? Individual emails sent
Actual attendees:
Aib, Saqib, Joao, Les, Bebo
Administration
...
- They are using the native java tools, they are not running the pinger2.pl <http://pinger2.pl> script on android since the native java tools have the following advantages
- easier for user,
- no need for prior installation of any software, e.g. load perl interpreter which may require missing skills, especially for a non technical user
- doesn't need a rooted phone
- only the apk needs to be installed to run
They have now updated the underlying ping command to ping -n -c 10 -w 30 -i 1 -s 100 www.google.com <http://www.google.com> this now allows them to collect 10 pings with 30 pings being the maximum limit. The attached text file (data.rtf) shows a sample situation wherein 11 packets are sent and 10 are received where packet 3 was lost. This was not possible in the previous implementation.
There is a bug in the sequence number reported, they are looking at.
They have also tested all the other edge cases and use regex to validate the ping data received before writing it to the text file. If they get an unknown host it fails the regex check therefore is not written into the text file.
Next steps:
Extend extend the Extend the target list by getting the Beacon list from SLAC. It is at http://www-iepm.slac.stanford.edu/pinger/pinger.xml on a regular basis and updating the <BeaconList> section at their site. This was part of pinger2.pl.
- Also they will need a utility to clean out old recorded data (say older than 3 months), since it will be gathered from SLAC (via the proxy) and eventually they may run out memory on the Android.
...
- They are using the original pinger2.pl script.
- This guarantees a better, more complete (logs, checks, updating the Beacon list etc.) match to the existing MAs.
- There is a tutorial on the android version.
- They are working on getting a public fixed IP
Discussion
To a large extent it depend on how we plan to use this.
...
Adib is blessed with a baby girl (Maryam) on Sunday 18, August. Currently on parental leave, he will try to attend.
Adib enquired about the status of his request to visit SLAC. After the meeting Les followed up with SLAC's international services, they said requests are taking 3-9 months to process.
Adib asked a student (Jaafrau) to explore “Creative visualization of PingER data, including rich interaction;”. He has come up with a good design, yet the development part needs a lot of work. Adib will ask him to upload his interface and share the link. No update 8/24/2016
Adib has another student starting in September. Adib will look at directing him to PingER.
Adib had a a student from Thailand who is working with Adib at UUM who may be interested in installaing a PIngER MA in Thailand. Adib had a meeting with Mr. Chaisit Choosong <chaisitc@gmail.com>, from Rajamangala University of Technology Srivijaya last week. Adib gave him a brief about PingER project, aim, objectives, and its installation requirements. He is interested to setup a PingER monitoring node at his site. Adib sent another email to introduce Chaisit to Dr. Les and hopefully, Les has followed up with an email on 8/21/2016 with an invitation and information on how to set up the monitor. Adib will follow up.
Adib has written a case study on the Internet performance in ASEAN countries and its implication on the Socio-Economic Indexes.
Following Prof. Bebo suggestion to find one of the IEEE journals that have good exposure in Asia. Adib used IEEE Publication Recommender tool and got a long list of journals within our article scope. However. They have page limits or # words limit. We do not have many choices; here is a short list of most potential ones:IEEE Technology and Society Magazine: “the scope of IEEE Technology and Society Magazine overlaps most IEEE Publications since we are concerned with the social implications of technology across the wide range of IEEE fields of interests.” http://ieeexplore.ieee.org/xpl/aboutJournal.jsp?punumber=44Editor-in-Chief
Katina Michael
School of Information Systems and Technology
University of Wollongong
NSW 2522 AustraliaIEEE Communications Surveys & Tutorials: http://ieeexplore.ieee.org/xpl/aboutJournal.jsp?punumber=9739Editor-in-Chief
Ekram Hossain, Ph.D., P.Eng.
Professor
Department of Electrical and Computer Engineering
University of Manitoba
UNIMAS
...
Aqsa has completed her research work on "visualization on pingER data" and now working on to publish a conference paper. Here are few details of the research work.
The query results can be exported as CSV file. I use the CSV file of Query results from Impala to draw Line and Bar charts by using Google API.
She has created a Data warehouse on pingER data. First we transform the pingER text files into CSV files. Then i upload these CSV files on HDFS and populate Impala Tables and queries.
- Line and Bar charts are created on a webpage running or executed by localhost server. it can be updated as the query results varies.
Aqsa and Saba are working together. Their goal is focusing on visualization of PingER historical data using warehouse. The idea is to develop a warehouse in UAF university and make it publicly available.
Aqsa has put together an abstract of a conference paper and submitted to "The 3rd IEEE/ACM International Conference on Big Data Science, Engineering and Applications (BDSEA 2016)" (http://computing.derby.ac.uk/bdcat2016/). "Applying Big Data Warehousing and Visualization Techniques on pingER Data", Aqsa Hameed, Dr. Saqib Ali, Dr. Les Cottrell and Bebo White, submitted to BDSEA 2016. Authors can access it via: https://easychair.org/conferences/?conf=bdsea2016 . Aqsa updated the paper and submitted, the last date for submit is 31st August, 2015. The conference is 6-9 Shanghai.
- Sara Masood - See PingER on Android above
Saqib will proceed to install Pinger in UAF Pakistan 6/22/2016.There used to be an MA at UAF Les will send sent the information to Saqib. it is below (Is there an update?):
Code Block NODENAME: uaf.seecs.edu.pk IPADDRESS: 121.52.152.22 SITENAME: seecs.edu.pk NICKNAME: PK.UAF.SEECS.EDU.N1 FULLNAME: University of Agriculture, Faisalabad LOCATION: Faisalabad COUNTRY: Pakistan CONTINENT: South Asia LATANDLONG: 31.433741 73.070476 PROJECTTYPE: D PINGSERVER: http://uaf.seecs.edu.pk/cgi-bin/traceroute.pl?function=ping TRACESERVER: http://uaf.seecs.edu.pk/cgi-bin/traceroute.pl? DATASERVER: http://uaf.seecs.edu.pk/cgi-bin/ping_data.pl? URL: http://www.uaf.edu.pk CONTACTS: Ahsan Raza Sattar , COMMENTS: Add by Cottrell 11/5/2012. Host not working as a monitor and not pingable. There is another Monitor in faisalabad, so Disabled by Cottrell 6/26/2014.
MYREN
He has the userid and password, The IP address will change
MYREN
pingersonar-usm.myren.netpingersonar-usm.myren.net.my was restored to a working state August 4th. pingersonat-utm.myren.net.my is having problems, email sent to Fitzi.
PingER at SLAC
Joao has provided a cronjob to automatically update the PingER hourly data onin tne FTP space. He has also provided for a client to get new data via the web. Needs documenting.
Also has a 4 node cluster with Cloudera manager for Hadoop, Next step are to get impala working for queriesHadoop, Data is also accessible via jdbc. Requires SQL but Joao will provide an application.
He has been scrubbing date looking at the space and time saved. Looking at nanocubes to study visualization, The hope is to speed up the response time. There have been meeting with various professors in Brazil. He plans to continue work when he returns to Brazil. We need to ensure his account at SLAC is preserved.
Working on the following hosts to be able to gather data
Host | State | last seen | Status |
---|---|---|---|
www.univ-ouaga.bf | Unreliable, No data since June 20th. | June 2016 | Does not ping |
www.ihep.ac.cn | Email 8/3/2016, ping_data.pl works but there is no data, fixed 8/7/2016 | July 28th, 2016 | ping_data.pl works but there is no data |
perfsonar-unimas.myren.net.my | No data August 2016, pings., Emailed Fitzi 8/20/2016 | 7/31/2016 | Not pingable |
pinger-sonar.utm.myren.my | Fixed 8/19/2016, emailed Fitzi 8/19/2016 | 8/9/2016 | Fixed |
pinger.unimas.my | No data since 8/6/2016, emailed Johari 8/20/2016. | 8/6/2016 | Not pingable |
...
/2016 | Fixed | ||
pinger.unimas.my | No data since 8/6/2016, emailed Johari 8/20/2016. | 8/6/2016 | Not pingable |
NUST
- Currently it does not respond to ping pingerqta.pern.edu.pk
271cottrell@pinger:~$ping pingerqta.pern.edu.pk
ping: unknown host pingerqta.pern.edu.pk[cottrell@pinger ~]$ nslookup pingerqta.pern.edu.pk
272cottrell@pinger:~$nslookup pingerqta.pern.edu.pk
Server: 134.79.111.111
Address: 134.79.111.111#53** server can't find pingerqta.pern.edu.pk: NXDOMAIN
274cottrell@pinger:~$ping 121.52.157.157
PING 121.52.157.157 (121.52.157.157) 56(84) bytes of data.
^C
--- 121.52.157.157 ping statistics ---
6 packets transmitted, 0 received, 100% packet loss, time 5625ms- http://121.52.157.148, responds with the default Apache web page
- http://121.52.157.148//cgi-bin/ping_data.pl? responds (albeit very slowly) with Get Ping Data from sharedw228.b2bhosting.net Also there is data.
- This is a funny hostname. It comes from the system response to the perl commands:
use Net::Domain qw(hostname hostfqdn hostdomain);
my $hostname = hostfqdn();
- This is a funny hostname. It comes from the system response to the perl commands:
- The following needs to reflect the new IP address at 121.52.157.148. It is very easy to change the IP address once the Measurement Agent is up and running and responding, in fact the PingER meta data at SLAC was changed in February 2015. However the DNS still points to:
Output from: /bin/cat /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 localhost.localdomain localhost 121.52.157.157 pingerqta.pern.edu.pk
Also asked for an update on the following 7/30/2016:
As of 8/19/2016 the following hosts are down and not responsive for >= 1 month. Anas Abrar reports the nodes were contacted many times for identifying their issues. i.e turn on their pinGER Computers but never responded well. Some have already been Disabled, (strikethroughs as proposed at the 6/22/2016 meeting and hearing nothing from Pakistan following the meeting), I will disable the others if I hear nothing.
- aup.seecs.edu.pk^ #Anas Abrar reports: AUP said that they will look intothe issue in a while everytime I ask them or give them the reminder. Does not ping. No data sinve Nov 2015, Disabled 8/19/2016. Renabled at at request of Abrar 8/21/2016
- cae.seecs.edu.pk^ #Does not ping, No data since Jan 2016, Disabled 8/19/2016, Re-enabled at request of Abrar 8/21/2016.
- maggie1.seecs.edu.pk^ # Ping responds with Time to live exceeded, No data since March 2016, , Disabled 8/19/2016, re-enabled at request of Abrar 8/21/2016
- maggie2.seecs.edu.pk^ #Does not ping. No data since March 2016, Disabled 8/19/2016, re-enabled at request of Abrar 8/21/2016.
- namal.seecs.edu.pk^ #Does not ping, no data since June 2016
npm.neduet.edu.pk* # Not pingable I no longer gather data from it so state unknown 7/30/2016, no data since Aug 2015, Disabled 6/19/2016.- pinger.comsats.edu.pl^ #Does not ping, no data since June 2016.
- pinger.iba-suk.edu.pk(30)^ # Pings, ping_data.pl gives page not found from Sukkar Instituute of Business Administration, disabled 8/8/2016 no data for 12 months. Re-enabled by Cottrell at request of Abrar 8/21/2016.
- pinger.isra.edu.pk^ # Not pingable, No longer gather data from it so state is unknown 7/30/2016, Disabled 8/19/2016, re-enabled at request of Abrar 8/21/2016.
...
...
- pinger.isra.edu.pk # http://pinger.isra.edu.pk/cgi-bin/ping_data.pl works but the xml config file contains no beacons. See FAQ at http://www-iepm.slac.stanford.edu/pinger/faq.html#nodata on how to fix
The following 8 .pk hosts are still working:
- comsatsswl.seecs.edu.pk
- monitor.seecs.edu.pk
- nukhimain.seecs.edu.pk
- pinger.aiou.edu.pk
- pinger.nwfpuet.edu.pk
- pinger-ncp.ncp.edu.pk
- pinger.vu.edu.pk
* This host was noted at the 3/9/2016 meeting as being down for the last 30 days.
+ Not seen in June 2016
^ Not seen in July 2016
Les proposes 7/30/2016):
- Give up (i.e. remove from Monitoring node table by setting Projecttype to D (for Disabled)) on non-responsive hosts not working for 2 months.
- I would not oppose extending this to all non-responsive, non-working hosts.
- Focus on the close to working hosts
...
Next Meeting
Next meeting: Wednesday Aug 24 Sep 21 9:00pm Pacific Standard Time, Thursday Aug 25Sep 22, 2016 9:00am Pakistan time, Thursday Aug 25 Sep 22 2016 12:00noon Malaysian time, Thursday Aug 25 Sep 22 2016 02:00am Rio Standard Time.
...