Versions Compared

Old Version 1

changes.mady.by.user Les Cottrell

Saved on

compared with

New Version 2

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Wajahat Hussain+, ajmal.farooq@seecs.edu.pk, Muhammad Anas Abrar (SEECS); Saqib, Aqsa (UAF); Johari, Adnan Khan (UNIMAS);  Badrul,  Ridzuan, Ibrahim (UM); (UTM); Adib, Fatima (UUM); Fizi Jalil (MYREN);  Dr Dr. Charnsak Srisawatsakul, LesLes+, Bebo-

+ Confirmed attendance

...

Amity

  • Les provided input to a paper on the impact on PingER of the  Vardha cyclone In India

    Manuscript titled - Clustering Analysis of PingER Network Data for Vardha Cyclone has been PEER REVIEWED and ACCEPTED for publication in the Confluence-2018:8th International Conference: on the theme “Cloud Computing, Data Science & Engineering”  to be held on 11th - 12th January 2018 at Amity University Uttar Pradesh, Noida, India. 

  • Amity provided progress/code/screen shots of the pinger android implementation attached. We have also attached the executable file.
  • Their PingER MA system has crashed and they are reinstalling the project.

    • They have understood the procedure and will be implementing the steps as soon as their major exams get over (18th of December).   Sent reminder 1/8/2018/

Bebo

Looking into moving PingER to a "block chain" database good for distribution of data. Hot topic. Monitoring sites would then be able to write to a distributed ledger. This would change the architecture to a more peer to peer architecture. Help with continuity of PingER. Might be compelling.  See Block Chain in Future PingER Projects. Saqib is interested.  Update?  

Wajahat mentions "Bebo mentioned things related to bitcoins.  One of Wajahat's colleagues (Dr Taha Ali) is working in this area. He will be giving a course on Block Chain to MS students at NUST next quarter. He wants to know how we are planning to use bitcoins for pinger data. A little detail will be helpful."  

  • Bebo responded: "The discussion dealt with the possible use of block chain technology with PingER independent of bitcoin. However, an understanding of bitcoin applications and how they interact with a blockchain would probably be useful." 

  • Bebo would be interested in the syllabus for the Block Chain course. Wjahat provided Taha's email address (taha.ali@seecs.edu.pk) and will put Taha in contact with Bebo.

Bebo needs some closure re: his associate status before he is willing to devote much time to PingER. Les is working with HR to clarify and it appears to be resolved, he will be an Affiliate and Dr Umar Kalim will renew it yearly.

Thailand

We now have two MAs in Thailand: pinger.cs.ubru.ac.th (in NE Thailand) and pinger.rmutsv.ac.th (in Bangkok). The former has just been added. Both are working, SLAC is gathering data and the analysis is now available.    Dr. Charnsak fixed the inbound firewall rule to enable pings.

Charnsak is interested in using the PingER data. It could be used for a case study on Internet performance within Thailand, and from say the US to Thailand. Also a comparison of the performance of the two MAs in Thailand would be interesting.  A list of papers and presentations related to PingER is available. Some case studies are seen below:

...

    • The paper was not accepted :( despite some positive reviews, two reviewers accept the paper and only one reject it. Anyway, I have been working on a more rigorous analysis to resolve the correlation/causation doubt (to answer David comments) and the new analysis is ready.  Adib needs a few days to update our paper with the new analysis then will share with us to comment and advise.
      • He has been working with a statistician to identify correlations between Internet performance (IP) and ICT Development Index (IDI), Human Development Index (HDI), Fertility, GDP, and the Happy Planet Index (HPI).
      • They then look at the normality of the data. All except GDP pass the normality test. For GDP they use Spearman's non-parametric correlation, while Pearson Correlation is used for the rest.
      • There are strong positive correlations for IDI and HDI, a strong negative correlation between Fertility rate and a moderate correlation for HPI. GDP also has a  moderate correlation
      • It then looks at the cause-effect relationship using regression.
      • Finally, it comes up with a model of the form:

        IP = 2724.288 + 0.008GDP + 275.904 IDI -3238.298 HDI – 220.264 – 8.084HPI

      • And they test its predictive behavior using various statistical tests. It looks very good.

      • Adib is finalizing the paper and hopes to complete by the end of the week 9/25/2017. Progress?

  • There is  was  a problem pinging the MA pinger.uum.edu.my. Update 12/4/2017 It is no working as promised.

  • Adib has sent PingER MA invitation to Nigerian person who used to be a student at UUM. He is awaiting a response.

  • Adib, Bebo, Les met with Southampton Web observatory person. There seemed to be enthusiasm. Adib was going to send some materials to Southampton. The person at Southampton gave us some links.

...

Wajahat is trying to contact the sick Pakistani MA nodes but the current week is exam week. He will give detailed response next week. So Les has paused Disabling (see below). We can always restore an MA for testing or when it is once again reliable.  Wajahat proposes to get  alist a list of the new Universities in Pakistan and contact them encouraging them to joing joining participate in PingER and set up MA. He will start next week when the students are available.

There is an upcoming grant call for projects between Pakistan and the US. Topics may be focused on cybersecurity, health and education. It has not been announced yet. Wjahat will get the details and share them with the team as soon as they are available. It is interesting since getting a US partner appears to be a roadblock for many potential Pakistani responders. However, the topics may not be very related to PingER. For cyber the main things we could think of were: punching holes in firewalls to allow pings, how to misuse ping (e.g. ping-of-death, or using anomalous ping packets to deduce the OS etc. flood pings for DOS), host can respond to ping but applications do not work.  Fear of misuse of pings can result in the system administrator, network administrator or cyber security blocking pings. Possibilty Possibility might be a study of what fraction of say working www/dns etc. apps (i.e. checking if a host responds to the relevant port) do not respond to pings.  This could be by application, by country or by region etc.  Also how to protect a remote pinger traceroute or server from being used in DOS attacks.

 
We were unable to gather data from:
  • aup.seecs.edu.pk  not pingable as of March 6th, 2017.   host is pingable, Wajahat still trying, not given up. Still down 4/15/2017, 7/3/2017, 8/11/2017, 9/16/2017 (does not ping), 1/8/2018 (pings). Not responding. Contacted and they will fix the problem soon.10/24/2017. Should we Disable?
  • cae.seecs.edu.pk working again as of 3/6/2017. Down since March 17, 2017. Down 7/3/2017, Down 8/11/2017 did not ping, 9/16/2017 pings but unable to gather any data. Reconfigured 9/19/2017. Intermittent access this month (10/24/2017). Worked for a day after configuring 11/28/2017. Worked Jan 1-5, no response Jan 6-7.
  • kinnaird.seecs.edu.pl pings but unable to gather data 8/11/2017, unable to ping, Contacted. 9/16/2017.  Unable to gather data. Contacted fix problem soon. 10/24/2017. Should we disable 11 Disabled 11/30/2017.
  • namal.seecs.edu.pk (host is not pingable). Institution unreachable from start, we are trying to locate the person in charge, fingers crossed (Wajahat 1/10/206). Working 2/1/2018, still working 3/20/2017. Down since April 1st 2017. Down 7/3/2017, 8/11/2017. 9/16/2016 pings unable to gather data. Contact person missing. No data 10/24/2017. Unable to access this node. Disabled 11/30/2017
  • nukimain.seecs.edu.pk down since March 24th, 2017. Down 7/3/2017, 8/11/2017,9/16/2017 unable to ping, still unable to ping or gather data. No contact information. 10/24/2017. Disabled 11/30/2017.
  • pinger-ncp.aiouncp.edu.pk  down since April 15th, down 73/2017, 8 pings but can't gather data 8/11/2017 . 9and 9/16/2017 unable to ping.  Not Interested.They are not interested, Disabled 10/24/2017.pinger-ncp.ncp.edu.pk pings but Contacted. Pings but can't gather data 8/11/2017 and 9/16/2017. Contacted. Pings but can't gather data 10/24/2017. Do we disable 11/30/2017? Stlll nothing 1/8/2018. 
  • pinger.vu.edu.pk down since May 22nd, down 7/3/2017. Problem with missing XML/Simple.pm missing. Unable to gather data, pings 8/11/2017 and 9/16/2017.  Reconfigured 9/19/2017.  No data to gather 10/24/2017, it pings OK, however there is no data in the 200 OK response to http://pinger.vu.edu.pk/cgi-bin/ping_data.pl? Port 80 is responding. http://pinger.vu.edu.pk/  takes you a front page for the Virtual University of Pakistan.The link to http://pinger.vu.edu.pk/cgi-bin/traceroute.pl?choice=yes works (a bit slow), however the link to Get PingER data (i.e. ping_data.pl) does not work. Person who started left, current people  do not respond. Do we Disable 11/30/2017? Still nothing 1/8/2018.

...

Saqib submitted a project in CERNET to monitor the performance of  IPv6 network using PingERv6. Hereceived He received the news that the is project is accepted with 100K RMB. Now he has 2 accepted propjets regarding PingER and total amount we have he has is near about 40K USD. Further, in his lab, three U1 servers are have already arrived through another  grant for research purpose. We can also use them for our PingER project.

...

PingER MA at GZHU is now accessible publicly and is successfully gathering data and incorporated in PingER. It would make a good beacon, however it was not pingable 7/16/2017, sent email. Saqib is trying to convince the IT department to open the ping. No success yet. Hopefully in next 2 weeks.  (9/26/2016). Still not pingable 10/24/2017. No success. However, requested to move PingER to dual stack subnet to ping Ipv6 address space. In coming week, then will see what we can ping. Update 12/4/2017?

PingER Project of 150K RMB is accepted by Guangzhou Postdoctoral Special Funds of China. Hopefully, in the coming month, I will get two 1U servers to install data repository in GU, hopefully next month

CERNET backbone is currently at 10Gbps will upgrade to 100Gbps in a couple of years. There are about 20 core nodes that run IPv6 and they will be extending to 50 core nodes.Saqib submitted a proposal to extend PingER to support IPv6 monitoring of the CERNET backbone  (deadline was 30 Sept 2017).

PingER has valuable historical data for the last 20 years.Many analysis and case studies have been carried using this data. A lot of information is available on the website. Saqib's idea is to publish the brief summary all these analysis through a survey paper covering the history and utilization of PingER data starting from 1998 to 2017. Saqib started on it, Les is providing assistance. Need your feedback on the idea of Measuring the Digital Development of the Countries using PingER data.          Is there something you want me to review some, e.g. some draft document on Measuring the Digital Development of the Countries using PingER data , or are you asking if it is a good idea to review and create such a document. If the latter I think this is a fascinating subject. Part of the challenge is the chicken and egg problems: i.e. is it network performance influencing advancement of the country, or is it the reverse that advanced countries can afford good networks.  My belief is it goes both ways. Also one needs to extend the analysis beyond just Africa else it’s kind of a repeat of Pinging Africa , R. Les Cottrell, IEEE Spectrum February 2013. Also see A Simple Tool for Measuring Digital Development , by R. Les Cottrell, IEEE Spectrum February 2013. This is derived from SLAC-PUB-15333. 

·       Also it may be related to Adib’s paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries that was submitted to IEEE and rejected.

Currently, no data is available on PingER on Android due to unavailability of the live IP address. No update 4/19/2017, 7/6/2017. Email sent to Sara Masood. No update 9/24/2017. Any update 10/24/2017. Update 12/4/2017?

PingER at SLAC

Working with Saqib to test pinger2.pl to make it work with IPv6 servers and targets. pinger2.pl seems to be fixed.

To assist Saqib who was trying to install PingER on CENTOS 6.8, I have asked for and have a CENTOS VM to test PingER etc on CentOS 7. I have sudo access. Many requirements were missing (e.g. ping and ping6, traceroute,wget, mail). Installed them using yum. Also installed Apache and started it. Now I am stuck installing XML::Simple on perl. Once I have that I will install PingER.  Meanwhile however, Saqib faced fewer issues on Centos 7 and installed PingER on it in VMware. Version 7 was not available in the Cloud. Therefore, he requested them to install Ubuntu 16 in the Cloud. Now PingER is running on a Ubuntu 16 in Cloud and left the Centos.

...

has valuable historical data for the last 20 years.Many analysis and case studies have been carried using this data. A lot of information is available on the website. Saqib's idea is to publish the brief summary all these analysis through a survey paper covering the history and utilization of PingER data starting from 1998 to 2017. Saqib started on it, Les is providing assistance. Need your feedback on the idea of Measuring the Digital Development of the Countries using PingER data.          Is there something you want me to review some, e.g. some draft document on Measuring the Digital Development of the Countries using PingER data , or are you asking if it is a good idea to review and create such a document. If the latter I think this is a fascinating subject. Part of the challenge is the chicken and egg problems: i.e. is it network performance influencing advancement of the country, or is it the reverse that advanced countries can afford good networks.  My belief is it goes both ways. Also one needs to extend the analysis beyond just Africa else it’s kind of a repeat of Pinging Africa , R. Les Cottrell, IEEE Spectrum February 2013. Also see A Simple Tool for Measuring Digital Development , by R. Les Cottrell, IEEE Spectrum February 2013. This is derived from SLAC-PUB-15333. 

·       Also it may be related to Adib’s paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries that was submitted to IEEE and rejected.

Currently, no data is available on PingER on Android due to unavailability of the live IP address. No update 4/19/2017, 7/6/2017. Email sent to Sara Masood. No update 9/24/2017. Any update 10/24/2017. Update 12/4/2017?

PingER at SLAC

Working with Saqib to test pinger2.pl to make it work with IPv6 servers and targets.

...

  • am able to test pinger2.pl MA code to ensure and understand how it works for IPv6.

...

...

...

  •   
  • A host to test against is ipv6.google.com (2607:f8b0:4007:800::200e).
  • pinger2.pl is fixed,
  • gathering of the data from others sites is fixed,
  • aggregation, analysis, and presentation modified and believed fixed but not tested. 
  • working on meta database to accept IPv6 addresses

:800::200e).Currently pinger2.pl works for either an IPv4 MA or an IPv6 MA, but not both at once. Thus Saqib has two MAs one for Ipv4 and one for IPv6. Looking at being able to make pinger2.pl work for both. This will enable migration, but will also require a new analysis workflow (the current analysis scripts are heavily based on IPv4 only).and presentation, e.g. the ability to select IPv4 or IPv6 measurements or both

Modified traceroute.pl to address some IPv6 issues Saqib identified. When done will announce Announced to perfSONAR team.

HostStatelast seenStatus
pinger.vu.edu.pkUnable to gather data missing XML/Simple.pm, email sent 6/28/2017, no response.May 22nd 
pinger.uum.edu.myUnable to gather data since July 17 2017, also does not ping by IP address, by name gives Name does not resolve. Sent Email 8/9/2017. Name does not resolve, address resolves to is.grid.uum.edu.myJuly 2017Does not ping
pinger.ictp.it Pings but nothing else. Emails sent June 6, 2017, June 28, 2017, August 9, 2017.Mar 9thDown
www.hepgrid.uerj.br

Due to a major issue with the cluster's electrical infrastructure we will have to shut down all machines, in order to preserve our hardware. The cause of the outage is still being investigated. Emails 11/21/2016, 8/9/2017. Given up. Disabled.

Sept 31, 2016Does not ping

Next Meeting

Next meeting:  Thursday January 11th  , February 22nd  9pm Pacific time, ; Friday January 12th , February 23rd, 2018  9:00am Pakistan time, Friday January 12th 2018 ; Friday, February 23rd 2018 12:00noon Malaysian and Guangzhou .time, ; and 11am Thailand time.

...

Old information

...