Versions Compared

Old Version 6

changes.mady.by.user Les Cottrell

Saved on

compared with

New Version 7

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Amity

  • Les proved provided input to a paper on the impact on PingEr PingER of the  Vardha cyclone In India
  • Amity provided  progress/code/screen shots of the pinger android implementation attached. We have also attached the executable file.
  • Their PingER MA system has crashed and they are reinstalling the project.

UUM

  • The paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries to IEEE Access.

Bebo

Looking into moving PingER to a "block chain" data base good for distribution of data. Hot topic. Monitoring sites would then be able to write to  a distributed ledger. This would change architecture to a more peer to peer architecture. Help with continuity of PingER. Might be compelling.  Saqib is interested.

UUM

  • The paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries to IEEE Access.

    • The paper was not accepted :( despite some positive reviews, two reviewers accept the paper and only one reject it. Anyway, I have been working on a more rigorous analysis to resolve the correlation/causation doubt (to answer David comments) and the new analysis is ready.  Adib needs a few days to update our paper with the new analysis then will share with us to comment and advise.
      • He has been working with a statistician to identify correlations between Internet performance (IP) and ICT Development Index (IDI), Human Development Index (HDI), Fertility, GDP, and the Happy Planet Index (HPI).
      • They then look at the normality of the data. All except GDP pass the normality test. For GDP they use Spearman's non-parametric correlation, while Pearson Correlation is used for the rest.
      • There are strong positive correlations for IDI and HDI, a strong negative correlation for Fertility rate and a moderate correlation for HPI. GDP also has a  moderate correlation
      • It then looks at the cause effect relationship using regression.
      • Finally it comes up with a model of the form:

        IP = 2724.288 + 0.008GDP + 275.904 IDI -3238.298 HDI – 220.264 – 8.

      The paper was not accepted :( despite some positive reviews, two reviewers accept the paper and only one reject it. Anyway, I have been working on a more rigorous analysis to resolve the correlation/causation doubt (to answer David comments) and the new analysis is ready.  Adib needs a few days to update our paper with the new analysis then will share with us to comment and advise.
      • He has been working with a statistician to identify correlations between Internet performance (IP) and ICT Development Index (IDI), Human Development Index (HDI), Fertility, GDP, and the Happy Planet Index (HPI).
      • They then look at the normality of the data. All except GDP pass the normality test. For GDP they use Spearman's non-parametric correlation, while Pearson Correlation is used for the rest.
      • There are strong positive correlations for IDI and HDI, a strong negative correlation for Fertility rate and a moderate correlation for HPI. GDP also has a  moderate correlation
      • It then looks at the cause effect relationship using regression.
      • Finally it comes up with a model of the form:

        IP = 2724.288 + 0.008GDP + 275.904 IDI -3238.298 HDI – 220.264 – 8.084HPI

      • And they test its predictive behavior using various statistical tests. It looks very good.

      • Adib is finalizing the paper and hopes to complete by the end of the week 9/25/2017. Progress?

  • pinger.uum.edu.my is not responding, Adib contacted UUM IT staff, they promised to fix this issue by Tuesday.  Adib will do his best to fix it this week, 

  • Adib has sent PingER MA invitation to Nigerian person who used to be a student at UUM. He is awaiting a response.

  • Adib, Bebo, Les met with Southampton Web observatory person. There seemed to be enthusiasm.

NUST: Updates August 2017?

  • Adib was going to send some  maerials to Southampton. The person at Southampton gave us some links.

NUST: Updates August 2017?

One student is working on: Data Mining doing research on PingER data. He will be using Hadoop on a supercomputer at NUST.

  • The student is getting to know Hadoop.  Once the student is comfortable with the tools we can start applying the tools to pinger data.

We were unable to gather data from:

  • the tools we can start applying the tools to pinger data. he is working on Hadoop. Student is working on exams at the monent, Wajahat will conttact student

We were unable to gather data from:
Trying to locate other hosts in Pakistan who are interested contacting new sites.
  • aup.seecs.edu.pk  not pingable as of March 6th, 2017. Wajahat still trying, not given up. Still down 4/15/2017, 7/3/2017, 8/11/2017, 9/16/2017 (does not ping). Not responding. Contacted and they will fix the problem soon.10/24/2017
  • cae.seecs.edu.pk working again as of 3/6/2017. Down since March 17, 2017. Down 7/3/2017, Down 8/11/2017 did not ping, 9/16/2017 pings but unable to gather any data. Reconfigured 9/19/2017. Intermittent access this month (10/24/2017)
  • kinnaird.seecs.edu.pl pings but unable to gather data 8/11/2017, unable to ping, Contacted. 9/16/2017.  Unable to gather data. Contacted fix problem soon. 10/24/2017.
  • maggie1.seecs.edu.pk Down 8/11/2017, 9/16/2017 pings unable to gather data. Reconfigured 9/19/2017.  Working
  • monitor.seecs.edu.pk down since 23 April, down 7/3/2017. Usually working 9/16/2017. Working
  • namal.seecs.edu.pk (host is not pingable). Institution unreachable from start, we are trying to locate the person in charge, fingers crossed (Wajahat 1/10/206). Working 2/1/2018, still working 3/20/2017. Down since April 1st 2017. Down 7/3/2017, 8/11/2017. 9/16/2016 pings unable to gather data. Contact person missing. No data 10/24/2017. Unable to access this node. Do we give up/Disable?
  • nukimain.seecs.edu.pk down since March 24th, 2017. Down 7/3/2017, 8/11/2017,9/16/2017 unable to ping, still unable to ping or gather data. No contact information. 10/24/2017.
  • pinger.aiou.edu.pk  down since April 15th, down 73/2017, 8/11/2017. 9/16/2017 unable  to ping. Not Interested.They are not interested, Disabled 10/24/2017.
  • pinger-ncp.ncp.edu.pk pings but can't gather data 8/11/2017 and 9/16/2017. Contacted. Pings but can't gather data 10/24/2017.
  • pinger.vu.edu.pk down since May 22nd, down 7/3/2017. Problem with missing XML/Simple.pm missing. Unable to gather data, pings 8/11/2017 and 9/16/2017.  Reconfigured 9/19/2017.  No data to gather 10/24/2017, it pings OK, however there is no data in the 200 OK reponse to http://pinger.vu.edu.pk/cgi-bin/ping_data.pl? Port 80 is reponding. http://pinger.vu.edu.pk/  takes you a front page for the Virtual University of Pakistan.The link to http://pinger.vu.edu.pk/cgi-bin/traceroute.pl?choice=yes works (a bit slow), however the link to Get PingER data (i.e. ping_data.pl) does not work. Person who started left, current people do not respond. 
  • aup.seecs.edu.pk  not pingable as of March 6th, 2017. Wajhat still trying, not given up. Still down 4/15/2017, 7/3/2017, 8/11/2017, 9/16/2017 (does not ping). Not responding. 10/24/2017
  • cae.seecs.edu.pk working again as of 3/6/2017. Down since March 17, 2017. Down 7/3/2017, Down 8/11/2017 did not ping, 9/16/2017 pings but unable to gather any data. Reconfigured 9/19/2017. Intermittent access this month (10/24/2017)
  • kinnaird.seecs.edu.pl pings but unable to gather data 8/11/2017, unable to ping 9/16/2017. Contacted. Unable to gather data 10/24/2017.
  • maggie1.seecs.edu.pk Down 8/11/2017, 9/16/2017 pings unable to gather data. Reconfigured 9/19/2017.  Working
  • monitor.seecs.edu.pk down since 23 April, down 7/3/2017. Usually working 9/16/2017. Incomplete each day, are they shutting down at night?
  • namal.seecs.edu.pk (host is not pingable). Institution unreachable from start, we are trying to locate the person in charge, fingers crossed (Wajahat 1/10/206). Working 2/1/2018, still working 3/20/2017. Down since April 1st 2017. Down 7/3/2017, 8/11/2017. 9/16/2016 pings unable to gather data. Contact person missing. No data 10/24/2017. Do we give up/Disable?
  • nukimain.seecs.edu.pk down since March 24th, 2017. Down 7/3/2017, 8/11/2017,9/16/2017 unable to ping, still unable to ping or gather data 10/24/2017.
  • pinger.aiou.edu.pk  down since April 15th, down 73/2017, 8/11/2017. 9/16/2017 unable  to ping. Not Interested. Disabled 10/24/2017.
  • pinger-ncp.ncp.edu.pk pings but can't gather data 8/11/2017 and 9/16/2017. Contacted. Pings but can't gather data 10/24/2017.
  • pinger.vu.edu.pk down since May 22nd, down 7/3/2017. Problem with missing XML/Simple.pm missing. Unable to gather data, pings 8/11/2017 and 9/16/2017.  Reconfigured 9/19/2017.  No data to gather 10/24/2017

They are focusing on the hosts they can ping. In many cases the researcher has left and others do not see the purpose. Wajahat will keep trying pointing out the value for international research and papers.

...

The paper title: " Missing Values Imputation in PingER Internet End-to-end Performance Measurements using k-nearest neighbors (k NN)" was not accepted in IMC 2017. He is updating the paper according to the reviewer’s comments. Hopefully, Saqib will submit it at some other venue. Not yet decided about the submission venue. Need some suggestions. Updared but not decided where to submit

PingER MA at GZHU is now accessible publicly and is successfully gathering data and incorporated in PingER. It would make a good beacon, however it was not pingable 7/16/2017, sent email. Saqib is trying to convince the IT department to open the ping. No success yet. Hopefully in next 2 weeks.  (9/26/2016). Still not pingable 10/24/2017. No success. However, requested to move PingER to dual stack subnet to ping Ipv6 address spacedual stack subnet to ping Ipv6 address space. In coming week, then will see what we can ping.

We now have about 230+ educational sites in China that respond to pings. , about 200 have been entered into the PingER Meta database. About 10% are not responding. Saqib has entered about 48 municipalty sites, so all sites are updated. End of this month GZHU security level should be reduced and blocked internet access goes away (since 27th August)

PingER Project of 150K RMB is accepted by Guangzhou Postdoctoral Special Funds of China. Hopefully, in the coming month, I will get two 1U servers to install data repository in GU. , hopefully next month

 CERNET backbone is currently at 10Gbps will upgrade to 100Gbps in a couple of years. There are about 20 core nodes that run IPv6 and they will be extending to 50 core nodes.Saqib submitted a proposal to extend PingER to support IPv6 monitoring of the CERNET backbone  (deadline was 30 Sept 2017).

PingER has valuable historical data for the last 20 years.Many analysis and case studies have been carried using this data. A lot of information is available on the website. Saqib's idea is to publish the brief summary all these analysis through a survey paper covering the history and utilization of PingER data starting from 1998 to 2017. Saqib started on it, Les is providing assistance. Need your feedback on the idea of Measuring the Digital Development of the Countries using PingER data.  ·                 Is there something you want me to review some, e.g. some draft document on Measuring the Digital Development of the Countries using PingER data , or are you asking if it is a good idea to review and create such a document. If the latter I think this is a fascinating subject. Part of the challenge is the chicken and egg problems: i.e. is it network performance influencing advancement of the country, or is it the reverse that advanced countries can afford good networks.  My belief is it goes both ways. Also one needs to extend the analysis beyond just Africa else it’s kind of a repeat of Pinging Africa , R. Les Cottrell, IEEE Spectrum February 2013. Also see A Simple Tool for Measuring Digital Development , by R. Les Cottrell, IEEE Spectrum February 2013. This is derived from SLAC-PUB-15333. 

·                Also it may be related to Adib’s paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries that was submitted to IEEE and rejected.. 

Currently, no data is available on PingER on Android due to unavailability of the live IP address. No update 4/19/2017, 7/6/2017. Email sent to Sara Masood. No update 9/24/2017. Any update 10/24/2017.

...

Next Meeting

Next meeting:  Thursday October 26th December 7th 9pm Pacific time,  Friday October 27th December 8th , 2016  9:00am Pakistan time, Friday October 27th December 8th 2017 12:00noon Malaysian and Guangzhou .time

...