Versions Compared

Old Version 22

changes.mady.by.user Les Cottrell

Saved on

compared with

New Version 23

changes.mady.by.user Les Cottrell

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

See: http://pinger.unimas.my/pinger/contact.php

Requested Johari  to add DrJohara added Dr. Charnsak Srisawatsakul <charnsak.s@ubru.ac.th>, Skype ID charnsaksrisawatsakul. Faculty of Computer Science Ubon Ratchathani Rajabhat University, Ubon Ratchathani, Thailand,  web site http://www.charnsak.com to the file.

Attendees

Invitees:

Wajahat Hussain+, ajmal.farooq@seecs.edu.pk, Muhammad Anas Abrar (SEECS); Saqib+, Aqsa (UAF); Johari+, Adnan Khan (UNIMAS);  Badrul,  Ridzuan, Ibrahim (UM); (UTM); Adib?, Fatima (UUM); Fizi Jalil (MYREN);  Dr. Charnsak Srisawatsakul+, Les+, Bebo+

...

? Individual emails sent

Actual Attendees

Adib, Bebo, Charnsak, Johari, saqib, Wajahat, Les

Others

Administration

...

Looking into moving PingER to a "block chainblockchain" database good for decentralize distribution of data. Hot topic. Monitoring sites would then be able to write to a distributed ledger. This would change the architecture to a more peer to peer architecture. Help It helps with continuity of PingER . Might be compelling.  since reduces dependence on a single site (SLAC). See Block Chain in Future PingER Projects. Saqib is interested.  Update?  

Wajahat mentions "Bebo mentioned things related to bitcoins.  One of Wajahat's colleagues (Dr Taha Ali) is working in this area. He will be giving a course on Block Chain to MS students at NUST next quarter. He wants to know how we are planning to use bitcoins for pinger data. A little detail will be helpful."  

  • Bebo responded: "The discussion dealt with the possible use of block chain technology with PingER independent of bitcoin. However, an understanding of bitcoin applications and how they interact with a blockchain would probably be useful." 

  • Bebo would be interested in the syllabus for the Block Chain course. Wjahat provided Taha's email address (taha.ali@seecs.edu.pk) and will put Taha in contact with Bebo.

Thailand

We now have two MAs in Thailand: pinger.cs.ubru.ac.th (in NE Thailand) and pinger.rmutsv.ac.th (in Bangkok). The former has just been added. Both are working, SLAC is gathering data and the analysis is now available.    Dr. Charnsak fixed the inbound firewall rule to enable pings.

Charnsak is interested in using the PingER data. It could be used for a case study on Internet performance within Thailand, and from say the US to Thailand. Also a comparison of the performance of the two MAs in Thailand would be interesting.  A list of papers and presentations related to PingER is available. Some case studies are seen below:

Another possibility would be to compare the RTTs from ping/ICMP with those from TCP SYN ACK delays as seen from Thailand for both ipv4 and ipv6. See Validating ICMP ping measurements against TCP nping measurements.

UUM (No input from Adib 12/7/2017)

  • The paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries to IEEE Access.

    • The paper was not accepted :( despite some positive reviews, two reviewers accept the paper and only one reject it. Anyway, I have been working on a more rigorous analysis to resolve the correlation/causation doubt (to answer David comments) and the new analysis is ready.  Adib needs a few days to update our paper with the new analysis then will share with us to comment and advise.
      • He has been working with a statistician to identify correlations between Internet performance (IP) and ICT Development Index (IDI), Human Development Index (HDI), Fertility, GDP, and the Happy Planet Index (HPI).
      • They then look at the normality of the data. All except GDP pass the normality test. For GDP they use Spearman's non-parametric correlation, while Pearson Correlation is used for the rest.
      • There are strong positive correlations for IDI and HDI, a strong negative correlation between Fertility rate and a moderate correlation for HPI. GDP also has a  moderate correlation
      • It then looks at the cause-effect relationship using regression.
      • Finally, it comes up with a model of the form:

        IP = 2724.288 + 0.008GDP + 275.904 IDI -3238.298 HDI – 220.264 – 8.084HPI

      • And they test its predictive behavior using various statistical tests. It looks very good.

      • Adib is finalizing the paper and hopes to complete by the end of the week 9/25/2017. Progress?

  • There was  a problem pinging the MA pinger.uum.edu.my.  It is now working as promised.

  • Adib has sent PingER MA invitation to Nigerian person who used to be a student at UUM. He is awaiting a response.

  • Adib, Bebo, Les met with Southampton Web observatory person. There seemed to be enthusiasm. Adib was going to send some materials to Southampton. The person at Southampton gave us some links.

NUST: Updates 12/8/2017

One student is working on: Data Mining doing research on PingER data. He will be using Hadoop on a supercomputer at NUST.

  • The student is getting to know Hadoop.  Once the student is comfortable with the tools we can start applying the tools to pinger data. he is working on Hadoop. Student is working on exams at the moment, Wajahat will contact student

Wajahat is trying to contact the sick Pakistani MA nodes but the current week is exam week. He will give detailed response next week. So Les has paused Disabling (see below). We can always restore an MA for testing or when it is once again reliable.  Wajahat proposes to get  a list of the new Universities in Pakistan and contact them encouraging them to joining participate in PingER and set up MA. He will start next week when the students are available.

There is an upcoming grant call for projects between Pakistan and the US. Topics may be focused on cybersecurity, health and education. It has not been announced yet. Wjahat will get the details and share them with the team as soon as they are available. It is interesting since getting a US partner appears to be a roadblock for many potential Pakistani responders. However, the topics may not be very related to PingER. For cyber the main things we could think of were: punching holes in firewalls to allow pings, how to misuse ping (e.g. ping-of-death, or using anomalous ping packets to deduce the OS etc. flood pings for DOS), host can respond to ping but applications do not work.  Fear of misuse of pings can result in the system administrator, network administrator or cyber security blocking pings. Possibility might be a study of what fraction of say working www/dns etc. apps (i.e. checking if a host responds to the relevant port) do not respond to pings.  This could be by application, by country or by region etc.  Also how to protect a remote pinger traceroute or server from being used in DOS attacks.

 
We were unable to gather data from:
  • aup.seecs.edu.pk  host is pingable, Wajahat still trying, not given up. Still down 4/15/2017, 7/3/2017, 8/11/2017, 9/16/2017 (does not ping), 1/8/2018 (pings). Contacted and they will fix the problem soon.10/24/2017. Should we Disable?
  • cae.seecs.edu.pk working again as of 3/6/2017. Down since March 17, 2017. Down 7/3/2017, Down 8/11/2017 did not ping, 9/16/2017 pings but unable to gather any data. Reconfigured 9/19/2017. Intermittent access this month (10/24/2017). Worked for a day after configuring 11/28/2017. Worked Jan 1-5, no response Jan 6-7.
  • kinnaird.seecs.edu.pl pings but unable to gather data 8/11/2017, unable to ping, Contacted. 9/16/2017.  Unable to gather data. Contacted fix problem soon. 10/24/2017. Disabled 11/30/2017.
  • namal.seecs.edu.pk (host is not pingable). Institution unreachable from start, we are trying to locate the person in charge, fingers crossed (Wajahat 1/10/206). Working 2/1/2018, still working 3/20/2017. Down since April 1st 2017. Down 7/3/2017, 8/11/2017. 9/16/2016 pings unable to gather data. Contact person missing. No data 10/24/2017. Unable to access this node. Disabled 11/30/2017
  • nukimain.seecs.edu.pk down since March 24th, 2017. Down 7/3/2017, 8/11/2017,9/16/2017 unable to ping, still unable to ping or gather data. No contact information. 10/24/2017. Disabled 11/30/2017.
  • pinger-ncp.ncp.edu.pk pings but can't gather data 8/11/2017 and 9/16/2017. Contacted. Pings but can't gather data 10/24/2017. Do we disable 11/30/2017? Stlll nothing 1/8/2018. 
  • pinger.vu.edu.pk down since May 22nd, down 7/3/2017. Problem with missing XML/Simple.pm missing. Unable to gather data, pings 8/11/2017 and 9/16/2017.  Reconfigured 9/19/2017.  No data to gather 10/24/2017, it pings OK, however there is no data in the 200 OK response to http://pinger.vu.edu.pk/cgi-bin/ping_data.pl? Port 80 is responding. http://pinger.vu.edu.pk/  takes you a front page for the Virtual University of Pakistan.The link to http://pinger.vu.edu.pk/cgi-bin/traceroute.pl?choice=yes works (a bit slow), however the link to Get PingER data (i.e. ping_data.pl) does not work. Person who started left, current people  do not respond. Do we Disable 11/30/2017? Still nothing 1/8/2018.

Bebo sent several references to Saqib who has looked at them. We could start with real time data without including the whole archive, i.e. in parallel to the continued centrally manged archive. It would be a private Blockchain.  Joahari is also interested and will follow up with Bebo and Saqib.

Thailand

A possible project would be to compare the RTTs from ping/ICMP with those from TCP SYN ACK delays as seen from Thailand for both ipv4 and ipv6. See Validating ICMP ping measurements against TCP nping measurements. Les will send to Johari and Charnsak, the perl script (ping-vs-tcp.pl) he has written to make the measurements.

UUM (No input from Adib 12/7/2017)

  • Adib has updated the paper on Internet Performance and its Reflection on Socioeconomic Development in the ASEAN Countries to IEEE Access and sent to Les and Bebo for review. Then we will need to find a suitable place to publish.

  • The BIND paper ("BIND: An Indexing Strategy for Big Data Processing") is now online.  Adib will provide a URL or a copy of the paper so we can add it to papers related to PingER.

  • There was  a problem pinging the MA pinger.uum.edu.my.  It is now working as promised.

  • Adib, Bebo, Les met with Southampton Web observatory person. There seemed to be enthusiasm. Adib was going to send some materials to Southampton. The person at Southampton gave us some links. Adib is in the early stages of exploring what web observatory data to link with such as business context indicatorsm social media and  government sites.

NUST: Updates 12/8/2017

One student is working on: Data Mining doing research on PingER data. He will be using Hadoop on a supercomputer at NUST.

  • The student is getting to know Hadoop.  Once the student is comfortable with the tools we can start applying the tools to pinger data. he is working on Hadoop. Student is working on exams at the moment, Wajahat will contact student

Wajahat is trying to contact the sick Pakistani MA nodes but the current week is exam week. He will give detailed response next week. So Les has paused Disabling (see below). We can always restore an MA for testing or when it is once again reliable.  Wajahat proposes to get  a list of the new Universities in Pakistan and contact them encouraging them to joining participate in PingER and set up MA. He will start next week when the students are available.

There is an upcoming grant call for projects between Pakistan and the US. Topics may be focused on cybersecurity, health and education. It has not been announced yet. Wajahat will get the details and share them with the team as soon as they are available. It is interesting since getting a US partner appears to be a roadblock for many potential Pakistani responders. However, the topics may not be very related to PingER. For cyber the main things we could think of were: punching holes in firewalls to allow pings, how to misuse ping (e.g. ping-of-death, or using anomalous ping packets to deduce the OS etc. flood pings for DOS), host can respond to ping but applications do not work.  Fear of misuse of pings can result in the system administrator, network administrator or cyber security blocking pings. Possibility might be a study of what fraction of say working www/dns etc. apps (i.e. checking if a host responds to the relevant port) do not respond to pings.  This could be by application, by country or by region etc.  Also how to protect a remote pinger traceroute or server from being used in DOS attacks.

 
We were unable to gather data from:
  • aup.seecs.edu.pk  host is pingable, Wajahat still trying, not given up. Still down 4/15/2017, 7/3/2017, 8/11/2017, 9/16/2017 (does not ping), 1/8/2018 (pings). Contacted and they will fix the problem soon.10/24/2017. They are non responsive as og Jan 19, 2018. We will Disable
  • cae.seecs.edu.pk working again as of 3/6/2017. Down since March 17, 2017. Down 7/3/2017, Down 8/11/2017 did not ping, 9/16/2017 pings but unable to gather any data. Reconfigured 9/19/2017. Intermittent access this month (10/24/2017). Worked for a day after configuring 11/28/2017. Worked Jan 1-5, no response Jan 6-7. Working since Jan 9th 2018.
  • kinnaird.seecs.edu.pl pings but unable to gather data 8/11/2017, unable to ping, Contacted. 9/16/2017.  Unable to gather data. Contacted fix problem soon. 10/24/2017. Disabled 11/30/2017.
  • namal.seecs.edu.pk (host is not pingable). Institution unreachable from start, we are trying to locate the person in charge, fingers crossed (Wajahat 1/10/206). Working 2/1/2018, still working 3/20/2017. Down since April 1st 2017. Down 7/3/2017, 8/11/2017. 9/16/2016 pings unable to gather data. Contact person missing. No data 10/24/2017. Unable to access this node. Disabled 11/30/2017
  • nukimain.seecs.edu.pk down since March 24th, 2017. Down 7/3/2017, 8/11/2017,9/16/2017 unable to ping, still unable to ping or gather data. No contact information. 10/24/2017. Disabled 11/30/2017.
  • pinger-ncp.ncp.edu.pk pings but can't gather data 8/11/2017 and 9/16/2017. Contacted. Pings but can't gather data 10/24/2017. They are in the process of restoring 1/17/2018.
  • pinger.vu.edu.pk down since May 22nd, down 7/3/2017. Problem with missing XML/Simple.pm missing. It is working again as of  January 8th 2018.

They have made a list of new university sites, communications networks, Labs in different regions of Pakistan (especially the remote regions) and will make contactThey are focusing on the hosts they can ping. In many cases the researcher has left and others do not see the purpose. Wajahat will keep trying pointing out the value for international research and papers.

UNIMAS (Johari unable to attend 9/21/2017, 10/2617 12/07/2017 so no update)

...