Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Wajahat is recovering from numerous infections, starting to visit office once again (has recovered and was back at the office  2/17/2020).

Actual Attendees

Umar, Bebo, Kiran.

Use of Zoom

IMPORTANT NOTE: The meeting is set up to record automatically. By joining the meeting you are agreeing to be recorded (see details

Roger (Les) Cottrell is inviting you to a scheduled Zoom meeting.

Topic: PingER Collaboration meeting 

Topic: Roger (Les) Cottrell's Zoom Meeting

Time: Apr 16, 2020 09:00 PM Pacific Time (US and Canada)

Join Zoom Meeting.

https://zoom.us/j/98304541563?pwd=cEI1TDNpYzJCaWhtS0s4QWI0MmFyZz09

Meeting ID: 983 0454 1563

It requires a password provided in email invitation

Now might be a good time to update your Zoom app to make it more secure.

How to set up and use Zoom:

To use the software, you would have to download the Zoom client (and installed if prompted). The instructions to do so are listed here: https://zoom.us/download#client_4meeting

The instructions about setting up the software are listed at the URL below. You may want to create an account if you do not have one already. If you are invited to a meeting (i.e., you are not hosting the meeting), you are not required to create an account; you can simply join the meeting using the meeting ID.

Amity 

Amity team photo:

Image Removed

 

Umar was able to get in using the password Les provided.
After Bebo entered the meeting Les saw he was on and was able to accept him. Same for Kiran.

The meeting was for 45 minutes, there was a 10 minute warning.:w

Amity 

Amity team photo:

Image Added

 

Bebo

Bebo brought our attention

Bebo

Bebo's account at SLAC was 'Off-Boarded' since his sponsor (Umar) had left SLAC and there was nobody to 'On-Board' him when his current term expired. Les got the new head of networking at SLAC (Mark) to sponsor Bebo, and Bebo was 'On-Boarded' 3/2/2020.

Bebo brought our attention to a report from KeepitOn on the 213 Internet shutdowns in 2019. An internet shutdown happens when someone — usually a government — intentionally disrupts the internet or mobile apps to control what people say or do.

NUST

 

IPv6 host at NUST:

Wajahat has requested Hasan to install PingER on an IPv6 host at NUST, Saqib has contacted Hasan to tell him where to find and upload the code. There is not a host name for the MA yet. Hopefully, this will be available by next month's meeting.

  •  7/24/2019 Les emailed Wajahat with a request for an update.
  • At the meeting Wajahat had asked the student to contact Saqib and get the information on energizing IPv6. Saqib provided the information, but the student could not access the URL (apparently the URLwas down). Wajahat was on leave and when he returned the internship had expired, so Wajahat is unsure what happened. Wajahat will start a new student next week and will set him on the IPv6 project. Progress? 

Sent email on 2/4/2020 to Kiran at NUST on how to bring the vu host's pinger.xml up to date. As of 2/3/2020 pinger.xml at vu now looks good and we now appear to be able to gather good data.

We are working on maggie2, monitor and nwfpuet:

UAF (University of Agriculture, Faisalabad)/GHZU

Saqib plans to continue work on PingER monitoring for remote areas, in particular in Pakistan. He will use Android PingERs. This may partially tie into the Amity project.

He will also continue his work on Blockchain and plans to attend a Blockchain workshop in Guangzhou.

The 4th  Call for Proposals for The Asi@Connect Project:

  • Saqib submitted a concept note in WP6 with Wajahat and Les as co-applicant.
  • It was accepted and Saqib was given the go-ahead to submit a Full Proposal.
  • With suggestions and an endorsement letter from PERN plus CVs from Wajahat and Les, Saqib put together a full proposal and it was submitted 11/6/2019.
  • However, it was not accepted

Saqib plans to get 2-3 undergraduate students in a month or so and plans to look at Android PingER.

He has been invited to an APAN meeting in Nepal, however, with the Corona Virus it was postponed.

Saqib registered a DNS name for GC Women University Faisalabad. The new URL is http://pinger.gcwuf.edu.pk/cgi-bin/ping_data.pl. Previously there was no DNS name so the name was reported as 121.52.153.227. This required a change in the <SrcName> in pinger.xml and exposed a bug in ping_data.pl which has been fixed in the latest release (4.6).

SLAC

  • Les turned on the debugging to investigate the discovery that several analysis scripts had stopped working in November 2019
    • Each night we run about 100 analysis scripts as batch jobs and after fixing problems with the mon-lib.pl etc. we still found about 10% were randomly failing.
    • After about 4 weeks it eventually transpired that some of the batch machines had not been enabled to access the Oracle database via the firewall. The jobs submitted to those hosts failed.
    • The cause of the problem was eventually identified about January 3rd and fixed about January 6th. No data was lost.
  • The new version of Linux CentOS7, does not appear to support the following modules that are used by the PingER analysis.
    • The Oracle database interface. PingER uses Oracle so there could be a problem. 
    • The perl statistics module
    • I will restrict the PingER analysis jobs to the earlier version of Linux (RHEL6) to avoid these problems. I am working with the systems folks at SLAC and looking into when the current version of Linux at SLAC (RHEL6) will no longer be supported and following SLAC's planning on how or whether to address the issues.
      • Rhel6 has full support until Nov 30, 2020. It then goes on "extended" support until June 2024. I expect SLAC will continue to use it during the extended support phase, at least for a couple of years.
      • Umar did some research and found:

Umar 

State of MAs.

Host
State
last seen
Status
pinger.nchc.org.tw Intermittent problems starting 11/9/2019, it is not pingable starting 11/12/2019.  
pinger.vu.edu.pkUnable to gather data since 29th August, 2019. The host is pingable. Emailed Wajahat 11/3/2019. Wajahat responded 11/11/2019 "Anything improved?". Les responded they are still not working with more details and suggesting we focus on vu. 11/20/2019 Les asks if there is an update? Wajanat responded 11/20/2019 "These guys are not responding. We are trying to contact them. Already tried multiple times." This just applies to vu. Wajahat recommends we keep trying to gather data. I have turned off the warnings. Kiran fixed it 2/3/2020 by restoring the pinger.xml file following email instructions from Les8/28/2019Fixed 2/3/2020.
monitor.seecs.edu.pkNo data since 10/29/2019, host is pingable email to Wajahat 11/7/2019. Reminder to Kiran and Wajahat 2/16/2020. Host not pingable sent email to Kiran and Wajahat 3/3/2020.10/27/2019 
maggie2.seecs.edu.pkNo data since 11/4/2019, host is pingable email to Wajahat 11/2/2019, 11/20/2019. Reminder to Kiran and Wajahat 2/16/2020. Host no longer pingable, sent email to Kiran and Wajahat 3/3/2020.  
pinger.nwfpuet.edu.pkSomething amiss since April 2019 when it dropped from monitoring over 150 targets down to 4. There is nothing in <BeaconsList>, all the hosts it attempts to monitor are in the locally manually maintained <NodeList>. Does not ping by name. Email sent 11/7/2019, and again 11/20/2019. Reminder to Kiran and Wajahat 2/16/2020.   
pingeramity.inContinues to be unstable. Email 8/29/2019. Turned off email warnings 11/20/2019.  

Next Meeting

Next meeting:  There will be a Doodle poll, for  2020 at 9 pm Pacific time; a day later 9:00 am Pakistan time; 9:30 am India time; 12:00 pm Malaysian & Guangzhou time;  1:00 pm Thailand time; 6:00 am Jordan time. 5:00am Turkey time.  

...

We are working on maggie2, monitor and nwfpuet:

  • On 2/16/2020 sent emails to Kiran about monitor.seecs.edu.pk not being pingable, maggie2.seecs.edu.pk not responding to  http://maggie2.seecs.edu.pk/cgi-bin/ping_data.pl?, and pinger.nwfpuet.edu.pk looking like it has a bad pinger.xml file (missing the BeaconList).
  • Emails exchanged on maggie2 2/18/2020. Not there yet. 
  • 2/26/2020 corresponded with Kiran via zoom to clarify problems. She is working on monitor, maggie2, nwfpuet.
  • 4/14/2020 Kiran reports: "due to coronavirus we are not going to university. But I have requested the university admin to cooperate with me and install a teamviewer so that I can remotely access the PC and the monitor and maggie2. If the university does so then I will call you on skype so that we can resolve the issue." Kiran has no time estimate as to when this may happen. Kiran's current post terminates in Sept 2020.

UAF (University of Agriculture, Faisalabad)/GHZU

Saqib plans to continue work on PingER monitoring for remote areas, in particular in Pakistan. He will use Android PingERs. This may partially tie into the Amity project.

He will also continue his work on Blockchain and plans to attend a Blockchain workshop in Guangzhou.

Saqib plans to get 2-3 undergraduate students in a month or so and plans to look at Android PingER. No update 4/16/2020.

/afs/slac.stanford.edu/package/pinger/prm/prm.pl -lp true -c /afs/slac.stanford.edu/package/pinger/prm/prm-last120days-slac.conf 

UMAR

SLAC

  • Bebo posed the question of whether PingER can identify changes in Internet responsiveness as measured by PingER as a result of the impact of the Covid-19 virus.
  • The first attempts looking et PingER statistics and see if there were any noticeable changes in performance attributable to Covid-19 interventions (e.g. shutting down schools,  social distancing, gathering cancellations, lockdowns), were not very successful (see PingER and COVID-19). See https://covid19-interventions.com/ for interventions in European, and some Asian countries.
  • Another attempt to correlate the impacts might be to use a tool such as Google Motion Charts to look for correlations between say Covid-19 cases (cases, hospital admissions, deaths etc) and PingER metrics as a function of time, by country, continent, plus population or density of population. The idea is that as Covid-19 cases pass say 100, the country will impose interventions such as school closing,  social distancing etc. which will change the usage patterns of the Internet which may have noticeable impacts on the PingER measurements.
  • Unfortunately Google Motion metrics relies on Flash and is no longer supported .
    • A possible alternative is Charta.ca
    • I have therefore put together a Perl script (chart-covid.pl) to take daily PingER metrics for the last 120 days together with up-to-date raw data on the coronavirus from the Johns HopkinsUniversity GitHub site: https://github.com/CSSEGISandData/COVID-19, for various countries with their population, area, population density and cast the data in a format suitable for Charta.ca.
    • There is a web page I put together on how to use Charta.ca at Using Chart.ca.
    • There is an example at https://charteca.blob.core.windows.net/pubs/3Z3qcBXqCT9B3WHz
    • Instead of using Covid-19 confirmed cases, it might be good to use the Unacast cell phone location data to get a measure of how people are social distancing. I have sent them two emails but no response.
  • Discussion:
    • The major Russian network Rostelcom, high jacked traffic around April 5, 2020 see https://www.zdnet.com/article/russian-telco-hijacks-internet-traffic-for-google-aws-cloudflare-and-others/. This may have had some impact on PingER metrics.
    • Les pointed out that many of our targets (and of course the SLAC Measurement Agent) for the US (ESnet and Internet2), Europe (Dante, and national education/research networks etc.), Australia (AARNET) and parts of Asia (TEIN) are on well-provisioned, lightly loaded networks so it is the transit networks are not expected to see big changes.
    • Umar pointed out that the closing of schools, people staying at home should increase the traffic (e.g. between students and profs teaching remotely, people surfing the web watching videos etc) on CDNs (Content Deliverable Networks), and much of this traffic is on public networks. Thus one might see big changes for traffic transitting public networks. 
    • Since PingER is not monitoring homes and content deliverers, PingER would not expect to see big changes in responsiveness for most of our targets in the above regions.
    • On the other hand, African networks are less well developed and PingER may see more of an effect for such targets.

State of MAs.

Host
State
last seen
Status
pinger.nchc.org.tw Intermittent problems starting 11/9/2019, it is not pingable starting 11/12/2019. Fixed 3/24/2020.  
pinger.rmutsv.ac.thUnable to gather data since November 13, 2019. Host is pingable. Sent email to chaisit.c@rmutsv.ac.th 3/26/2020. No response by 4/13/2020  
pinger.gcwuf.edu.pkUnable to gather data since 3/31/2020, host is not pingable. Email sent to Saqib 4/13/20203/31/2020 
pinger.vu.edu.pkUnable to gather data since 29th August, 2019. The host is pingable. Emailed Wajahat 11/3/2019. Wajahat responded 11/11/2019 "Anything improved?". Les responded they are still not working with more details and suggesting we focus on vu. 11/20/2019 Les asks if there is an update? Wajanat responded 11/20/2019 "These guys are not responding. We are trying to contact them. Already tried multiple times." This just applies to vu. Wajahat recommends we keep trying to gather data. I have turned off the warnings. Kiran fixed it 2/3/2020 by restoring the pinger.xml file following email instructions from Les8/28/2019Fixed 2/3/2020.
comsatsswl.seecs.edu.pkUnable to gather data since 3/26/20210, hoast not pingable. Disabled by Cottrell 4/13/2020.  
monitor.seecs.edu.pkNo data since 10/29/2019, host is pingable email to Wajahat 11/7/2019. Reminder to Kiran and Wajahat 2/16/2020. Host not pingable sent email to Kiran and Wajahat 3/3/2020. Email sent to Kiran and Wajahat 4/13/2020.10/27/2019 
maggie2.seecs.edu.pkNo data since 11/4/2019, host is pingable email to Wajahat 11/2/2019, 11/20/2019. Reminder to Kiran and Wajahat 2/16/2020. Host no longer pingable, sent email to Kiran and Wajahat 3/3/2020. Email sent to Kiran and Wajahat 4/13/2020.  
pinger.nwfpuet.edu.pkSomething amiss since April 2019 when it dropped from monitoring over 150 targets down to 4. There is nothing in <BeaconsList>, all the hosts it attempts to monitor are in the locally manually maintained <NodeList>. Does not ping by name. Email sent 11/7/2019, and again 11/20/2019. Reminder to Kiran and Wajahat 2/16/2020. Email sent to Kiran and Wajahat 4/13/2020.  

Next Meeting

Next meeting:  There will be a Doodle poll, for  2020 at 9 pm Pacific time; a day later 9:00 am Pakistan time; 9:30 am India time; 12:00 pm Malaysian & Guangzhou time;  1:00 pm Thailand time; 6:00 am Jordan time. 5:00am Turkey time.  

...

Old information

NUST moved here 4/14/2020

Pv6 host at NUST:

Wajahat has requested Hasan to install PingER on an IPv6 host at NUST, Saqib has contacted Hasan to tell him where to find and upload the code. There is not a host name for the MA yet. Hopefully, this will be available by next month's meeting.

  •  7/24/2019 Les emailed Wajahat with a request for an update.
  • At the meeting Wajahat had asked the student to contact Saqib and get the information on energizing IPv6. Saqib provided the information, but the student could not access the URL (apparently the URLwas down). Wajahat was on leave and when he returned the internship had expired, so Wajahat is unsure what happened. Wajahat will start a new student next week and will set him on the IPv6 project. Progress? 

Sent email on 2/4/2020 to Kiran at NUST on how to bring the vu host's pinger.xml up to date. As of 2/3/2020 pinger.xml at vu now looks good and we now appear to be able to gather good data.

SLAC moved here 4/13/2020.

The new version of Linux CentOS7, does not appear to support the following modules that are used by the PingER analysis.

  • The Oracle database interface. PingER uses Oracle so there could be a problem. 
  • The perl statistics module
  • I will restrict the PingER analysis jobs to the earlier version of Linux (RHEL6) to avoid these problems. I am working with the systems folks at SLAC and looking into when the current version of Linux at SLAC (RHEL6) will no longer be supported and following SLAC's planning on how or whether to address the issues.
    • Rhel6 has full support until Nov 30, 2020. It then goes on "extended" support until June 2024. I expect SLAC will continue to use it during the extended support phase, at least for a couple of years.
    • Umar did some research and found:

Umar moved here 1/10/2020

...