Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

IMPORTANT NOTE: The meeting is set up to record automatically. By joining the meeting you are agreeing to be recorded (see details

Hi there,

roger cottrell is inviting you to a scheduled Zoom meeting.

Topic: Pinger Monthly meeting
Time: Oct 16, 2019 10:00 PM Pacific Time (US and Canada)

Join from PC, Mac, Linux, iOS or Android: https://stanford.zoom.us/j/878389026

Or iPhone one-tap (US Toll): +18333021536,,878389026# or +16507249799,,878389026#

Or Telephone:
Dial: +1 650 724 9799 (US, Canada, Caribbean Toll) or +1 833 302 1536 (US, Canada, Caribbean Toll Free)

Meeting ID: 878 389 026
International numbers available: https://zoom.us/u/abCOWPniNq

Meeting ID: 878 389 026
SIP: 878389026@zoomcrc.com

How to set up and use Zoom:

To use the software, you would have to download the Zoom client (and installed if prompted). The instructions to do so are listed here: https://zoom.us/download#client_4meeting

The instructions about setting up the software are listed at the URL below. You may want to create an account if you do not have one already. If you are invited to a meeting (i.e., you are not hosting the meeting), you are not required to create an account; you can simply join the meeting using the meeting ID.

Amity 

Amity team photo:

  • We met with Amity 9/19/2019. The action items are below. Email was sent to Amity 10/10/2019, since there were no updates, no response. Another email was sent 10/18/2019Bebo has an invitation to be a Keynote Speaker in the 10th International Conference, CONFLUENCE-2020 at Amity on the theme “Cloud Computing, Data Science & Engineering” to be held on 29th– 31th January, 2020. The topics are big data and the cloud. It would be by Skype. We could fit in the big data aspect. Bebo will put them in contact with Les.
    • Amity will mail the update with the lat, long included. Amity will annotate the photo captured of the Amity team in the meeting. Done 10/19/2019, see above
    • SLAC also needs to know how to access the Firebase data.
      • Once that is known and the data with lat, long included and we understand the format and how to access it, Les will look at how to incorporate in a backward-compatible fashion into the current PingER.Amity sent some information 10/19/2019. Les sent a long email 11/15/2019, asking how to understand files, how to get the lat/long and engaging Bebo and Saqib etc. 
    • Bebo will get hold of some Android phones and once he is given instructions on accessing the native app look at experimenting.
      • Bebo has 4 phones as of 10/16/2019
      • As of email from Amity 10/19/2019 "Drive link to the app is app" (I think it is called Firebase). 
      • Amity sent a userid and password, I think it is for the Firebase app. But it may be for accessing the Firebase data. If the latter I need some instructions  on what URL to use etc. In response to an email Naman clarified  it a little "These are the credentials which can be used to access firebase database online. See https://firebase.google.com/" 
      • Bebo sent email to Amity to get an update.
    • Amity will look to see if they know of any targets in Jammu Kashmir.
      • Answer appears to be no.
    • Next meeting will be in a month.
      • Amity will set up a google poll to determine the date and time 
        • The current time of 20:00 in the US and 08:30 at Amity is appropriate.
      • Amity will set up and notify the team of the meeting by Zoom. If this is a big problem Les can set up the Zoom meeting.
      • Amity responded 10/18/2019: We will set up a meeting within the next week. No response by 11/15/2019

Bebo

Is wondering about a meeting of PingER collaborators with possible funding from the Internet Archive or possibly others. Also possibly seeking other sources of funding for PingER activities.

It is time to re-raise and discuss the talk for the Internet Archive, and what we might expect from them and how much effort it is to prepare, document and make the data available to the Archive. So far:

  • Les and Bebo visited the Internet Archive (IA, see https://archive.org/) and initiated a discussion on archiving PingER data (i.e. a mirror for SLAC) at the IA and also giving a talk on PingER at the IA. 

    We agreed to put together a disk with a snapshot of the appropriate archive files containing analyzed data back to 1998 plus some documentation and then approach them about archiving the data, and a possible talk showing how the data can be used, e.g. comparison with economic indices, identifying on the network on events such as earthquake, societal unrest, cutting of cables etc.  First part of the talk based on the presentation at Samsung. Depending on level of interest and support, we could . offer to update the data.
    • The IA responded with information on using an IA Python library to archive the data at the IA. Les responded with interest but lack of resources until mid-September at the earliest.  Also maybe after giving a talk at IA there might be interest in collaborating from some of the attendees.
    • The IA also responded pointing to a form to fill out for a request to give a talk at the IA.
      • Les filled out the form.
      • Les sent an email to the IA to make sure they had received the form and asking if anything else is required.
      • IA suggested September, given the China meeting, this was missed.

NUST (Updated 7/24/2019)

IPv6 host at NUST:

Wajahat has requested Hasan to install PingER on an IPv6 host at NUST, Saqib has contacted Hasan to tell him where to find and upload the code. There is not a host name for the MA yet. Hopefully, this will be available by next month's meeting.

  •  7/24/2019 Les emailed Wajahat with a request for an update.
  • At the meeting Wajahat had asked the student to contact Saqib and get the information on energizing IPv6. Saqib provided the information, but the student could not access the URL (apparently the URLwas down). Wajahat was on leave and when he returned the internship had expired, so Wajahat is unsure what happened. Wajahat will start a new student next week and will set him on the IPv6 project. Progress?

Wajahat has a new intern. He is going through training for installing PingER. Wajahat hopes he will be ready to start real working in a couple of weeks following last month's meeting. Progress?

UAF (University of Agriculture, Faisalabad)/GHZU

Saqib plans to continue work on PingER monitoring for remote areas, in particular in Pakistan. He will use Android PingERs. This may partially tie into the Amity project.

He will also continue his work on Blockchain and plans to attend a Blockchain workshop in Guangzhou.

The 4th  Call for Proposals for The Asi@Connect Project:

  • Saqib submitted a concept note in WP6 with Wajahat and Les as co-applicant.
  • It was accepted and Saqib was given the go-ahead to submit a Full Proposal.
  • With suggestions and an endorsement letter from PERN plus CVs from Wajahat and Les, Saqib put together a full proposal and it was submitted 11/6/2019.

Thailand, Charnsak 10/15/2019

MAs are down. Charnsak (by email 10/22/2019) said: "They have changed the Networking policy. The pinger may need to wait for 5-6 months for me to go back (from post-doc at University of Vienna) and change things myself." Charnsak is in Vienna for several months. Both the IPv4 and IPv6 MAs were disabled 11/5/2019.

UNIMAS

MA is down, email sent asking for update 10/13/2019. No response by 11/3/2019,  MA has been Disabled.

SLAC (Updated 8/26/2019) 

The talk on PingER at the Silicon Valley Samsung HQ 7/17/2019, went well, see link below. We can use this talk for the Internet Archive.

Les developed a tool to help in determining where targets are needed and some possibilities etc.

Motion metrics are working once again.  See https://www-iepm.slac.stanford.edu/pinger/pinger-metrics-motion-chart.html (you will need to enable Flash, this is easiest done on Firefox)

Umar 

Motion charts at https://www-iepm.slac.stanford.edu/pinger/pinger-metrics-motion-chart.html was failing it no longer displayed the contents of the charts. Umar looked at the problem and suggested a solution.  Les applied solution but did not fix in Chrome or Firefox.  See PingER Metrics Motion Chart#October2019 for details. Les finally discovered and fixed a few problems with prm.pl, create-motion-charts-page.pl, create-motion-charts-pages.pl. It is now working again but requires enabling Flash. Discussed with Umar, i=t would be possible to make the web page not use Flash, but it could be non-trivial. An alternative might be to use a similar tool called Explorer (see https://www-iepm.slac.stanford.edu/pinger/explorer.html). The web is very valuable for identifying anomalous behavior which may require filtering the data.

Unfortunately Umar has not had any cycles to look into IPv6 vs IPv4 study. I suspect we should give up on this.

State of MAs.

    • Amity will look to see if they know of any targets in Jammu Kashmir.
      • Answer appears to be no.
    • Next meeting will be in a month.
      • Amity will set up a google poll to determine the date and time 
        • The current time of 20:00 in the US and 08:30 at Amity is appropriate.
      • Amity will set up and notify the team of the meeting by Zoom. If this is a big problem Les can set up the Zoom meeting.
      • Amity responded 10/18/2019: We will set up a meeting within the next week. No response by 11/15/2019. Amity responded

Bebo

Bebo noted the recent unrest in Iran and asked whether the impact could be seen in the PingER data. Les investigated.  The impact is very noticeable see PingER Iran Internet interrupted November 2019

Bebo wondered if we could detect such impacts automatically. Les pointed out it may be possible. A problem maybe avoiding a large number of false positives. Some work was been done on detecting similar anomalies in TCP throughput data see for example Anomalous Event Detection that included the Plateau project. This would be an interesting project for a student.

 

NUST (Updated 7/24/2019)

 

IPv6 host at NUST:

Wajahat has requested Hasan to install PingER on an IPv6 host at NUST, Saqib has contacted Hasan to tell him where to find and upload the code. There is not a host name for the MA yet. Hopefully, this will be available by next month's meeting.

  •  7/24/2019 Les emailed Wajahat with a request for an update.
  • At the meeting Wajahat had asked the student to contact Saqib and get the information on energizing IPv6. Saqib provided the information, but the student could not access the URL (apparently the URLwas down). Wajahat was on leave and when he returned the internship had expired, so Wajahat is unsure what happened. Wajahat will start a new student next week and will set him on the IPv6 project. Progress?

Wajahat has a new intern. He is going through training for installing PingER. Wajahat hopes he will be ready to start real working in a couple of weeks following last month's meeting. Progress?

There is a problem with the nwfpuet host that appears to have started in April 2019.  For more detail see here.  Email sent to Wajahat 11/7/2019 and again 11/20/2019.

The Pakistan hosts: monitor, maggie2 and vu are not working. There have been several email exchanges between Wajahat and Les, and Wajahat says "These guys are not responding. We are trying to contact them. Already tried multiple times."

UAF (University of Agriculture, Faisalabad)/GHZU

Saqib plans to continue work on PingER monitoring for remote areas, in particular in Pakistan. He will use Android PingERs. This may partially tie into the Amity project.

He will also continue his work on Blockchain and plans to attend a Blockchain workshop in Guangzhou.

The 4th  Call for Proposals for The Asi@Connect Project:

  • Saqib submitted a concept note in WP6 with Wajahat and Les as co-applicant.
  • It was accepted and Saqib was given the go-ahead to submit a Full Proposal.
  • With suggestions and an endorsement letter from PERN plus CVs from Wajahat and Les, Saqib put together a full proposal and it was submitted 11/6/2019.

Thailand, Charnsak 10/15/2019

MAs are down. Charnsak (by email 10/22/2019) said: "They have changed the Networking policy. The pinger may need to wait for 5-6 months for me to go back (from post-doc at University of Vienna) and change things myself." Charnsak is in Vienna for several months. Both the IPv4 and IPv6 MAs were disabled 11/5/2019.

UNIMAS

MA is down, email sent asking for update 10/13/2019. No response by 11/3/2019,  MA has been Disabled.

SLAC (Updated 8/26/2019) 

The talk on PingER at the Silicon Valley Samsung HQ 7/17/2019, went well, see link below. We can use this talk for the Internet Archive.

Les developed a tool to help in determining where targets are needed and some possibilities etc.

Motion metrics are working once again.  See https://www-iepm.slac.stanford.edu/pinger/pinger-metrics-motion-chart.html (you will need to enable Flash, this is easiest done on Firefox)

Umar 

Motion charts at https://www-iepm.slac.stanford.edu/pinger/pinger-metrics-motion-chart.html was failing it no longer displayed the contents of the charts. Umar looked at the problem and suggested a solution.  Les applied solution but did not fix in Chrome or Firefox.  See PingER Metrics Motion Chart#October2019 for details. Les finally discovered and fixed a few problems with prm.pl, create-motion-charts-page.pl, create-motion-charts-pages.pl. It is now working again but requires enabling Flash. Discussed with Umar, it would be possible to make the web page not use Flash, but it could be non-trivial. An alternative might be to use a similar tool called Explorer (see https://www-iepm.slac.stanford.edu/pinger/explorer.html). The web is very valuable for identifying anomalous behavior which may require filtering the data.

Unfortunately Umar has not had any cycles to look into IPv6 vs IPv4 study. I suspect we should give up on this.

State of MAs.

vupk 29th August, The host Emailed Wajahat 11/3/2019.
Host
State
last seen
Status
pinger.nchc.org.tw Intermittent problems starting 11/9/2019, it is not pingable starting 11/12/2019.  
pinger.vu.edu.pkUnable to gather data since 29th August, 2019. The host is pingable. Emailed Wajahat 11/3/2019. Wajahat responded 11/11/2019 "Anything improved?". Les responded they are still not working with more details and suggesting we focus on vu. 11/20/2019 Les asks if there is an update? Wajanat responded 11/20/2019 "These guys are not responding. We are trying to contact them. Already tried multiple times." I propose we disable.8/28/2019 
monitor.seecs.edu.pkNo data since 10/29/2019, host is pingable email to Wajahat 11/7/2019, see vu for follow up.10/27/2019 
maggie2.seecs.edu.pkNo data since 11/4/2019, host is pingable email to Wajahat 11/2/2019, 11/20/2019. See vu for follow up.  
pinger.nwfpuet.edu.pkSomething amiss since April 2019 when it dropped from monitoring over 150 targets down to 4. There is nothing in <BeaconsList>, all the hosts it attempts to monitor are in the locally manually maintained <NodeList>. Does not ping by name. Email sent 11/7/2019, and again 11/20
Host
State
last seen
Status
pinger.nchc.org.tw Intermittent problems starting 11/9/2019, it is not pingable starting 11/12/2019.  
pinger.uum.edu.my

Unable to gather data since

2nd May 2019.

Host is pingable.

8/28/2019 
monitor.seecs.edu.pkNo data since 10/29/2019, host is pingable email to Wajahat 11/7/2019.10/27/2019 
maggie2.seecs.edu.pkNo data since 11/4/2019, host is pingable email to Wajahat 11/2/2019.  
pinger.nwfpuet.edu.pkSomething amiss since April 2019 when it dropped from monitoring over 150 targets down to 4. There is nothing in <BeaconsList>, all the hosts it attempts to monitor are in the locally manually maintained <NodeList>. Does not ping by name.  
pinger.uum.edu.my

Unable to gather data since 2nd May 2019. Host is pingable. Sent email 5/5/2019 to Adib, he will contact Dr. Suhaidi. Sent reminder 5/14/2019, Adib has contacted Dr Suhaidi who will get someone to help. Still down 6/2/2019, sent another reminder to Adib. Adib nudged Sohail. 6/19/2019 emailed Adib. 6/26/2019 Adib responded "Prof. Suhaidi has promised to follow up, but he was fully occupied / outstation early this month.Kindly give our friends some time ^_*". Sent reminder email 8/25/2019. Email 10/13/2019 to Adib and Sohail, will disable if no update by end October 2019. Suhaidi responded "Hi Les, will address this and get back to you soon. ". 11/3/2019 Still no data gathered, Disabled gathering and notified Sohail and Abid.

5/2/2019Disabled
pinger.unimas.myThis has been unavailable for 6 months. Disabled as of end October since no response to emails. Notified Johari 11/3/2019.5/20/2019Disabled
pingeramity.inContinues to be unstable. Email 8/29/2019.   

Sent email 5/5/2019 to Adib, he will contact Dr. Suhaidi. Sent reminder 5/14/2019, Adib has contacted Dr Suhaidi who will get someone to help. Still down 6/2/2019, sent another reminder to Adib. Adib nudged Sohail. 6/19/2019 emailed Adib. 6/26/2019 Adib responded "Prof. Suhaidi has promised to follow up, but he was fully occupied / outstation early this month.Kindly give our friends some time ^_*". Sent reminder email 8/25/2019. Email 10/13/2019 to Adib and Sohail, will disable if no update by end October 2019. Suhaidi responded "Hi Les, will address this and get back to you soon. ". 11/3/2019 Still no data gathered, Disabled gathering and notified Sohail and Abid.

5/2/2019Disabled
pinger.unimas.myThis has been unavailable for 6 months. Disabled as of end October since no response to emails. Notified Johari 11/3/2019.5/20/2019Disabled
pingeramity.inContinues to be unstable. Email 8/29/2019.   
pinger6.cs.ubru.ac.th

Stopped being pingable 2/25/2019. Thus by default, the gathering failed. Emailed Charnsak 3/4/2019, 3/15/2019. Down again 4/23/2019, restored 4/27/2019. Down again 6/6/2019. It is pingable. Sent email 7/5/2019. No response. Sent another email 7/24/2019 it was not pingable. Fixed 8/15/2019, then down again 8/24/2019, it is pingable from SLAC. Unable to ping from http://pinger6.cs.ubru.ac.th/cgi-bin/traceroute.pl?function=ping&target=www.slac.stanford.edu&options=-i%200.2. Email 8/28/2019. Email 10/13/2019. Charnsak responded he plans to look at it. Charnsak responded 10/22/2019 "They have changed the Networking policy. The pinger may need to wait for 5-6 months for me to go back (from post-doc at University of Vienna) and change things myself." Host disabled 11/3/2019

9/29/2019Disabled
pingerpinger6.cs.ubru.ac.th

Stopped being pingable 2/25/2019. Thus by default, the gathering failed. Emailed Charnsak 3/4/2019, 3/15/2019. Down again 4/23/2019, restored 4/27/2019. Down again 6/6/2019. It is pingable. Sent email 7/5/2019. No response. Sent another email 7/24/2019 it was not pingable. Fixed 8/15/2019, then down again 8/24/2019, it is pingable from SLAC. Unable to ping from http://pinger6.cs.ubru.ac.th/cgi-bin/traceroute.pl?function=ping&target=www.slac.stanford.edu&options=-i%200.2. Email 8/28/2019. Email 10/13/2019. Charnsak responded he plans to look at it. Charnsak responded 10/22/2019 "They have changed the Networking policy. The pinger may need to wait for 5-6 months for me to go back (from post-doc at University of Vienna) and change things myself." Host disabled 11/3/2019

9/29/2019Disabled
pinger.cs.ubru.ac.thDown starting 8/19/2019, unable to ping from SLAC. Email 8/28/2019. Email 10/13/2019, Charnsak responded he plans to look at it. Charnsak responded he plans to look at it. Charnsak responded 10/22/2019 "They have changed the Networking policy. The pinger may need to wait for 5-6 months for me to go back (from post-doc at University of Vienna) and change things myself." Host disabled 11/3/20198/19/2019Disabled

Next Meeting

Next meeting:  There will be a Doodle poll, for December or January 2020 at 10 pm Pacific time; a day later 10:00 am Pakistan time; 10:30 am India time; 1:00 pm Malaysian & Guangzhou time;  2:00 pm Thailand time; 7:00 am Jordan time. 6:00am Turkey time.  

...

Down starting 8/19/2019, unable to ping from SLAC. Email 8/28/2019. Email 10/13/2019, Charnsak responded he plans to look at it. Charnsak responded he plans to look at it. Charnsak responded 10/22/2019 "They have changed the Networking policy. The pinger may need to wait for 5-6 months for me to go back (from post-doc at University of Vienna) and change things myself." Host disabled 11/3/20198/19/2019Disabled

Next Meeting

Next meeting:  There will be a Doodle poll, for December or January 2020 at 10 pm Pacific time; a day later 10:00 am Pakistan time; 10:30 am India time; 1:00 pm Malaysian & Guangzhou time;  2:00 pm Thailand time; 7:00 am Jordan time. 6:00am Turkey time.  

...

Old information

Bebo Moved here 11/20/2019

Is wondering about a meeting of PingER collaborators with possible funding from the Internet Archive or possibly others. Also possibly seeking other sources of funding for PingER activities.

It is time to re-raise and discuss the talk for the Internet Archive, and what we might expect from them and how much effort it is to prepare, document and make the data available to the Archive. So far:

  • Les and Bebo visited the Internet Archive (IA, see https://archive.org/) and initiated a discussion on archiving PingER data (i.e. a mirror for SLAC) at the IA and also giving a talk on PingER at the IA. 

    We agreed to put together a disk with a snapshot of the appropriate archive files containing analyzed data back to 1998 plus some documentation and then approach them about archiving the data, and a possible talk showing how the data can be used, e.g. comparison with economic indices, identifying on the network on events such as earthquake, societal unrest, cutting of cables etc.  First part of the talk based on the presentation at Samsung. Depending on level of interest and support, we could . offer to update the data.
    • The IA responded with information on using an IA Python library to archive the data at the IA. Les responded with interest but lack of resources until mid-September at the earliest.  Also maybe after giving a talk at IA there might be interest in collaborating from some of the attendees.
    • The IA also responded pointing to a form to fill out for a request to give a talk at the IA.
      • Les filled out the form.
      • Les sent an email to the IA to make sure they had received the form and asking if anything else is required.
      • IA suggested September, given the China meeting, this was missed.

Adib  (Updated 7/22/2019) Moved here 11/7/2019.

...