Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

? Individual emails sent

Actual Attendees

Wajahat, Saqib, Charnsak, Umar, Les

Others

Administration

...

  • Manuscript titled - Clustering Analysis of PingER Network Data for Vardha Cyclone has been PEER REVIEWED and ACCEPTED for publication in the Confluence-2018:8th International Conference: on the theme “Cloud Computing, Data Science & Engineering”  prevented presented on 11th - 12th January 2018 at Amity University Uttar Pradesh, Noida, India. 

  • Their PingER MA system has crashed and they are reinstalling the project.
    • They are having problems with the traceroute server and ping_data.pl (that gathers the data). PingER MA having problems, Les is working with them. I believe traceroute.pl (they have an unusual linux traceroute command that does not support all the options used by PingER) and ping_data.pl are fixed. It looks like pinger2.pl is not running.

Bebo

Bebo (No update 3/8/2018)

Looking into moving PingER to a "blockchain" database good for decentralize distribution of data. Monitoring sites would then be able to write to a distributed ledger. This would change the architecture to a more peer to peer architecture. It helps with continuity of PingER since reduces dependence on a single site (SLAC). See Block Chain in Future PingER Projects. Bebo sent several references to Saqib who has looked at them. We could start with real time data without including the whole archive, i.e. in parallel to the continued centrally manged archive. It would be a private Blockchain.  Joahari is also interested and will follow up with Bebo and Saqib.

Thailand

A possible project would be to compare the RTTs from ping/ICMP with those from TCP SYN ACK delays as seen from Thailand for both ipv4 and ipv6. See Validating ICMP ping measurements against TCP nping measurements. Les sent to Johari and Charnsak, the perl script (ping-vs-tcp.pl) he has written to make the measurements. No update 3/8/2018. Charnsak will look at new tool from Umar that compare TCP and ping RTTs, plus IPv6 vs IPv4. Hopes to install new MA. Les is looking at MoU.

UUM (No input from Adib 12/7/2017, 3/8/2018)

...

  • The BIND paper ("BIND: An Indexing Strategy for Big Data Processing") is now online.  Adib will provide a URL or a copy of the paper so we can add it to papers related to PingER.

  • There was  a problem pinging the MA pinger.uum.edu.my.  It is now working as promised.

  • Adib, Bebo, Les met with Southampton Web observatory person. There seemed to be enthusiasm. Adib was going to send some materials to Southampton. The person at Southampton gave us some links. Adib is in the early stages of exploring what web observatory data to link with such as business context indicatorsm social media and  government sites.

NUST: Updates 12Updated 3/8/20172018)

One

The student

is working on: Data Mining doing research on PingER data. He will be using Hadoop on a supercomputer at NUST.The student is getting to know Hadoop.  Completed

who was working on getting new Pakaistani MAs has completed the intership and left at the end of Feb.

Looking

Wajahat is looking for new students, it will take

3

~3 weeks find and train one so no progress in setting up new MA

Wajahat is trying to contact the sick Pakistani MA nodes but the current week is exam week. He will give detailed response next week. So Les has paused Disabling (see below). We can always restore an MA for testing or when it is once again reliable.  Wajahat proposes to get  a list of the new Universities in Pakistan and contact them encouraging them to joining participate in PingER and set up MA. He will start next week when the students are availableproposes to get  a list of the new Universities in Pakistan and contact them encouraging them to joining participate in PingER and set up MA. They have made a list of new university sites, communications networks, Labs in different regions of Pakistan (especially the remote regions) and will make contact.

There is an upcoming grant call for projects between Pakistan and the US. Topics may be focused on cybersecurity, health and education. It has not been announced yet. Wajahat will get the details and share them with the team as soon as they are available. It is interesting since getting a US partner appears to be a roadblock for many potential Pakistani responders. However, the topics may not be very related to PingER. For cyber the main things we could think of were: punching holes in firewalls to allow pings, how to misuse ping (e.g. ping-of-death, or using anomalous ping packets to deduce the OS etc. flood pings for DOS), host can respond to ping but applications do not work.  Fear of misuse of pings can result in the system administrator, network administrator or cyber security blocking pings. Possibility might be a study of what fraction of say working www/dns etc. apps (i.e. checking if a host responds to the relevant port) do not respond to pings.  This could be by application, by country or by region etc.  Also how to protect a remote pinger traceroute or server from being used in DOS attacks.

 

...

  • 121.52.146.180 (kohat.edu.pk) down since Nov 22/2017. Wajahat recommends conitnuinconitnuing
  • aup.seecs.edu.pk  host is pingable, Wajahat still trying, not given up. Still down 4/15/2017, 7/3/2017, 8/11/2017, 9/16/2017 (does not ping), 1/8/2018 (pings). Contacted and they will fix the problem soon.10/24/2017. They are non responsive as of Jan 19, 2018. Disabled
  • pinger-ncp.ncp.edu.pk pings but can't gather data 8/11/2017 and 9/16/2017. Contacted. Pings but can't gather data 10/24/2017. They are in the process of restoring 1/17/2018. Still down February 28, 2018, await new student.

They have made a list of new university sites, communications networks, Labs in different regions of Pakistan (especially the remote regions) and will make contact.

...

UNIMAS (No update 3/8/2018)

  • Johari ran into a problem with the Raspberry Pi image creation. Apparently the image has to be burnt with exactly the same size as the capacity of the microSSD, and the latter varies. There may not be a solution. Do we give up?
  • We have lost both MAs at UNIMAS:
    • Johari is looking at updating the PingER Malaysia web site (pinger.unimas.my)
    • Johari has been unable to contact Hafiz to get MyREN monitor at UNIMAS (perfsonar-unimas.myren.net.myworking again. There was a dicussion between Johari and Adib. Adib confirm Hafiz is still at MYREN, MYREN are moving locations which may have impact on some servers and availability of Hafiz.  Adib will try and contact Hafiz.

...

Working on proposed framework for Blockchain, has a rough draft, will sahre share with the group

Pinger.gzhu.edu.cn MA is down since November due to a possible security issue. Saqib recommends giving Is there any progress, can we assist, do we disable?up.

IPv6 node in Beijing is down they are upgrading the subnet cloud. Hope to be restored in 2 weeks.

Saqib submitted a project in CERNET to monitor the performance of  IPv6 network using PingERv6. He received the news that the project is accepted with 100K RMB. Now he has 2 accepted projects regarding PingER and total amount he has is near about 40K USD. Further, in his lab, three U1 servers have already arrived through another  grant for research purpose. We can also use them for our PingER project.  

Therefore, the CERNET has given Saqib a IPv6 based CentOS 6.8 machine in cloud. Now he is  trying to deploy the PingER server on the machine. Lets see how it will work on IPv6 based network.  This is a 2 year project.

Saqib has made contact with John Pickard author of  "Quality of IPv6 Enablement of Universities: An International Study"  who has provided a list of about 125 Universities in about 60 countries hosting IPv6 sites. However many are proxies.  Les has suggested using perfSONAR (there are about 1000 and they all have lat longs in the sperfSONAR data base. Saqib is gathering the list, then we will see how many have IPv6 addresses.

The paper title: " Missing Values Imputation in PingER Internet End-to-end Performance Measurements using k-nearest neighbors (k NN)" was not accepted in IMC 2017. He is updating the paper according to the reviewer’s comments. Hopefully, Saqib will submit it at some other venue. Not yet decided about the submission venue. Need some suggestions. Updated but not decided where to submit. Update 12/4/2017?

Currently, no data is available on PingER on Android due to unavailability of the live IP address. No update 4/19/2017, 7/6/2017. Email sent to Sara Masood. No update 9/24/2017. Any update 10/24/2017. No progress 1/18/2018.

PingER at SLAC

Umar looking at extending the comparison IPv6 vs IPv4 ping RTTs and TCP vs ICMP/ping RTTs. See Towards Analysis of ICMP vs TCP Ping Latencies

XSS vulnerability in traceroute.pl

Working with Saqib to test pinger2.pl to make it work with IPv6 servers and targets.

  • Meta database (NODEDETAILS) is now fully ipv6 compliant, need to enter some ipv6 hosts.
  • pinger2.pl works for either an IPv4 MA or an IPv6 MA. 
  • Gathering works for both IPv4 and IPv6, the analysis and presentation is also working for both. 
  • We will need to add an item to the pingtable.pl form to enable the ability to select IPv4 or IPv6 measurements or both. 

Working on Validating ICMP ping measurements against TCP nping measurements.  

  • Scripts written to generate configuration files for perfSONAR and PingER targets.  
  • Also have script to compare ICMP/ping RTTs with TCP (syn/ack) RTTs.
  • Staring analysis with Excel. The agreement looks good. 
  • Want MAs at SLAC (Les, Umar), China (Saqib), Malaysia (Johari), Thailand (Charnsak), Pakistan (Wajahat?)

PingER data is currently kept on a Sun Solaris file server front ending a  1TByte disk array.  Solaris is no longer supported at SLAC and the disk array is 13 years old so we need to migrate the data to GPFS. Les is working on this.

 

HostStatelast seenStatus
PakistanSee above.  
rainbow.inp.nsk.suUnable to gather data or ping host, Sent email 1/26/2018.Dec 6, 2017restored January 27,2018
pinger.ascr.doe.govNode changed to appsvr2.ascr.doe.gov, unable to ping or gather data, email sent 1/26/2018appsvr2 never seenFixed the SrcName working again Feb 12, 2018
pinger.gzhu.edu.cnThey have security concernsNov 23, 2017 
pingeramity.inUnable to gather data, needs re-installing the MA. Working with Amity, emails Jan 12, Jan 16, Jan 26, Feb 20March 22, 2017 
multivac.sdsc.eduDisabled Jan 2018Aug 13, 2017 
pinger.ictp.it Pings but nothing else. Emails sent June 6, 2017, June 28, 2017, August 9, 2017. Jan 17, 2018, gave up, does not ping,marked as DisabledMar 9thDown

Next Meeting

Next meeting:  Thursday, March 28th  9pm Pacific time; Friday, March 29th, 2018  9:00am Pakistan time; 12:00noon Malaysian & Guangzhou .time; and 11am Thailand time.

...

PingER at SLAC

Umar looking at extending the comparison IPv6 vs IPv4 ping RTTs and TCP vs ICMP/ping RTTs. See Towards Analysis of ICMP vs TCP Ping Latencies

XSS vulnerability in traceroute.pl

Working with Saqib to test pinger2.pl to make it work with IPv6 servers and targets.

  • Meta database (NODEDETAILS) is now fully ipv6 compliant, need to enter some ipv6 hosts.
  • pinger2.pl works for either an IPv4 MA or an IPv6 MA. 
  • Gathering works for both IPv4 and IPv6, the analysis and presentation is also working for both. 
  • We will need to add an item to the pingtable.pl form to enable the ability to select IPv4 or IPv6 measurements or both. 

Working on Validating ICMP ping measurements against TCP nping measurements.  

  • Scripts written to generate configuration files for perfSONAR and PingER targets.  
  • Also have script to compare ICMP/ping RTTs with TCP (syn/ack) RTTs.
  • Staring analysis with Excel. The agreement looks good. 
  • Want MAs at SLAC (Les, Umar), China (Saqib), Malaysia (Johari), Thailand (Charnsak), Pakistan (Wajahat?)

PingER data is currently kept on a Sun Solaris file server front ending a  1TByte disk array.  Solaris is no longer supported at SLAC and the disk array is 13 years old so we need to migrate the data to GPFS. Les is working on this.

 

HostStatelast seenStatus
PakistanSee above.  
rainbow.inp.nsk.suUnable to gather data or ping host, Sent email 1/26/2018.Dec 6, 2017restored January 27,2018
pinger.ascr.doe.govNode changed to appsvr2.ascr.doe.gov, unable to ping or gather data, email sent 1/26/2018appsvr2 never seenFixed the SrcName working again Feb 12, 2018
pinger.gzhu.edu.cnThey have security concernsNov 23, 2017 
pingeramity.inUnable to gather data, needs re-installing the MA. Working with Amity, emails Jan 12, Jan 16, Jan 26, Feb 20March 22, 2017 
multivac.sdsc.eduDisabled Jan 2018Aug 13, 2017 
pinger.ictp.it Pings but nothing else. Emails sent June 6, 2017, June 28, 2017, August 9, 2017. Jan 17, 2018, gave up, does not ping,marked as DisabledMar 9thDown

Next Meeting

Next meeting:  Thursday, March 28th  9pm Pacific time; Friday, March 29th, 2018  9:00am Pakistan time; 12:00noon Malaysian & Guangzhou .time; and 11am Thailand time.

...

Old information

GZHU (moved here 3/8/2018)

Saqib submitted a project in CERNET to monitor the performance of  IPv6 network using PingERv6. He received the news that the project is accepted with 100K RMB. Now he has 2 accepted projects regarding PingER and total amount he has is near about 40K USD. Further, in his lab, three U1 servers have already arrived through another  grant for research purpose. We can also use them for our PingER project.  

Therefore, the CERNET has given Saqib a IPv6 based CentOS 6.8 machine in cloud. Now he is  trying to deploy the PingER server on the machine. Lets see how it will work on IPv6 based network.  This is a 2 year project.

Saqib has made contact with John Pickard author of  "Quality of IPv6 Enablement of Universities: An International Study"  who has provided a list of about 125 Universities in about 60 countries hosting IPv6 sites. However many are proxies.  Les has suggested using perfSONAR (there are about 1000 and they all have lat longs in the sperfSONAR data base. Saqib is gathering the list, then we will see how many have IPv6 addresses.

The paper title: " Missing Values Imputation in PingER Internet End-to-end Performance Measurements using k-nearest neighbors (k NN)" was not accepted in IMC 2017. He is updating the paper according to the reviewer’s comments. Hopefully, Saqib will submit it at some other venue. Not yet decided about the submission venue. Need some suggestions. Updated but not decided where to submit. Update 12/4/2017?

Currently, no data is available on PingER on Android due to unavailability of the live IP address. No update 4/19/2017, 7/6/2017. Email sent to Sara Masood. No update 9/24/2017. Any update 10/24/2017. No progress 1/18/2018.

GZHU (moved here 1/15/2018)

...