Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

APEX/Oracle user interface to PingER NODEDETAILS database

This does did not accept IPv6 Addresses, see INC0176849 and INC0176966. It has been fixed. 

Code Block
%NODE_DETAILS=(
"2001:da8:270:2018:f816:3eff:fef3:bd3" => [  
"2001:da8:270:2018:f816:3eff:fef3:bd3",   
"gzhu.edu.cn",   
"CN.GZHU.EDU.IPV6",
"CERNET Cloud",  
"Tsinghua University, Beijing",  
"China",
"East Asia",
"23.037002 113.36777",
"M",
"http://[2001:da8:270:2018:f816:3eff:fef3:bd3]/cgi-bin/traceroute.pl?function=ping",
"http://[2001:da8:270:2018:f816:3eff:fef3:bd3]/cgi-bin/traceroute.pl?choice=yes",
"http://[2001:da8:270:2018:f816:3eff:fef3:bd3]/cgi-bin/ping_data.pl",
"http://www.gzhu.edu.cn/",
"",
"",
"",
"Saqib Ali <saqibutm\@outlook.com>, Prof. Guojun Wang, csgjwang\@gzhu.edu.cn; csgjwang\@gmail.com",
"Test record by Venkat based on add by Cottrell 12/19/2017.",
],

...

ipaddress 

Ipaddress is limited to 14 15 characters and expecting a format of ^[[:digit:]]{1,3}\.[[:digit:]]{1,3}\.[[:digit:]]{1,3}\.[[:digit:]]{1,3}$

If you want to increase the length or change the format, we need to modify the interface code. Proposal is to extend the field to 100 characters (like the other fields) and not apply any filters.  This was done.

Testing

The connection to the database is  defined in: /afs/slac/package/pinger/oracleArchive/netratDb.pm

...

One can use https://network-tools.webwiz.net/ping.htm to check if a target responds to IPv6 pings.  As part of this we discovered that the SLAC border was blocking IPv6 pings (see INC0178575). This was fixed.

XML file at Guanhzhou

See here. Currently, it contains random pingable IPv6 addresses as Saqib took it from http://www.ipv6forum.com/ipv6%5fenabled/approval%5flist.php.  He proceeded as follows:

  1. I am trying to make a list of IPv6 pingable sites of the education institutes of the world. For this, I have taken the list of top 1000 universities of the world (http://cwur.org/2017.php)
  2. Next I am validating each site on http://ipv6-test.com/validate.php for AAAA record.
  3. When I get the IPv6 address, I checked its ping status on https://network-tools.webwiz.net/ping.htm . Currently, I do not have a direct access to IPv6 machine.
  4. If the address is pingable, I add its details in the attached excel sheet.
  5. Latitude and Longitude are calculated using https://www.iplocation.net/index.php
  6. The XML file in use on the Measurement Agent is available.
  7. I have added few sites in the attached file. However, I am facing problems in finding Lat/log of the server as it seems that they are not located on the campus of the University. Kindly check the remarks column of the US universities.
perfSONAR

Unfortunately it is very common that sites use a proxy for common services such as www.   A possibility is to use perfSONAR. These are high performance throughput monitoring sites mainly in US, and Europe. perfSONAR fully supports IPv6 and has a data base that includes latitude and longitude.  When we were working on TULIP ( the use of pings from ping servers to find the location of targets) we used these perfSONAR ping/traceroute servers/landmarks to make the RTT measurements.  There is some documentation at https://confluence.slac.stanford.edu/display/IEPM/Automated+PerfSONAR+Landmark+finding

East Carolina University list

Quality of IPv6 Enablement of Universities: An International Study by John Pickard and Anne Y Patric of East Carolina University has a list of about 1000 world universities and their IPv6 addresses if they have them. It uses IT sonar agents from  Nephos6, to perform "user experience" measurements accessing select websites from multiple global geographic vantage points. About 125 hosts have IP addresses. We wrote a  perl script (ping-ipv6.pl) to ping all those IPv6 addresses from an IPv6 host at SLAC and about 67 respond to pings. The script runs against the file of ipv6 universities exported from the Excel spreadsheet as a tab delimited file (top-uni.txt). Unfortunately, many of these hosts were proxies at unknown (to us) places.  

perfSONAR

Unfortunately it is very common that sites use a proxy for common services such as www.   A possibility is to use perfSONAR. These are high-performance throughput monitoring sites mainly in US, and Europe. perfSONAR fully supports IPv6 and has a database that includes latitude and longitude.  When we were working on TULIP ( the use of pings from ping servers to find the location of targets) we used these perfSONAR ping/traceroute servers/landmarks to make the RTT measurements.  There is some There is a spreadsheet of active landmarks that can make pings at http://www-wanmon.slac.stanford.edu/cgi-wrap/reflector.cgi?function=landmarks&ability=1. I am not sure how current this is, the psonar_auto.pl job updates the web page information and runs monthly.  Tulip has not been maintained for a couple of years.  There is more documentation at https://confluence.slac.stanford.edu/display/IEPM/Automated+PerfSONAR+Landmark+finding

There is a spreadsheet of active landmarks that can make pings TULIP+Analysis and looking at http://www-iepmwanmon.slac.stanford.edu/pinger/crontab-slaconly.txt you can see the tulip jobs that are run by cron.

In the spreadsheet there is a column labelled Ping URL. It contains the URL of the ping server for the Measurement Agent (MA). 

We wrote a perl script ping-ipv6-ps.pl  to ping all those IPv6 addresses from an IPv6 host at SLAC and none responded to an IPv6 ping. The config file is /u/sf/cottrell/ps-lm.csv obtained by exporting the active landmarks. This yielded about 27 host with their lat, long, country and city. One can also look at the JSON files with the information for the perfSONAR nodes using the information here.

East Carolina University list

cgi-wrap/reflector.cgi?function=landmarks&ability=1. I am not sure how current this is, the psonar_auto.pl job updates the web page information and runs monthly.  Tulip has not been maintained for a couple of years.  There is more documentation at https://confluence.slac.stanford.edu/display/IEPM/TULIP+Analysis and looking at http://www-iepm.slac.stanford.edu/pinger/crontab-slaconly.txt you can see the tulip jobs that are run by cron.

In the spreadsheet there is a column labelled Ping URL. It contains the URL of the ping server for the Measurement Agent (MA). However this only yielded a few (53) hosts.

We, therefore, wrote a perl script json-to-xml.pl  to read the perfSONAR JSON configuration (see information) and produce in STDOUT a CSV file of hosts with  IPv4 and IPv6 addresses (e.g. ps-v4-lc.cf, lc stands for created by Les Cottrell, as opposed to sq created by Saqib Ali).These files were used as config files inputted to ping-vs-tcp-ps.pl that measured the ICMP and TCP RTTs to each of the hosts and outputted the information to STDOUT (e.g. ping-vs-tcp-ps.pl --conf  ps-v4-lc.cf | tee ps-v4-sl, sl stands for the MA at SLAC as opposed to ch for China, th for Thailand) that were filtered using for example grep summary ps-v4-sl.txt >! ps-v4-sl.csv and then imported to Excel analyzed and saved as ps-v4-sl.xlsxQuality of IPv6 Enablement of Universities: An International Study by John Pickard and Anne Y Patric of East Carolina University has a list of about 1000 world universities and their IPv6 addresses if they have them. It uses IT sonar agents from  Nephos6, to perform "user experience" measurements accessing select websites from multiple global geographic vantage points. About 125 hosts have IP addresses. We wrote a  perl script (ping-ipv6.pl) to ping all those IPv6 addresses from an IPv6 host at SLAC and about 67 respond to pings. The script runs against the file of ipv6 universities exported from the Excel spreadsheet as a tab delimited file (top-uni.txt).  

SLAC IPv4 Pinger hosts

Using %NODE_DETAILS we wrote a script ping-ipv6vs-pingertcp.pl to identify (using dig hostname AAAA) whether the host has an IPv6 address and if so try and ping it with ping6to read a configuration file of hosts to ping and nping (measures TCP RTT for SYN and return ACK). This yielded about 53 successful hosts for which we provided the name(ipv6 address), lat long, country.

...