Purpose
PingER (Ping End-to-end Reporting) is the name given to the Internet End-to-end Performance Measurement (IEPM) project to monitor end-to-end performance of Internet links. The project now involves hundreds of sites in many countries all over the world and we are actively seeking new partners for this project.
- Brochure, Examples of Use, Publication, Tutorial , What is PingER (from ICTP/Trieste)
Case Studies
Also see https://www.internetperils.com/perilwatch/index.php for routing changes occurring from major events, and Keep it On on the 213 Internet shutdowns in 2019. An internet shutdown happens when someone — usually a government — intentionally disrupts the internet or mobile apps to control what people say or do.
Performance comparisons
- Comparison of Speedtest download speeds vs PingER derived throughput, 2014
- Throughput vs Loss, 2000
- Ookla's speedtest throughput measurements, 2007
- ZDnet Australia Speedtest , 2007
Covid-19
PingER and Covid-19 and the Republic of South Africa and the impact of High Speed connectivity
Covid-19 - Visualizing the data with Motion Charts
Europe
Africa
Impact of cable cuts on Southern Africa Jan 2020.
Liquid Telecom to build new undersea cable, by 2018
Forecast 2014: Africa
Sudan disconnects from the Internet, Sep 2013
Nigeria case study, 2012
Sub-Saharan Africa - Updates for year 2010 Created by Syed Zafar Ul Hussan Gilani on Oct 20, 2010.
New E. Coast of Africa Fibre Created by Les Cottrell Jul 24, 2009
Sub-Saharan Africa - Revised Statistics (2008) Created by Umar Kalim on Dec 18, 2008.
IHY Case Study Created by Shahryar Khan on Jun 12, 2007.
Election interference and Internet shutdowns. Created by Les Cottrell, 6/21/2019
East Asia
Japanese Earthquake March 11th, 2011 Created by Les Cottrell on Mar 12, 2011.
East Asia Case Study Created by Shahryar Khan on Aug 10, 2007.
Central Asia
Kazakhstan January 2022, see https://www.theguardian.com/world/2022/jan/06/kazakhstan-bitcoin-internet-shutdown
Fibre Cut
WASC Fibre Cut Created by Umar Kalim on Aug 06, 2009.
Effects of Mediterranean Fibre Cuts December 2008 Created by Les Cottrell on Dec 20, 2008.
Effects of Fibre Outage through Mediterranean Created by Les Cottrell on Jan 31, 2008.
Latin America
Colombia, 2015
Chilean Earthquake Feb 27th, 2010 Created by Les Cottrell on Mar 02, 2010.
Latin America Case Study Created by Shahryar Khan on Dec 18, 2006.
Middle East
Syria May 7-8 2013
Syria shuts down its Internet connection, November 2012
The Arab Spring 2011 and Internet Instability seen by PingER Created by Les Cottrell on Feb 21, 2011.
Egypt shuts down their Internet Created by Zafar Ul Hussan Gilani on Jan 30, 2011.
Palestine Case Study Created by Les Cottrell on May 03, 2007.
South Asia
India revokes special status of Jammu Kashmir, August 2019.
Nepal Earthquake April 2015
Change in traceroute from SLAC to NUST 2014-2015
Bangladesh case study November 2014
Afghanistan Case Study on routing, updated 2014
South Asia Case Study 2010 Created by Les Cottrell on Apr 11, 2010.
South Asia Case Study - 2008 Created by Shahryar Khan on Jan 26, 2007.
Connecting to TEIN3
Pakistan and TEIN3 Created by Les Cottrell on Apr 12, 2010.
Indian Network Connects to TEIN3 Created by Les Cottrell on Apr 11, 2010.
Nepal connects to TEIN3 Created by Les Cottrell on Apr 11, 2010.
Sri Lankan LEARN network connects to TEIN3 Created by Les Cottrell on Apr 3, 2010.
Pakistan
Traffic between Lahore and Quetta being routed to Europe. Sept 2012.
Data Analysis for PERN Created by Amber Madeeha Zeb on October 17, 2011.
HEC PERN Analysis Report for September 2011 Created by Amber Madeeha Zeb on October 13, 2011.
Comparison of PoP (pingerjms.pern.edu.pk) and Non-PoP (pinger.usindh.edu.pk) Created by Amber Madeeha Zeb on May19, 2011.
UETTAXILA Analysis of changed Network Created by Les Cottrell on May 13, 2011.
Status of Pakistani monitoring hostsCreated by Les Cottrell on May 05, 2011.
Pakistani Case Study 2010-2011 Created by Les Cottrell on Dec 30, 2010.
SEECS to UET Taxila link Created by Les Cottrell on Dec 27, 2010.
Pakistan Created by Les Cottrell on Dec 27, 2010.
International Islamic University, Islamabad Created by Les Cottrell on Apr 24, 2010.
University of Balochistan Created by Les Cottrell on Apr 24, 2010.
University of Peshawar Created by Les Cottrell on Apr 24, 2010.
Case Study of SEECS, NUST & Pakistan - Jan '09 Created by Umar Kalim on Jan 21, 2009.
NIIT/Pakistan created on Jan 07, 2007.
South East Asia
Myanmar military shutdown Internet February 2021
Massive route leak slows down the Internet June 12, 2015
Denial of Service attack on UM Mar 2015
PingER: Malaysia Case Study 2014
AAG cable cut between Hong Kong and Vietnam September 15, 2014
Congestion at UNIMAS
Routing from UNIMAS
Malaysian Case Study
SE Asian Case Study
North America
Traceroute anomalies
Presentations on Case Studies
- Quantifying the Digital Divide: A Scientific Overview of Network Connectivity and Grid Infrastructure in South Asian Countries, S. Khan, R. L. Cottrell, U Kalim, A. Ali, CHEP07, Victoria Canada. Also SLAC-PUB 12581. Poster
- Internet Connectivity in Africa, presented by Les Cottrell at the Internet and Grids in Africa: An Asset fro African Scientists for the Benefit of African Society, 10-12 December 2007, Montpellier France.
- Internet View of the Digital Divide, Especially for Sub-Saharan Africa, presented by Les Cottrell at the IHY Africa Workshop 11-16 November 2007, Addis Ababab, Ethiopia.
- http://www.slac.stanford.edu/grp/scs/net/talk07/icfa-mexico07.pptQuantifying the Digital Divide: Latin America, S. Asia, Africa, presented by Les Cottrell at the ICFA Workshop on Digital Divide Issues for Global e Science, Mexico City Oct 24-27, 2007
- ICFA/SCIC report on Africa, Created Jan 07, 2007.
- Powerpoint presentation on Sub-Saharan Africa presented by Les Cottrell at the Sharing knowledge across the Mediterranean ICTP Trieste on Nov 06-08, 2006.
- Sub-Sahara Region, Created by Syed Akbar Mehdi on Oct 20, 2006.
Related Documents
From Content Blocking to National Shutdowns: Understanding Internet Disruptions
PingER Validation
- Derived Throughput
- Daily Data Validation Management
PingER Operations
- Downloading Pinger
- Requirements for Monitoring Host, Requirements for Remote Host
- Data: Meta database (NODEDETAILS), NODEDETAILS hints, NODEDETAILS schema, NODEDETAILS in Perl, NODETAILS in XML, Raw Data Format; Adding a new node to NODEDETAILS .
- PingER FAQ
- Management: Data Processing Workflow, Duties, Gathering delays, Maintaining collection & analysis, Restoring data, Usage Information for Scripts
PingER Deployment
- PingER deployment 2008
- Shockwave Map, Google Map, Node count Intensity map, Node count GeoMap, Interactive Java Map (VIPER)
- Beacons , Beacon Expansion
- Monitoring Hosts, Remote Hosts
- Regions, Hosts per Country by REgion
- Status of Pakistani monitoring hosts
PingER Databases
- NODEDETAILS
- Countries and Regions
- Database Passwords
- Database Synchronization
- PingER-DB Implementation details
- PingER DB usage
PingER Analysis
- PingER data Analysis
- Monitoring Data Format
- Anomalous Hosts
- CERN View
- Conditional Port Probability
- MOS
- Derivation of Directness of Connection
Toolbox
- PingER Host Searcher
- PingER Route Visualizer
- PingER Visualization(VIPER)
- PingER Smokeping Integration
- PingER Metrics Motion Chart
- PingER Metrics Intensity Maps
- PingER Node Count Intensity & GeoMaps
- PingER Monitored Node Status
- Deploying table.pl
- Updating ping_data.pl and traceroute.pl
Porting PingER Archive to NUST
- PingER Meta-Database
- Web interface to manage the PingER Meta-Database
- Synchronization of the SLAC and NUST databases
- Scripts for fetching data from monitoring sites and pinger management
PingER2
Installation
http://www.rnoc.gatech.edu/pinger2/
SLAC
http://confluence.slac.stanford.edu/display/IEPM/PingER2+at+SLAC
PingER2 Data Flow
Work in Progress
- Automating the creation of offsite.nodes directly from nodedetails.
- Automating the creation of beacons.txt directly from nodedetails.
- Document procedures for editing existing nodes.
Future Projects
Internet Lectures
TULIP
- TULIP Landmarks Analysis of tiering
- TULIP Central Reflector
- TULIP2
- TULIP Analysis
- TULIP Algorithm Trilateration
- TULIP Landmarks Laundering
- TULIP Replicated Servers
- TULIP Distance Calculation based on RTT
- TULIP database backup
- TULIP Landmarks Maintenance
- TULIP Web Based Visualization
- TULIP Algorithm Multilateration
- TULIP database Adding or Updating Landmarks
- TULIP Landmark finding the Latitude and Longitude manually
- TULIP Creating the Landmark XML files
- TULIP Roadmap
- TULIP Distance Variation with Alpha
- TULIP Landmarks Selection of Tier=0 hosts
- TULIP Alpha Determination
- TULIP Alpha Distributions
- TULIP Correlation Between RTT and Distance
- TULIP Alpha Variability
- TULIP Algorithm Trilateration with CBG
- TULIP Distance Error (Apollonius) based on Alpha
- TULIP Algorithm Alternative Trilateration Method
- TULIP Summary for CBG (Visualization Tool)
- TULIP Comparing geolocation techniques
- TULIP Algorithm Apollonius Technique and its Performance
- TULIP Algorithm CBG with Apollonius
- TULIP Algorithm with Multilateration
- TULIP database through a GUI
- TULIP Map (Landmarks)
- TULIP SEECS CBG+ Archive Implementation
- TULIP Landmark Density (Average Distance between Landmarks) impact on Apollonius Error Distance
- TULIP Stress testing for Asia using CBG
- TULIP Stress Testing for North America using CBG
- TULIP Stress Testing for South Asia using CBG
- TULIP Stress testing for Europe using CBG
- TULIP Landmark finding
- TULIP Stress Testing for North America
- Target Data using reflector with Tier All
- TULIP Stress Testing for Australia
- Tulip Report Generation Method
- TULIP Calculating distance from latitude and longitude
- TULIP variability of Alpha with min_RTT for Pakistan
- TULIP methods to improve speed
- Automated PerfSONAR Landmark finding
- Visual Traceroute (VTrace)
- TULIP and UNDNS
- TULIP AIG with water exclusion
- AIG Paper Changes
- TULIP Examples of Use
- TULIP results and code Mar 2015
- TULIP: Data Flow
- TULIP CAIDA RTT vs Distance Results
- TULIP comparison of geolocation with database based approaches
- TULIP Task List
- CAIDA RTT vs. distance results
- Comparisons of various Geolocation methods
- TULIP database backup
- Laundering Landmarks
- Incorrect geolocation results
- TULIP Task List
- Circle selection for Apollonius results
The following sections provide documentation and instruction on how to do any and everything in Pinger. This is a work in progress as new tools are documented as developed and old code revamped.