Deployment
Monitoring Hosts
In 2010, following a series of workshops and site visits, the team at /NUST and SLAC worked with Pakistan’s Education and Research Network (PERN) and Pakistani Universities to put together an end-to-end (E2E) network monitoring infrastructure for PERN connected higher education sites. By the end of 2010 they had have installed the PingER monitoring tools and started gathering data at 18 sites in Pakistan. This includes 4 sites (NUST, COMSATS, PERN and NCP/Quaid-i-Azam) which have been in place for a longer time. In addition they are working on a further 8 monitoring sites. Over 2010 the number of monitoring host – remote host pairs (both in Pakistan) has increased from about 30 to over 220.
The figure below shows the main regions where the hosts are located and how the regions are connected by PERN:
The difficulty of the installations has varied host to host. The technical installation has been simple and not resulted in delays. The delays between deciding to install a monitoring host and gathering measurements from the host have mostly been due to: machine availability; getting administrative approval within university; and delays in making the DNS record entry. The table below shows the history of the installations:
Monitoring Site |
URLs |
Installed (Month/year) |
Ist Data Gathered (Month/year) |
City |
State |
School of Electrical Engineering and Computer Sciences, NUST |
monitor.niit.edu.pk |
1/2005 |
2/2005 |
Islamabad |
Punjab |
COMSATS University |
pinger.comsats.edu.pk |
2/2007 |
3/2007 |
Islamabad |
Punjab |
Pakistan Education Research Network PERN, Islamabad |
pinger.pern.edu.pk |
4/2007 |
5/2007 |
Islamabad |
Punjab |
NCP, Quaid-e-Azam University |
pinger-ncp.ncp.edu.pk |
4/2007 |
5/2007 |
Islamabad |
Punjab |
UET at Lahore |
pinger.uet.edu.pk |
7/2009 |
8/2009 |
Lahore |
Punjab |
International Islamic University at Islamabad |
vle.iiu.edu.pk |
4/2010 |
4/2010 |
Islamabad |
Punjab |
Lahore School of Economics |
111.68.102.40 |
4/2010 |
8/2010 |
Lahore |
Punjab |
University of Balochistan |
pinger.uob.edu.pk |
4/2010 |
4/2010 |
Quetta |
Balochistan |
University of Arid Agriculture at Rawalpindi |
pinger.uaar.edu.pk |
6/2010 |
9/2010 |
Islamabad |
Punjab |
UET at Taxila |
pinger.uettaxila.edu.pk |
6/2010 |
6/2010 |
Islamabad |
Punjab |
Agriculture University of Peshawar |
pinger.aup.edu.pk |
6/2010 |
6/2010 |
Peshawar |
Khyber Pakhtunkhwa |
UET at Peshawar |
pinger.nwfpuet.edu.pk |
6/2010 |
6/2010 |
Peshawar |
Khyber Pakhtunkhwa |
NED University of Engineering & Technology |
npm.neduet.edu.pk |
8/2010 |
8/2010 |
Karachi |
Sindh |
Allama Iqbal Open University |
pinger.aiou.edu.pk |
10/2010 |
11/2010 |
Islamabad |
Punjab |
Punjab University, ITC, Department |
pinger-itc.pu.edu.pk |
10/2010 |
11/2010 |
Lahore |
Punjab |
National College of Arts |
pinger.nca.edu.pk |
10/2010 |
12/2010 |
Lahore |
Punjab |
Hazara University at Mansehra |
pinger.hu.edu.pk |
10/2010 |
|
Peshawar |
Khyber Pakhtunkhwa |
KUST at Kohat |
pinger.kohat.edu.pk |
10/2010 |
12/2010 |
Peshawar |
Khyber Pakhtunkhwa |
FAST at Peshawar |
pinger.pwr.nu.edu.pk |
10/2010 |
12/2010 |
Peshawar |
Khyber Pakhtunkhwa |
University of Science & Technology at Bannu |
pinger.ustb.edu.pk |
10/2010 |
|
Peshawar |
Khyber Pakhtunkhwa |
FAST at Lahore |
pinger.lhr.nu.edu.pk |
11/2010 |
12/2010 |
Lahore |
Punjab |
University of Sindh at jamshoro |
pinger.usindh.edu.pk |
12/2010 |
12/2010 |
Karachi |
Sindh |
Isra University at Hyderabad |
pinger.isra.edu.pk |
12/2010 |
12/2010 |
Karachi |
Sindh |
Lahore College for Women University |
pinger.lcwu.edu.pk |
12/2010 |
12/2010 |
Lahore |
Punjab |
Pakistan Education Research Network PERN, Quetta |
pingerqta.pern.edu.pk |
12/2010 |
12/2010 |
Quetta |
Balochistan |
In addition work is in progress to install: BUITMS in Quetta, Bolochistan; Sind Agriculture University Tandojam in Karachi, Sind; NCEMB University in Punjab, Lahore; Virtual University Lahore, Ounjab; Air University in Islamabad, Punjab, Kinnaired College for Women in Lahore, Punjab.
The growth in the number of monitors and host pairs being monitored over 2010, is seen below (spreadsheet):
Map of sites
The locations of the Pakistani monitoring (red) and remote(red and blue) hosts are seen in the maps below.
|
|
|
Pakistani PingER sites with lines showing the minimum RTT in msec. seen from NUST |
Details of PingER sites in Islamabad, the lines show the average RTT seen from NUST |
Details of PingER sitesv in Islamabad, the lines show the minimum RTT from PERN |
It is interesting to see (right hand map above) the large differences in minimum RTT between PERN and say NCP (at Quaid i Azam university in N.E. Islamabad) of < 10msec (blue line or more exactly 1.3msec) and that between PERN and NUST in the S.W. corner of between 40-80msec (red line or more exactly 44msec.). Presumably this is due to the routing of PERN connections in Islamabad region. Also interesting to see (middle map above) is that the connection from NUST to the DSL site (blue line) is much less than that to the physically closer NUST host.
Archive, analysis site
IN 2010, a second instance of the SLAC archive-analysis site was set up at NUST. This provides backup for data and access, and improved performance for Pakistani users.
Measurements
Using PingER, the monitoring hosts ping each remote host with 10 pings every 30 minutes. From this data we are able to measure minimum and average Round Trip Times (RTT), jitter, loss, unreachabilty (all 10 pings fail) and derive throughput and Mean Opinion Score (MOS). The data is gathered from the monitoring sites on a daily basis by the archiving sites at NUST, SLAC and FNAL.
RTT and Losses for 2010
|
|
|
|
---|---|---|---|
|
|
|
|
|
Various percentiles for the Inter Packet Delay Variation (IPDV or jitter) between Pakistani monitoring hosts and remote host pairs. The line shows the number of pairs with measurements contributing to the results. Spreadsheet |
The blue dots are the median losses seen between all pairs of monitoring and remote hosts for each month. The error bars show the extent of the 25 and 75 percentiles. The red dots are the number of pairs contributing to the packet loss measurements. Spreadsheet |
|
To try and show the network performance trends within Pakistan in 2010 Amber created a graph showing the inter-regional average RTT performance over the whole year.
Unreachability
A host is considered unreachable if none of the pings sent to it are responded to. To illustrate this we chose a reliable host at SLAC (pinger.slac.stanford.edu) and analyzed the unreachability of Pakistani hosts seen from SLAC.
|
|
|
Table of unreachability seen from SLAC to Pakistani hosts in 2010. Higher values (bad) are colored redder. The data is sorted by increasing unreachability in Jan 2011. Spreadsheet |
Chart of the unreachability of Pakistani hosts seen from SLAC Dec 2010 and Jan 2011 |
Smokeping examples of unreachabilltyseen from SLAC for 120 days Oct 2010 - Jan 2011. |
It is seen that several hosts exhibit high unreachability. The reasons behind the high unreliability are usually site specific and vary from lack of reliable power and a source of backup power, floods, lack of access to the site when there are problems that require physical access, lack of expertise, and lack of interest from a site.
Understanding the large variations Jan-Apr 2010
We were concerned about the large variations seen in January 210 through May 2010. Zafar suggested the problem might be to do with the congestion of the links. Jitter (Inter Packet Delay Variation - IPDV) tends to be a good indicator of queuing/congestion, so he suggested looking at this.
The IPDV shows similar behavior to the average RTT:
We then looked to see what portion of the larger IPDV early in the year was related to adding new monitoring and remote hosts. If we select the same host-pairs in both say Nov 2010 and April 2010 then the improvement ((ipdv(Apr)-ipdv(Nnov))/ipdv(Apr) in IPDV is about 47%. Thus things have improved with lower IPDVs for the selected host pairs.
Unfortunately we do not have traceroutes between all the sites to see if they have changed over time.
Comparing for Nov 2010 the average IPDV for all pairs with that for just the pairs in both April 2010 and November 2010 one gets 5.13ms verses 4.58. Thus some of the reduction appears to be due to the new hosts added.
, prior to this there are less than 100. It is suspected that this is partially the cause of the more stable values of IPDV following this date.
Returning to the average RTT graph, we believe it is less confusing to mainly focus on the data from May 2010 onwards, in order to remove the effects of small statistics. In this case, the average RTTs from Jun through November 2010 have been pretty flat.
Differences in RTTs for regions
Looking at the data for November 2010 it is seen that the average RTts to Karachi and Lahore are two to three times less than those to Quetta, Islamabad and Peshawar. This needs to be investigated.