...

• To change the metric represented by the size of the bubble use the 'size' combo box to the right of the chart.
• Click on the pull down box of an axis' label to change the metric that is displayed on an axis or in a table. Other PingER metrics that are available include minimum_rtt, ipdv, packet_loss, internet users, population, n throughput, MOS and unreachability, Ping unreachability, Corruption Perception Index (CPI), Digital Opportunity Index (DOI), Human Development Index (HDI), ICT Development Index (IDI) and internet penetration index.
• Move the mouse over a bubble to identify the values for the bubble.
• Linear or logarithmic scales may be selected using the combo box along the axis.
• Move the mouse over a colored legend symbol to blink the bubbles associated with the symbol's color.
• To follow the changes in detail simply move the slider bar with the mouse.
• One can select a bubble by clicking on it to provide a label for the bubble that persists with the motion. The trails check box leaves a trail to follow the motion of selected bubbles. N.B. selected bubbles determine how far the data to be displayed goes back in time. 
• By clicking the link at the right top of the page, one may select the vantage point, the observed region and the granularity of the measurements.

Implementation Details

HTML Output

• On the left top there is a selection box for comparison. By default it is set to compare countries. However, selecting the desired region here, one can compare the performance of countries within a region.

Implementation Details

HTML Output

To create a motion chart, the To create a motion chart, the data must be populated in a data structure (as stated by Google public data explorer  and copied below):

...

• The column headings in the first line of the data file must exactly match the concept id and the property id of the concept with which the data is associated (though order may vary).
• Each row must have exactly the same number of elements as the number of properties on the concept (even if the value is empty).
• Each value for the concept's id field (here, the country code) must be unique and non-empty (an empty field is one with zero or only whitespace characters).
• Values for properties that reference other concepts must either be empty or be a valid value of the referenced concept.
• Values that contain the comma character must be represented without comma; for example 23,400 must be represented as 23400.

Relevant Files

The scripts and files are placed at /afs/slac.stanford.edu/package/pinger/explorer . Two scripts have to be run for generating the data file in the format required by the google data explorer. First script is generate-metric-files-for-explorer.pl . This script takes metric values from prmout folder and transposes the data such that years are now incremented vertically and not horizontally. The files generated by generate-metric-files-for-explorer.pl  are then given as an input to the script generate-alldata-for-pinger-data-explorer.pl,  which outputs the data for all the metrics altogether in one file named file.csv. This file is in the format as required by the google data explorer.

...

The script generate-metric-files-for-explorer.pl converts the metric files in the format below:

AFG,1998,
AFG,1999,
AFG,2000,
AFG,2001,
AFG,2002,
AFG,2003,
AFG,2004,
AFG,2005,
AFG,2006,
AFG,2007,767.453
AFG,2008,732.841
AFG,2009,728.492
AFG,2010,750.940
AFG,2011,743.080
ALB,1998,
ALB,1999,
ALB,2000,
ALB,2001,
ALB,2002,
ALB,2003,
ALB,2004,
ALB,2005,
ALB,2006,
ALB,2007,
ALB,2008,234.933
ALB,2009,235.681
ALB,2010,254.324
ALB,2011,225.474
DZA,1998,
DZA,1999,

...

#country,year,population,average_rtt,ipdv,minimum_rtt,MOS,nthroughput,throughput,unreachability,packet_loss,internetusers,
#Internet_Penetration, DOI, HDI, CPI, IDI
AFG,1998,22441529, , , , , , , , ,,0.1,0,0,0,0
AFG,1999,23028254, , , , , , , , ,
AFG,2000,0.1,0,0,0,0
AFG,2000,23630320, , , , , , , , ,,0.1,0,0,0,0
AFG,2001,24232219, , , , , , , , ,1000,0.1,0,0,0,0
AFG,2002,24849449, , , , , , , , ,1000,0.1,0,0,0,0
AFG,2003,25482401, , , , , , , , ,20000,0.1,0,0,0,0
AFG,2004,26131476, , , , , , , , ,25000,0.1,0,0.347,0,0
AFG,2005,26797083, , , , , , , , ,300000
AFG,20060.1,275188090, ,0.347,2.5,0
AFG,2006,27518809, , , , , , , , ,535000,0.1,0,0.35,0,0
AFG,2007,28259973,767.453,13.43043,697.938,1.2,100.822,100.822,12.859,2.279,500000,0.1,0,0.352,1.8,0
AFG,2008,29021099,732.841,8.295,696.396,1.5,175.8008,175.8008,4.813,0.836,500000,0.1,0,0.352,1.5,0
AFG,2009,29802724,728.492,6.604,687.919,1.6,216.936,216.936,9.495,0.564,1000000,1.5,0,0.352,1.3,0
AFG,2010,30175351,750.94094,10.811,675.284,1.5,128.965,128.965,7.024,2.279,900472.2222
AFG,2011,,1.5,0,0.352,1.3,0
AFG,2011,30823706,743.08008,9.967,684.141,1.7,142.843,142.843,9.709,1.534,1016522.222,1.5,0,0.352,1.3,0
ALB,1998,3075628, , , , , , , , ,2000,2.4,0.36,0.784,0,0
ALB,1999,3069856, , , , , , , , ,2500,2.4,0.36,0.784,0,0
ALB,2000,3067556, , , , , , , , ,3500,2.4,0.36,0.784,0,0
ALB,2001,3069383, , , , , , , , ,10000
ALB,,2.4,0.36,0.784,0,0
ALB,2002,3076282, , , , , , , , ,12000,2.4,0.36,0.801,2.5,1.92
ALB,2003,3086736, , , , , , , , ,30000,2.4,0.36,0.801,2.5,1.92
ALB,2004,3098677, , , , , , , , ,75000,2.4,0.36,0.811,2.5,1.92
ALB,2005,3110579, , , , , , , , ,188000
ALB,2006,3121751,2.4,0.36,0.811,2.4,1.92
ALB,2006,3121751, , , , , , , , ,300000,2.4,0.37,0.814,2.6,1.92
ALB,2007,3132458, , , , , , , , ,471000,2.4,0.37,0.818,2.9,2.73
ALB,2008,3143291,234.933,5.869,204.462,4,584.968,584.968,8.125,0.728,750000,2.4,0.37,0.818,3.4,2.73
ALB,2009,3155271,235.681,7.91091,197.166,3.9,527.683,527.683,7.358,0.884,1300000
ALB,2010,3140420,16,0.37,0.818,3.2,2.73
ALB,2010,3140420,254.324,10.106,199.379,3.8,406.381,406.381,4.935,1.613,719805.7143,16,0.37,0.818,3.2,2.73
ALB,2011,3145807,225.474,1.847,200.22022,4,602.674,602.674,24.037,0.759,783557.6786
DZA,1998,29646386, , , , , , , , ,6000.037,0.759,783557.6786,16,0.37,0.818,3.2,2.73
DZA,1998,29646386, , , , , , , , ,6000,2.6,0.39,0.713,0,0
DZA,1999,30071594, , , , , , , , ,60000,2.6,0.39,0.713,0,0
DZA,2000,30506054, , , , , , , , ,150000,2.6,0.39,0.713,0,0

It is important to note here that the CPI, IDI, HDI, DOI and Internet Penetration data has been taken from Motion chart data files (demographics.csv) placed at /afs/slac.stanford.edu/package/pinger/motion-chart.

Implementation

Following is the algo of implementation:

...

The files have to be generated manually and uploaded manually. There is no crontab that is running these scripts to generate files and the folder to be uploaded. These files need to be updated each year. to be uploaded. These files need to be updated each year. Once the data set is uploaded, it checks for errors. If there are no errors then you can preview the data and once it is up to the mark, publish the dataset.

Miscellaneous Details

• Tool: The interactive graph was generated using the Google Public Data Explorer.
• Data: The data presented here was collected by the PingER  project, processed by prmout. The same data is available in tabular format. The statistics of Population and internet users were acquired from the World bank , the country to region mapping was obtained by the geographical database maintained by the PingER project, the Corruption Perception Index (CPI) was taken from Transparency International and extracted from Wikipedia , the Digital Opportunity Index (DOI) is obtained from ITU's ICT Statistics , Human Development Index (HDI) is obtained from UNDP Human development reports and ICT Development Index (IDI) is obtained from ITU Reports .
• Please note that while all the statistics were acquired over several years (i.e. since 1998), the Internet usage statistics were documented in Nov. 2007.
• Loading: The time to load and render the web page is largely determined speed of the link, the file length (about a MByte that is determined by the number of metrics and frequency of data points and the number of metrics) and the speed of the client rendering.
• Metrics: Average RTT (ms), Normalized Throughput (Kbps), Throughput (Kbps), Internet Users (#), Population (#), Minimum RTT (ms), Packet Loss (%), Unreachability (%), IPDV (ms), MOS, IDI, HDI, DOI, CPI and Internet penetration Index.
• Authors: Faisal Zahid & Amber Zeb 29/8/2011. Idea champion: Faisal Zahid.

...