Internet End-to-End Performance Monitoring

PingER

Version 79 by Umar Kalim on Sep 04, 2009 15:32. << Changes from 78 to 79 compared with Current by fahad satti on Nov 12, 2009 12:11.

Key These lines were removed. This word was removed. These lines were added. This word was added. View page history

There are 2 changes. View first change.

		h3. Purpose
		PingER (Ping End-to-end Reporting) is the name given to the Internet End-to-end Performance Measurement (IEPM) project to monitor end-to-end performance of Internet links. The project now involves hundreds of sites in many countries all over the world and we are actively seeking new partners for this project.
		* [Brochure|http://www-iepm.slac.stanford.edu/monitoring/bulk/sc2005/pinger.pdf], [Examples of Use|http://www-iepm.slac.stanford.edu/pinger/uses.html],  [Publication|http://www-iepm.slac.stanford.edu/paperwork/ieee/ieee.pdf],  [Tutorial |http://www.slac.stanford.edu/comp/net/wan-mon/tutorial.html], [What is PingER|http://sdu.ictp.it/pinger/index.html] (from ICTP/Trieste)
		h3. Case Studies
		{children:page=PingER Case Studies}
		* [NIIT/Pakistan |http://www.slac.stanford.edu/xorg/icfa/icfa-net-paper-jan07/#_Toc157325928]
		* [Development Indices and pingER|https://confluence.slac.stanford.edu/display/IEPM/Development+Indices+and+PingER]
		h4. Presentations on Case Studies
		* [Sub-Sahara Region|Sub-Sahara Case Study],
		* [ICFA/SCIC report on Africa|http://www.slac.stanford.edu/xorg/icfa/icfa-net-paper-jan07/#_Toc157325931],
		* [Powerpoint presentation on Sub-Saharan Africa|http://www.slac.stanford.edu/grp/scs/net/talk06/sub-sahara-ictp-nov06.ppt]
		* [Internet Connectivity in Africa|http://www.slac.stanford.edu/grp/scs/net/talk07/montpellier-dec07.ppt], presented by Les Cottrell at the Internet and Grids in Africa: An Asset fro African Scientists for the Benefit of African Society, 10-12 December 2007, Montpellier France.
		* [Internet View of the Digital Divide|http://www.slac.stanford.edu/grp/scs/net/talk07/ihy-ethiopia-nov07.ppt], Especially for Sub-Saharan Africa, presented by Les Cottrell at the IHY Africa Workshop 11-16 November 2007, Addis Ababab, Ethiopia.
		* [http://www.slac.stanford.edu/grp/scs/net/talk07/icfa-mexico07.ppt|http://www.slac.stanford.edu/grp/scs/net/talk07/icfa-mexico07.ppt][Quantifying the Digital Divide: Latin America, S. Asia, Africa,|http://www.slac.stanford.edu/grp/scs/net/papers/chep07/CHEP_final1.doc] presented by Les Cottrell at the ICFA Workshop on Digital Divide Issues for Global e Science, Mexico City Oct 24-27, 2007
		* [Quantifying the Digital Divide: A Scientific Overview of Network Connectivity and Grid Infrastructure in South Asian Countries|http://www.iop.org/EJ/abstract/1742-6596/119/5/052022], S. Khan, R. L. Cottrell, U Kalim, A. Ali, CHEP07, Victoria Canada. Also [SLAC-PUB 12581|http://www.slac.stanford.edu/cgi-wrap/pubpage?slac-pub-12851]. [Poster|http://www.slac.stanford.edu/comp/net/wan-mon/viper/chep07.jpg]
		h3. PingER Validation
		* Derived Throughput
		** [Throughput versus Loss |http://www.slac.stanford.edu/comp/net/wan-mon/thru-vs-loss.html]
		** [Ookla Speedtest.net Throughput|Ookla's Speedtest Throughput Measures]
		** [ZDnet Australia's Speedtest|ZDnet Australia's Speedtest]
		* [Daily Data Validation Management|PingER Daily Management]
		** [Down Sites|http://www.slac.stanford.edu/cgi-wrap/downsites.cgi], [Collection Status|http://www-iepm.slac.stanford.edu/monitoring/checkdata/]
		h3. PingER Operations
		* [Downloading Pinger|http://www.rnoc.gatech.edu/pinger2/]
		* [Requirements for Monitoring Host|http://www-iepm.slac.stanford.edu/pinger/tools/mon-req.html], [Requirements for Remote Host|http://www.slac.stanford.edu/comp/net/wan-req.html]
		* Data: [Meta database (NODEDETAILS)|https://oraweb.slac.stanford.edu/apex/slacprod/f?p=123:1], [NODEDETAILS hints|http://www-iepm.slac.stanford.edu/pinger/slaconly/nodedetails-readme],  [NODEDETAILS schema|http://www-iepm.slac.stanford.edu/pinger/slaconly/nodedetails-schema.txt], [NODEDETAILS in Perl|http://www-iepm.slac.stanford.edu/pinger/pingerworld/slaconly-nodes.cf], [NODETAILS in XML|http://www-iepm.slac.stanford.edu/pinger/pingerworld/rss.xml],  [Raw Data Format|http://www-iepm.slac.stanford.edu/pinger/tools/retrievedata.html#rawdataformat]
		* [PingER FAQ|http://www-iepm.slac.stanford.edu/pinger/faq.html]
		* Management: [Data Processing Workflow|PingER Data Processing Workflow], [Duties|http://www-iepm.slac.stanford.edu/pinger/pingerduties.html],  [Gathering delays|http://www-iepm.slac.stanford.edu/pinger/getdata.xls], [Maintaining collection & analysis|http://www-iepm.slac.stanford.edu/tools/tips/pinger.html], [Restoring data|http://www-iepm.slac.stanford.edu/pinger/tools/restoredata.html]
		h3. [PingER Deployment]
		* [Shockwave Map|http://www-iepm.slac.stanford.edu/pinger/pingerworld/], [Google Map|http://www.slac.stanford.edu/comp/net/wan-mon/viper/tulipmap.htm], [Node count Intensity map|http://www-iepm.slac.stanford.edu/pinger/pinger-node-count-intensity-map.html], [Node count GeoMap|http://www-iepm.slac.stanford.edu/pinger/geomaps/pinger-node-count-geomap.html], [Interactive Java Map (VIPER)|http://www.slac.stanford.edu/comp/net/wan-mon/viper/]
		* [Beacons |http://www-iepm.slac.stanford.edu/pinger/beacon.html], [Beacon Expansion|PingER Beacon Expansion]
		* [Monitoring Hosts|http://pinger.fnal.gov/participants.html], [Remote Hosts|http://www-iepm.slac.stanford.edu/monitoring/remote_sites.html]
		* [Regions|PingER Regions], [Hosts per Country by REgion|http://www-iepm.slac.stanford.edu/pinger/sites-per-country.html]
		h3. PingER Databases
		* [NODEDETAILS|PingER NODEDETAILS]
		* [Countries and Regions|http://www.slac.stanford.edu/comp/net/mon/countries.tsv]
		h3. PingER Analysis
		* [Monitoring Data Format |PingER Monitor node format]
		h3. Toolbox
		* [PingER Host Searcher]
		* [PingER Route Visualizer|PingER Route Visualizer using Traceroutes]
		* [PingER Visualization(VIPER)|http://www.slac.stanford.edu/comp/net/wan-mon/viper/]
		* [PingER Smokeping Integration]
		* [PingER Metrics Motion Chart]
		* [PingER Metrics Intensity Maps]
		* [PingER Node Count Intensity & GeoMaps]
		* [PingER Monitored Node Status|https://confluence.slac.stanford.edu/display/IEPM/Monitored+Nodes+Status|Web script to analyse status of Monitored Nodes; quickly]
		h3. Porting PingER Archive to NUST
		* [PingER Meta-Database|IEPM:PingER Meta Database]
		* [Web interface to manage the PingER Meta-Database|IEPM:Web Interface for the PingER Meta Database]
		* Synchronization of the SLAC and NUST database
		* [Synchronization of the SLAC and NUST databases|IEPM:Database Synchronization]
		* [Scripts for fetching data from monitoring sites and pinger management|Scripts - PingER Management]
		h3. Work in Progress
		# Automating the creation of offsite.nodes directly from nodedetails.
		# Automating the creation of beacons.txt directly from nodedetails.
		# Document procedures for editing existing nodes.
		h3. Future Projects
		# Document procedures for entering new nodes.
		# Modularize all analysis scripts.
		# Streamline all Pinger documentation into WIKI format.
		h3. [TULIP|TULIP]
		{children:page=TULIP}
		* [TULIP database backup]
		* [Laundering Landmarks]
		* [Incorrect geolocation results|Incorrect geolocation results by database based approaches]
		* [TULIP Task List|https://confluence.slac.stanford.edu/display/IEPM/Task+List]
		The following sections provide documentation and instruction on how to do any and everything in Pinger. This is a work in progress as new tools are documented as developed and old code revamped.
		h3. Progress Reports
		 [Shahryar's Progress Report|Shahryar Progress Report]