The involvement of SLAC towards the improvement of perfSONAR network monitoring are three-fold:
PingER Services
Ping provides a simple, yet effective metric for network performance. It can provide both latency and loss measurements between two sites. When tests are performed in a mesh between numerous sites, much information about the network can be gleamed from the cross correlation and analysis of such data. More importantly, it typically requires very little network support and is easily deployable.
With this in mind, an effort to upgrade the PingER 1 tool set to support the perfSONAR framework was undertaken. This involved not only re-architecting PingER to better support metrics such as jitter, but also to provide dynamic discovery of PingER sites and the conversion of SQL database data for representation in perfSONAR XML.
PingER for perfSONAR is now a standard part of the perfSONAR-PS distribution, with easily installable packages in tar.gz, RPM and CPAN modules 2. The introduction of a 'Live CD' 3 that incorporates both perfSONAR and PingER toolsets has also provided the opportunity for a level of ease of deployment and thus outreach that was previously not possible.
Topology
As perfSONAR aims to provide global outreach to provide network monitoring, it was felt that visual presentation of the dispersion and inter-relation of the various perfSONAR deployments around the world would provide impact and momentum towards the growth and deployment of perfSONAR in the future.
Due to the openness and community driven nature of perfSONAR and the use of XML for communication, a Google Maps 'mashup' 4 was created that provides interactive examination of all perfSONAR services. Utilizing the Global Lookup Service to provide a hierarchical depiction of the numerous perfSONAR services deployed worldwide, this mashup provides intuitive and a visually appealing method by which one can explore and display Topology, PingER, BWCTL, and OWAMP performance metrics. This has been used very successfully in several public demonstrations of perSONAR.
This very simple, yet effective tool provided a platform from which various parts of the perfSONAR framework could be thoroughly tested and vetted. This included validation of data collection, registration of services to the Lookup Services, consistency of data representation and ability to interrogate service metadata and performance data.
A start was made on a 3D display of a globe plotting the perfSONAR nodes together with rotation of the globe, and drill down access to more data. The project was delayed by the need to set up a PingER MA at SLAC and a 3D mathematical model to draw lines and rotate them with the Globe rotation.
Diagnosis
One of the more important applications perfSONAR will be the automatic analysis and diagnosis of performance changes. Due to the vast volume of distributed (yet federated) that will be available from a global deployment, it becomes important that, for example, a network engineer is alerted of problems on the network before users complain of network issues.
A step towards this is the low level analysis of performance data for anomaly detection. Applied to say, throughput between two sites, measurements can be fitted against various distributions and outliers flagged as being potential performance alerts. We have prepared a paper that was submitted to Infocom to be published, with application towards generic data as proof of concept 5.
In addition, the collection and cross correlation of various network metrics (that perfSONAR provides) in order to identify a performance 'culprit' can provide an extensive method of wading through the vast amounts of data. It will also provide a means by which problem tickets can provide more useful information than simply that something is wrong 6.
1 Active Internet Performance Monitoring for the HENP Community, IEEE Communications Magazine on Network Traffic Measurements and Experiments.
2 perfsonar modules
3 live cd
4 Google Maps Mashup
5 A Decision-Theoretic Approach to Detect Anomalies in Internet Paths, Fida Hussein, Umar Kalim, Noman Latif, Syed Ali Kayam, submitted to Infocom, 2008.
6 adnan