Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Badrul plans for his undergraduate student (Abdulrahim Haroun Ali) to have a draft paper on anomalies in PingER measurements to share for review by the end of semester (January). Update?

Ridzuan  is still in the configuration process for communication between the Hadoop nodes. Need some troubleshooting at the moment.successfully setup hadoop environment for the servers. He is now looking into how best to input the pinger data to the environment and type of analytics that can be done. 

Ibrahim Abaker  is planning to work on topic initially entitled " leveraging pingER big data with a modified pingtable for event-correlation and clustering", The purpose of this project is to make Pinger more efficient and more scalable to retrieve and analysis pingER raw data. Consequently it may improve pinger data store. He is planning to use key-value store model with high expandability and shorter query response time. The benefit of such project will help in the design of real time analysis and distributed pinger data across multiple servers for analysis. Les has sent him a pointer to documentation on the data flow at SLAC and also listings of pingtable.pl and associated script. He is currently  writing a proposal, which will contain a problem statement, objectives, scope and the approach to tackle the problem. He asked: how much PingER data is captured and stored so far (~ 1TByte)? Is there a published paper (see http://www-iepm.slac.stanford.edu/paperwork/ieee/ieee.pdf)?

...