...
- Faisal and Les are putting together a video on the motion charts. It is at the editing stage.
Faisal is looking at the next generation of motion charts with maps etc. - Public Data Explorer Next Gen Motioncharts.
- Faisal is creating DSPL dataset
- Concepts are done, tested few slices and a table.
- Incrementally building tables based on concepts and slices (no debugging or error tracking)
- Provide amber the csv structure
Pakistani case study - Zafar, Anjum
...
- The new schema of PingER which is close to perfsonar is designed such that it stores raw data as well as analyzed data in the same table. Previous architecture of PingER first collects the data into files or table, then analyze this data and store results in another file or table. And then these hourly results are used for calculating daily and monthly results. The mechanism is as follows:*# At archive site, as the data is downloading from monitoring sites line by line, the new script does not store this data in to file on table but it uses each line's data (Basically one line contains sequence numbers, RTTs, packet size, packets sent and recieved, time and nodes information) and calculate different metrics by using data of this line.*# Stores these calculated metrics into arrays or keys and moves to the next line and same procedure goes again and again for every line.
- When all lines are processed we calculate or aggregate results on hourly basis and store all related raw data and analyzed data for this hour in one row.
- Daily and monthly analysis scripts which are running separately use this data (that is calculated previously) and again store results in same table but this time no raw data is stored in respective rows which contains daily and monthly data.
...