...
Performance Analysis
I used the Benchmark library and applied it on create_File function. Here is the result of creating 10 RRDs on nfs space
In order to get list of unique Source Destination pairs (links) SelectSrcDest1.pm used to traverses through all the raw pinger files for the last 120 days and finded the list. This was extremely expensive in terms of time consumed so we needed to reduce this. This was reduced to one day which made the code 120 times more faster.
I used the Benchmark library and applied it on create_File function. Here is the result of creating 10 RRDs on nfs space
| Code Block |
|---|
CreateRRD took:38 wallclock secs (19.76 usr 3.99 sys \+ 2.57 cusr 0.82 csys = 27.14 CPU)
CreateRRD took:38 wallclock secs (20.06 usr 3.39 sys \+ 2.46 cusr 0.84 csys = 26.75 CPU)
CreateRRD took:67 wallclock secs (21.25 usr 9.75 sys \+ 2.49 cusr 1.03 csys = 34.52 CPU)
CreateRRD took:66 wallclock secs (21.19 usr 9.06 sys \+ 2.73 cusr 0.90 csys = 33.88 CPU)
CreateRRD took:68 wallclock secs (20.97 usr 9.47 sys \+ 2.78 cusr 0.74 csys = 33.96 CPU)
CreateRRD took:68 wallclock secs (20.80 usr 9.40 sys \+ 2.44 cusr 0.96 csys = 33.60 CPU)
CreateRRD took:23 |
| Code Block |
CreateRRD took:38 wallclock secs (19.7619 usr 30.9986 sys \+ 2.5727 cusr 0.8291 csys = 2723.1423 CPU) CreateRRD took:3823 wallclock secs (2019.0609 usr 31.3913 sys \+ 2.4655 cusr 0.8492 csys = 2623.7569 CPU) CreateRRD took:6766 wallclock secs (21.2513 usr 98.7545 sys \+ 2.4953 cusr 10.0393 csys = 3433.5204 CPU) CreateRRD took:6667 wallclock secs (21.1924 usr 9.0661 sys \+ 2.7323 cusr 0.9091 csys = 33.8899 CPU) |
I created the same 10 RRD files on local disk, clearly its less expensive to write to local disk.
| Code Block |
|---|
CreateRRD took:6822 wallclock secs (2019.9775 usr 90.4779 sys \+ 2.7860 cusr 0.7475 csys = 3323.9689 CPU) CreateRRD took:6821 wallclock secs (2019.8066 usr 90.4085 sys \+ 2.4470 cusr 0.9676 csys = 3323.6097 CPU) CreateRRD took:2324 wallclock secs (1920.1949 usr 01.8644 sys \+ 2.2749 cusr 0.9183 csys = 2325.2325 CPU) CreateRRD took:23 wallclock secs (1920.0977 usr 1.1311 sys \+ 2.5553 cusr 0.9288 csys = 2325.6929 CPU) CreateRRD took:6623 wallclock secs (2120.1388 usr 81.4526 sys \+ 2.5340 cusr 0.9390 csys = 3325.0444 CPU) CreateRRD took:6724 wallclock secs (2120.2491 usr 91.6106 sys \+ 2.2339 cusr 0.91 csys = 33.99 CPU) |
I created the same 10 RRD files on local disk, clearly its less expensive to write to local disk.
| Code Block |
|---|
.96 csys = 25.32 CPU) CreateRRD took:2221 wallclock secs (19.7511 usr 0.7950 sys \+ 2.6042 cusr 0.7597 csys = 23.8900 CPU) CreateRRD took:21 wallclock secs (19.6613 usr 0.8562 sys \+ 2.7058 cusr 01.7602 csys = 23.9735 CPU) CreateRRD took:2423 wallclock secs (20.4977 usr 1.4412 sys \+ 2.4956 cusr 0.8382 csys = 25.2527 CPU) CreateRRD took:23 wallclock secs (20.7779 usr 1.1112 sys \+ 2.5336 cusr 0.8887 csys = 25.29 CPU) CreateRRD took:2325.14 CPU) |
While data for NCP monitoring site took very minimal time because it monitors few links. SLAC monitoring host took an average of 500 seconds for the creation of each RRD. Here is the data for the creation of 3 RRDs
| Code Block |
|---|
CreateRRD took:511 wallclock secs (20419.8857 usr 122.2694 sys \+ 251.40 cusr 0.9011 cusr 6.53 csys = 25500.4415 CPU) CreateRRD took:24503 wallclock secs (20416.9139 usr 121.0693 sys \+ 250.39 cusr 0.9649 cusr 4.99 csys = 25493.3280 CPU) CreateRRD took:21504 wallclock secs (19416.1166 usr 022.5082 sys \+ 250.42 cusr 0.9744 cusr 6.41 csys = 23496.0033 CPU) |
The update function takes very little time even for SLAC monitoring host. Here is the data for the update function for the same three RRDs
| Code Block |
|---|
CreateRRD took:21 4 wallclock secs (19 3.1356 usr 0.6205 sys \+ 20.5843 cusr 10.0205 csys = 23.35= 4.09 CPU) CreateRRD took:23 3 wallclock secs (20 3.7755 usr 10.1204 sys \+ 20.5644 cusr 0.8201 csys = 254.2704 CPU) CreateRRD took:23 4 wallclock secs (20 3.7957 usr 10.1207 sys \+ 20.3654 cusr 0.8709 csys = 254.1427 CPU) |
Deployment of PingertoSmokePing
...