...
The data sets used in the study may be downloaded from the links listed below. These data sets were collected by the IEPM-BW project and the latest performance statistics may be accessed from here.
Table 1: Performance measurement statistics compiled by IEPM, as seen from SLAC.
| Raw data | Labeled data | |||||
|---|---|---|---|---|---|---|---|
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="533d2b4046454bc5-f411b29d-4f9e4993-9431bde1-8754c085b8387caf382114b3"><ac:plain-text-body><![CDATA[ | SDSC | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/SDSC-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/SDSC-pathchirp.xls]] | [[txt | http://www.slac.stanford.edu/~kalim/event-detection/published-data/UTORONTO-pathchirp-labeled-events.txt]] | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="280d85ebe8c34d04-cc8be156-42194c2f-a100852d-2ce31067c855d752649e9a26"><ac:plain-text-body><![CDATA[ | CERN | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/CERN-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/CERN-pathchirp.xls]] | [[txt | http://www.slac.stanford.edu/~kalim/event-detection/published-data/CERN-pathchirp-labeled-events.txt]] | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="7fc9f918c035d7f2-0028a8c2-430444fd-9843b917-d2be3e5f8b233aef97eda3e9"><ac:plain-text-body><![CDATA[ | FZK | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/FZK-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/FZK-pathchirp.xls]] | [[txt | http://www.slac.stanford.edu/~kalim/event-detection/published-data/FZK-pathchirp-labeled-events.txt]] | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="582d6bd6e8bf4278-601e9edf-480941bb-99b7a804-5fffff0250fe8f8fffcd737a"><ac:plain-text-body><![CDATA[ | DESY | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/DESY-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/DESY-pathchirp.xls]] | [[txt | http://www.slac.stanford.edu/~kalim/event-detection/published-data/DESY-pathchirp-labeled-events.txt]] | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="0dcbaa6b1d65e0c0-513fcb82-4ab24b2b-99e4a91c-df9db64979f7c27fdcea8a57"><ac:plain-text-body><![CDATA[ | UTORONTO | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/UTORONTO-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/UTORONTO-pathchirp.xls]] | [[txt | http://www.slac.stanford.edu/~kalim/event-detection/published-data/UTORONTO-pathchirp-labeled-events.txt]] | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="a41aa1ce7578e96b-ae85f1d1-4990467e-8a4a8129-3717c57e43fd44ea1c39a8dd"><ac:plain-text-body><![CDATA[ | TRIUMF | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/TRIUMF-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/TRIUMF-pathchirp.xls]] | [[txt | http://www.slac.stanford.edu/~kalim/event-detection/published-data/TRIUMF-pathchirp-labeled-events.txt]] | ]]></ac:plain-text-body></ac:structured-macro> |
<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="d6c3b1e9ad8b5aa5-7c515f2f-480344ec-875aa9d9-5c4fe23baab9459e1771ef17"><ac:plain-text-body><![CDATA[ | ORNL | [[csv | http://www.slac.stanford.edu/~kalim/event-detection/published-data/ORNL-pathchirp.csv]], [[xls | http://www.slac.stanford.edu/~kalim/event-detection/published-data/ORNL-pathchirp.xls]] | [txt] | ]]></ac:plain-text-body></ac:structured-macro> |
...
We initially define the sensitivity as one (1) and determine the optimal threshold value for each link (i.e. the value with the optimal ratio of true-positives to false positives). As suggested by the authors, this threshold falls between 30%-40%. Finally for the history buffer length, the trigger buffer length and the optimal threshold, we vary the sensitivity to determine the spectrum of the ratio of true-positive rate to false positive rate. Based on the observations we plot the ROC curves as shown in figure 2.
Table 2: Results compiled by Plateau when analyzing the Internet path between SLAC and DESY.
H | TB | TH | S | TP | FP | #P | N~days | TPR | FPR |
|---|---|---|---|---|---|---|---|---|---|
240 | 45 | 30% | 2.3 | 0 | 25 | 31 | 672 | 0 | 0.037 |
240 | 40 | 30% | 2.2 | 1 | 28 | 31 | 672 | 0.032 | 0.042 |
240 | 32 | 30% | 2.1 | 1 | 32 | 31 | 672 | 0.032 | 0.048 |
240 | 28 | 30% | 2.0 | 2 | 35 | 31 | 672 | 0.065 | 0.052 |
240 | 24 | 30% | 1.9 | 2 | 41 | 31 | 672 | 0.065 | 0.061 |
240 | 19 | 30% | 1.8 | 4 | 50 | 31 | 672 | 0.129 | 0.074 |
240 | 16 | 30% | 1.7 | 6 | 59 | 31 | 672 | 0.194 | 0.088 |
240 | 13 | 30% | 1.6 | 7 | 66 | 31 | 672 | 0.226 | 0.098 |
240 | 10 | 30% | 1.5 | 11 | 74 | 31 | 672 | 0.355 | 0.11 |
240 | 9 | 30% | 1.4 | 13 | 81 | 31 | 672 | 0.419 | 0.121 |
240 | 8 | 30% | 1.3 | 14 | 97 | 31 | 672 | 0.452 | 0.144 |
240 | 7 | 30% | 1.2 | 16 | 103 | 31 | 672 | 0.516 | 0.153 |
240 | 6 | 30% | 1.1 | 20 | 114 | 31 | 672 | 0.645 | 0.17 |
240 | 6 | 30% | 1.0 | 21 | 122 | 31 | 672 | 0.677 | 0.182 |
Legend:
H - History buffer length, TB - Trigger buffer length, TH - threshold, S - sensitivity, TP - true positives obtained, FP - false positives obtained, #P - true positives, N~days - days observed, TPR - true positive rate, FPR - false positive rate.
| Wiki Markup |
|---|
The source code of the implementation is available in [C#|http://www.slac.stanford.edu/~kalim/event-detection/published-src/c-plateau-impl.html] \[[cs|http://www.slac.stanford.edu/~kalim/event-detection/published-src/plateau.cs]\] and [perl|http://www.slac.stanford.edu/~kalim/event-detection/published-src/plateau.pl.html] \[[pl|http://www.slac.stanford.edu/~kalim/event-detection/published-src/plateau.pl]\] |
...