Project Progress

Unknown macro: {html}

This outline is based on the <a href="https://confluence.slac.stanford.edu/display/IEPM/Project+Plan">Project Plan</a>.
<h3> Project Progress </h3>

<ol>
<li>
Ontology
<ol>
<li>Goal
<ul>
<li>
To define the vocabulary used by PingER as well as its terms, concepts, taxonomy, and relations between each of the terms.
</li>
</ul>
</li>
<li>Progress
<ul>
<li>
We are basing our ontology on the one proposed by the project MOMENT <a href="https://svn.fp7-moment.eu/svn/moment/public/Ontology/">[1]</a> described by the article Measurement Ontology for IP traffic (MOI); IP traffic measurement ontologies architecture, by the European Telecommunications Standards Institute (ETSI) <a href="http://www.etsi.org/deliver/etsi_gs/MOI/001_099/003/01.01.01_60/gs_moi003v010101p.pdf">[2]</a>.
</li>
<li>
More terms and relations were added and edited on the based ontology. More specifically, metrics were properly added (Directivity, Conditional Loss Probability, Duplicate Packets, Inter-Packet Delay Variation, Out of Order Packets, TCP Throughput, Ping Unpredictability, Ping Unreachability, and Zero Packet Loss Frequency). Statistical measurements were also added (Inter-quartile Range, Median, 75%, 90%, and 95%). Information about the nodes were also added based on the Confluence page specifications <a href="https://confluence.slac.stanford.edu/display/IEPM/PingER+NODEDETAILS">[3]</a> (Site Name, Nick Name, Full Name, Contact for the host, Comments, Trace Server, App User, Ping Size, Ping Server, URL, Project Type, and GMT).
</li>
<li>
Other existing ontologies are also being linked to our ontology:
<ul type="circle">
<li>The Food and Agriculture Organization of the United Nations Geopolitical (FAO) <a href="http://www.fao.org/countryprofiles/geoinfo/geopolitical/">[4]</a> to support the definitions of country, continent, and region. </li>
<li>Friend of a Friend (FOAF) <a href="http://www.foaf-project.org/">[5]</a> to support the description of the Contact for the host.</li>
<li>DBPedia <a href="http://dbpedia.org/About">[6]</a>, the ontology and the resources, will be used to provide more variety of information about geographic locations or any other thing Wikipedia has that can be related to PingER. So it should be possible to make very specific and sophisticated queries.</li>
</ul>
</li>
</ul>
</li>
<li>To do
<ul>
<li>
Test and verify if the ontology works as desired. It is likely that small modifications will be needed. Verify if the instances created with the ontology are consistent.
</li>
</ul>
</li>
<li>Dates
<ul>
<li>
We started building the ontology on May 29, 2013.
</li>
</ul>
</li>
</ol>
</li>
 
<li>
RDF Repository
<ol>
<li>Goal
<ul>
<li>
To establish a good environment for the RDF <a href="http://www.w3.org/RDF/">[7]</a> repository.
</li>
</ul>
</li>
<li>Progress
<ul>
<li>
After analyzing the existing technologies for RDF Repository <a href="http://www.bioontology.org/wiki/images/6/6a/Triple_Stores.pdf">[8]</a>, Jena SDB <a href="http://jena.apache.org/documentation/sdb/">[9]</a> backed with MySQL was chosen to be the storage for all the RDF data.
</li>
<li>
Some instances for the classes of the ontology were created for testing and loaded (via command line) into the repository.
</li>
<li>
Programmatically loaded data into the repository using Jena Api. Successfully inserting either an entire RDF file or a single triple statement into the database.
</li>
<li>
A SPARQL Endpoint <a href="http://www.w3.org/TR/rdf-sparql-query/">[10]</a><a href="http://semanticweb.org/wiki/SPARQL_endpoint">[11]</a> was set up locally (on the developer's machine) and can be used to query the repository. Java Web with Tomcat Servlets is being used for the web server.
</li>
</ul>
</li>
<li>To do
<ul>
<li>
Cross data with multiple data sets. Use SPARQL Queries that link multiple data sets (FOAF, DBPedia, FAO, etc) with our data set. Run these queries on the local (developer’s machine) SPARQL Endpoint.
</li>
</ul>
</li>
<li>Dates
<ul>
<li>
Started on June 5, 2013.
</li>
</ul>
</li>
</ol>
</li>
 
<li>
Generate RDF Data
<ol>
<li>Goal
<ul>
<li>
Generate RDF data from PingER data using the ontology built.
</li>
</ul>
</li>
<li>Progress
</li>
<li>To do
<ul>
<li>
Analyze and study the data from PingER. Find out a good way to write the data in RDF format.
</li>
<li>
Analyze the raw data. Verify the standards and patterns and check if we can use good technologies to extract the data from the raw data, transform it to RDF format, and load them into the RDF repository. Do some search about Kettle/Pentaho ETL tools <a href="http://en.wikipedia.org/wiki/Extract,_transform,_load">[12]</a><a href="http://kettle.pentaho.com/">[13]</a>.
</li>
</ul>
</li>
<li>Dates
</li>
</ol>
</li>

</ol>

<h6>References</h6>

[1] Project MOMENT Ontologies. Retrieved from <a href="https://svn.fp7-moment.eu/svn/moment/public/Ontology/">https://svn.fp7-moment.eu/svn/moment/public/Ontology/</a> on June 5, 2013.


[2] ETSI. Measurement Ontology for IP traffic (MOI); IP traffic measurement ontologies architecture. Retrieved from <a href="http://www.etsi.org/deliver/etsi_gs/MOI/001_099/003/01.01.01_60/gs_moi003v010101p.pdf">http://www.etsi.org/deliver/etsi_gs/MOI/001_099/003/01.01.01_60/gs_moi003v010101p.pdf</a> on June 5, 2013.


[3] PingER Node Details. Retrieved from <a href="https://confluence.slac.stanford.edu/display/IEPM/PingER+NODEDETAILS">https://confluence.slac.stanford.edu/display/IEPM/PingER+NODEDETAILS</a> on June 5, 2013.


[4] Food And Agriculture Organization Of The United Nations Ontology. Retrieved from <a href="http://www.fao.org/countryprofiles/geoinfo/geopolitical/">http://www.fao.org/countryprofiles/geoinfo/geopolitical/</a> on June 5, 2013.


[5] Friend of a Friend Ontology. Retrieved from <a href="http://www.foaf-project.org/">http://www.foaf-project.org/</a> on June 5, 2013.


[6] DBPedia. Retrieved from <a href="http://dbpedia.org/About">http://dbpedia.org/About</a> on June 5, 2013.


[7] Resource Description Framework (RDF). Retrieved from <a href="http://www.w3.org/RDF/">http://www.w3.org/RDF/</a> on June 5, 2013.


[8] Comparison of Triple Stores. Retrieved from <a href="http://www.bioontology.org/wiki/images/6/6a/Triple_Stores.pdf">http://www.bioontology.org/wiki/images/6/6a/Triple_Stores.pdf</a> on June 5, 2013.


[9] Jena SQL DB. Retrieved from <a href="http://jena.apache.org/documentation/sdb/">http://jena.apache.org/documentation/sdb/</a> on June 7, 2013.


[10] SPARQL. Retrieved from <a href="http://www.w3.org/TR/rdf-sparql-query/">http://www.w3.org/TR/rdf-sparql-query/</a> on June 5, 2013.


[11] SPARQL Endpoint. Retrieved from <a href="http://semanticweb.org/wiki/SPARQL_endpoint">http://semanticweb.org/wiki/SPARQL_endpoint</a> on June 5, 2013.


[12] Extract, Transform, Load (ETL). Retrieved from <a href="http://en.wikipedia.org/wiki/Extract,_transform,_load">http://en.wikipedia.org/wiki/Extract,_transform,_load</a> on June 5, 2013.


[13] Pentaho Kettle Project. Retrieved from <a href="http://kettle.pentaho.com/">http://kettle.pentaho.com/</a> on June 5, 2013.

Child pages

Project Progress