狠狠撸

狠狠撸Share a Scribd company logo
Where Big Data meets Linked Data:
Applying standarddata models to
environmental data streams
Adam Leadbetter, Damian Smyth, Robert Fuller, Eoin O’Grady
Marine Institute, Ireland
Adam Shepherd
Woods Hole Oceanographic Institution, US
adam.leadbetter@marine.ie
http://whatis.techtarget.com/definition/3Vs
HTTP://XKCD.COM/927/
https://s-media-cache-ak0.pinimg.com/564x/e7/c2/6b/e7c26b7963b2628d10fe649008b02d23.jpg
https://upload.wikimedia.org/wikipedia/commons/thumb/9/9d/Sir_Tim_Berners-Lee.jpg/640px-Sir_Tim_Berners-Lee.jpg/
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
http://iode.org/index.php?option=com_oe&task=viewDocumentRecord&docID=875
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
http://smartbay.marine.ie
http://github.com/IrishMarineInstitute/uwobs
2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
%{NUMBER:pressure:float}
%{SPACE}
%{NUMBER:temperature:float}
%{SPACE}
%{NUMBER:conductivity:float}
%{SPACE}
%{NUMBER:salinity:float}
%{SPACE}
%{NUMBER:sound_velocity:float}
%{SPACE}%{TIME:raw_time}
2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
%{NUMBER:pressure:float}
%{SPACE}
%{NUMBER:temperature:float}
%{SPACE}
%{NUMBER:conductivity:float}
%{SPACE}
%{NUMBER:salinity:float}
%{SPACE}
%{NUMBER:sound_velocity:float}
%{SPACE}%{TIME:raw_time}
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
property
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
Feature property
An observation is an action whose result is an estimate of
the value of some property of the feature-of-interest,
obtained using a specified procedure
Observation
result
Feature property
procedure
{
"id":"foo",
"phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"},
"featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"},
"member":[{
"id":"#temperature",
"type":"Measurement",
"result": {
"value":16.118,
"uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/"
},
"observedProperty": {
"href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/"
},
"procedure":{
"href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/"
},
"resultTime":"2016-08-18T11:42:59.782Z“
}]}
{
"@context": "http://example.org/om-context",
"id":"foo",
"phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"},
"featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"},
"member":[{
"id":"#temperature",
"type":"Measurement",
"result": {
"value":16.118,
"uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/"
},
"observedProperty": {
"href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/"
},
"procedure":{
"href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/"
},
"resultTime":"2016-08-18T11:42:59.782Z“
}]}
@prefix mi-feature: < http://linked.marine.ie/feature/>.
@prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>.
@prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>.
@prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>.
@prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>.
mi-gbco:temperature om:process nvs-l22:TOOL0861;
om:observedProperty nvs-p01:TEMPPR01;
om:result <_:result>.
om:resultTime "2016-08-18T11:42:59.782Z" .
<http://spiddal.marine.ie/2016-08-18-11-42-59-782>
om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation;
om:phenomenonTime "2016-08-18T11:42:59.782Z" .
om:relatedObservation mi-gbco:temperature.
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
Where Linked Data meets Big Data: Applying standard data models to environmental data streams
“There are emergent technologies throughout the
fields around oceanography which we will
incorporate into oceanography, and through
that convergence we will make oceanography
into something even more magical”
John Delaney
Adam Leadbetter
adam.leadbetter@marine.ie
@AdamLeadbetter

More Related Content

Where Linked Data meets Big Data: Applying standard data models to environmental data streams

  • 1. Where Big Data meets Linked Data: Applying standarddata models to environmental data streams Adam Leadbetter, Damian Smyth, Robert Fuller, Eoin O’Grady Marine Institute, Ireland Adam Shepherd Woods Hole Oceanographic Institution, US adam.leadbetter@marine.ie
  • 6. @prefix mi-feature: < http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 7. @prefix mi-feature: < http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 8. @prefix mi-feature: < http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 9. @prefix mi-feature: < http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 18. 2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M
  • 19. 2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M %{NUMBER:pressure:float} %{SPACE} %{NUMBER:temperature:float} %{SPACE} %{NUMBER:conductivity:float} %{SPACE} %{NUMBER:salinity:float} %{SPACE} %{NUMBER:sound_velocity:float} %{SPACE}%{TIME:raw_time}
  • 20. 2016-10-03T00:10:04.863Z|I-OCEAN7-304-XXXX| 24.51 14.837 37.002 29.784 1500.4781 00:15:13.86M %{NUMBER:pressure:float} %{SPACE} %{NUMBER:temperature:float} %{SPACE} %{NUMBER:conductivity:float} %{SPACE} %{NUMBER:salinity:float} %{SPACE} %{NUMBER:sound_velocity:float} %{SPACE}%{TIME:raw_time}
  • 21. An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure
  • 22. An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation
  • 23. An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result
  • 24. An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result property
  • 25. An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result Feature property
  • 26. An observation is an action whose result is an estimate of the value of some property of the feature-of-interest, obtained using a specified procedure Observation result Feature property procedure
  • 28. { "@context": "http://example.org/om-context", "id":"foo", "phenomenonTime": {"instant":"2016-08-18T11:42:59.782Z"}, "featureOfInterest":{"href":"http://linked.marine.ie/feature/exampleURI"}, "member":[{ "id":"#temperature", "type":"Measurement", "result": { "value":16.118, "uom":"http://vocab.nerc.ac.uk/collection/P06/current/UPAA/" }, "observedProperty": { "href":"http://vocab.nerc.ac.uk/collection/P01/current/TEMPPR01/" }, "procedure":{ "href":"http://vocab.nerc.ac.uk/collection/L22/current/TOOL0861/" }, "resultTime":"2016-08-18T11:42:59.782Z“ }]}
  • 29. @prefix mi-feature: < http://linked.marine.ie/feature/>. @prefix mi-gbco: <http://spiddal.marine.ie/2016-08-18-11-42-59-782#>. @prefix nvs-l22: <http://vocab.nerc.ac.uk/collection/L22/current/>. @prefix nvs-p01: <http://vocab.nerc.ac.uk/collection/P01/current/>. @prefix om: <http://def.seegrid.csiro.au/isotc211/iso19156/2011/observation#>. mi-gbco:temperature om:process nvs-l22:TOOL0861; om:observedProperty nvs-p01:TEMPPR01; om:result <_:result>. om:resultTime "2016-08-18T11:42:59.782Z" . <http://spiddal.marine.ie/2016-08-18-11-42-59-782> om:featureOfInterest mi-feature:GalwayBayCableObservatoryLocation; om:phenomenonTime "2016-08-18T11:42:59.782Z" . om:relatedObservation mi-gbco:temperature.
  • 35. “There are emergent technologies throughout the fields around oceanography which we will incorporate into oceanography, and through that convergence we will make oceanography into something even more magical” John Delaney