Number of Urban Data Streams available in the smart cities are in continuous increase. We presented an automated discovery and integration system which not only discovers the most relevant data streams for the citizens based on their requirements and context. But also composes the primitive data streams into complex events and executes over existing stream query reasoning engines.
Toward Semantic Data Stream - Technologies and ApplicationsRaja Chiky
油
Massive data stream processing is a scientific challenge and an industrial concern. But with the current volumes of data streams , their number and variety, current techniques are not able to meet the requirements of applications. The Semantic Web tools , through the RDF for example, allow to address the problem of heterogeneous data. Thus, the data stream are converted to semantic data stream by using RDF triples extended with a timestamp. To be able to query , filter, or reason semantic data streams, the query language SPARQL must be extended to include concepts such as windowing , based on what has been done in Data Stream Management Systems. In this talk, I will present recent work on the semantic data stream management , particularly extensions made on SPARQL language and associated benchmarks.
Research Seminar Presentation - A framework for partitioning and execution of...malinga2009
油
This is a presentation slide-set which presented at Research Seminar Series in UCSC on 12th of August 2013. Two new research papers will be presented and discussed in each week and audience will be motivated to ask questions regarding those two papers. Altogether 40 papers will be presented within an academic year.
Abstract : This paper addresses the problem of automatic temporal annotation of realistic human actions in video using minimal manual supervision. To this end we consider two associated problems: (a) weakly-supervised learning of action models from readily available annotations, and (b) temporal localization of human actions in test videos. To avoid the prohibitive cost of manual annotation for training, we use movie scripts as a means of weak supervision. Scripts, however, provide only implicit, noisy, and imprecise information about the type and location of actions in video. We address this problem with a kernel-based discriminative clustering algorithm that locates actions in the weakly-labeled training data. Using the obtained action samples, we train temporal action detectors and apply them to locate actions in the raw video data. Our experiments demonstrate that the proposed method for weakly-supervised learning of action models leads to significant improvement in action detection. We present detection results for three action classes in four feature length movies with challenging and realistic video data.
Link to paper :
http://dl.acm.org/citation.cfm?id=2479946
1. Real-time analytics of social networks can help companies detect new business opportunities by understanding customer needs and reactions in real-time.
2. MOA and SAMOA are frameworks for analyzing massive online and distributed data streams. MOA deals with evolving data streams using online learning algorithms. SAMOA provides a programming model for distributed, real-time machine learning on data streams.
3. Both tools allow companies to gain insights from social network and other real-time data to understand customers and react to opportunities.
CityPulse is a project that aims to develop a distributed framework for processing large-scale real-time IoT and social data streams to extract knowledge for smart city applications. The framework will semantically integrate heterogeneous data sources, perform large-scale analytics, and adapt processing in real-time based on context. It will be tested through prototype smart city applications to evaluate its ability to support future smart city platforms and products. The key issues addressed are virtualization of data, on-demand federation of sources, large-scale aggregation and analytics, real-time interpretation and processing control, and reliable information extraction.
Course "Machine Learning and Data Mining" for the degree of Computer Engineering at the Politecnico di Milano. In in this lecture we overview the mining of data streams
Data Stream Processing with Apache FlinkFabian Hueske
油
This talk is an introduction into Stream Processing with Apache Flink. I gave this talk at the Madrid Apache Flink Meetup at February 25th, 2016.
The talk discusses Flink's features, shows it's DataStream API and explains the benefits of Event-time stream processing. It gives an outlook on some features that will be added after the 1.0 release.
This document discusses mapping sensor data streams to ontologies to enable semantic querying. It presents work done for the SwissEx sensor network project, where sensor metadata from different sites was represented in an SSN ontology and observation data was mapped to ontologies using R2RML mappings. An ontology-based query service was implemented to allow SPARQL queries over streaming data from hundreds of heterogeneous sensors accessed via GSN. Future work includes improving usability, integrating streaming and stored RDF data, applying the approach to other sensor networks and technologies.
In a tool-heavy infrastructure world, this talk explains how to rethink DevOps as being a Contract first, instead of focusing on tools or teams or roles.We will cover 5 different infrastructure areas, how each of them were treated before as a tool, what bottlenecks they faced, how they were remodeled to a being a contract, and how the whole area scaled up. Every organization that wants to scale their Infrastructure up will highly relate to the problems and solutions outlined in these examples.
https://www.devopsdays.org/events/2018-berlin/program/subhas-dandapani/
This document provides an introduction to open and agile smart cities. It discusses using common APIs and data models to integrate diverse real-time and historical city data from sensors, systems, and users. The NGSI standard is presented as a way to expose context data via a RESTful API from various sources. FIWARE's context broker and IoT agents help connect sensors. CKAN is identified as an open data platform to publish, search, and manage city data. Several smart city pilots are highlighted to showcase applying these approaches. Overall the document outlines OASC's principles of driving smart city implementations through open specifications and sharing best practices.
MELA: Monitoring and Analyzing Elasticity of Cloud Services -- CloudCom 2013Daniel Moldovan
油
Cloud computing has enabled a wide array of applications to be exposed as elastic cloud services. While the number of such services has rapidly increased, there is a lack of techniques for supporting cross-layered multi-level monitoring and analysis of elastic service behavior. In this paper we introduce novel concepts, namely elasticity space and elasticity pathway, for understanding elasticity of cloud services, and techniques for monitoring and evaluating them. We present MELA, a customizable framework that enables service providers and developers to analyze cross-layered, multi-level elasticity of cloud services, from the whole cloud service to service units, based on service structure dependencies. Besides support for real-time elasticity analysis of cloud service behavior, MELA provides several customizable features for extracting functions and patterns that characterize that behavior. To illustrate the usefulness of MELA, we conduct several experiments with a realistic data-as-a-service in an M2M cloud platform.
Prototype and Demos at http://tuwiendsg.github.io/MELA/
Paper DOI: http://dx.doi.org/10.1109/CloudCom.2013.18
XGSN: An Open-source Semantic Sensing Middleware for the Web of ThingsJean-Paul Calbimonte
油
The document discusses XGSN, an open-source semantic sensing middleware for the Web of Things. It describes how XGSN allows users to store, process, and semantically annotate sensor data from heterogeneous sources. XGSN uses wrappers to integrate different sensor types and formats data using ontologies. It also supports defining virtual sensors that aggregate and correlate multiple data streams. The document considers issues around annotating dynamic sensor data streams at scale and balancing semantic representations with efficient querying and processing of sensor observations.
The document discusses several interoperability standards for IoT - CoAP, OMA LWM2M, and IPSO Smart Objects. It describes how they build upon each other with CoAP providing REST APIs for constrained devices, OMA LWM2M building on CoAP to define device management objects and models, and IPSO Smart Objects further defining application objects based on the LWM2M model. The standards provide a layered approach to connectivity, services, data models and applications to enable interoperability for IoT devices and services.
This document discusses standards for IoT interoperability, including IPSO Smart Objects, OMA LWM2M, and CoAP. IPSO Smart Objects define a simple data model and object model to enable semantic interoperability across IoT devices. OMA LWM2M builds on CoAP to provide a server profile for IoT middleware and defines reusable management objects. CoAP defines a RESTful protocol for constrained networks and devices that can be used for device discovery and interaction.
Complex Event Processing (CEP) involves detecting patterns in streams of event data. CEP tools analyze multiple simple events to identify complex events inferred from simpler ones. Typical applications of CEP include monitoring for business anomalies, detecting fraud or security threats. CEP augments service-oriented architectures by allowing services to trigger from events and generate new event streams. Event processing engines use techniques like filtering, windows, and correlation to detect patterns across events over time.
The document discusses event processing as a service (EPaaS) delivered through cloud computing. It describes EPaaS as processing complex event patterns over dynamic data streams. Standardizations are needed for describing event patterns of interest, specifying quality of service levels, and identifying event sources to monitor. EPaaS could leverage other cloud services like computing, software, monitoring, and messaging to dynamically allocate resources based on event workload. The document predicts that multiple cloud-based EP services will be necessary to filter massive event data and provide structured outputs to users and systems.
This document describes a project to aggregate data from various sources about events and traffic conditions, and visualize that data to help explain abnormal traffic patterns. Data is collected from APIs providing information about scheduled events, weather, traffic incidents, and real-time traffic flow. The data is stored in a database and can be visualized on a map interface, allowing users to search for events within a given location and time range. The goal is to help analyze reasons for congestion and support future traffic prediction and analysis.
This document provides an overview of Microsoft's StreamInsight Complex Event Processing (CEP) platform. It discusses CEP concepts and benefits, the StreamInsight architecture and development environment, and deployment scenarios. The presentation aims to introduce IT professionals to CEP and Microsoft's StreamInsight solution for building event-driven applications that process streaming data with low latency.
Enabling SDN for Service Providers by Khay Kid ChowMyNOG
油
1. The document discusses how programmable networks and network functions virtualization (NFV) enable new use cases and business models for service providers by making networks software-defined and services elastic.
2. Key aspects covered include centralizing network control, virtualizing network functions, and using orchestration to dynamically provision and monitor virtualized services across compute and network infrastructure on demand.
3. The benefits highlighted are automating network operations, enabling new self-service capabilities, and decreasing time to revenue through agile service creation.
LarKC Tutorial at ISWC 2009 - Urban ComputingLarKC
油
The document discusses understanding and manipulating urban computing workflows. It describes three workflows used in the Alpha Urban LarKC system: 1) a monument selection workflow, 2) an event selection workflow, and 3) a path finding workflow. Each workflow utilizes various LarKC plugins to integrate, transform, and reason over distributed data sources for responding to user queries about points of interest in a city.
1. The ALMANAC project addresses all layers of smart cities through an Internet of Things approach, focusing on life services, data/information, smart infrastructure, and basic infrastructure.
2. It takes a novel approach of federating different city stakeholders, both private and public, to address all layers by design.
3. The platform uses a distributed microservices architecture running on multiple locations and technologies to connect over 60,000 synthetic sensors in a single federation of 3 platform instances, demonstrating scalability.
Observability foundations in dynamically evolving architecturesBoyan Dimitrov
油
Holistic application health monitoring, request tracing across distributed systems, instrumentation, business process SLAs - all of them are integral parts of todays technical stacks. Nevertheless many teams decide to integrate observability last which makes it an almost impossible challenge - especially if you have to deal with hundreds and thousands of services. Therefore starting early is essential and in this talk we are going to see how we can solve those challenges early and explore the foundations of building and evolving complex microservices platforms in respect to observability.
We are going to share some of the best practices and quick wins that allow us to correlate different telemetry systems and gradually build up towards more sophisticated use-cases.
We are also going to look at some of the standard AWS services such as X-Ray and Cloudwatch that help us get going "for free" and then discuss more complex tooling and integrations building up towards a fully integrated ecosystem. As part of this talk we are also going to share some of the learnings we have made at Sixt on this topic and we are going to introduce some of the solutions that help us operate our microservices stack
This document discusses device management for OSGi IoT gateways. It introduces Kura, an Eclipse open source project for IoT gateways built on OSGi. It discusses using MQTT and CoAP/LwM2M protocols for device management, including remote OSGi bundle and service configuration management. It provides examples of using MQTT for request/response workflows and managing OSGi configurations. It also discusses representing Kura components and configurations using LwM2M objects. A demo is promised and next steps include using CoAP as an alternative transport and discussing LwM2M over MQTT.
The document provides an overview of new features in CICS Transaction Server V4.1, including enhancements to support event processing, Atom feeds, service component architecture, Java 6, and Web services addressing. Key goals of the new release are to help customers compete by responding quickly to business needs, comply with regulations, and control costs through simplified management and development.
The cyber threat landscape is becoming more dangerous and challenging all the time. Here, youll find a practical, expert-crafted resource to help keep your enterprise secure and successful for the long-term. Its our way to help you get informed -- and stay safe.
Protection API
-Transforms your existing devices into a complete APT solution
-Complements current network security
-Enhances perimeter defenses
oneM2M - Management, Abstraction and SemanticsoneM2M
油
The document discusses concepts related to management, abstraction, and semantics in oneM2M including:
- Management provides unified APIs for configuring, monitoring, and managing devices, applications, and service entities.
- Abstraction hides the complexity of specific technologies by providing a single, unified information model and methods for applications.
- Semantics adds meaning and relationships between concepts to enable machine understandable interoperability.
- oneM2M provides resource models and protocols for management, and attributes for basic semantic annotation. Interworking proxies map non-oneM2M models to common oneM2M resources.
This document discusses the timeline server which collects and stores application metrics and event data in YARN. It describes the limitations of the original job history server and application history server, which only supported MapReduce jobs and did not capture YARN-level data. The timeline server versions 1 and 2 are presented as improved solutions, with version 2 focusing on distributed and reliable storage in HBase, a new data model to support arbitrary application types, and online aggregation of metrics.
This document discusses consuming web services from an Android application using SOAP and REST. It provides examples of using a SOAP client to call a .NET web service hosted on IIS and returning data in an XML envelope. It also discusses using a REST client to invoke PHP services on a web server and receive JSON responses. The document outlines the layers of the web service architecture including transport, messaging, description and discovery.
This document provides an introduction to open and agile smart cities. It discusses using common APIs and data models to integrate diverse real-time and historical city data from sensors, systems, and users. The NGSI standard is presented as a way to expose context data via a RESTful API from various sources. FIWARE's context broker and IoT agents help connect sensors. CKAN is identified as an open data platform to publish, search, and manage city data. Several smart city pilots are highlighted to showcase applying these approaches. Overall the document outlines OASC's principles of driving smart city implementations through open specifications and sharing best practices.
MELA: Monitoring and Analyzing Elasticity of Cloud Services -- CloudCom 2013Daniel Moldovan
油
Cloud computing has enabled a wide array of applications to be exposed as elastic cloud services. While the number of such services has rapidly increased, there is a lack of techniques for supporting cross-layered multi-level monitoring and analysis of elastic service behavior. In this paper we introduce novel concepts, namely elasticity space and elasticity pathway, for understanding elasticity of cloud services, and techniques for monitoring and evaluating them. We present MELA, a customizable framework that enables service providers and developers to analyze cross-layered, multi-level elasticity of cloud services, from the whole cloud service to service units, based on service structure dependencies. Besides support for real-time elasticity analysis of cloud service behavior, MELA provides several customizable features for extracting functions and patterns that characterize that behavior. To illustrate the usefulness of MELA, we conduct several experiments with a realistic data-as-a-service in an M2M cloud platform.
Prototype and Demos at http://tuwiendsg.github.io/MELA/
Paper DOI: http://dx.doi.org/10.1109/CloudCom.2013.18
XGSN: An Open-source Semantic Sensing Middleware for the Web of ThingsJean-Paul Calbimonte
油
The document discusses XGSN, an open-source semantic sensing middleware for the Web of Things. It describes how XGSN allows users to store, process, and semantically annotate sensor data from heterogeneous sources. XGSN uses wrappers to integrate different sensor types and formats data using ontologies. It also supports defining virtual sensors that aggregate and correlate multiple data streams. The document considers issues around annotating dynamic sensor data streams at scale and balancing semantic representations with efficient querying and processing of sensor observations.
The document discusses several interoperability standards for IoT - CoAP, OMA LWM2M, and IPSO Smart Objects. It describes how they build upon each other with CoAP providing REST APIs for constrained devices, OMA LWM2M building on CoAP to define device management objects and models, and IPSO Smart Objects further defining application objects based on the LWM2M model. The standards provide a layered approach to connectivity, services, data models and applications to enable interoperability for IoT devices and services.
This document discusses standards for IoT interoperability, including IPSO Smart Objects, OMA LWM2M, and CoAP. IPSO Smart Objects define a simple data model and object model to enable semantic interoperability across IoT devices. OMA LWM2M builds on CoAP to provide a server profile for IoT middleware and defines reusable management objects. CoAP defines a RESTful protocol for constrained networks and devices that can be used for device discovery and interaction.
Complex Event Processing (CEP) involves detecting patterns in streams of event data. CEP tools analyze multiple simple events to identify complex events inferred from simpler ones. Typical applications of CEP include monitoring for business anomalies, detecting fraud or security threats. CEP augments service-oriented architectures by allowing services to trigger from events and generate new event streams. Event processing engines use techniques like filtering, windows, and correlation to detect patterns across events over time.
The document discusses event processing as a service (EPaaS) delivered through cloud computing. It describes EPaaS as processing complex event patterns over dynamic data streams. Standardizations are needed for describing event patterns of interest, specifying quality of service levels, and identifying event sources to monitor. EPaaS could leverage other cloud services like computing, software, monitoring, and messaging to dynamically allocate resources based on event workload. The document predicts that multiple cloud-based EP services will be necessary to filter massive event data and provide structured outputs to users and systems.
This document describes a project to aggregate data from various sources about events and traffic conditions, and visualize that data to help explain abnormal traffic patterns. Data is collected from APIs providing information about scheduled events, weather, traffic incidents, and real-time traffic flow. The data is stored in a database and can be visualized on a map interface, allowing users to search for events within a given location and time range. The goal is to help analyze reasons for congestion and support future traffic prediction and analysis.
This document provides an overview of Microsoft's StreamInsight Complex Event Processing (CEP) platform. It discusses CEP concepts and benefits, the StreamInsight architecture and development environment, and deployment scenarios. The presentation aims to introduce IT professionals to CEP and Microsoft's StreamInsight solution for building event-driven applications that process streaming data with low latency.
Enabling SDN for Service Providers by Khay Kid ChowMyNOG
油
1. The document discusses how programmable networks and network functions virtualization (NFV) enable new use cases and business models for service providers by making networks software-defined and services elastic.
2. Key aspects covered include centralizing network control, virtualizing network functions, and using orchestration to dynamically provision and monitor virtualized services across compute and network infrastructure on demand.
3. The benefits highlighted are automating network operations, enabling new self-service capabilities, and decreasing time to revenue through agile service creation.
LarKC Tutorial at ISWC 2009 - Urban ComputingLarKC
油
The document discusses understanding and manipulating urban computing workflows. It describes three workflows used in the Alpha Urban LarKC system: 1) a monument selection workflow, 2) an event selection workflow, and 3) a path finding workflow. Each workflow utilizes various LarKC plugins to integrate, transform, and reason over distributed data sources for responding to user queries about points of interest in a city.
1. The ALMANAC project addresses all layers of smart cities through an Internet of Things approach, focusing on life services, data/information, smart infrastructure, and basic infrastructure.
2. It takes a novel approach of federating different city stakeholders, both private and public, to address all layers by design.
3. The platform uses a distributed microservices architecture running on multiple locations and technologies to connect over 60,000 synthetic sensors in a single federation of 3 platform instances, demonstrating scalability.
Observability foundations in dynamically evolving architecturesBoyan Dimitrov
油
Holistic application health monitoring, request tracing across distributed systems, instrumentation, business process SLAs - all of them are integral parts of todays technical stacks. Nevertheless many teams decide to integrate observability last which makes it an almost impossible challenge - especially if you have to deal with hundreds and thousands of services. Therefore starting early is essential and in this talk we are going to see how we can solve those challenges early and explore the foundations of building and evolving complex microservices platforms in respect to observability.
We are going to share some of the best practices and quick wins that allow us to correlate different telemetry systems and gradually build up towards more sophisticated use-cases.
We are also going to look at some of the standard AWS services such as X-Ray and Cloudwatch that help us get going "for free" and then discuss more complex tooling and integrations building up towards a fully integrated ecosystem. As part of this talk we are also going to share some of the learnings we have made at Sixt on this topic and we are going to introduce some of the solutions that help us operate our microservices stack
This document discusses device management for OSGi IoT gateways. It introduces Kura, an Eclipse open source project for IoT gateways built on OSGi. It discusses using MQTT and CoAP/LwM2M protocols for device management, including remote OSGi bundle and service configuration management. It provides examples of using MQTT for request/response workflows and managing OSGi configurations. It also discusses representing Kura components and configurations using LwM2M objects. A demo is promised and next steps include using CoAP as an alternative transport and discussing LwM2M over MQTT.
The document provides an overview of new features in CICS Transaction Server V4.1, including enhancements to support event processing, Atom feeds, service component architecture, Java 6, and Web services addressing. Key goals of the new release are to help customers compete by responding quickly to business needs, comply with regulations, and control costs through simplified management and development.
The cyber threat landscape is becoming more dangerous and challenging all the time. Here, youll find a practical, expert-crafted resource to help keep your enterprise secure and successful for the long-term. Its our way to help you get informed -- and stay safe.
Protection API
-Transforms your existing devices into a complete APT solution
-Complements current network security
-Enhances perimeter defenses
oneM2M - Management, Abstraction and SemanticsoneM2M
油
The document discusses concepts related to management, abstraction, and semantics in oneM2M including:
- Management provides unified APIs for configuring, monitoring, and managing devices, applications, and service entities.
- Abstraction hides the complexity of specific technologies by providing a single, unified information model and methods for applications.
- Semantics adds meaning and relationships between concepts to enable machine understandable interoperability.
- oneM2M provides resource models and protocols for management, and attributes for basic semantic annotation. Interworking proxies map non-oneM2M models to common oneM2M resources.
This document discusses the timeline server which collects and stores application metrics and event data in YARN. It describes the limitations of the original job history server and application history server, which only supported MapReduce jobs and did not capture YARN-level data. The timeline server versions 1 and 2 are presented as improved solutions, with version 2 focusing on distributed and reliable storage in HBase, a new data model to support arbitrary application types, and online aggregation of metrics.
This document discusses consuming web services from an Android application using SOAP and REST. It provides examples of using a SOAP client to call a .NET web service hosted on IIS and returning data in an XML envelope. It also discusses using a REST client to invoke PHP services on a web server and receive JSON responses. The document outlines the layers of the web service architecture including transport, messaging, description and discovery.
How to create security group category in Odoo 17Celine George
油
This slide will represent the creation of security group category in odoo 17. Security groups are essential for managing user access and permissions across different modules. Creating a security group category helps to organize related user groups and streamline permission settings within a specific module or functionality.
Unit 1 Computer Hardware for Educational Computing.pptxRomaSmart1
油
Computers have revolutionized various sectors, including education, by enhancing learning experiences and making information more accessible. This presentation, "Computer Hardware for Educational Computing," introduces the fundamental aspects of computers, including their definition, characteristics, classification, and significance in the educational domain. Understanding these concepts helps educators and students leverage technology for more effective learning.
Dr. Ansari Khurshid Ahmed- Factors affecting Validity of a Test.pptxKhurshid Ahmed Ansari
油
Validity is an important characteristic of a test. A test having low validity is of little use. Validity is the accuracy with which a test measures whatever it is supposed to measure. Validity can be low, moderate or high. There are many factors which affect the validity of a test. If these factors are controlled, then the validity of the test can be maintained to a high level. In the power point presentation, factors affecting validity are discussed with the help of concrete examples.
How to Configure Deliver Content by Email in Odoo 18 SalesCeline George
油
In this slide, well discuss on how to configure proforma invoice in Odoo 18 Sales module. A proforma invoice is a preliminary invoice that serves as a commercial document issued by a seller to a buyer.
AI and Academic Writing, Short Term Course in Academic Writing and Publication, UGC-MMTTC, MANUU, 25/02/2025, Prof. (Dr.) Vinod Kumar Kanvaria, University of Delhi, vinodpr111@gmail.com
Odoo 18 Accounting Access Rights - Odoo 18 際際滷sCeline George
油
In this slide, well discuss on accounting access rights in odoo 18. To ensure data security and maintain confidentiality, Odoo provides a robust access rights system that allows administrators to control who can access and modify accounting data.
Comprehensive Guide to Antibiotics & Beta-Lactam Antibiotics.pptxSamruddhi Khonde
油
Comprehensive Guide to Antibiotics & Beta-Lactam Antibiotics
Antibiotics have revolutionized medicine, playing a crucial role in combating bacterial infections. Among them, Beta-Lactam antibiotics remain the most widely used class due to their effectiveness against Gram-positive and Gram-negative bacteria. This guide provides a detailed overview of their history, classification, chemical structures, mode of action, resistance mechanisms, SAR, and clinical applications.
What Youll Learn in This Presentation
History & Evolution of Antibiotics
Cell Wall Structure of Gram-Positive & Gram-Negative Bacteria
Beta-Lactam Antibiotics: Classification & Subtypes
Penicillins, Cephalosporins, Carbapenems & Monobactams
Mode of Action (MOA) & Structure-Activity Relationship (SAR)
Beta-Lactamase Inhibitors & Resistance Mechanisms
Clinical Applications & Challenges.
Why You Should Check This Out?
Essential for pharmacy, medical & life sciences students.
Provides insights into antibiotic resistance & pharmaceutical trends.
Useful for healthcare professionals & researchers in drug discovery.
Swipe through & explore the world of antibiotics today!
Like, Share & Follow for more in-depth pharma insights!
12. Smart City Applications - Challenges
Virtualisation
Federation of heterogeneous data streams
Processing users queries in terms of requirements rather
than hard-bind queries
Optimal data source selection while taking users
constraints and preferences into account
Automated composition of primitive data services/streams
into complex events
Automated generations of queries from the complex
events composition plan
12 19/10/2014
13. ACEIS - Features
Automated Complex Event Implementation System
Enables users to provide requirements rather than hard
bind streams
Automatically discovers the relevant data streams
Selects optimal data stream after evaluating users
constraints and preferences
On demand data federation using complex event patterns
Transformation of complex event into stream queries
13 19/10/2014
14. 19/10/2014
ACEIS - Architecture
14
Semantic Annotation
Application
Interface
ACEIS Core
Resource
Management
Knowledge Base
QoI/QoS
Stream
Description
Data Mgmt,
Indexing,
Caching
User Input
Event Request
Data
Federation
Resource Discovery
Event Service Composer
Composition Plan
Subscription Manager
Query Transformer
Query Engine
Query
Results
Adaptation
Manager
Constraint
Validation
Constraint
Violation
Data Store
IoT Data
Stream
Social Data
Stream
15. Complex Event Service Ontology Overview (1/2)
The Complex Event Service Ontology (CES ontology) is an extension of
19/10/2014
15
OWL-S ontology.
CES ontology is used together with SSN (Semantic Sensor Network)
ontology, SSN is used to describe the sensor aspects
An Event Service is described with a Grounding and an Event Profile.
1. Groundings specify how to access and interact with event services.
2. Event Profiles describe the events provided by the services with Patterns and
Non-Functional Properties (NFP).
An Event Request is specified as an incomplete Event Service
description, without concrete service bindings.
17. Complex Event Service Ontology Event Pattern
EventService
rdf:_x (contains)
rdf:_x (contains)
rdf:Seq rdf:Bag
19/10/2014
17
ComplexEvent
Service
owls:presents
EventProfile
hasPattern
Pattern
Namespaces:
default: <http://www.insight-centre.org/ces#>
rdf: <http://www.w3.org/1999/02/22-rdf-syntax-ns#>
owls: <http://www.daml.org/services/owl-s/1.2/Service.owl#>
Legend:
Class (unimplemented)
Object property
subClassOf
Sequence
Or
Repetition And
hasFilter
Aggregation Filter SlidingWindow
Class
ValueAssignment
hasWindow
onEvent onPayload hasExpression
EventService EventPayload Expression
18. Stream Discovery Sensor Stream Annotation
A sensor service description is annotated as:
PrimitiveEventService in CES ontology, as well as a Sensor device in SSN on-tology.
The CES ontology is mainly used to describe the non-functional aspects
Pd FoId
of sensor service requests/descriptions, including sensor event types, quality pa-rameters
and sensor service groundings. SSN ontology is used to describe the
19/10/2014
18
sdesc = (td, g, qd, Pd, FoId, fd)
type grounding QoS Observed
Properties
Feature Of
Iterest
functional aspects, including ObservedProperties and FeatureOfInterest.
Listing 1. Trac sensor service description
:sampleTrafficSensor a ssn:Sensor ,ces:PrimitiveEventService;
owls:presents :sampleProfile ;
owls:supports :sampleGrounding;
ssn:observes [ a ces:AverageSpeed;
ssn:isPropertyFor :Seg_1],
[ a ces:VehicleCount;
ssn:isPropertyFor :Seg_1],
[ a ces:EstimatedTime;
ssn:isPropertyFor :Seg_1 ].
:sampleProfile a ces:EventProfile ;
owls:serviceCategory [ a ces: TrafficReportService ;
owls: serviceCategoryName traffic_report ^^ xsd:string ].
Listing 2. Trac sensor service request
:sampleRequest a ssn:Sensor ,ces:EventRequest;
owls:presents :requestProfile ;
19. 19/10/2014
ACEIS - Architecture
19
Semantic Annotation
Application
Interface
ACEIS Core
Resource
Management
Knowledge Base
QoI/QoS
Stream
Description
Data Mgmt,
Indexing,
Caching
User Input
Event Request
Data
Federation
Resource Discovery
Event Service Composer
Composition Plan
Subscription Manager
Query Transformer
Query Engine
Query
Results
Adaptation
Manager
Constraint
Validation
Constraint
Violation
Data Store
IoT Data
Stream
Social Data
Stream
20. Stream Discovery Event Request Annotation
Similarly, a sensor service request is annotated:
19/10/2014
20
sr = (tr, Pr, FoIr, fr, pref, C)
type
Requested
Properties
Feature of
Interest
Pd FoId
owls:supports :sampleGrounding;
ssn:observes [ a ces:AverageSpeed;
ssn:isPropertyFor :Seg_1],
[ a ces:VehicleCount;
ssn:isPropertyFor :Seg_1],
[ a ces:EstimatedTime;
ssn:isPropertyFor :Seg_1 ].
:sampleProfile a ces:EventProfile ;
owls:serviceCategory [ a ces: TrafficReportService ;
owls: serviceCategoryName traffic_report ^^ xsd:string ].
Listing 2. Trac sensor service request
:sampleRequest a ssn:Sensor ,ces:EventRequest;
owls:presents :requestProfile ;
ssn:observes [ a ces:EstimatedTime;
ssn:isPropertyFor :Seg_1 ];
ces:hasConstraint [ rdf:type ces:NFPConstraint;
ces:onProperty ces:Availability;
ces:hasExpression
[ emvo:greaterThan 0.9^^xsd:double]],
[ rdf:type ces:NFPConstraint;
ces:onProperty ces:Accuracy;
ces:hasExpression
[ emvo:greaterThan 0.9^^xsd:double]].
:requestProfile a ces:EventProfile ;
owls:serviceCategory [ a ces: TrafficReportService ;
owls: serviceCategoryName traffic_report ^^ xsd:string ].
A sensor service description is denoted as sdesc = (td, g, qd, Pd, FoId, fd),
where t is the sensor event type, g is the service grounding, qd is a QoS vector
describing the QoS values, Pd is the set of ObservedProperties, FoId is the set
21. Stream Discovery Event Request Annotation
Similarly, a sensor service request is annotated:
19/10/2014
21
sr = (tr, Pr, FoIr, fr, pref, C)
type
Requested
Properties
Feature of
Interest
Pd FoId
no
grounding
NFP
ConstraintPrefer
ences
owls:supports :sampleGrounding;
ssn:observes [ a ces:AverageSpeed;
ssn:isPropertyFor :Seg_1],
[ a ces:VehicleCount;
ssn:isPropertyFor :Seg_1],
[ a ces:EstimatedTime;
ssn:isPropertyFor :Seg_1 ].
:sampleProfile a ces:EventProfile ;
owls:serviceCategory [ a ces: TrafficReportService ;
owls: serviceCategoryName traffic_report ^^ xsd:string ].
Listing 2. Trac sensor service request
:sampleRequest a ssn:Sensor ,ces:EventRequest;
owls:presents :requestProfile ;
ssn:observes [ a ces:EstimatedTime;
ssn:isPropertyFor :Seg_1 ];
ces:hasConstraint [ rdf:type ces:NFPConstraint;
ces:onProperty ces:Availability;
ces:hasExpression
[ emvo:greaterThan 0.9^^xsd:double]],
[ rdf:type ces:NFPConstraint;
ces:onProperty ces:Accuracy;
ces:hasExpression
[ emvo:greaterThan 0.9^^xsd:double]].
:requestProfile a ces:EventProfile ;
owls:serviceCategory [ a ces: TrafficReportService ;
owls: serviceCategoryName traffic_report ^^ xsd:string ].
A sensor service description is denoted as sdesc = (td, g, qd, Pd, FoId, fd),
where t is the sensor event type, g is the service grounding, qd is a QoS vector
describing the QoS values, Pd is the set of ObservedProperties, FoId is the set
22. 19/10/2014
ACEIS - Architecture
22
Semantic Annotation
Application
Interface
ACEIS Core
Resource
Management
Knowledge Base
QoI/QoS
Stream
Description
Data Mgmt,
Indexing,
Caching
User Input
Event Request
Data
Federation
Resource Discovery
Event Service Composer
Composition Plan
Subscription Manager
Query Transformer
Query Engine
Query
Results
Adaptation
Manager
Constraint
Validation
Constraint
Violation
Data Store
IoT Data
Stream
Social Data
Stream
23. Stream Discovery Matching Condition
A sensor service description Sd matches a service
request Sr iff the following three conditions are true:
1. tr subsumes td:
3. p1 Pr,p2 Pd T(p1) subsumes T(p2) fr(p1) = fd(p2):
19/10/2014
2. qd satifies C:
23
24. Stream Discovery Matching Condition
A sensor service description Sd matches a service
request Sr iff the following three conditions are true:
1. tr subsumes td:
19/10/2014
24
Requested service type is same or a super-type of provided service type.
2. qd satifies C:
Quality-of-service properties of the provided sensor service satisfy the
constraints specified in the service request.
3. p1 Pr,p2 Pd T(p1) subsumes T(p2) fr(p1) = fd(p2):
Provided sensor service observes all requested physical properties from the
requested feature-of-interest (a geographical location or physical entity from
which the observations are made).
25. 19/10/2014
ACEIS - Architecture
25
Semantic Annotation
Application
Interface
ACEIS Core
Resource
Management
Knowledge Base
QoI/QoS
Stream
Description
Data Mgmt,
Indexing,
Caching
User Input
Event Request
Data
Federation
Resource Discovery
Event Service Composer
Composition Plan
Subscription Manager
Query Transformer
Query Engine
Query
Results
Adaptation
Manager
Constraint
Validation
Constraint
Violation
Data Store
IoT Data
Stream
Social Data
Stream
26. Stream Integration Complex Event Service
A Complex Event Service (CES) integrates different sensor
streams to detect complex events based on event patterns.
An Event Pattern describes the correlations of integrated
streams.
19/10/2014
26
matched by the trac sensor service. When the discovery component finds all
service candidates suitable for the request, a Simple-Additive-Weighting algo-rithm
[5] is used to rank the service candidates based on qd, qr and pref.
4.3 Sensors Streams Integration
Sensor stream discovery deals only with primitive event service discovery. To
discover and integrate (composite) sensor streams for complex event service re-quests,
the event patterns specified in the complex event service requests/de-scriptions
need to be considered.
Listing 3. Complex event service request
:SampleEventRequest a ces:EventRequest;
owls:presents :SampleEventProfile.
:SampleEventProfile rdf:type owls:EventProfile;
ces:hasPattern [ rdf:type ces:And , rdf:Bag;
rdf:_1 : locationRequest ;
rdf:_2 : seg1CongestionRequest ;
rdf:_3 : seg2CongestionRequest ;
rdf:_4 : seg3CongestionRequest ;
ces:hasWindow 5^^ xsd:integer ].
In the context of integrated sensor stream discovery and composition, the
0d
definition of sensor stream description is extended to denote composite sensor
stream descriptions Sd = (epd,Qd,G),where epd consists of a set of sensor stream
descriptions sd and/or a set of composite sensor stream descriptions S, and a set
of event operators including Sequence, Repetition, And, Or, Selection, Filter and
27. Stream Integration Matching condition
Discovery and composition of complex event services
are based on matching event patterns (and
aggregated NFP values).
Procedure:
1. Derive canonical forms of event patterns of CESs.
2. Apply tree isomorphism algorithms over the canonical event patterns and the
19/10/2014
27
requested event pattern to identify reusable or equivalent event patterns.
3. Generate all possible composition plans.
4. Aggregate NFPs based on event patterns and compare aggregated NFP values
against requested constraints to filter out unsatisfied composition plans.
5. Rank the remaining composition plans based on preferences (soft constraints).
28. Canonical Event Pattern (1/2)
Create complete event patterns
ES1
ES2 ES3
e1 e2
Or
And Seq
e3 e4
ES2
Or
And Seq
e1 e2 e3 e4
getCompletePattern()
ES3
28 19/10/2014
30. Event Composition via Reusability
Create event reusability hierachy
Reusable relation: R(ep1,ep2) holds if Rd(ep1,ep2) or Ri(ep1,ep2) holds.
a set of event
% T(v) We denote p1 is
reusable to ep2, denoted
reusable to ep2, but
sequence of op-erations
ep1, as a result, it
have four types:
the roots of syntax
multiplies the cardinality
T adds a se-quence
prefixes or suces;
the parallel roots.
set of syntax trees,
in-directly reusable
a set of event
e1
SEQ
e2
OR
e4
e3
e1
directly reusable in-directly reusable
SEQ
e2 e3
SEQ
e2 e3
in-directly reusable
Figure 7: Example of event pattern reusability
R(p1, p3) R(p3, p2), where p1, p2 P are event patterns of
t1, t2. According to this definition, if we build an ERH for
the three event patterns in Figure 7, the edge at the top-right
is ignored. The nodes do not reuse any other nodes
are called roots in the ERH, the nodes cannot be reused by
other nodes are leaves.
30 19/10/2014
31. Stream Integration Composition Plan
Example of a composition plan:
e1
SEQ
OR
e2
e3
Query
Event Service 1 Event Service 2
e1 e2
Event Service 3 Event Service 4
e1
SEQ
type= e4
loc=loc4
e2
e3
type= e3
loc=loc3
type= e2
loc=loc2
type= e1
loc=loc1
Composition Plan
OR
e3
e4
loc=loc4 loc=loc3
31 19/10/2014
32. 19/10/2014
ACEIS - Architecture
32
Semantic Annotation
Application
Interface
ACEIS Core
Resource
Management
Knowledge Base
QoI/QoS
Stream
Description
Data Mgmt,
Indexing,
Caching
User Input
Event Request
Data
Federation
Resource Discovery
Event Service Composer
Composition Plan
Subscription Manager
Query Transformer
Query Engine
Query
Results
Adaptation
Manager
Constraint
Validation
Constraint
Violation
Data Store
IoT Data
Stream
Social Data
Stream
33. Repetition is a generalization of sequence, it indicates a sequence pattern should
be repeated Query several Transformation times, therefore it is also Semantic not supported. Alignment
An And operator
indicates all its sub-events should occur, it can be mapped to the Join opera-tor.
An Or operator indicates at least one of its sub-events should occur, it can
Goal: transform the composition plan into a stream query which can be
evaluated by a stream reasoning engine over RDF data streams
be mapped to LeftOuterJoin operator in CQELS (OPTIONAL keyword) with
bound filters. Selection is mapped to Projection in CQELS to select the message
payloads for complex events. Filter and Window operators in event patterns
can be mapped to Filter and Window operators in CQELS, respectively. Ta-ble
Requirements:
Alignments of event pattern operators to stream query operators
Transformation Algorithm
1 summarizes the semantics alignment between event operators and CQELS
operators.
Table 1. Semantics Alignment
Alignments for CQELS query language:
Event Pattern sd Sequence Repetition And Or Selection Filter Window
CQELS Operator SGP - - Join Optional Projection Filter Window
Sequence and Repetition not supported by CQELS.
Sensor requests mapped to Stream Graph Pattern.
AND operator mapped to stream join.
OR operator mapped to OPTIONAL keyword (left-outer-join).
5.2 Transformation Algorithm
Previously (see Section 4.1), we briefly described how event patterns are speci-fied
in CES ontology. An event pattern can be recursively defined with sub event
patterns and event service descriptions, thus formulating an event pattern tree.
In this section we elaborate algorithms for parsing event pattern trees and cre-ating
33 19/10/2014
34. Query Transformation Transformation Example
Example of composition plan
AND Event textual description:
seg2
traffic
Monitor the user's current
location as well as the traffic
conditions (estimated travel time)
of all the 3 street segments on
seg1
traffic
seg3
traffic
user
loc
CQELS Query Transformation Result:
the chosen route
Listing 5. CQELS query example
Select ... Where {
Graph http :// purl.oclc.org/NET/ssnx/ssn#
{?ob rdfs:subClassOf ssn: Observation}
Stream locationStreamURL [range 5s]
{? locId rdf:type ?ob. ?locId ssn:observedBy ?es4.
?locId ssn:observationResult ?result1.
?result1 ssn:hasValue ?value1.
?value1 ct:hasLongtitude ?lon. ?value1 ct:hasLatitude ?lat.
?loc ct:hasLongtitude ?lon. }
Stream trafficStreamURL1 [range 5s]
{? seg1Id rdf:type ?ob. ?seg1Id ssn:observedBy ?es1.
?seg1Id ssn:observationResult ?result2.
?result2 ssn:hasValue ?value2.
?value2 ssn:hasQuantityValue ?eta1.}
Stream trafficStreamURL2 [range 5s] {...}
Stream trafficStreamURL3 [range 5s] {...} }
34 19/10/2014
6 RelatedWork
35. Automated Complext Event Implementation System
Information model for dynamic discovery and selection of sensor
data streams i.e. Complex Event Ontology, Event Pattern
Ontology and Event Reuest/Profile
Algorithm to create optimal composition plan using event
reusability heirachy
Transfoormation of the composition plan into stream queries
(CQELS)
19/10/2014
Conclusion
35