Context-Aware Multimedia Services in a Pervasive EnvironmentThe Daidalos Approach Kevin Doolin, Andreas Pashalidis, Andreas Kassler, Telma Mota Prosense Workshop Dublin, Ireland
Outline Introduction Pervasiveness Context-Awareness Sensor
as Context Sources Daidalos Solution Conclusion
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 2
Services: The reality
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 3
Services: The Pervasive vision
Enabler
Enabler Enabler Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 4
Trends and Visions
Ubiquituous Computing (M. Weisser) •
enhances computer use by making computers “available throughout the physical environment, while making them effectively invisible for the human user.“
Pervasive Computing •
people are surrounded by intelligent and intuitive interfaces embedded in everyday objects around them.
•
interfaces recognize and respond to the situation and behavior of an individual in a personalized manner, while considering the context and conditions in the surrounding environment
•
making use of multiple independent devices that are seamlessly interconnected and aim to provide various intelligent services in a transparently and self-configuring manner, while ensuring a fair degree of privacy / nonintrusiveness Persense Workshop 03/08, Dublin, Ireland
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
© The Daidalos Consortium
Page 5
Context-Definition
Schmidt, 1999: •
Chen and Kotz, 2000: •
"A context describes a situation and the environment a device or user is in. A context is identified by a unique name. For each context, a set of features is relevant. For each relevant feature a range of values is determined (implicit or explicit) by the context” "Context is the set of environmental states and settings that either determines an application's behaviour or in which an application event occurs and is interesting to the user”
Context-Awareness: •
“A system is context-aware if it uses context to provide relevant information and/or services to the user, where relevancy depends on the user’s task.” [Dey, 2001 “Understanding and using context”]
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 6
Context-Awareness and Service Enablers
Context and Context-Awareness [Roussaki et al., 2006] • •
• •
•
The information and knowledge necessary to enable devices and services to sense changes in their environment, or discover the characteristics of the current situation, and to automatically adapt and act based on these changes/characteristics, considering the user’s preferences, requirements and objectives.
Depending on Preferences and Context, Service Enablers can: • • • •
•
Select Proper Content Send the content to the user(s) in a proper time Select the interested users to receive the content Choose the most adequate interfaces, networks and providers to use in order to distribute the content. Discover, choose , create, access, adapt and deploy the most interesting multimedia services/applications
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 7
Context-Awareness
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Spatial (location, presence, proximity, velocity, acceleration) Temporal (past/present/future, hours, minutes, seconds, …) Environmental / physical (weather, temperature, humidity,…) User (identity, profile, age, gender, preferences, features, agenda,activity, bio parameters, emotional state, social, …) Service / Device features System / Plattform / Network features Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 8
Trends and Visions
Sensors and Networked (embedded) Objects • •
Agriculture Road safety -
•
Homeland security -
•
Ice on road Large area monitoring
Urban Sensing
Use SensorNW as Context SourceÆ Context Sensing
End-to-end unicast flows Multicast/convergecast flows
www.nanotech-now.com/smartdust.htm
Context-Aware Multimedia Services in a Pervasive http://www.berkeley.edu/news/media/releases/2002/08/images/mote.jpg Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 9
Sensors as Context Source
Location (e.g. GPS, WiFi, Cellular, …) Presence, Proximity, Vicinity Light (w.r.t. intensity, direction, reflection, type, wavelength, …) Audio (w.r.t. sound level, type, direction, distance, frequency, …) Movement, Acceleration, Orientation (e.g. accelerometers, tachymeter, angular sensors, ball switches, …) Visual sensors (e.g. camera, optical character recognition) Electro-Magnetic Field Temperature, Humidity, Air Pressure, Wind Speed Weight, Force, Touch Gas-Sensors, Electronic Noses Bio-Sensors (w.r.t. blood pressure, sugar level, body temperature, …) ID sensors (e.g. Barcode, RFID)
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 10
UbiSec&Sens FP6 Project security & reliability
routing & transport
-
in-network processing
authentication “re-recognition” key predistribution
-
WSN access
secure distributed secure routing data storage concealed data aggregation data plausibility routing & secure Secure reliable transport aggregator DCU node election aggregator node discrepancy election query
-
Sensors report to aggregators because of security requirements: “concealed data aggregation” Aggregators report to the sink submit queries to the sink S knows a consolidated result
To provide a security and reliability architecture for medium and large-scale WSNs acting in volatile environments Apply a radically new design cycle for secure sensor networks To provide a complete toolbox of security and reliability aware components for sensor network application debelopment Focus on the intersection of security, routing and in-network processing
R1
R2
…
S
AGR
AGR AGR
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Wireless PageSensor 11 Network
Rn
How to make IMS context aware?
IMS – IP based Multimedia Subsystem • • •
•
Generic service plattform for NGN Network operators are highly interested to provide services Based on SIP, using centralized elements such as P-CSCF, SCSCF Mostly static information, presence as only context information
Goal: Enhance/Augment IMS • •
to support pervasive multimedia services to interact with and integrate sensor networks -
•
can provide contextual data as input for making the multimedia service as context-aware as possible
Promote a distributed architecture where the user terminal is seen by the applications as an “enabling server”. -
Improves scalability when compared with IMS.
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 12
Daidalos Pervasive Architecture Terminal Service Enablers PCM
PM
LeM
IdM
CoM
DeM
SDM
CM
Servers CMS SDS
LS
Deploy Services LM
Traffic Service Doctor Service
MMSB
WSN
Server MA
proxy
sink
MMSPUA CE
Ctx Sources
UA
Proxy NCM
Ctx Consumers IMS Component
•Collect context information (push + pull) •Notify context changes •Distributed context maintenance •Context propagation and access control •Context query handling •Context inference •History and Quality of Context support •Context consistency control
WSN/ AGR
QOS Client
Sensor
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
ZQoS Brk ARM
ID Brk A4C
AGR
AG
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 13
Daidalos Pervasive Architecture •Service discovery, filtering, composition •Service deployment and service lifecycle Terminal Service Enablers PCM
PM
LeM
IdM
CoM
DeM
SDM
CM
Servers CMS SDS
LS
Deploy Services LM
Traffic Service Doctor Service
MMSB
WSN
Server MA
proxy
MMSPUA CE
Ctx Sources
UA
Proxy NCM
Ctx Consumers IMS Component
sink
WSN/ AGR
QOS Client
Sensor
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
ZQoS Brk ARM
ID Brk A4C
AGR
AG
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 14
Daidalos Pervasive Architecture Terminal Service Enablers PCM
PM
LeM
IdM
CoM
DeM
SDM
CM
Servers CMS SDS
LS
Deploy Services LM
Traffic Service Doctor Service
MMSB
WSN
Server MA
proxy
sink
MMSPUA CE
Ctx Sources
UA
Proxy NCM
Ctx Consumers IMS Component
•manages user preferences •“when in lecture theater, switch-off ringtone and vibrate only” •storing and retrieving preferences •evaluating preference conditions •determine actual preference outcome •monitoring context conditions affecting preferences
WSN/ AGR
QOS Client
Sensor
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
ZQoS Brk ARM
ID Brk A4C
AGR
AG
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 15
Daidalos Pervasive Architecture •analyses user interaction with service enabler layer and 3rd party services, •learn the behavior of the user •create new preferences inferred from learned behaviour.
Terminal Service Enablers PCM
PM
LeM
IdM
CoM
DeM
SDM
CM
Servers CMS SDS
LS
Deploy Services LM
Traffic Service Doctor Service
MMSB
WSN
Server MA
proxy
MMSPUA CE
Ctx Sources
UA
Proxy NCM
Ctx Consumers IMS Component
sink
WSN/ AGR
QOS Client
Sensor
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
ZQoS Brk ARM
ID Brk A4C
AGR
AG
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 16
Daidalos Pervasive Architecture Terminal Service Enablers PCM
PM
LeM
IdM
CoM
DeM
SDM
CM
Servers CMS SDS
LS
Deploy Services LM
Traffic Service Doctor Service
MMSB
WSN
Server MA
proxy
sink
MMSPUA CE
Ctx Sources
UA
Proxy NCM
Ctx Consumers IMS Component
•negotiation of multimedia session control •setup, modification and teardown •SIP signaling and RTP for corresponding flows, •QoS (de)allocation, •retrieval and sending of authentication •notification of context-related multimedia specific events to CM
WSN/ AGR
QOS Client
Sensor
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
ZQoS Brk ARM
ID Brk A4C
AGR
AG
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 17
Daidalos Pervasive Architecture •IMS Call Session Control Functions •CSCF - Proxy, Interrogating and Server •coordinates resource admission control components for QoS assurance •provides support for session and terminal mobility in a fixed-mobile converged environment
Terminal Service Enablers PCM
PM
LeM
IdM
CoM
DeM
SDM
CM
Servers CMS SDS
LS
Deploy Services LM
Traffic Service Doctor Service
MMSB
WSN
Server MA
proxy
MMSPUA CE
Ctx Sources
UA
Proxy NCM
Ctx Consumers IMS Component
sink
WSN/ AGR
QOS Client
Sensor
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
ZQoS Brk ARM
ID Brk A4C
AGR
AG
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 18
Integration of DAIDALOS & UbiSec&Sens
Use Use SensorNW SensorNW as as Context Context SourceÆ SourceÆ Context Context Sensing Sensing
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 19
Integration of DAIDALOS & UbiSec&Sens
DAIDALOS specific
Integration Point
UbiSec&Sens specific
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 20
Integration Properties WSN-specific
protocols are decoupled from the WSN interface and the CMS;
•
•
Allows to exchange sensors and aggregators without having to interrupt service towards the CMS. translation between raw sensor data and CMS format -
WSN •
• •
proxy serves as a management point
operator can configure access control rights of the CMS.
WNS •
Context Model/Ontology
proxy protects against power drainage.
proxy will never pull measurements from the WSN as a result of an incoming query from the CMS; update rate on WSN decoupled from CMS requests The proxy reports locally cached measurements to the CMS.
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 21
Context-aware Scenarios
Scene 1: •
Sensor Input: -
• •
Context Inferred: User is sleeping Action: Redirect incoming calls
Scene 2 •
Sensor Input: -
It is dark, silent, type of place is indoors, time is “night-time”, user is horizontal, rarely moves, absolute user location is stable.
Place type is indoors, user is moving to classroom (locationing) Context Inferred: User is entering classroom Action: As his agenda shows user has to give a lecture, redirect incoming calls to secretary
Scene 3 •
Sensor Input: -
-
Place type is indoors, user is moving from living room to kitchen (locationing), TV is displaying Football game Context Inferred: User is wants to get some beer Action: Football game is redirected to fridge display
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach
Persense Workshop 03/08, Dublin, Ireland © The Daidalos Consortium Page 22
Context-Aware Multimedia Services in a Pervasive Environment- The Daidalos Approach …end of presentation.
