This document discusses the history and future of ubiquitous computing. It describes how computing has evolved from large mainframe computers used by many people to personal computers for individuals to many small computers everywhere for everything. Emerging technologies like embedded processors, wireless connectivity, new materials, improved sensors and localization will enable smart objects to cooperate and form an Internet of Things. Ubiquitous computing promises exciting applications but also presents challenges in infrastructure, usability, security and privacy that must be addressed.
1. 5/29/2010
Computer 1975
Ubiquitous Computing
Marc Langheinrich
University of Lugano
5/28/2010 F. Ma. 22
Most 際際滷s courtesy of Prof. F. Mattern: Lecture Series Ubiquitous Computing, ETH Zurich
Computer 1990 Computer 2005
5/28/2010 F. Ma. 23 5/28/2010 F. Ma. 24
Size Number
Computer 2009 Computing: A Clear Trend
One computer
(mainframe)
for many people
One computer
(PC) for
everyone
Many
computers
for everyone
5/28/2010 25 5/28/2010 F. Ma. 26
1
2. 5/29/2010
Number A Short History of the
Computing: A Clear Trend Computing Metamorphosis
And the future?
computer
for
yone
Internet of Things?
Many
computers
smart
for everyone dust?
5/28/2010 Size F. Ma. 27 5/28/2010 F. Ma. 30
The Computer as
The Computer as a Calculator a Data Processor
If it should ever turn out that the basic logics of a machine designed
for the numerical solution of differential equations coincide with the
logics of a machine intended to make bills for a department store, I would
regard this as the most amazing coincidence that I have ever encountered.
-- Howard Aiken, 1956 (MARK I)
5/28/2010 F. Ma. 31 5/28/2010 F. Ma. 32
The Computer as a Personal, The Computer as an
Interactive Tool Information Device
BTX, Germany (1983-2001) Minitel, France (1982-1999)
5/28/2010 F. Ma. 33 5/28/2010 34
2
3. 5/29/2010
The Computer as a
The Computer as a Toy
Communication Device
5/28/2010 35 5/28/2010 F. Ma. 36
Soon: The Computer as Blood pressure
too high
Im here, Mummy
N 51.30.24 W 0.08.19
Accident
an invisible and ahead
omnipresent
background assistance?
Wuff!
N 52.12.56 W 10.12.08
You lost
me here
Ground OK
needs
water
April 2007
5/28/2010 F. Ma. 37 5/28/2010 F. Ma. 38
Instead of World inside the
The Vision of Ubiquitous Computing
Computer...
The most profound technologies
are those that disappear. They
weave themselves into the fabric Not like this!
of everyday life World inside Computer
indistinguishable from it. would be Virtual Reality
Mark Weiser (1952 1999), XEROX PARC
Basic Motivation of Ubiquitous Computing
Integrating computers with intuitive user interfaces
The computer as a tool for the everyday, everywhere
Things are aware of each other and the environment
5/28/2010 F. Ma. 39 5/28/2010 F. Ma. 40
3
4. 5/29/2010
Computer in the World A Vision Of The Future: The Smart Grid
Appliances negotiate energy needs w/ utilities
Freezer waits until electricity is cheap, then cools
! Washing machine starts laundry an hour later
Energy provider can avoid high energy demand
gy p g gy
eCar
Smart Meter
Smart
Laundry
Smart
5/28/2010 F. Ma. 41 5/28/2010 Grid 42
Image Source: NIST
Another Vision Of The Future Forecasting is Hard...
(in 1955)
Moon Colonies Maglev Trains
This particularly too expensive? too expensive?
streamlined model Sub-aquatic Cities Supersonic Flight
from the year 1975 is + not comfy? the Concorde, and then?
Flying Cars Nuclear Fusion
an elegant t
l t two- + too dangerous? too optimistic?
seater with a nuclear Video Phone Households Robots
powered engine in is Skype finally it? getting there (Roomba)?
the back..." Home-PC
I think there is a world market for maybe 5
SMS
By-product of mobile telephony,
computers. Thomas Watson, CEO of IBM, 43 success without advertising
5/28/2010 5/28/2010 44
F. Ma. 43
1. Moores Law (1965)
Processing speed and storage capacity double
every 18 months
cheaper, smaller, faster
Exponential increase
Ubiquitous Computing
will probably go on for the
next 10 years at same rate
TECHNOLOGY DRIVERS
(FIVE TRENDS)
5/28/2010 46 5/28/2010 F. Ma. 47
4
5. 5/29/2010
Consequence: Very Small Chips Consequence: Entire Libraries on a Stick
Bild: Hitachi
5/28/2010 F. Ma. 48 5/28/2010 F. Ma. 49
2. Progress in Communication
Soon: Ubiquitous Connectivity
Technology
Wireless (and very cheap) access to the Internet
At any place
Without manual configuration (instant on)
Real-world objects can access services on the Internet
Everything could be connected together, even
objects without a power source
Contact-less chip cards
Radio Frequency Identification (RFID)
Near Field Communication (NFC)
Nostalgy
5/28/2010 F. Ma. 50 5/28/2010 F. Ma. 51
Communication by Touching Communication by Touching
Near Field Communication
Short-range interaction with
handheld devices (~ 10 cm)
mobile phone,
NFC/RFID tag camera, PDA,
5/28/2010 F. Ma. 52 5/28/2010 F. Ma. 53
5
6. 5/29/2010
Communication by Touching Communication by Touching
Owner:
Heinz Lieb
Bought on
12 Sep 2007
Intuitive way of interaction Intuitive way of interaction
access content and services by access content and services by
touching other smart objects touching other smart objects
(magic touch) (magic touch)
5/28/2010 F. Ma. 54 5/28/2010 55
Friedemann Mattern
3. New Materials Smart Paper, Electronic Ink
Pigments keep orientation even after power is cut Low-power displays
Smart Paper
Micro capsules Top transparent
electrode
Negatively charged
Positively charged black pigment chips
white pigment chips
Clear fluid
Bottom electrode
+ -
Flexible Organic LEDs
0.2 mm No backlight (readable in sunlight)!
5/28/2010 F. Ma. 57 5/28/2010 F. Ma. 58
E-Books (2009)
Smart Paper, Electronic Ink
Amazon Barnes & Noble Nook, USD 259,-
Kindle
USD 259,-
E-Ink, 2001
5/28/2010 E-Ink, 2005 F. Ma. 59 5/28/2010 60
6
7. 5/29/2010
Flexible Displays: The PC of the Future? 4. Better Sensors
Miniaturized cameras, microphones,...
Biometric sensors
Sensors for
temperature,
humidity,
acceleration,...
Location sensors
But what about its e.g., GPS
energy source?
(Fuel cells?)
5/28/2010 F. Ma. 61 5/28/2010 F. Ma. 62
Example: Fingerprint Sensor Example: Instrumenting a Golf Ball with
Wireless Sensors
Technical specifications of the sensor cube:
* Antenna: integrated
* Transmitter frequency: 2.4 GHz (Bluetooth)
CMOS silicon chip * Range of transmitter: ca. 5 m
* Clock cycle: 1 x per second
Thermal imaging * Lifetime: ca. 200 tee off (built-in power source)
* Weight of the Golf ball with microsystem: 48 g
0.4 mm x 14 mm sensing
area
Finger sweeping
interface
eGrain
image source: Fraunhofer
5/28/2010 F. Ma. 63 5/28/2010 64
Example: Passive Radio Sensors
image source: Siemens
No external power supply
energy from the actuation process
piezoelectric and pyroelectric materials transform changes in pressure
or temperature into energy
息 MIMOSA project Can be read wirelessly (from up to 20 m) by reflecting RF signal
E.g., tire pressure sensor
5/28/2010 F. Ma. 65 5/28/2010 F. Ma. 66
7
8. 5/29/2010
What should (or wants to) be
5. Localisation localised?
Keys, pets, luggages, parcels, containers,
Technology improves weapons, rental cars, cars that havent paid road
smaller, cheaper, more precise toll, expensive things (theft), toxic products,
GPS, A-GPS, WiFi, UWB, ... Children?
Unfaithful Spouse? POSITION
New Applications Foreigners with Visa?
N 047属
2317
Finding friends E 008属
For their own safety 3426
Finding lost objects
Finding cool places
5/28/2010 F. Ma. 67 5/28/2010 68
Where Does All the Technological
Progress Lead To?
POSITION
Wireless high-speed N 047属
?
2317
communication NFC/RFID E 008属
Better sensors 3426 Vision
SMART OBJECTS
Item localization
New materials
Moores law
5/28/2010 F. Ma. 74 5/28/2010 75
Embedded Processors Allow for Embedded Processors Allow for
Cooperating Smart Objects Cooperating Smart Objects
Small, cheap, integrated Small, cheap, integrated
sensors sensors
processors processors
wireless communication wireless communication
5/28/2010 F. Ma. 76 5/28/2010 F. Ma. 77
8
9. 5/29/2010
Cooperating Smart
Everyday Things?
When the tooth brush
communicates with the
bathroom mirror
animated cartoon appears
on the mirror
brushing the teeth
becomes a computer
game, the tooth brush
becomes a joy stick
high-score lists, collect
rewarding points,
5/28/2010 F. Ma. 78 image source: Philips F.Ma. 79
Cooperating Smart Objects: Workplace
Safety
When entering a confined space:
Is breathing apparatus detected?
Is there a permit to work?
Is there more than one
person present?
Do those present have valid Vision 2
training certificates?
SMART PEOPLE
Source: BP
5/28/2010 F. Ma. 80 5/28/2010 83
Smart Glasses Smart Glasses Yesterday
You could wear a pair of glasses with a
small amount of face recognition built-
in, look at a person, and his name would
pop up in a balloon above his head. You Water
Take
...my
could know instantly who the person is, Jimmy
me out
me
Brown day
b
birthday!
even if you don't immediately recognize
him. I look at my tree, and a little
balloon pops up saying, "Water me," I
look at my dog, it says, "Take me out,"
or I look at my wife, it says, "Don't forget
my birthday!"
Eyeglass with tiny laser and mirrors projects an
M. Satyanarayanan (CMU)
image directly onto the retina
5/28/2010 F. Ma. 85 5/28/2010 F. Ma. 86
9
10. 5/29/2010
Smart Glasses Today
5/28/2010 F. Ma. 87 5/28/2010 F. Ma. 88
Smart Glasses Tomorrow?
SUMMING UP
5/28/2010 89 5/28/2010 91
http://spectrum.ieee.org/biomedical/bionics/augmented-reality-in-a-contact-lens/0
Friedemann Mattern
Ubiquitous Computing
Things, places and routines are
increasingly being computerized,
digitized
E i i consequences!
Exciting !
Huge informatics challenges
Infrastructure
Usability
Security & Privacy
5/28/2010
Tomorrows Lecture! 92
10