際際滷

際際滷Share a Scribd company logo
5/29/2010




                                                                                                                           Computer 1975


                  Ubiquitous Computing

                              Marc Langheinrich
                                 University of Lugano




                                                                                                      5/28/2010                                                   F. Ma. 22
   Most 際際滷s courtesy of Prof. F. Mattern: Lecture Series Ubiquitous Computing, ETH Zurich




                           Computer 1990                                                                                   Computer 2005




5/28/2010                                                                                 F. Ma. 23   5/28/2010                                                   F. Ma. 24




                                                                                                       Size                                            Number
                           Computer 2009                                                                          Computing: A Clear Trend
                                                                                                                  One computer
                                                                                                                  (mainframe)
                                                                                                                  for many people
                                                                                                                                    One computer
                                                                                                                                    (PC) for
                                                                                                                                    everyone




                                                                                                                                                   Many
                                                                                                                                                   computers
                                                                                                                                                   for everyone
5/28/2010                                                                                       25    5/28/2010                                                   F. Ma. 26




                                                                                                                                                                              1
5/29/2010




                    Number                                                           A Short History of the
                Computing: A Clear Trend                                           Computing Metamorphosis
                                        And the future?

computer
for
yone


                                      Internet of Things?


                Many
                computers
                                            smart
                for everyone                  dust?
    5/28/2010                  Size                       F. Ma. 27   5/28/2010                                                                    F. Ma. 30




                                                                                                                    The Computer as
                  The Computer as a Calculator                                                                      a Data Processor




                                                                           If it should ever turn out that the basic logics of a machine designed
                                                                           for the numerical solution of differential equations coincide with the
                                                                           logics of a machine intended to make bills for a department store, I would
                                                                           regard this as the most amazing coincidence that I have ever encountered.
                                                                           -- Howard Aiken, 1956 (MARK I)
    5/28/2010                                             F. Ma. 31   5/28/2010                                                                    F. Ma. 32




                The Computer as a Personal,                                               The Computer as an
                      Interactive Tool                                                    Information Device
                                                                                         BTX, Germany (1983-2001)                 Minitel, France (1982-1999)




    5/28/2010                                             F. Ma. 33   5/28/2010                                                                          34




                                                                                                                                                                2
5/29/2010




                                                                                                    The Computer as a
             The Computer as a Toy
                                                                                                  Communication Device




5/28/2010                                                           35      5/28/2010                                                                 F. Ma. 36




            Soon: The Computer as                                                                                            Blood pressure
                                                                                                                                 too high
                                                                             Im here, Mummy
                                                                           N 51.30.24 W 0.08.19
                                                                                                                                                    Accident
       an invisible and                                                                                                                             ahead

          omnipresent
 background assistance?
                                                                                                              Wuff!
                                                                                                      N 52.12.56 W 10.12.08



                                                                          You lost
                                                                          me here
                                                                                                                Ground                         OK
                                                                                                                 needs
                                                                                                                 water


                                April 2007
5/28/2010                                                     F. Ma. 37     5/28/2010                                                                 F. Ma. 38




                                                                                           Instead of World inside the
    The Vision of Ubiquitous Computing
                                                                                                  Computer...
                             The most profound technologies
                             are those that disappear. They
                             weave themselves into the fabric                        Not like this!
                             of everyday life                                        World inside Computer
                             indistinguishable from it.                             would be Virtual Reality

                            Mark Weiser (1952  1999), XEROX PARC



 Basic Motivation of Ubiquitous Computing
       Integrating computers with intuitive user interfaces
       The computer as a tool for the everyday, everywhere
       Things are aware of each other and the environment
5/28/2010                                                     F. Ma. 39     5/28/2010                                                                 F. Ma. 40




                                                                                                                                                                  3
5/29/2010




                Computer in the World                                  A Vision Of The Future: The Smart Grid
                                                                          Appliances negotiate energy needs w/ utilities
                                                                                 Freezer waits until electricity is cheap, then cools
            !                                                                    Washing machine starts laundry an hour later
                                                                                 Energy provider can avoid high energy demand
                                                                                      gy p                       g       gy
                                                                                                                                                                           eCar



                                                                                                                                  Smart Meter


                                                                                                                                                                               Smart
                                                                                                                                                                               Laundry
                                                                                        Smart
5/28/2010                                      F. Ma. 41                 5/28/2010        Grid                                                                                   42
                                                                  Image Source: NIST




            Another Vision Of The Future                                                          Forecasting is Hard...
                          (in 1955)
                                                                          Moon Colonies                                              Maglev Trains
                             This particularly                                       too expensive?                                           too expensive?
                             streamlined model                            Sub-aquatic Cities                                         Supersonic Flight
                             from the year 1975 is                                     + not comfy?                                           the Concorde, and then?
                                                                          Flying Cars                                                Nuclear Fusion
                             an elegant t
                                 l     t two-                                           + too dangerous?                                      too optimistic?
                             seater with a nuclear                        Video Phone                                                Households Robots
                             powered engine in                                        is Skype finally it?                                     getting there (Roomba)?
                             the back..."                                      Home-PC
                                                                               I think there is a world market for maybe 5
                                                                                                                                         SMS
                                                                                                                                         By-product of mobile telephony,
                                                                               computers.        Thomas Watson, CEO of IBM, 43          success without advertising




5/28/2010                                                                5/28/2010                                                                                               44
                                                      F. Ma. 43




                                                                                              1. Moores Law (1965)
                                                                          Processing speed and storage capacity double
                                                                           every 18 months
                                                                                 cheaper, smaller, faster
                                                                          Exponential increase
   Ubiquitous Computing
                                                                                 will probably go on for the
                                                                                  next 10 years at same rate
   TECHNOLOGY DRIVERS
   (FIVE TRENDS)

5/28/2010                                            46                  5/28/2010                                                                                         F. Ma. 47




                                                                                                                                                                                         4
5/29/2010




      Consequence: Very Small Chips                    Consequence: Entire Libraries on a Stick




       Bild: Hitachi
5/28/2010                                  F. Ma. 48   5/28/2010                                                      F. Ma. 49




            2. Progress in Communication
                                                               Soon: Ubiquitous Connectivity
                     Technology
                                                        Wireless (and very cheap) access to the Internet
                                                              At any place
                                                              Without manual configuration (instant on)
                                                              Real-world objects can access services on the Internet

                                                        Everything could be connected together, even
                                                         objects without a power source
                                                              Contact-less chip cards
                                                              Radio Frequency Identification (RFID)
                                                              Near Field Communication (NFC)
 Nostalgy

5/28/2010                                  F. Ma. 50   5/28/2010                                                      F. Ma. 51




            Communication by Touching                              Communication by Touching




                                                        Near Field Communication
                                                        Short-range interaction with
                                                        handheld devices (~ 10 cm)
                                                                                                      mobile phone,
                                                                                       NFC/RFID tag   camera, PDA,

5/28/2010                                  F. Ma. 52   5/28/2010                                                      F. Ma. 53




                                                                                                                                  5
5/29/2010




              Communication by Touching                                                           Communication by Touching




                                                        Owner:
                                                       Heinz Lieb
                                                       Bought on
                                                      12 Sep 2007
   Intuitive way of interaction                                                        Intuitive way of interaction
       access content and services by                                                      access content and services by
       touching other smart objects                                                        touching other smart objects
       (magic touch)                                                                     (magic touch)

 5/28/2010                                                            F. Ma. 54       5/28/2010                                                                               55




                                                                 Friedemann Mattern




                      3. New Materials                                                            Smart Paper, Electronic Ink
                                                                                              Pigments keep orientation even after power is cut   Low-power displays




 Smart Paper
                                                                                      Micro capsules                                                       Top transparent
                                                                                                                                                           electrode

                                                                                                                                                        Negatively charged
                                                                                       Positively charged                                               black pigment chips
                                                                                       white pigment chips

                                                                                             Clear fluid
                                                                                                                                                           Bottom electrode

                                                                                                                    +                     -
                                                       Flexible Organic LEDs
                                                                                                                  0.2 mm                  No backlight (readable in sunlight)!


  5/28/2010                                                           F. Ma. 57       5/28/2010                                                                        F. Ma. 58




                                                                                                                E-Books (2009)
               Smart Paper, Electronic Ink
                                                                                           Amazon                                             Barnes & Noble Nook, USD 259,-
                                                                                             Kindle
                                                                                          USD 259,-




E-Ink, 2001
  5/28/2010                             E-Ink, 2005                   F. Ma. 59       5/28/2010                                                                               60




                                                                                                                                                                                     6
5/29/2010




 Flexible Displays: The PC of the Future?                                                          4. Better Sensors

                                                                 Miniaturized cameras, microphones,...
                                                                 Biometric sensors
                                                                 Sensors for
                                                                         temperature,
                                                                          humidity,
                                                                          acceleration,...
                                                                 Location sensors
                                  But what about its                     e.g., GPS
                                  energy source?
                                  (Fuel cells?)
5/28/2010                                         F. Ma. 61     5/28/2010                                                                  F. Ma. 62




            Example: Fingerprint Sensor                         Example: Instrumenting a Golf Ball with
                                                                           Wireless Sensors
                                                              Technical specifications of the sensor cube:
                                                                * Antenna: integrated
                                                                * Transmitter frequency: 2.4 GHz (Bluetooth)
 CMOS silicon chip                                             * Range of transmitter: ca. 5 m
                                                                * Clock cycle: 1 x per second
 Thermal imaging                                               * Lifetime: ca. 200 tee off (built-in power source)
                                                                * Weight of the Golf ball with microsystem: 48 g
 0.4 mm x 14 mm sensing
  area
 Finger sweeping
  interface
                                                                                                                                            eGrain




                                                                                image source: Fraunhofer


5/28/2010                                         F. Ma. 63     5/28/2010                                                                        64




                                                                        Example: Passive Radio Sensors
                                                                                                                                                   image source: Siemens




                                                                 No external power supply
                                                                         energy from the actuation process
                                                                         piezoelectric and pyroelectric materials transform changes in pressure
                                                                          or temperature into energy
                               息 MIMOSA project                  Can be read wirelessly (from up to 20 m) by reflecting RF signal
                                                                         E.g., tire pressure sensor

5/28/2010                                         F. Ma. 65     5/28/2010                                                                  F. Ma. 66




                                                                                                                                                                           7
5/29/2010




                                                                                                           What should (or wants to) be
                      5. Localisation                                                                              localised?
                                                                                               Keys, pets, luggages, parcels, containers,
 Technology improves                                                                           weapons, rental cars, cars that havent paid road
       smaller, cheaper, more precise                                                          toll, expensive things (theft), toxic products,
       GPS, A-GPS, WiFi, UWB, ...                                                             Children?
                                                                                               Unfaithful Spouse?                           POSITION
 New Applications                                                                             Foreigners with Visa?
                                                                                                                                             N 047属
                                                                                                                                               2317
       Finding friends                                                                                                                       E 008属
                                                                                                     For their own safety                      3426
       Finding lost objects
       Finding cool places

5/28/2010                                                                         F. Ma. 67   5/28/2010                                                    68




            Where Does All the Technological
                  Progress Lead To?



                                                                      POSITION
Wireless high-speed                                                   N 047属




                                                                                        ?
                                                                        2317
   communication       NFC/RFID                                       E 008属
                                      Better sensors                    3426                  Vision

                                                                                                 SMART OBJECTS
                                                  Item localization

                      New materials


     Moores law
5/28/2010                                                                         F. Ma. 74   5/28/2010                                                    75




            Embedded Processors Allow for                                                                 Embedded Processors Allow for
              Cooperating Smart Objects                                                                     Cooperating Smart Objects
 Small, cheap, integrated                                                                     Small, cheap, integrated
       sensors                                                                                      sensors
       processors                                                                                   processors
       wireless communication                                                                       wireless communication




5/28/2010                                                                         F. Ma. 76   5/28/2010                                              F. Ma. 77




                                                                                                                                                                  8
5/29/2010




                                                                                                                 Cooperating Smart
                                                                                                                  Everyday Things?
                                                                                                  When the tooth brush
                                                                                                  communicates with the
                                                                                                  bathroom mirror
                                                                                                   animated cartoon appears
                                                                                                    on the mirror
                                                                                                   brushing the teeth
                                                                                                    becomes a computer
                                                                                                    game, the tooth brush
                                                                                                    becomes a joy stick
                                                                                                   high-score lists, collect
                                                                                                    rewarding points,

  5/28/2010                                                                           F. Ma. 78                                 image source: Philips   F.Ma. 79




    Cooperating Smart Objects: Workplace
                  Safety

  When entering a confined space:
   Is breathing apparatus detected?
   Is there a permit to work?
   Is there more than one
   person present?
   Do those present have valid                                                                       Vision 2
   training certificates?
                                                                                                     SMART PEOPLE

                                                   Source: BP

  5/28/2010                                                                           F. Ma. 80   5/28/2010                                                   83




                            Smart Glasses                                                                       Smart Glasses Yesterday

You could wear a pair of glasses with a
small amount of face recognition built-
in, look at a person, and his name would
pop up in a balloon above his head. You                          Water
                                                                  Take
                                                                     ...my
could know instantly who the person is,                         Jimmy
                                                                me out
                                                                   me
                                                                Brown day
                                                                   b
                                                                   birthday!
even if you don't immediately recognize
him. I look at my tree, and a little
balloon pops up saying, "Water me," I
look at my dog, it says, "Take me out,"
or I look at my wife, it says, "Don't forget
my birthday!"
                                               Eyeglass with tiny laser and mirrors projects an
M. Satyanarayanan (CMU)
                                               image directly onto the retina



  5/28/2010                                                                           F. Ma. 85   5/28/2010                                             F. Ma. 86




                                                                                                                                                                    9
5/29/2010




               Smart Glasses Today




5/28/2010                                                                                                F. Ma. 87       5/28/2010       F. Ma. 88




            Smart Glasses Tomorrow?




                                                                                                                            SUMMING UP


5/28/2010                                                                                                      89        5/28/2010             91
                http://spectrum.ieee.org/biomedical/bionics/augmented-reality-in-a-contact-lens/0




                                                                                                    Friedemann Mattern




             Ubiquitous Computing
 Things, places and routines are
  increasingly being computerized,
  digitized

 E i i consequences!
  Exciting          !

 Huge informatics challenges
       Infrastructure
       Usability
       Security & Privacy

5/28/2010
                                                         Tomorrows Lecture!                                   92




                                                                                                                                                     10

More Related Content

20100528 ubiquitous computing_langheinrich_lecture01

  • 1. 5/29/2010 Computer 1975 Ubiquitous Computing Marc Langheinrich University of Lugano 5/28/2010 F. Ma. 22 Most 際際滷s courtesy of Prof. F. Mattern: Lecture Series Ubiquitous Computing, ETH Zurich Computer 1990 Computer 2005 5/28/2010 F. Ma. 23 5/28/2010 F. Ma. 24 Size Number Computer 2009 Computing: A Clear Trend One computer (mainframe) for many people One computer (PC) for everyone Many computers for everyone 5/28/2010 25 5/28/2010 F. Ma. 26 1
  • 2. 5/29/2010 Number A Short History of the Computing: A Clear Trend Computing Metamorphosis And the future? computer for yone Internet of Things? Many computers smart for everyone dust? 5/28/2010 Size F. Ma. 27 5/28/2010 F. Ma. 30 The Computer as The Computer as a Calculator a Data Processor If it should ever turn out that the basic logics of a machine designed for the numerical solution of differential equations coincide with the logics of a machine intended to make bills for a department store, I would regard this as the most amazing coincidence that I have ever encountered. -- Howard Aiken, 1956 (MARK I) 5/28/2010 F. Ma. 31 5/28/2010 F. Ma. 32 The Computer as a Personal, The Computer as an Interactive Tool Information Device BTX, Germany (1983-2001) Minitel, France (1982-1999) 5/28/2010 F. Ma. 33 5/28/2010 34 2
  • 3. 5/29/2010 The Computer as a The Computer as a Toy Communication Device 5/28/2010 35 5/28/2010 F. Ma. 36 Soon: The Computer as Blood pressure too high Im here, Mummy N 51.30.24 W 0.08.19 Accident an invisible and ahead omnipresent background assistance? Wuff! N 52.12.56 W 10.12.08 You lost me here Ground OK needs water April 2007 5/28/2010 F. Ma. 37 5/28/2010 F. Ma. 38 Instead of World inside the The Vision of Ubiquitous Computing Computer... The most profound technologies are those that disappear. They weave themselves into the fabric Not like this! of everyday life World inside Computer indistinguishable from it. would be Virtual Reality Mark Weiser (1952 1999), XEROX PARC Basic Motivation of Ubiquitous Computing Integrating computers with intuitive user interfaces The computer as a tool for the everyday, everywhere Things are aware of each other and the environment 5/28/2010 F. Ma. 39 5/28/2010 F. Ma. 40 3
  • 4. 5/29/2010 Computer in the World A Vision Of The Future: The Smart Grid Appliances negotiate energy needs w/ utilities Freezer waits until electricity is cheap, then cools ! Washing machine starts laundry an hour later Energy provider can avoid high energy demand gy p g gy eCar Smart Meter Smart Laundry Smart 5/28/2010 F. Ma. 41 5/28/2010 Grid 42 Image Source: NIST Another Vision Of The Future Forecasting is Hard... (in 1955) Moon Colonies Maglev Trains This particularly too expensive? too expensive? streamlined model Sub-aquatic Cities Supersonic Flight from the year 1975 is + not comfy? the Concorde, and then? Flying Cars Nuclear Fusion an elegant t l t two- + too dangerous? too optimistic? seater with a nuclear Video Phone Households Robots powered engine in is Skype finally it? getting there (Roomba)? the back..." Home-PC I think there is a world market for maybe 5 SMS By-product of mobile telephony, computers. Thomas Watson, CEO of IBM, 43 success without advertising 5/28/2010 5/28/2010 44 F. Ma. 43 1. Moores Law (1965) Processing speed and storage capacity double every 18 months cheaper, smaller, faster Exponential increase Ubiquitous Computing will probably go on for the next 10 years at same rate TECHNOLOGY DRIVERS (FIVE TRENDS) 5/28/2010 46 5/28/2010 F. Ma. 47 4
  • 5. 5/29/2010 Consequence: Very Small Chips Consequence: Entire Libraries on a Stick Bild: Hitachi 5/28/2010 F. Ma. 48 5/28/2010 F. Ma. 49 2. Progress in Communication Soon: Ubiquitous Connectivity Technology Wireless (and very cheap) access to the Internet At any place Without manual configuration (instant on) Real-world objects can access services on the Internet Everything could be connected together, even objects without a power source Contact-less chip cards Radio Frequency Identification (RFID) Near Field Communication (NFC) Nostalgy 5/28/2010 F. Ma. 50 5/28/2010 F. Ma. 51 Communication by Touching Communication by Touching Near Field Communication Short-range interaction with handheld devices (~ 10 cm) mobile phone, NFC/RFID tag camera, PDA, 5/28/2010 F. Ma. 52 5/28/2010 F. Ma. 53 5
  • 6. 5/29/2010 Communication by Touching Communication by Touching Owner: Heinz Lieb Bought on 12 Sep 2007 Intuitive way of interaction Intuitive way of interaction access content and services by access content and services by touching other smart objects touching other smart objects (magic touch) (magic touch) 5/28/2010 F. Ma. 54 5/28/2010 55 Friedemann Mattern 3. New Materials Smart Paper, Electronic Ink Pigments keep orientation even after power is cut Low-power displays Smart Paper Micro capsules Top transparent electrode Negatively charged Positively charged black pigment chips white pigment chips Clear fluid Bottom electrode + - Flexible Organic LEDs 0.2 mm No backlight (readable in sunlight)! 5/28/2010 F. Ma. 57 5/28/2010 F. Ma. 58 E-Books (2009) Smart Paper, Electronic Ink Amazon Barnes & Noble Nook, USD 259,- Kindle USD 259,- E-Ink, 2001 5/28/2010 E-Ink, 2005 F. Ma. 59 5/28/2010 60 6
  • 7. 5/29/2010 Flexible Displays: The PC of the Future? 4. Better Sensors Miniaturized cameras, microphones,... Biometric sensors Sensors for temperature, humidity, acceleration,... Location sensors But what about its e.g., GPS energy source? (Fuel cells?) 5/28/2010 F. Ma. 61 5/28/2010 F. Ma. 62 Example: Fingerprint Sensor Example: Instrumenting a Golf Ball with Wireless Sensors Technical specifications of the sensor cube: * Antenna: integrated * Transmitter frequency: 2.4 GHz (Bluetooth) CMOS silicon chip * Range of transmitter: ca. 5 m * Clock cycle: 1 x per second Thermal imaging * Lifetime: ca. 200 tee off (built-in power source) * Weight of the Golf ball with microsystem: 48 g 0.4 mm x 14 mm sensing area Finger sweeping interface eGrain image source: Fraunhofer 5/28/2010 F. Ma. 63 5/28/2010 64 Example: Passive Radio Sensors image source: Siemens No external power supply energy from the actuation process piezoelectric and pyroelectric materials transform changes in pressure or temperature into energy 息 MIMOSA project Can be read wirelessly (from up to 20 m) by reflecting RF signal E.g., tire pressure sensor 5/28/2010 F. Ma. 65 5/28/2010 F. Ma. 66 7
  • 8. 5/29/2010 What should (or wants to) be 5. Localisation localised? Keys, pets, luggages, parcels, containers, Technology improves weapons, rental cars, cars that havent paid road smaller, cheaper, more precise toll, expensive things (theft), toxic products, GPS, A-GPS, WiFi, UWB, ... Children? Unfaithful Spouse? POSITION New Applications Foreigners with Visa? N 047属 2317 Finding friends E 008属 For their own safety 3426 Finding lost objects Finding cool places 5/28/2010 F. Ma. 67 5/28/2010 68 Where Does All the Technological Progress Lead To? POSITION Wireless high-speed N 047属 ? 2317 communication NFC/RFID E 008属 Better sensors 3426 Vision SMART OBJECTS Item localization New materials Moores law 5/28/2010 F. Ma. 74 5/28/2010 75 Embedded Processors Allow for Embedded Processors Allow for Cooperating Smart Objects Cooperating Smart Objects Small, cheap, integrated Small, cheap, integrated sensors sensors processors processors wireless communication wireless communication 5/28/2010 F. Ma. 76 5/28/2010 F. Ma. 77 8
  • 9. 5/29/2010 Cooperating Smart Everyday Things? When the tooth brush communicates with the bathroom mirror animated cartoon appears on the mirror brushing the teeth becomes a computer game, the tooth brush becomes a joy stick high-score lists, collect rewarding points, 5/28/2010 F. Ma. 78 image source: Philips F.Ma. 79 Cooperating Smart Objects: Workplace Safety When entering a confined space: Is breathing apparatus detected? Is there a permit to work? Is there more than one person present? Do those present have valid Vision 2 training certificates? SMART PEOPLE Source: BP 5/28/2010 F. Ma. 80 5/28/2010 83 Smart Glasses Smart Glasses Yesterday You could wear a pair of glasses with a small amount of face recognition built- in, look at a person, and his name would pop up in a balloon above his head. You Water Take ...my could know instantly who the person is, Jimmy me out me Brown day b birthday! even if you don't immediately recognize him. I look at my tree, and a little balloon pops up saying, "Water me," I look at my dog, it says, "Take me out," or I look at my wife, it says, "Don't forget my birthday!" Eyeglass with tiny laser and mirrors projects an M. Satyanarayanan (CMU) image directly onto the retina 5/28/2010 F. Ma. 85 5/28/2010 F. Ma. 86 9
  • 10. 5/29/2010 Smart Glasses Today 5/28/2010 F. Ma. 87 5/28/2010 F. Ma. 88 Smart Glasses Tomorrow? SUMMING UP 5/28/2010 89 5/28/2010 91 http://spectrum.ieee.org/biomedical/bionics/augmented-reality-in-a-contact-lens/0 Friedemann Mattern Ubiquitous Computing Things, places and routines are increasingly being computerized, digitized E i i consequences! Exciting ! Huge informatics challenges Infrastructure Usability Security & Privacy 5/28/2010 Tomorrows Lecture! 92 10