This document discusses several next generation user interfaces including gesture interfaces, augmented reality, voice user interfaces, and tangible user interfaces. Gesture interfaces allow interaction through bodily motions detected by cameras or sensors. Augmented reality enhances the real world with computer-generated perceptual information. Voice user interfaces enable interaction through speech. Tangible user interfaces couple physical objects with digital information for manipulation. These emerging interfaces provide more natural, intuitive ways for humans to interact with technology beyond the traditional graphical user interface.
Convert to study guideBETA
Transform any presentation into a summarized study guide, highlighting the most important points and key insights.
3. INTRODUCTION
User Interface
Graphical User Interface (GUI)
User interfaces provide a means of
Input, allowing the users to manipulate a system
Output, allowing the system to indicate the effects of the users'
manipulation
4. Here are some key features of
1. Gesture Interfaces
2. Augmented Reality (AR)
3. Voice User Interface (VUI)
4. Tangible User Interface (TUI)
5. Gesture Interfaces
Gesture recognition is a topic in computer science interpreting
human gestures via mathematical algorithms.
Gestures can originate from any bodily motion (commonly
originate from the face or hand )
It enables humans to communicate with the machine
Gestures enabled applications provide interface to interact with the
system
6. Gesture types
Offline gestures : Those gestures that are processed after the
user interaction with the object. An example is the gesture to
activate a menu.
Online gestures : Direct manipulation gestures. They are used
to scale or rotate a tangible object.
7. Uses of gestures interfaces
1.
Sign language recognition
2. Control through facial gestures
3.
Alternative computer interfaces
4.
Immersive game technology
5. Affective computing
6.
Remote control
8. Input devices
1. Wired gloves
Data glove
2. Depth-aware cameras
3. Controller-based gestures
4. Single camera
Depth aware camera
9. Sixth Sense Technology (Example system )
'Sixth Sense' is a wearable gestural interface that augments the
physical world around us with digital information and lets us
use natural hand gestures to interact with that information
Pranav mistry , inventor of the SixthSense
10. prototype is comprised of a Pocket Projector, a Mirror and a Camera
connected with the mobile computing device in the users pocket.
The software program processes the video stream data captured by the
camera and tracks the locations of the colored markers
Sixth Sense also supports multi-touch and multi-user interaction
11. Applications
Navigate a map
Multi-touch based systems
Zoom in, zoom out
Drawing application
Takes photos using framing gestures
It augments the physical objects
12. Devices used
Navigation, Zoom in / zoom out
Taking photos with gestures
Augmented reality using 6th sense
technology
13. Augmented Reality (AR)
Augmented reality (AR) is a live, copy view of real-world environment
whose elements are augmented by computer-generated sensory input
such as sound, video, graphics or GPS data
17. Voice User Interface (VUI)
A voiceuser interface (VUI) makes human interaction
with computers possible through a voice/speech platform in order to
initiate an automated service or process.
18. Future Uses
1.
Smart phone and PDA`s working
2.
Helps the people who are slow in typing, (avoids straining and
Injuries )
3.
Helps the handicapped people
4.
Facilitate to create portable devices (with no keyboard, no separation
between content and keyboard on the touch screen )
5.
Reduce the devices half in size ( laptop computers , desktop, sliding
mobile devices)
19. 1. The VUI must be sophisticated enough to distinguish between the
input commands, and background conversation
2. It need highly sophisticated software in order to accurately process
and find or retrieve as per the particular user's preferences
21. Understanding Speech Technology
Barge-In
Grammar
Tuning
Voice User Interface
VXML
The Voice XML Specification
The Voice XML Advantage
22. Tangible User Interface
A tangible user interface (TUI) is a user interface in which a person
interacts with digital information through the physical environment.
23. Characteristics TUI
Physical representations are computationally coupled to
underlying digital information.
Physical representations with visible/ tangible interfaces for
interactive control.
Aware of physical objects through sensors and coupled to digital
representation
24. Properties of tangible user interfaces
space-multiplex both input and output
concurrent access
spatially aware (position, area, size etc)
26. Surface computing
Surface computing enables user to interact directly with the system
Without using keyboard and mouse
Features
Direct interaction
Multi user experience
Multi touch
Object recognition
27. Application
Used in hotel, restaurants and retails stores
In casinos (watch video , games, navigation, ..etc)
Digital image painting
Advantages
Disadvantages
Wireless communication
Not portable
Time saving
Very Expansive
New and improved learning
experience
29. CONCLUSION
Next Generation user interfaces are focused on real world objects
The future electronic gadgets will be working on the above discussed
concepts
Many of these technologies are implemented now and some of them
are in developing stage
The trend changes in Electronics and IT will make effect on future
user interfaces also
31. TED talks References
John Underkoffler
(Gestures interfaces)
( www.ted.com )
Pranav Mistry
(Sixth sense technology)
Tomi Ahonen
(Augmented reality)
TED is a global set of conferences owned by the private non-profit Sapling Foundation