This document introduces various topics related to exploring human-computer interaction (HCI). It discusses how computers are becoming more ubiquitous and integrated into devices. New areas for HCI exploration include virtual reality, augmented reality, and wearable devices. The document then summarizes technologies, domains, and ideas that are relevant to HCI research and design. Technologies discussed include VR, AR, ubiquitous computing, robotics, and mobile. Domains include education, healthcare, security, and games. Ideas span context-sensitive computing, gesture-based interaction, visualization, cooperative work, and social computing.
2. Computers are finding their way into more
and more devices, and as a result, HCI is
becoming more and more ubiquitous.
New technological developments are opening
up new areas for exploration
Were seeing really fascinating progress in
area like virtual reality, augmented reality,
wearable devices.
3. As we study HCI, were going to talk a lot
about things youve already used.
If youre interested in HCI, youll be designing
for these new application areas.
So were going to quickly preview some of
these.
Well divide them into three areas:
technologies, domains and ideas.
4. Technologies are emerging technological
capabilities that let us create new and
interesting user interactions.
Domains are pre-existing areas that could be
significantly disrupted by computer interface
like healthcare and education.
Ideas span both of these: they are the
theories about the way people interact with
the interfaces and the world around them.
5. Virtual reality
An immersive computer-simulated reality.
VR is an entire new classification of interaction
and visualization and were definitely still at
the beginning of figuring out what we can do
with these new tools.
VR has application to dozen of spaces:
Tourism, Education, Commerce, Art.
6. For example, there is a lab in Michigan that is
using VR to treat phobias (VR therapy and
counselling center, Grand Rapids, Michigan)
They are creating safe space where people can
very authentically and realistically confront
their fears
The possible applications of VR are really
staggering
7. Augmented reality
VR generally works by replacing the real
worlds visual , auditory and sometimes every
all factory or kinesthetic stimuli with its own
input.
AR on the other hand compliments what you
see and hear in the real world.
Devices that can integrate directly into our
everyday lives enhancing our reality like
Google glass.
8. Imagine systems that can automatically
translate text or speech in a foreign language,
or could show your reviews for restaurants as
you walk down the street.
The application of AR can be truly stunning,
but it relies on cameras to take input from the
world and that actually raises some interesting
societal problems
9. Ubicomp and wearables
Ubiquitous computing (pervasive computing)
refers to the trend towards embedding
computing power in more and more everyday
objects
It is deeply related to the emerging idea of
internet of things
Modern HCI means thinking about whether
someone might use computer while theyre
driving a car or going on a run
10. It means figuring out how to build smart
devices that also some of the cognitive load
from the user, like refrigerators that track their
own content and deliver advice to the users at
the right time.
This push of increasing pervasiveness has also
led to the rise of wearable technologies :
exercise monitors, smart watches, Google
glass, AR headsets, advanced hearing aids
11. Robotics
A lot of the current focus on robotics is on
their physical construction and abilities or on
the artificial intelligence that underlies their
physical forms.
But as robotics became more and more
mainstream, were going to see the
emergence of a new sub-field of HCI : Human
Robot Interaction
12. The first conference on human robot interaction
took place in 2006 in Salt Lake City and several
similar conferences have been created since then.
As robots in the mainstream, were going to have
to answer some interesting questions about how
we interact with them.
For example, how do we ensure robots dont
harm humans through faulty reasoning?
How do we integrate robots in our social live, or
do we even need to?
13. How do we support humans in teaching things
to robots not just programming?
Can we create robots that can teach things to
human?
14. Mobile
One of the biggest changes to computing over
the past several years has been the incredible
growth of mobile as a computing platform.
This has introduced some significant design
challenges
Screen is now far more limited
Input methods are less precise
Distracted users
15. Mobile computing is deeply related to fields
like context-aware computing, ubiquitous
computing and AR as it possesses the
hardware necessary to complement those
efforts.
17. Idea: context-sensitive computing
To build good interface between humans and
computers, we must equip computers with some
understanding of context
thats where context-sensitive computing comes
in.
Context-sensitive computing : equipping user
interfaces with historical, geographical and other
forms of contextual knowledge.
Example: Google maps indicating time to get
work during work days
Travel reminder .
18. Idea: gesture based interaction
We communicate naturally with gestures
everyday, we even have an entire language
built out of gestures.
So, wouldnt it be great if our computers can
interpret our gestures as well?
Thats the emerging field of gesture based
interaction
Example: Microsoft Kinect which has far
ranging application from healthcare to gaming
20. Idea: Pen-and-touch based interaction
A powerful technique for creating simple user
interfaces because it shortens the distance
between the user and the tasks theyre trying
to accomplish
21. Idea: information and visualization
One of the biggest trends of the information age
is the incredible availability of data
Scientists and researchers use data science and
machine learning to look at lots of data and draw
conclusions.
But often times, these conclusions are only useful
if we can communicate them to ordinary people.
Thats where information visualization comes in.
Computers give a powerful way to represent data
in complex, animated and interactive ways.
22. Idea : CSCW
Computer-supported cooperative work: using
computers to support people working
together.
Distributed teams are just one example of
CSCW among others.
We can think of design as whether or not
were designing for the users in the same time
and space or different time and place.
23. One goal of our good interface is to match the
users mental model to the reality of the task
at hand in the same way the foal of
information visualization is to match the
readers mental model of the phenomenon to
the reality of it.
(a visualization is just a representation of data)
24. Idea: Social computing
Social computing is the part of HCI that is
interested in how computers affect the way
we interact and socialize
From online gaming and wikipedia to social
media to dating websites
Social computing is really interested in all
areaswhere computing intersects with our
social life.
26. Domain: special needs
One of the most exciting application on HCI is
helping people with special needs: disabilities,
injuring, aging..
Think of robotic prosthetic for example: of
course, part of that is engineering, part is
neuroscience, but its also important to
understand how the person intend to use such
a limb and the tasks they need to perform.
Thats HCI intersecting with robotics.
27. Think also about communicating data to blind
people: Dr. Walker Sonification lab works in
communicating data using sound.
A lot of emerging areas of HCI technologies
could have extraordinary significance for
people with special needs.
28. Domain: Education
A huge portion of designing educational
technology is really just straightforward HCI:
You might use HCI to introduce some desirable
difficulties.
Some learning experiences for students.
The worst thing you can do in HCI is to raise
the students cognitive load because theyre
too busy thinking about your interface instead
of the subject matter itself.
29. Domain : Healthcare
A lot of current efforts in healthcare are about
processing the massive quantities of data that
are recorded everyday.
There are numerous applications of HCI to
personal healthcare like Fitbit for exercise
monitoring or myFitnessPal for tracking your
diet .
Those interfaces succeed if theyre really
usable for users.
30. Domain : Security
Weve found people have very little patience
for instance where security measures get in
the way of them doing their tasks
For security to be useful, it has to be usable.
If it isnt usable, people wont use it
CAPTCHAs are forms to ensure users are
humans
HCI can make security more usable by
visualizing and communicating the need
31. Domain : Games
Games are one of the purest examples of HCI
We discuss the need for logical mapping between
actions and effects.
The actions that the user takes with the
controller should feel like theyre actually
interacting with the game world.
We discuss the power of feedback cycles.
If you read about a video game reviews, youll
find that most of the criticisms are about bad HCI