ºÝºÝߣ

ºÝºÝߣShare a Scribd company logo
Minimal Mobile
Human computer Interaction
Abdallah El Ali
15 Nov, 2013

www.abdoelali.com
4.5 years
6 chapters
157 content pages
~10 min!
#ugh
Why
Human Computer
Interaction?!
http://thumbs.dreamstime.com/z/businessman-multitasking-25640436.jpg
Efficiency,
accuracy,
recall,
satisfaction,
...

http://www.smartgirl.org/brain-food/career-hubs/human-computer-interaction.png
http://www.gfktechtalk.com/wp-content/uploads/2012/08/mobmobmob.jpg
4
Touchscreen Interaction
6

http://why-sci.com/wp-content/uploads/2013/07/touchscreen1.jpg
6

http://www.rustoneyeinstitute.com/images_content/eye.jpg
Attention Demanding
Frustrating
Safety

5
Minimal Mobile Human Computer Interaction
Hmmm...

http://www.wallm.com/images/2013/01/original-rubiks-cube-colorful-melting-background.jpg
Eyes-free Interaction

6

http://www.danielgallo.co.uk/wp-content/uploads/2013/01/MinorityReport.jpg
Touchscreen
is here to stay...
Context-aware
computing
Multimodal Interaction
3D Gestural Input

6

http://solidsmack.com/wp-content/uploads/2012/05/the-leap-02.jpg
Minimal Use of
Visual Modality
Okay, but why?
Location-Aware
Multimedia Messaging
time
!"#$%"$&"'$(')*+,-$&"'.$
/+012-3$2,$4'5126$4106+78
!"#"$%&'()*$%+

!"#$%"$&"'$(')*+,-$&"'.$
/+012-3$2,$4'5126$4106+78
$

/*0
,*
+

5$

$

%#$

?
$

+3

@7

?

%#$

)9
.4A
->

01
*3
?
?
15

&"#$

*->

5$

Domain Ratings!

=4
-+

41
<1
*+
3

!"#$

81
9:;

$

"#$

35

(#$

41
*-7
+

!%#$

)2
2

'#$

6$

&&#$

4+
5

!"#$

)*
+,
-./
$01
23

1,
2+3
6,4
78
52
95
$
+2$
:$
;,
-<
=,
/5,
.>+
2$
3 $:
$?
,>>
@A
,/*
B$
)8
95
.4
7*
$
153
/+,
5+9
-,
C-.
$
*2
D7
-+.
47
*$
12
2/ B
*0
,*
+$

)*
+,
-+.

Results

Task Ratings!

!%#$

&"#$
&'#$
(#$
$

/*0
,*
+

1,
2+3
6,4
78
52
95
$
+2$
:$
;,
-<
=,
/5,
.>+
2$
3 $:
$?
,>>
@A
,/*
B$
)8
95
.4
7*
$
153
/+,
5+9
-,
C-.
$
*2
D7
-+.
47
*$
12
2/ B
*0
,*
+$

)*
+,
-+.
!"#$

Domain Ratings!

!%#$

!"#$

&"#$

&"#$

&&#$

%#$

?
$

%#$

)9
.4A
->

$

5$

?

+3

*->

@7

=4
-+

$

5$

35

41
<1
*+
3

01
*3
?
?
15

81
9:;

41
*-7
+

"#$

)2
2

(#$

6$

'#$

4+
5

D
E
M
R
I
F
N
O
C
)*
+,
-./
$01
23

Results

Task Ratings!

!%#$

&'#$

(#$
Minimal Mobile Human Computer Interaction
2

http://good-wallpapers.com/wallpapers/19486/Yawn%20Cat.jpg
Playful
Location-aware
Multimedia Messaging
Minimal Mobile Human Computer Interaction
Representation vs
Interaction

Incentive Mechanisms
Testing
Methodology

http://www.thebizseller.com/blog/wp-content/uploads/2012/07/3arrows1.jpg
Minimal Mobile Human Computer Interaction
2

http://bridgetoit.com/wp-content/uploads/2012/11/Bridge_Wallpaper_by_tonvanalebeek.jpg
Automatic Exploration-based
Route Planning
2

http://www.eurocheapo.com/blog/wp-content/uploads/2011/06/La-Rambla-Barcelona-crowds.jpg
Minimal Mobile Human Computer Interaction
Pffft...
Minimal Mobile Human Computer Interaction
Sequences in Amsterdam
Central Station to Museumplein Route
Photographer Paths
route (5.36 km)

Photo Density
route (3.83 km)

Google Maps
route (3.35 km)
Results
Central Station to Museumplein (CM) Route
"#

**

**

**

**

**

*

**

*

6789:1-#./)0123#!#
<,+/0),9:#46.!<5#

=>()-,?7:7@@#4=AA5#

$#

!"#$%

%#

&#

!%#

!$#

!"#

'()*+),-#./)0123#4'.5#

**
*

6789:1-#./)0123#!#;87:,23#
46.!;5#

&'("$)'*$%

!"#"$%$&
!"#"$%$'

'B929*()CB7(#')2B@#

'B929#D7:@123#

E99*07#F)C@#
Results
Central Station to Museumplein (CM) Route
"#

**

**
**

$#

!"#$%

%#

&#

!%#

!$#

!"#

D
E
M
R
I
F
N
O
C
**

*

!"#"$%$&
!"#"$%$'

*

**

'()*+),-#./)0123#4'.5#

**

**

6789:1-#./)0123#!#;87:,23#
46.!;5#

*

6789:1-#./)0123#!#
<,+/0),9:#46.!<5#

=>()-,?7:7@@#4=AA5#

&'("$)'*$%

'B929*()CB7(#')2B@#

'B929#D7:@123#

E99*07#F)C@#
Make the system context-aware
> Minimize user interaction
Minimal Mobile Human Computer Interaction
System /
Technique

Domain

Input
Modality

Output
Modality

Minimal
Interaction?

Location-aware
Multimedia
Messaging

Urban
Exploration

Touchscreen,
3D Gestures

Visual
(Augmented
Reality)

Contextawareness, Visualgestural Input

Location-aware
Multimedia
Messaging

Playfulness

Touchscreen,
3D Gestures

Visual
(Augmented
Reality)

Contextawareness, Visualgestural Input

Explorationbased Route
Planner

Urban
Exploration

Touchscreen

Visual
(Display)

Context-awareness

3D Gestural
Interaction

Taskindependent

3D Gestures

Visual
(Display)

Gestural Input

3D Gestures,
Touchscreen

Visual
(Display),
Non-speech
Audio

Visuo-Gestural
Input, Gestural
Input

3D Gestures,
Touchscreen

Visual
(Display),
Non-speech
Audio

Visuo-Gestural
Input, Gestural
Input

Magnet-based
ADI

Magnet-based
ADI

Playfulness

User
Authentication
Usability of
3D Gesture-based Interaction
2
http://www.dailygalaxy.com/photos/uncategorized/2008/02/27/minorityreport.jpg
Errors...!¡­!

http://www.dailygalaxy.com/photos/uncategorized/2008/02/27/minorityreport.jpg
Results
!"#$%&'()*'+(,-'+

;/<=-00/0=>%$"

!":+31=-00/0=>%$"

?+@(=-00/0=>%$"

%:
"8
/0
9&/

"0
"#
".
56

",

$+7

$0%
3*

,"

#
$+/

,"
%#
'"

0./

01

&
'(

)*

+,%

$%
"#
!

! !!
!!

!! !!
!!

43

43
56
",
$

+7"

'0

".
"

8
/0

0"

9&/
%:

#,
"

$+/
#
0%
20
3*
$

'"

0./

01

%#
,"

-.
./
0$

&
'(
)*
+,%

%&
"#
$
!

!!
!

0$

!

!!
!

!!
!

!! !
!!

'0

!

&

!

!
!!

!
!!

! !!
!!

-.
./

!

20

!"#$%"&'($)%*+$)

;/<=-00/0=>%$"

!":+31=-00/0=>%$"

?+@(=-00/0=>%$"
Results

D
E
M
R
I
F
N
O
C

!"#$%&'()*'+(,-'+

;/<=-00/0=>%$"

!":+31=-00/0=>%$"

?+@(=-00/0=>%$"

%:

,"

"8
/0
9&/

"0
"#
56

",

$+7

'0

$0%

3*

!":+31=-00/0=>%$"

".

$+/

,"

%#

'"

0./

01

&

)*

+,%

$%

"#

!

'(

;/<=-00/0=>%$"

! !!
!!

!! !!
!!

43

43
56
",
$

+7"

'0

".
"

8
/0

0"

9&/
%:

#,
"

$+/
#

0%

20
3*
$

'"

0./

01

%#
,"

-.
./
0$

&
'(
)*
+,%

%&
"#
$
!

!!
!

0$

!

!!
!

!!
!

!! !
!!

#

!

&

!

!
!!

!
!!

! !!
!!

-.
./

!

20

!"#$%"&'($)%*+$)

?+@(=-00/0=>%$"
40% user error tolerance shows
3D gestures are usable
http://eonreality.i3dsoftware.com/wp-content/uploads/2013/04/mwMch13eon-sch_0338-e1364923000265.jpg
Minimal Mobile Human Computer Interaction
Playful 3D Gestural Interaction
Magnet
Minimal Mobile Human Computer Interaction
Minimal Mobile Human Computer Interaction
Results

#$"
##"
#!"
'&"

!"#$%#&'()

'%"
'$"
'#"
'!"
&"
%"
$"
#"
!"

()$!"

$'*+!"

+'*%!"

%'*,!"

,'*&!"

*+#",-#)./.).'0"#)1,&-#)
./0"12"

./0"34/560"

./0"34/567859:"

&'*-!"

-'*'!!"
Results

D
E
M
R
I
F
N
O
C
#$"
##"
#!"
'&"

!"#$%#&'()

'%"
'$"
'#"
'!"

&"
%"
$"
#"
!"

()$!"

$'*+!"

+'*%!"

%'*,!"

,'*&!"

*+#",-#)./.).'0"#)1,&-#)

./0"12"

./0"34/560"

./0"34/567859:"

&'*-!"

-'*'!!"
Minimal Mobile Human Computer Interaction
3D Gestural
User Authentication
2

http://i1.ytimg.com/vi/hcXSzQjMJCc/maxresdefault.jpg
e
r
u
t
a
n
g
i
S
http://1.bp.blogspot.com/_xBMIyKYPNYs/TBMf8IVL8oI/AAAAAAAABZg/yV9_KcumZj4/s1600/shoulder+sur?ng.jpg
Minimal Mobile Human Computer Interaction
Results

ROC Curve!

NASA-TLX Scores!

'!!"

#!"
'&"
'%"

&!"
!"#$%&'()"*%

!"#$%&'$

'$"
%!"

$!"

'#"
'!"
&"
%"
$"

#!"

#"
!"

()*+,-"

!"
!"

#!"

$!"

%!"

("#$%&'$

&!"

./0123,-"

425)"

6789+"

'!!"

+#,"-().%

.)9:895,*3)" ;9<1+9,=8*"

><?@)3=A)"
B89C-8,D"
Results

D
E
M
R
I
F
N
O
C

ROC Curve!
'!!"

NASA-TLX Scores!

#!"
'&"
'%"

&!"

!"#$%&'()"*%

!"#$%&'$

'$"

%!"

$!"

'#"
'!"

&"
%"
$"

#!"

#"
!"

()*+,-"

!"
!"

#!"

$!"

%!"

("#$%&'$

&!"

./0123,-"

425)"

6789+"

'!!"

+#,"-().%

.)9:895,*3)" ;9<1+9,=8*"

><?@)3=A)"
B89C-8,D"
2

http://i.huffpost.com/gen/1323258/thumbs/o-PASSWORD-facebook.jpg
2

http://pages-tdm.au.dk/digitalkommunikation/?les/2013/09/Funny-Smileys-768x1366.jpg
Minimal Mobile Human Computer Interaction
System /
Technique

Domain

Input
Modality

Output
Modality

Minimal
Interaction?

Location-aware
Multimedia
Messaging

Urban
Exploration

Touchscreen,
3D Gestures

Visual
(Augmented
Reality)

Contextawareness, Visualgestural Input

Location-aware
Multimedia
Messaging

Playfulness

Touchscreen,
3D Gestures

Visual
(Augmented
Reality)

Contextawareness, Visualgestural Input

Explorationbased Route
Planner

Urban
Exploration

Touchscreen

Visual
(Display)

Context-awareness

3D Gestural
Interaction

Taskindependent

3D Gestures

Visual
(Display)

Gestural Input

3D Gestures,
Touchscreen

Visual
(Display),
Non-speech
Audio

Visuo-Gestural
Input, Gestural
Input

3D Gestures,
Touchscreen

Visual
(Display),
Non-speech
Audio

Visuo-Gestural
Input, Gestural
Input

Magnet-based
ADI

Magnet-based
ADI

Playfulness

User
Authentication
http://www.wallsave.com/wallpapers/2048x1152/yes/332959/yes-barack-obama-we-can-332959.jpg
Touchscreen
Touchscreen

Contextawareness

http://www.wyokids?rst.org/wp-content/uploads/2011/04/brain_cogs1.jpg
Touchscreen

Contextawareness

3D Gestural
Input
http://www.wyokids?rst.org/wp-content/uploads/2011/04/brain_cogs1.jpg
Eyes-free Interaction

6

http://www.danielgallo.co.uk/wp-content/uploads/2013/01/MinorityReport.jpg
Keep designing for touchscreens.
But use
context-awareness or 3D gestural input
to minimize user interaction.
Thanks!

www.abdoelali.com
ALERT!
[Incoming
Questions!]

More Related Content

Minimal Mobile Human Computer Interaction