1. The document proposes using the Nintendo Wii Remote as an intuitive interface for interacting with web-based learning content, such as a topic map-based science learning website.
2. Specifically, it describes using the Wii Remote as a pointer for real-world interactions like selecting constellations, and as a navigation device for exploring 3D representations and the structure of the topic map.
3. Motions and buttons on the Wii Remote are mapped to navigating different aspects of the topic map and triggering content from the website in an immersive way, allowing students to intuitively explore related science topics.
1 of 10
Download to read offline
More Related Content
Tmra2010 matsuuraposter
1. Use
of
the
Wii
Remote
for
Interac2on
in
a
Topic
Map-‐Based
Learning
Web
Site
Shu
Matsuura
Tokyo
Gakugei
University,
Faculty
of
Educa<on,
4-‐1-‐1
Nukuikita,
Koganei,
Tokyo
184-‐8501,
Japan
shumats0@gmail.com
This
work
tries
to
introduce
a
popular
game
console,
Nintendo
Wii
Remote,
which
is
easy
and
intui<ve
to
use
for
the
interac<ons
with
the
computer
in
the
above
environment.
The
Wii
Remote
naviga<ons
were
implemented
for
a
constella<on
observa<on
system,
a
stereoscopic
molecular
dynamics,
and
the
stereoscopic
Google
Earth.
2. Summary
A
topic
map-‐based
online
learning
system
for
science
subjects
at
hPp://tm.u-‐gakugei.ac.jp:8080/epw/,
Ontopia
navigator
server.
1. Wii
Remote
as
an
interface
of
web
contents.
-‐
as
a
pointer
for
real
space:
constella<on
pointer
Wii
Remote
detects
gravita<onal
accelera<on,
so
that
it
can
detect
the
angle
of
eleva<on
from
the
horizon.
We
need
both
GPS
and
magne<c
compass
(iPhone
have
both
of
them),
in
addi<on
to
Wii
Remote,
to
determine
the
posi<on
in
the
sky.
-‐
as
a
buPon
device
for
3D
space:
driving
a
view
point
for
stereoscopic
display
Mo<ons
of
camera
are
assigned
to
the
buPons
of
Wii
remote,
so
that
one
can
explore
3D
space
using
Wii
Remote.
Stereoscopic
display
s<mulates
observer
to
explore
in
the
3D
space,
and
Wii
Remote
works
as
an
intui<ve
steering
device.
2. Wii
Remote
as
a
naviga<on
device
of
topic
map.
-‐
correspondence
between
standard
web
page
design
and
Topic
Maps
structure
-‐
assign
movement
in
a)
topic
type
hierarchy
b)
type
–
instance
c)
associa<ons
d)
instance
–
occurrences
(reques<ng
corresponding
jsp
file)
to
the
buPons
of
Wii
Remote.
-‐
then,
one
can
explore
topic
map
driven
web
pages
by
Wii
Remote.
3. Constella<on
Pointer
Overview
JSP
page
requests
Google
Sky
to
present
corresponding
constella<ons.
GoogleSky
Topic
Map
server
Topic
map
server
returns
JSP
page
including
Google
Sky
presenta<on,
Flash
page
requests
the
topic
map
server
to
associated
constella<ons,
etc.
get
the
corresponding
constella<on
page.
A
flash
page
receives
Wii
data,
Input
data
of
posi<on
in
the
and
calculate
the
right
ascension
and
real
sky,
using
WiiRemote.
declina<on
of
the
pointed
posi<on
in
the
real
sky.
A
flash
base
web
page
to
WiiRemote
communicate
with
“WiiFlashServer”
transmit
data
from
WiiRemote.
WiiRemote
to
flash
web
page.
4. Wii
Flash
J
(works
good
for
win,
not
for
mac,,,)
Push
buPon
A
to
get
la<tude
from
google
geo-‐coding.
Set
la<tude
by
pushing
controller
buPons.
Angle
of
eleva<on
θ
from
the
horizon
is
calculated
by
the
applica<on
from
the
component
values
of
gravity
projected
on
the
three
axis
of
Wiiremote,
gx,
gy,
and
gz.
⎛ gx 2 + g 2 ⎞
θ = −arctan ⎜
y
⎟
⎜
⎝ gz ⎟
⎠
Get
azimuth
by
a
magne<c
compas,
and
set
the
value
by
pushing
controller
buPons.
Get
eleva<on
from
the
ground
by
pushing
the
backside
buPon
B.
g
Y
5. Screen
shot
of
sky_pointer.jsp.
Topic
map
helps
to
con<nue
to
explore
constella<on
related
subjects.
The
values
of
right
ascension
and
celes<al
declina<on
sent
Screen
shot
of
a
constella<on
instance
from
WiiRemote
Sky
posi<on
pointed
by
Wii
Remote.
Links
to
constella<on
instances
included
in
a
range
of
sky.
These
are
retrieved
from
topic
map.
6. Applica<on
of
Wii
Remote
control
to
3D
or
stereoscopic
display
contents.
Wii
Remote
can
be
used
intui2vely
for
the
movement
of
viewpoint.
Stereoscopic
representa2on
induces
explora2ve
ac2on
of
the
viewers.
7. Drive
Topic
map
with
Wii
Can
movement
in
the
topic
map
be
assigned
to
Wii
Remote
controller
buPons?
mode
change:
movement
1. type
hierarchy
topic
types
2. associa<on
3. occurrence
Instance
topics
inter-‐field
associa<on
movement
mode
change:
trans-‐silo
pathway
type-‐instance
etc.
a
retrieved
instance
interlinks
inside
silo
Instance
topics
occurrences
resources
intra-‐field
associa<on
8. Topic
map
cons<tuent→
web
design
from
aggregated
data
to
distributed
resouces
on
web
contents
organized
inside
server(s)
informa<on
organized
onto
a
topic
map
t
o t
p o
p
i
c i
c
contents
in
the
local
server
standard
design
of
web
page
iden<ty
page
header
search
global
naviga<on
Distributed
resources
in
the
internet
breadcrumb
trail
In
Topic
Maps,
we
have
1) topic
type
hierarchy
to
organize
subjects,
external,
2) topic
instances,
local
naviga<on
primary
page
content
internal
3) associa<ons
between
topic
instances,
links
4) role
types,
5) occurrences.
These
cons<tuents
are
equivalent
to
the
design
page
footer:
contact
inf.,
copyright
elements
of
standard
web
page.
10. Topic
map
web
page
design
and
drive
with
Wii
Page
layout
movement
in
the
topic
map
subject-‐subject
associa<on
inter-‐field
type
menu
intra-‐field
occurrences
←
resource
topic