CheckMarket Mechanical Turk (mTurk) is an easy-to-use tool to transcribe open responses from paper surveys. It works like this: Respondents complete a paper questionnaire; These forms are sent to CheckMarket; The forms are scanned and the responses to closed questions are automatically processed; Computers cannot read handwriting so handwritten responses are saved as images to be manually processed by humans.
3.
CheckMarket
Otterstraat 199
2300 Turnhout
Belgium
Step 3: Y
After signin
A task may
A Your u
B Main
C Welco
The table o
Task
Stat
Prog
Tota
Ope
Com
Cert
Unc
Clic
9
t
Your task
ng in, you w
be assigned
username – in
navigation
ome message
of tasks inclu
k
tus
gress
al
en
mplete
tain
certain
k on the na
ks
will see the m
d to more t
nterface langu
udes the fo
Name of t
Open or cl
Percent of
Total num
Number o
Number o
Number o
Number o
me of a tas
mTurk’s wel
han one pe
uage switch –
llowing info
task
losed depen
f the total n
mber of imag
of images th
of images tra
of images tra
of difficult to
k (E) to ope
Page 3
lcome page
erson at a ti
Sign out link
ormation:
nding on if t
number of i
ges in task
hat still need
anscribed
anscribed a
o read imag
en it.
e. You will fi
me to spee
D
E
F
there are an
mages com
d to be tran
and definite
ges
m
nd an overv
d up proces
Overview of y
Your tasks
Task statistic
ny images le
pleted
nscribed
ly correct
Tel.:
Fax:
www.ch
mturkteam@ch
view of all y
ssing.
your tasks
cs
eft
+32 14 700 703
+32 14 700 709
heckmarket.com
heckmarket.com
your tasks.
3
9
m
m
4.
CheckMarket
Otterstraat 199
2300 Turnhout
Belgium
Step 4: m
After openi
Here you ca
A Title
B Butt
C Butto
D Sear
Task statist
open (Open
gives you a
spent show
the Certain
My statistic
many items
personal w
Clic
Clic
9
t
mTurk ta
ing a task, y
an see the t
of the task +
on to start tra
on to review d
rch for words i
tics shows y
n Items), be
total of all
ws you the t
n and Uncer
cs gives you
s you have c
ord count a
k the green
k the orang
ask statis
you will go t
task’s overa
Status
anscribing
difficult to rea
in the comple
you how ma
eing filled o
individual w
total amoun
rtain images
u an overvie
completed,
and time sp
n Start input
ge Review U
stics
to the task’s
all statistics
ad images
ted items
any images
ut now (Bu
words that w
nt of time sp
s.
ew of your p
and how m
ent is also s
t button (B)
Uncertains b
Page 4
s overview
and your p
E
F
G
the task ha
sy now) or
were enter
pent on inp
personal co
many of the
shown.
) to start inp
button (C) t
page.
ersonal sta
E General ta
F Personal ta
G Contact inf
as (Total Ite
completed
ed, and not
ut. Again, t
ontribution t
m you were
putting.
to review di
m
tistics.
ask statistics
ask statistics
formation in c
ms), and ho
(Complete
t marked as
his overview
to the task.
e certain or
fficult to re
Tel.:
Fax:
www.ch
mturkteam@ch
case help is ne
ow many of
ed Items). W
s uncertain.
w gives you
You can se
r uncertain a
ead images.
+32 14 700 703
+32 14 700 709
heckmarket.com
heckmarket.com
eeded
f them are
Word count
Time
u a count of
ee how
about. Your
3
9
m
m
r
5.
CheckMarket
Otterstraat 199
2300 Turnhout
Belgium
Step 5: I
After clickin
A View t
B Quest
C Image
D Image
E Zoom
Simply ente
Next Image
uncertain a
blue Previo
Make sure
the process
Use the ma
9
t
nputting
ng the gree
the keyboard
tion
es completed /
e of the handw
in to the imag
er the hand
e button an
about some
ous Image b
you use th
s!!! Once yo
agnifying gla
g open an
n or orange
shortcuts
/ Total image
written answe
ge
written wo
d repeat. W
of the wor
button to go
e keyboard
ou reach thi
ass (E) to zo
nswers
e button, yo
s
er
rds you see
When you se
ds, mark it
o back.
d shortcuts
is screen, do
oom in for b
Page 5
ou will go th
F
G
H
I
J
e in the ima
ee an empty
as uncertai
(A) for fast
o not use th
better reada
he mTurk’s i
Answer inp
Previous im
Mark as em
Mark as un
Next image
ge (D) into
y image, ma
n (H). You c
er workflow
he mouse an
ability.
m
nput interf
ut
mage button (C
mpty (Ctrl + sp
ncertain (Ctrl +
e button (Ctrl +
the textbox
ark it as bla
can review t
w. This will
nymore!!
Tel.:
Fax:
www.ch
mturkteam@ch
face.
Ctrl + Backspa
pace)
+ ?)
+ Enter)
x (F), click th
nk, when yo
these later.
significantly
+32 14 700 703
+32 14 700 709
heckmarket.com
heckmarket.com
ace)
he green
ou are
Use the
y speed‐up
3
9
m
m
6.
CheckMarket
Otterstraat 199
2300 Turnhout
Belgium
Changin
Click My ac
You can cha
A Your a
B Save t
C New p
9
t
g your a
ccount in th
ange your n
account inform
the changes
password text
ccount in
he main nav
name, e‐ma
mation
tboxs
nformati
vigation bar
ail address a
Page 6
ion
to go to yo
and passwo
our account
rd here.
m
informatio
Tel.:
Fax:
www.ch
mturkteam@ch
n.
+32 14 700 703
+32 14 700 709
heckmarket.com
heckmarket.com
3
9
m
m