際際滷

際際滷Share a Scribd company logo
Not the Rocket Science
亳从舒 亟舒仄礌, 仍 舒舒仂于
丿-2016nika.adamian@parisdescartes.fr
仍仂舒 仆舒从舒 仆亠 弍亠亰于亠亟仆舒
仍仂仂亠 亳仍亠亟仂于舒仆亳亠 仂:
- 亠仄 亳 亠, 仗仂舒亠仆仆亠 仆舒 亳仂亟仆仂亠
亳仍亠亟仂于舒仆亳亠
- (亠仄 亳 亠)*2, 仗仂舒亠仆仆亠 仆舒
仂仗仂于亠亢亠仆亳亠 亳仂亟仆仂亞仂 亳仍亠亟仂于舒仆亳
- 丕于亠仍亳亠仆亳亠 仆舒仆仂亞仂 仄舒
- C仆亳亢亠仆亳亠 亟仂于亠亳亠 从 仂弍仍舒亳 亳仍亠亟仂于舒仆亳亶
亳 仆舒从亠 于 亠仍仂仄
仂亰仄仂亢仆仂 亟亠仍舒 仂仂 仆舒从 亠  于亠
 亅仂 仆亠 于仂仗仂 亳仆舒仆亳仂于舒仆亳
 亅仂 仆亠 于仂仗仂 亳仆舒从
 亅仂 于仂仗仂 亳仆仂仄亳仂于舒仆仆仂亳,
仂于亠于亠仆仆仂亳 亳 亢亠仍舒仆亳
舒从仂于舒 于仂仗仂亳亰于仂亟亳仄仂 仗亳仂仍仂亞亳亠从亳 亳仍亠亟仂于舒仆亳亶?
Nosek et al. (a lot of al!), 2015
 亰 100 亠仗仍亳亳仂于舒仆仆
亳仍亠亟仂于舒仆亳亶 弍仂仍亠亠 仗仂仍仂于亳仆
仆亠 仗仂亟于亠亟亳仍亳
舒亳亳亠从仂亶 亰仆舒亳仄仂亳
亠从舒
 丼亠仄 弍仂仍亠 舒亰仄亠 亠从舒
仂亳亞亳仆舒仍仆仂亞仂 亳仍亠亟仂于舒仆亳,
亠仄 于亠 于亠仂仆仂
仗亠仆仂亞仂 于仂仗仂亳亰于亠亟亠仆亳
亠亰仍舒仂于
Neuroskeptic, 2010
1. 亳仄弍
2. 弌仍仂仆 亳亰 仄亳
3. 仂亳
仗亳亟仄舒仆舒
亰舒亟仆亳仄 亳仍仂仄
4. 仂舒 仆舒 p
5. 亠舒亳于仆亠
于弍仂
6. 仍舒亞亳舒
7. 亠-仗弍仍亳从舒亳
8. 丼舒亳仆舒
仗弍仍亳从舒亳
9. 个舒仍亳亳从舒亳
亳亰从舒 舒亳亳亠从舒
仄仂仆仂
舒于舒亶亠 仗仂仄仂亢亠仄 仗亳仂仍仂亞舒仄 仆舒亶亳 仗舒于亳仍仆亶 从亞 舒亟舒!
Not the rocket science
亅从仗亠亳仄亠仆 1: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 亟亠从亳
仗亠亠仆 仆舒 弍亠从亳于仆亶 于仂亰舒?
: 亟亠从舒 亳仍亳 仂弍仆舒 仗亠仆
: 弍亠从亳于仆亶 于仂亰舒 (5 于舒亳舒仆仂于 仂于亠舒)
仂于舒亳舒舒: 于仂亰舒 仂舒
弍仂从舒: 30 c亟亠仆仂于
亠亰仍舒: 亟舒, 于仍亳磳! 亟亠从舒 仗亠仆 亰舒舒于仍磳
于于仂于舒 亠弍 舒亠 F(1, 27) = 5.06, p = .033
亅从仗亠亳仄亠仆 1: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 亟亠从亳
仗亠亠仆 仆舒 弍亠从亳于仆亶 于仂亰舒?
: 亟亠从舒 亳仍亳 仂弍仆舒 仗亠仆
: 弍亠从亳于仆亶 于仂亰舒 (5 于舒亳舒仆仂于 仂于亠舒)
仂于舒亳舒舒: 于仂亰舒 仂舒
弍仂从舒: 30 c亟亠仆仂于
亠亰仍舒: 亟舒, 于仍亳磳! 亟亠从舒 仗亠仆 亰舒舒于仍磳
于于仂于舒 亠弍 舒亠 F(1, 27) = 5.06, p = .033
亅从仗亠亳仄亠仆 2: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 仗亠仆亳 仂
亰亠仍仂仄 于仂亰舒亠 仆舒 弌丐?
: 亟亠从舒 仗亠仆 亳仍亳 Im 64
: 于仂亰舒
仂于舒亳舒舒: 于仂亰舒 仂舒
弍仂从舒: 20 c亟亠仆仂于
亅从仗亠亳仄亠仆 1: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 亟亠从亳
仗亠亠仆 仆舒 弍亠从亳于仆亶 于仂亰舒?
: 亟亠从舒 亳仍亳 仂弍仆舒 仗亠仆
: 弍亠从亳于仆亶 于仂亰舒 (5 于舒亳舒仆仂于 仂于亠舒)
仂于舒亳舒舒: 于仂亰舒 仂舒
弍仂从舒: 30 c亟亠仆仂于
亠亰仍舒: 亟舒, 于仍亳磳! 亟亠从舒 仗亠仆 亰舒舒于仍磳
于于仂于舒 亠弍 舒亠 F(1, 27) = 5.06, p = .033
亅从仗亠亳仄亠仆 2: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 仗亠仆亳 仂
亰亠仍仂仄 于仂亰舒亠 仆舒 弌丐?
: 亟亠从舒 仗亠仆 亳仍亳 Im 64
: 于仂亰舒
仂于舒亳舒舒: 于仂亰舒 仂舒
弍仂从舒: 20 c亟亠仆仂于
亠亰仍舒: 弌弌丶亊!!!
Not the rocket science
仗仂仍亰 仂 亢亠 亟亳亰舒亶仆 仂 亳 亅从仗亠亳仄亠仆 1, 仄 亟舒于舒仍亳
20 34 亟亠仆舒仄 丕仆亳于亠亳亠舒 亠仆仆亳仍于舒仆亳亳 仗仂仍舒
仗亠仆 Calimba 仍亳弍仂 I am Sixty-Four 仍亳弍仂 Hot Potato.
 舒仆舒仍亳亰亳仂于舒仍亳 亟舒仆仆亠 仗仂仍亠 从舒亢亟 10 仆舒弍仍ミ莞黍出湖.
舒亠仄, 于 仆亠 仂仆仂亠仄 从 仗亠仆亠 仂仗仂仆亳从亠, 亟亠仆
从舒亰于舒仍亳 于仂亶 于仂亰舒, 于仂亶 弍亠从亳于仆亶 于仂亰舒,
于仂亰舒 于仂亠亞仂 仂舒, 于仂亰舒 于仂亠亶 仄舒亠亳, 仂亠仍亳 弍 仂仆亳
仗仂亢亳仆舒 于 从舒亠, 从于舒亟舒仆亶 从仂亠仆 100, 仂亞仍舒仆 仍亳 仂仆亳 
于亠亢亟亠仆亳亠仄, 仂 从仂仄仗ム亠 - 仍仂亢仆舒 仄舒亳仆舒, 仗仂仍亰ム
仍亳 仂仆亳 从亳亟从舒仄亳 仆舒 舒仆仆亳亠 仗仂从仗从亳, 于仂亳 仗仂仍亳亳亠从亳亠
于亰亞仍磲, 于仂亶 亞亠仆亟亠, 舒仂 仍亳 仂仆亳 仂仗亳于舒ム 仗仂仍仂亠 从舒从
舒仂亠 亟仂弍仂亠 亳 从仂 亳亰 从舒仆舒亟从亳 仗仂仍亰舒亳仆亳从仂于 仗仂 亳
仄仆亠仆亳 仗仂仍亳仍 仆舒亞舒亟.
ANCOVA 于磦亳仍舒 仂亢亳亟舒亠仄亶 亠从: 仗仂仍亠
仗仂仍亳于舒仆亳 仗亠仆亳 Beatles 亳仗亠仄亠 弍仍亳 仆舒
仗仂仍仂舒 亞仂亟舒 仄仂仍仂亢亠 (adjusted M = 20.1) , 亠仄 仗仂仍亠
仗仂仍亳于舒仆亳 亟亠从仂亶 仗亠仆亳 (adjusted M = 21.5), F(1,17) =
4.92, p = .040. 亠亰 从仂仆仂仍 于仂亰舒舒 仂亟亳亠仍, 舒亰仆亳舒 弍仍舒
仄亠仆亠 亳 仆亠 亟仂亳亞仍舒 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 (M = 20.3 亳
21.2, 仂仂于亠于亠仆仆仂), F(1,18) = 1.01, p = .33.
仗仂仍亰 仂 亢亠 亟亳亰舒亶仆 仂 亳 亅从仗亠亳仄亠仆 1, 仄 亟舒于舒仍亳
20 34 亟亠仆舒仄 丕仆亳于亠亳亠舒 亠仆仆亳仍于舒仆亳亳 仗仂仍舒
仗亠仆 Calimba 仍亳弍仂 I am Sixty-Four 仍亳弍仂 Hot Potato.
 舒仆舒仍亳亰亳仂于舒仍亳 亟舒仆仆亠 仗仂仍亠 从舒亢亟 10 仆舒弍仍ミ莞黍出湖.
舒亠仄, 于 仆亠 仂仆仂亠仄 从 仗亠仆亠 仂仗仂仆亳从亠, 亟亠仆
从舒亰于舒仍亳 于仂亶 于仂亰舒, 于仂亶 弍亠从亳于仆亶 于仂亰舒,
于仂亰舒 于仂亠亞仂 仂舒, 于仂亰舒 于仂亠亶 仄舒亠亳, 仂亠仍亳 弍 仂仆亳
仗仂亢亳仆舒 于 从舒亠, 从于舒亟舒仆亶 从仂亠仆 100, 仂亞仍舒仆 仍亳 仂仆亳 
于亠亢亟亠仆亳亠仄, 仂 从仂仄仗ム亠 - 仍仂亢仆舒 仄舒亳仆舒, 仗仂仍亰ム
仍亳 仂仆亳 从亳亟从舒仄亳 仆舒 舒仆仆亳亠 仗仂从仗从亳, 于仂亳 仗仂仍亳亳亠从亳亠
于亰亞仍磲, 于仂亶 亞亠仆亟亠, 舒仂 仍亳 仂仆亳 仂仗亳于舒ム 仗仂仍仂亠 从舒从
舒仂亠 亟仂弍仂亠 亳 从仂 亳亰 从舒仆舒亟从亳 仗仂仍亰舒亳仆亳从仂于 仗仂 亳
仄仆亠仆亳 仗仂仍亳仍 仆舒亞舒亟.
ANCOVA 于磦亳仍舒 仂亢亳亟舒亠仄亶 亠从: 仗仂仍亠
仗仂仍亳于舒仆亳 仗亠仆亳 Beatles 亳仗亠仄亠 弍仍亳 仆舒
仗仂仍仂舒 亞仂亟舒 仄仂仍仂亢亠 (adjusted M = 20.1) , 亠仄 仗仂仍亠
仗仂仍亳于舒仆亳 亟亠从仂亶 仗亠仆亳 (adjusted M = 21.5), F(1,17) =
4.92, p = .040. 亠亰 从仂仆仂仍 于仂亰舒舒 仂亟亳亠仍, 舒亰仆亳舒 弍仍舒
仄亠仆亠 亳 仆亠 亟仂亳亞仍舒 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 (M = 20.3 亳
21.2, 仂仂于亠于亠仆仆仂), F(1,18) = 1.01, p = .33.
仗仂仍亰 仂 亢亠 亟亳亰舒亶仆 仂 亳 亅从仗亠亳仄亠仆 1, 仄 亟舒于舒仍亳
20 34 亟亠仆舒仄 丕仆亳于亠亳亠舒 亠仆仆亳仍于舒仆亳亳 仗仂仍舒
仗亠仆 Calimba 仍亳弍仂 I am Sixty-Four 仍亳弍仂 Hot Potato.
 舒仆舒仍亳亰亳仂于舒仍亳 亟舒仆仆亠 仗仂仍亠 从舒亢亟 10 仆舒弍仍ミ莞黍出湖.
舒亠仄, 于 仆亠 仂仆仂亠仄 从 仗亠仆亠 仂仗仂仆亳从亠, 亟亠仆
从舒亰于舒仍亳 于仂亶 于仂亰舒, 于仂亶 弍亠从亳于仆亶 于仂亰舒,
于仂亰舒 于仂亠亞仂 仂舒, 于仂亰舒 于仂亠亶 仄舒亠亳, 仂亠仍亳 弍 仂仆亳
仗仂亢亳仆舒 于 从舒亠, 从于舒亟舒仆亶 从仂亠仆 100, 仂亞仍舒仆 仍亳 仂仆亳 
于亠亢亟亠仆亳亠仄, 仂 从仂仄仗ム亠 - 仍仂亢仆舒 仄舒亳仆舒, 仗仂仍亰ム
仍亳 仂仆亳 从亳亟从舒仄亳 仆舒 舒仆仆亳亠 仗仂从仗从亳, 于仂亳 仗仂仍亳亳亠从亳亠
于亰亞仍磲, 于仂亶 亞亠仆亟亠, 舒仂 仍亳 仂仆亳 仂仗亳于舒ム 仗仂仍仂亠 从舒从
舒仂亠 亟仂弍仂亠 亳 从仂 亳亰 从舒仆舒亟从亳 仗仂仍亰舒亳仆亳从仂于 仗仂 亳
仄仆亠仆亳 仗仂仍亳仍 仆舒亞舒亟.
ANCOVA 于磦亳仍舒 仂亢亳亟舒亠仄亶 亠从: 仗仂仍亠
仗仂仍亳于舒仆亳 仗亠仆亳 Beatles 亳仗亠仄亠 弍仍亳 仆舒
仗仂仍仂舒 亞仂亟舒 仄仂仍仂亢亠 (adjusted M = 20.1) , 亠仄 仗仂仍亠
仗仂仍亳于舒仆亳 亟亠从仂亶 仗亠仆亳 (adjusted M = 21.5), F(1,17) =
4.92, p = .040. 亠亰 从仂仆仂仍 于仂亰舒舒 仂亟亳亠仍, 舒亰仆亳舒 弍仍舒
仄亠仆亠 亳 仆亠 亟仂亳亞仍舒 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 (M = 20.3 亳
21.2, 仂仂于亠于亠仆仆仂), F(1,18) = 1.01, p = .33.
丐仂, 仂 弍仍仂 亟亠仍舒仆仂, 仂仍亳舒亠
仂 仂亞仂, 仂 仂仗亳舒仆仂, 仆仂
亠亰仍舒 仂弍亠仗亠亳于舒ム
仗亠于仄, 舒 仆亠 于仂仄.
- 亠亠仆亳 仗亳仆亳仄舒ム 于 仗仂亠亠
仗仂于亠亟亠仆亳 亳仍亠亟仂于舒仆亳. 丼亠仄 仍仂亢仆亠亠
亟亳亰舒亶仆 亳 仄亠仂亟 舒仆舒仍亳亰舒  亠仄 弍仂仍亠
亠仗亠仆亠亶 于仂弍仂亟 (仆舒仗亳仄亠, 7000
从仂仄弍亳仆舒亳亶 仗舒舒仄亠仂于 亟仍 舒仆舒仍亳亰舒
丐(Carp, 2012).
- 亠 亠从亳 仗舒于亳仍 (于 仍亠仄 仍舒亠
从仂仆于亠仆亳亳)
- 仍亠亟仂于舒亠仍 仂亠 仗仂仍亳
舒亳亳亠从亳 亰仆舒亳仄亶 亠亰仍舒 (仗仂
仄仆仂亞亳仄 仗亳亳仆舒仄)
从亟舒 弍亠 仗仂弍仍亠仄
亠亠仆亳亠:
仗亠亟亠仍亠仆亳亠 舒亰仄亠舒 于弍仂从亳 a priori 
弌亠从于亠仆亳仂仆仆亠 舒亳亳亠从亳亠 仄亠仂亟
亠从仂仍从仂 仗仂仂弍仂于 仂仗亠亟亠仍亳 舒亰仄亠
于弍仂从亳:
- 舒亳舒 仆舒 仂仆仂于亠 仄仂仆仂亳
亠从舒 (仂仂仂 从仂亞亟舒 于仂亰仄仂亢仆仂)
- 仗仂仍亰仂于舒 从仂仆于亠仆亳仂仆舒仍仆亠 >n
亳亰仄亠亠仆亳亶 仆舒 亠亶从 (meh)
- 亰 从仂仆于亠仆亳仂仆舒仍仆仂亠 亰仆舒亠仆亳亠 亳
仂弍舒 于亟于仂亠 弍仂仍亠 亟舒仆仆 (not
bad)
 仍ミ頴笑 仍舒亠, 亞仍舒于仆仂亠 仆亠
仂舒仆舒于仍亳于舒 弍仂 亟舒仆仆 仗仂仂
仗仂仂仄 仂 仂弍仆舒亢亳仍亳 亰仆舒亳仄亠
舒亰仍亳亳
仂亠仄 舒从 于舒亢亠仆 舒亰仄亠
于弍仂从亳
C仂亞仍舒仆仂 仗弍仍亳从舒亳礆, 舒亰仆亳舒 弍于舒亠: 仆舒
仂于仆亠 舒亳亳亠从仂亶 亠仆亟亠仆亳亳 亳仍亳
仗舒从亳亠从亳 亟仂亳亞仍舒 仂于仆
舒亳亳亠从仂亶 亰仆舒亳仄仂亳 亳仍亳
舒亳亳亠从亳 仆亠 亰仆舒亳仄舒 于 亰从仂仄
仗仂仆亳仄舒仆亳亳 亳仍亳 仆亠 仗仂仍仆仂 亰仆舒亳仄舒. 
舒亠仄 仗仂于仂亟亳 亠, 亠仍亳 亠亞仂 亠亰仍舒
仆亠 于仍亳磳 仆舒 亳仆亠仗亠舒亳 亟舒仆仆?
仂仆亠仆仂, 弍仂亞 仍ミ頴狐 .06 仗仂亳 舒从 亢亠 从舒从 .05
弌仍从亳 仆舒 仗仂仍亠亰仆亠 亠:
G*Power: http://www.gpower.hhu.de/
en.html
亟亠舒仍仆亶 t-test . 舒从亠仆舒:
https://github.com/Lakens/Perfect-t-
test
仆舒仍亳亰 p-亰仆舒亠仆亳亶 仆舒 仂仆仂于亠
仗亳于亠亟亠仆仆 舒亳亳从
http://shinyapps.org/apps/p-checker/
仂仍仆亶 亟亳亰舒亶仆 亳仍亠亟仂于舒仆亳
 仍亠亟仂于舒亠仍从亳亠 于仂仗仂
 亳仗仂亠亰 (仆舒仗舒于仍亠仆仆亠 亳仍亳 仆亠仆舒仗舒于仍亠仆仆亠?)
 仗亠仄亠 (亰亟仂仂于亠 于亰仂仍亠? 亟亠亳? 仗舒亳亠仆? 亢亳于仂仆亠? 仄亠仆亠亟亢亠? 仂从亟舒
仂仆亳 亰仆舒ム 仗仂 亳仍亠亟仂于舒仆亳亠? 仂 仂仆亳 仗仂仍舒 亰舒 舒亳亠?)
 弍亠仄 于弍仂从亳 亳 亠亞仂 仂弍仂仆仂于舒仆亳亠 (舒仆舒仍亳亰 仄仂仆仂亳, 仆舒仍亳亳亠 亠仂于, 亟仂仗仆仂)
亳/亳仍亳 仗舒于亳仍仂 仂舒仆仂于从亳
 亠 仗亠亠仄亠仆仆亠 - 亳亰仄亠磳仄亠 亳 于舒亳亠仄亠
 弌仗仂仂弍 舒仆亟仂仄亳亰舒亳亳
 舒于亳仍舒 亳从仍ム亠仆亳 仆舒弍仍ミ莞黍出湖 亳 亰舒仗仂仍仆亠仆亳 仗仂仗亠仆仆 亰仆舒亠仆亳亶
 仍舒仆亳亠仄亠 舒仆仂仄舒亳亳 亟舒仆仆 亳 仗亠仗仂亠亳仆亞
 仍舒仆亳亠仄亠 舒亳亳亠从亳亠 亠
 亳亟亠舒仍亠, 仗亠于舒 舒 仂亠舒 仂弍 亳仍亠亟仂于舒仆亳亳 亟仂仍亢仆舒 仆舒 100%
仂仂于亠于仂于舒 仂仄, 仂 弍仍仂 亰舒仗仍舒仆亳仂于舒仆仂. 亠, 仂 仆亠 于仂亟亳仍仂 于
仗仍舒仆, 磦仍磳 从仗仍仂舒仂仆仂亶 舒 亳仍亠亟仂于舒仆亳, 仂 仂亢亠
亳仆亠亠仆仂, 仆仂 亟仂仍亢仆仂 弍 仂亟亠仍亠仆仂 仂 从仂仆亳仄舒仂仆仂亶 舒亳.
http://fivethirtyeight.com/features/science-isnt-broken/ 
https://osf.io/gvm2z/
亠 亳 于舒亳舒仆 舒仆舒仍亳亰舒 于仗仂仍仆亠仆 仗舒于亳仍仆仂
仂仍亳 仆亠从亳亶 亠亰仍舒 亞仂舒亰亟仂 仗仂亠, 亠仄 仗仂仆, 仂 仗仂亳仂亟亳 仆舒 舒仄仂仄 亟亠仍亠
 舒从 弍 仄 仆亳 舒舒仍亳, 仆舒从舒 仂舒亠
亟仂于仂仍仆仂 亞磶仆仄 亟亠仍仂仄
 亢仆仂 仗亳仆, 仂 仍ミ頴笑 亠亰仍舒 
于亠仄亠仆仆亶, 从舒从 亳 仍ミ頴委 亠仂亳
 亅仂 仆亠 亰仆舒亳, 仂 亟舒仆仆亠 仆亢仆仂
于仂仗亳仆亳仄舒 从舒从 亳仍仍ム舒亳 从 从舒亳仆亠
仄亳舒 仆仂亞仂  亟舒仆仆亠 仆亢仆仂 仍舒,
舒舒 仗仂弍仂仂 于仂亠 亠仄仍亠仆亳亠
仗仂亟于亠亟亳 仂弍于亠仆仆 亞亳仗仂亠亰
https://cos.io/prereg/
Attention, Perception & Psychophysics
Cognition & Emotion
Comparative Political Studies
Comprehensive Results in Social
Psychology
Cortex
Drug and Alcohol Dependence
eLife
European Journal of Neuroscience
Experimental Psychology
Human Movement Science
Journal of Business and Psychology
Journal of Media Psychology
Journal of Personnel Psychology
Perspectives on Psychological Science
Royal Society Open Science
Social Psychology
Stress & Health
Working, Aging and Retirement
亠亠亞亳舒亳
仂亟亠仍仆仂 仂
仗弍仍亳从舒亳亳
亠亠仆亰亳 仆舒 亳亟亠:
- 亠仂亳
- 亞亳仗仂亠亰
- 仄亠仂亟
- 舒仆舒仍亳亰
亳仆亳仗亳舒仍仆仂亠
仂亞仍舒亳亠 仆舒 仗弍仍亳从舒亳
(于 仍舒亠 亠仍亳 舒于仂 弍亟亠
仍亠亟仂于舒 于亠亢亟亠仆仆仂仄
仗仍舒仆
亠亠仆亰亳 仆舒 舒
- 于舒亢仆仂 仂仂于亠于ム
仍亳 于于仂亟
亠亰仍舒舒仄
- 仆亠 亳仄亠亠 亰仆舒亠仆亳
仂仂亳亶 仍亳
亠亰仍舒
PROFIT!
舒亳舒仆 舒亰于亳亳 仆舒 仗亳仄亠亠 仂亟仆仂亶 仍舒弍仂舒仂亳亳
https://sites.google.com/site/todorovicana/musings/crisis_report
1) 弍仍亳从仂于舒 亟舒仆仆亠 亳 从亳仗 亟仍 舒仆舒仍亳亰舒 (OSF, Zenodo) 
于亠仂仆仂 从舒亢亳 亟舒仆仆 仆舒仄仆仂亞仂 仄亠仆亠 于亠仂仆仂亳
仂亟仆亳亠于舒 + 仄仂亳于舒亳 亟亠亢舒 舒亶仍 于 仗仂磲从亠
2) 亠亠亟亠仍于舒 舒仆舒仍亳亰 亟亞 亰舒 亟亞仂仄 于仍亠仗
3) 亠亞亟舒 仂仗亳于舒 仂 弍 仂亟亳仆 仆亠亟舒于亳亶 舒仆舒仍亳亰 于 舒亠 亳仍亳
仗亳从仍舒亟于舒 仆亠亟舒于亳亠 亠亰仍舒 于 从舒亠于亠 亟仂仗仂仍仆亳亠仍仆
仄舒亠亳舒仍仂于
亞舒仆亳亰舒亳
亠仗仂亟亳亠仄
亳仍亠亟仂于舒仆亳亶
丿亳磻, 2015
丐亳仗亳仆亠 亠舒从亳亳 仆舒 仗仂弍 仗仂从舒亰舒 亟舒仆仆亠 亳 从仂亟
 仂亳 亟舒仆仆亠? 舒, 于仂 仗舒仗从舒  仗亠于仄 仗亳仍仂舒亢亠仄, 于仂  仗舒仗从 仂舒于亳仍舒 亟亠仆从舒, 仆仂 仂仆舒 舒从 亳
仆亠 亰舒从仂仆亳仍舒 于 仂弍亠仄,  仆亠 仂于亠仄 仗仂仄仆, 从舒从亳亠 亟舒仆仆亠 亳仗仂仍亰仂于舒仍亳, 仆舒亟仂
仗仂仄仂亠
 仂亟仂亢亟亳,   仄亠仆 亞亟亠-仂 于 从亠仍亠 弍仍舒 舒弍仍亳舒
 仂 仄仂亶 从亳仗 于 SPSS! 丕 亠弍 仆亠 SPSS? 舒从  舒从 亢亳于亠.
 亊 舒从 亟仂仍亞仂 亞仂仂于亳仍(舒)  仗亠亰亠仆舒亳, 舒 亠仗亠 仄仆亠 仗仂亳仍亳 亟仂弍舒 于弍仂从, 于亠 亞舒亳从亳
仗亳亟亠 仗亠亠亳仂于于舒
 仂 舒亳于 仂 于亠仄亳 从亳仗舒仄亳 仗仂 仂仄 仗仂亠从. 丐舒仄 仆亳亠亞仂 仆亠仗仂仆仆仂 亳 仆亠 从仂仄仄亠仆舒亳亠于, 仆仂 
仆舒亟亠ム  仗舒于亳=). 丼仂, 仂仆仂于仆仂亶 从亳仗 仆亠 舒弍仂舒亠? , 仗仂仆仆仂, 亠弍亠 仆亢仆仂
仂从仂仄仄亠仆亳仂于舒 亰亟亠, 舒仄 亳 , 亳 亳仗舒于亳 仄亳仆 仆舒 仗仍ム 于 仂从亠 157
Not the rocket science
亞舒仆亳亰舒亳 亳仍亠亟仂于舒仆亳
舒于亳仍仂: 亟亠仍舒 于亠 舒从, 仂弍 亠弍亠 弍仍仂 仂 仗仂仆仆仂 亠亠亰 5 仍亠. 丐仂亞亟舒 仂
弍亟亠 仗仂仆仆仂 亳 亟亞仂仄 亠亶舒.
丐亳仗亳仆舒 仂亞舒仆亳亰舒亳 舒亶仍仂于:
- 仍亳亠舒舒
- 亟亳亰舒亶仆 (+ 亟仂仗仂仍仆亳亠仍仆亠 仄舒亠亳舒仍, 仆从亳亳, etc)
- 亟舒仆仆亠
- 舒仆舒仍亳亰
- 仗弍仍亳从舒亳, 仗仂亠, 舒弍舒从
仆仂于仆亠 从仂仄仗ム亠仆亠
亳仆仄亠仆 舒弍仂
仗亳仂仍仂亞舒-亳仍亠亟仂于舒亠仍
F1000 Research
仆仄亠仆 亟仍 仂亰亟舒仆亳 从仗亠亳仄亠仆仂于
仂仗亳亠舒仆亶, 亰舒仂
舒弍仂舒亠 亳亰
从仂仂弍从亳
舒亳, 舒弍仂舒亠 于 Octave
(仂从舒 舒仍亠仆舒亳于舒
Matlab)
亠 仂亞仍舒舒亶亠 仆舒 仂
亠仗仍仂舒
亠亟舒 
从仆仂仗仂从舒仄亳,
仂从仂
亠仗仍舒仆仂, 仂从仂, 亟仂仗仆仂 亟仍 亳亰亠仆亳
弌仗亠亳舒仍仆亠 亳仆仄亠仆 亟仍 舒亳亳亠从仂亞仂 舒仆舒仍亳亰舒
JASP
JASP
+: 仂从亶, 亟仂弍仆亶, 仗仂仂亶,
仄亠亠 弍舒亶亠仂于从亳亠 舒亳亳从亳
-: 仆亠 仂舒仆磳 从亳仗, 仆亠
仄舒仆亳仗仍亳亠 亟舒仆仆仄亳
SPSS
+: 仆舒 亠仄 舒, 仄仂亢仆仂
仂舒仆亳 从亳仗
-: 亟仂仂亞仂亶, 仄亠亟仍亠仆仆亶, 礀亠仍亶,
仗仂仗亳亠舒仆亶, 舒仆亠仆从亳亶
R
+: 仂从亶, 仄仂仆亶,
舒从亳于仆仂 舒亰舒弍舒于舒亠,
亠 从 (亟舒亢亠 仆舒
从仂仄 磶从亠), 亟仂舒仂仆仂
仆亳亰从亳亶 仗仂仂亞 于仂亢亟亠仆亳,
亳仂于舒 于 ggplot 仂亟仆仂
亟仂于仂仍于亳亠
-: 仗亳 亠亟从仂仄
亳仗仂仍亰仂于舒仆亳亳 仆舒于从
亠磳
亠亠仆亳 亟仍 于亠亟亠仆亳 仍仂亞仂于
Jupyter notebooks: 弍舒亰亠仆亶, 仄仆仂亞仂仆从亳仂仆舒仍仆亶, 仂 仍亠 于亠亞仂 仗仂亟仂亟亳 亟仍
仂从仂于 亳 亳仆从亳亶. 亠仆 亟仂弍亠仆 于 仍舒, 从仂亞亟舒 仆亢仆仂 从仂仆仂仍亳仂于舒 舒弍仂
仆亠弍仂仍亳 从仂从仂于 从仂亟舒.

Rmarkdown: 亟仂弍仆仂 亟仍 于亠亞仂 仂 亟亠仍舒亠 于 R, 仂 亟仂于仂仍仆仂 弍仂 舒亰亟于舒亠.
丕亟仂弍仆仂 亞仂仂于亳 仗仂仄亠亢仂仆亠 仂亠.
OneNote, Evernote etc  仆亠亟仂弍仆仂 舒仆亳 从仂亟, 仂 仗仂亟仂亟亳 亟仍 从舒亳仆仂从 亳 亠从舒.

ミ英亠 于舒亳舒仆  从仂仆仂仍亠仄 于亠亳亶 亠亠亰 GitHub  仂仍亳仆仂, 仆仂 仆亢仆仂 仗亳于从仆.
弌从仂亠亠 仂仄舒 仗仂亠仗亠仆仆仂亞仂 仍亠仆亳 仆亠亢亠仍亳 仂仆仂仍仂亞亳亳.
从舒 仆舒从舒  亰仂仆亳仆亶 亠仄亳仆 亟仍 亟于亳亢亠仆亳, 亠仍 从仂仂仂亞仂  亟亠仍舒 仆舒仆亠
亳仍亠亟仂于舒仆亳, 亟舒仆仆亠 亳 亳 舒仗仂舒仆亠仆亳亠 亟仂仗仆仄亳 亟仍 于亠 仂于仆亠亶 亰舒亳仆亠亠仂于舒仆仆仂亞仂
仂弍亠于舒, 弍亟 仂 仍ミ頴狐亠仍亳 亳仍亳 仗仂亠亳仂仆舒仍.
亳仆亳仗 仂从仂亶 仆舒从亳
 从亠 仄亠仂亟
 Open source
 从亠 亟舒仆仆亠
 从亶 亟仂仗 从 仆舒仆仄 亠亰仍舒舒仄
 从仂亠 亠亠仆亰亳仂于舒仆亳亠
 从亠 仂弍舒亰仂于舒亠仍仆亠 亠
亠仂亠于亳亟仆亶, 仆仂 仗仂仍亠亰仆亶 仗仂弍仂仆亶
仗仂亟从 仂从仂亶 仆舒从亳  仂从仂亠
仂弍亠仆亳亠 仆舒从亠. 丐仂, 亠仄 舒仆亠
仆亢仆仂 弍仍仂 亳 于 仗亠亳亢仆
仄亠舒 于 仆亠仗仂亠亟于亠仆仆仂仄 从仂仆舒从亠
 舒于仂舒仄亳, 亠亶舒 舒仂 仆舒仂亟亳 于
仂从仂仄 亟仂仗亠.
 丕仂从亳 亳 亳仆从亳亳 (仗仂亞舒仄仄亳仂于舒仆亳亠, 舒仆舒仍亳亰
亟舒仆仆)
 仂亟 亳仍亠亟仂于舒亠仍从亳 仗仂亠从仂于
 舒亰仍亳仆亠 亳仗 亟舒仆仆
Not the rocket science
舒从 仂亳舒仍仆亠 仄亠亟亳舒 从仂亳仍亳 仆舒从
仂-仗弍仍亳从舒亳仂仆仆亠 亠亠仆亰亳亳 亳 HIBAR (亊!)
仍亳仆舒 于仂亰仄仂亢仆仂 于亳亟亠 舒亰仆亠 仂从亳 亰亠仆亳
舒 亠舒从亳 仆舒 仗弍仍亳从舒亳亳 (仗仂 舒于仆亠仆亳  仗亳仄仂仄 亠亟舒从仂
25 舒于亞舒: 于仂亟 仂仆仍舒亶仆 舒亳 Sadness Impairs
Color Perception, 仗亠-亠仍亳亰 于 仆亠从仂仍从亳 从仗仆
亳亰亟舒仆亳, 仆亠亟仂仄亠仆仆舒 亟亳从亳 于 于亳亠亠 
仂弍仆舒亢亠仆舒 仂亠于亳亟仆舒 仄亠仂亟亳亠从舒 仂亳弍从舒
4 亠仆磡: 仗亠于亶 从仂仄仄亠仆舒亳亶 PubPeer 
仂仗亳舒仆亳亠仄 仂亳弍从亳
12 亠仆磡: 仂弍仆舒亢亠仆 亠亠 仂亟亳仆 仆亠亟仂亠,
于磶舒仆仆亶  仂从亞仍亠仆亳亠仄 亟舒仆仆 于仆

5 仆仂磡: 舒于仂 仂亰于舒ム 舒
25 仆仂磡: 仗亠仗亳仆  仗仂亟仂弍仆仄 舒仆舒仍亳亰仂仄 从亠亶舒 亳
仆亠亟仂亠仂于
舒从 仆舒仂亟亳 亳仆亠亠仆仂亠
- 亠亠亰 亟亰亠亶  仗仂仂亢亳仄亳 亳仆亠亠舒仄亳
- 亠亠亰 亳亰于亠仆 于 仗仂.仂仂弍亠于亠 仗仂仍亰仂于舒亠仍亠亶
- 亠亠亰 仗仂亳从
- 亠亠亰 亠亠亞亳 (#ECRchat, #PhDchat)
 亠仄 仗亳舒 于亳
- 仗仂仍仆仂 于舒亠 亟亠仍仂
- 亠仍亳 仂亳亠 仂弍仂仆仂于舒 于 仆舒仆仂仄 于亳亠-仄亳亠 
仗仂 于仂亳 仆舒仆亠 仆舒仂亟从亳, 仗仂 仂, 亠仄 于
亰舒仆亳仄舒亠亠, 亳仆亠亠仆亠 舒亳 亳亰 于舒亠亶 亠,
亢亳于亠 仍亠仆  从仂仆亠亠仆亳亶
舒从 仗亠于舒 亳舒
- 仂舒仆亠仆亳亠 亟仍亳仆仆 亠从仂于 仆舒 仗仂仂仄  仍亳弍仂 
仗仂仄仂 从仆仂仗从亳 favourite 从仂仂舒 仆亠亟舒于仆仂 舒仍舒
从仆仂仗从仂亶 like, 仍亳弍仂  仗仂仄仂 仂仂仆仆亳 亠于亳仂于 亳仗舒
Pocket
亠仗仂亟舒于舒亠仍亳 丿 于 丐于亳亠亠: @nikuss , @ilia_zaharov , @lovakov, @cogdevelopment 亳 仄仆仂亞亳亠 亟亞亳亠!
- 亢仆舒仍 亳 亳 亰舒亞仂仍仂于从亳
- 仗仂亠亳仂仆舒仍仆亠
仂仂弍亠于舒
- 仆舒仆亠 弍仍仂亞亳
- 仂从仂仍仂仆舒仆亠 弍仍仂亞亳
舒于亠亟亳亠 Feedly 亳仍亳 TheOldReader 亳 亟仂弍舒于亠 仆仂于仂亳 仍ミ頴湖煮 弍仍仂亞仂于 亳 亢仆舒仍仂于
丼舒 2
弌仂舒于仂 仆亢仆 仂 弍 亟仍 仂亞仂 仂弍 亳舒
亠仆仂于亳从亳
Not the rocket science
弌仂亟仆亳亠于仂
弍亳亶 仗仂仂从仂仍
舒亰仆亠 舒仂于亠 仗仂舒
亳亞亳亠仆舒 舒弍仂亠亶 仗仂
弌仂亟仆亳亠于仂: 亟舒仆仆亠
仆亳仄舒仆亳亠 从 仄亠仍仂舒仄 (仆舒亰于舒仆亳 舒亶仍仂于, 亰舒仄亠从亳 于 仂亟亠 从仗亠亳仄亠仆舒, etc.)
弍舒 弍舒亰舒 + data dictionary
http://www.humanconnectomeproject.org/
https://www.humanbrainproject.eu/
仂仍仍舒弍仂舒亳亳
etc.
http://enigma.ini.usc.edu/
Not the rocket science
仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亟仂仗亳仄仂
仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亠舒仍亳亰亠仄仂
https://www.mturk.com/mturk/welcome
?Yale University, Yale School of Medicine
University of South Florida
Stanford University
University of California at San Francisco
University of Iowa College of Public Health
University of Alabama, Birmingham
仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 从舒从 仆亠 仆舒亟仂
Facebook study
http://www.eternagame.org/web/about/
仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亳仆亠亠仆仂
http://brain鍖ight.org/
http://fold.it/portal/info/about#folditpub
http://eyewire.org/explore
Not the rocket science
Not the rocket science
Not the rocket science
http://calhoun.nps.edu/bitstream/handle/10945/44013/14Sep_Tellioglu_Umit.pdf?
sequence=3&isAllowed=y
仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亳仆亠亠仆仂
舒从 仗亳于仍亠从舒 束从亳仂于?損

90 % 12,000 Phylo
top 20 players solved more than 700 puzzles each
舒从 舒弍仂舒  仍ミ観仄亳
仆仂仄亳仂于舒仆仆仂亠 仂亞仍舒亳亠
仍舒亳 仍亳 亳仗亠仄仄?
仍亳 亠 于仂亰仄仂亢仆仂, 仂 亟舒.
TCTS
仂亠亳仂仆舒仍仆亠 仂仂弍亠于舒
亠亢亟亳亳仗仍亳仆舒仆仂亠 仂亟仆亳亠于仂
https://vk.com/coopscience
1. Build replications into current study designs. Start with looking for an effect that is already published, then build on additional manipulations. That way
nobody needs to dedicate their time exclusively to replications, while published results will still be routinely checked.
2. If you are unable to come up with strong, precise, fully worked out hypotheses about all the possible and impossible things the brain might do in response to
your experimental manipulations, then make this a two-step process. Start out with some broad hypotheses about large scale neural activity, then stop the data
analysis and reassess. Think about mutually exclusive interpretations of your data, then try to come up with additional, targeted hypotheses about the nature of
the neural activity underlying your effects.
3. Publish the results of all your studies, if you think your experiments were methodologically and technically sound. These wont all get into journals with high
impact factors, but still write them up with care. It is incredibly important for others to know what does and doesnt work. Always give exact p-values for
nonsigni鍖cant results. The difference between 0.05 and 0.12 might be negligible; the difference between 0.12 and 0.9 is not.
4. Always plot the raw data in your manuscripts (a measure of central tendency and a measure of dispersion). Do not just show t-maps, model 鍖ts, correlations
with indices, difference plots. Show what neural activity looks like for each experimental condition. This makes it easier to compare results across studies, and
gives others a clearer insight into the data pattern underlying your effect. If at all possible, upload your data and scripts to a public repository.
5. Appreciate peoples research for more than their p-values. Hiring committees will mostly care about that, but we can behave differently. Give people's failed
experiments the attention they deserve. Failed experiments make us think, and thinking is a good thing.
1. Build replications into current study designs. Start with looking for an effect that is already published, then build on additional manipulations. That way
nobody needs to dedicate their time exclusively to replications, while published results will still be routinely checked.
2. If you are unable to come up with strong, precise, fully worked out hypotheses about all the possible and impossible things the brain might do in response to
your experimental manipulations, then make this a two-step process. Start out with some broad hypotheses about large scale neural activity, then stop the data
analysis and reassess. Think about mutually exclusive interpretations of your data, then try to come up with additional, targeted hypotheses about the nature of
the neural activity underlying your effects.
3. Publish the results of all your studies, if you think your experiments were methodologically and technically sound. These wont all get into journals with high
impact factors, but still write them up with care. It is incredibly important for others to know what does and doesnt work. Always give exact p-values for
nonsigni鍖cant results. The difference between 0.05 and 0.12 might be negligible; the difference between 0.12 and 0.9 is not.
4. Always plot the raw data in your manuscripts (a measure of central tendency and a measure of dispersion). Do not just show t-maps, model 鍖ts, correlations
with indices, difference plots. Show what neural activity looks like for each experimental condition. This makes it easier to compare results across studies, and
gives others a clearer insight into the data pattern underlying your effect. If at all possible, upload your data and scripts to a public repository.
5. Appreciate peoples research for more than their p-values. Hiring committees will mostly care about that, but we can behave differently. Give people's failed
experiments the attention they deserve. Failed experiments make us think, and thinking is a good thing.
Not the rocket science
Ad

Recommended

弌丕弌弌丐 . 丼丕 弌, 丕 丼?
弌丕弌弌丐 . 丼丕 弌, 丕 丼?
GEF.FUTURE
从舒亟亠仄亳亠从仂亠 仄仂亳于舒亳仂仆仆仂亠 仗亳仄仂
从舒亟亠仄亳亠从仂亠 仄仂亳于舒亳仂仆仆仂亠 仗亳仄仂
Nika Adamian
2024 Trend Updates: What Really Works In SEO & Content Marketing
2024 Trend Updates: What Really Works In SEO & Content Marketing
Search Engine Journal
Storytelling For The Web: Integrate Storytelling in your Design Process
Storytelling For The Web: Integrate Storytelling in your Design Process
Chiara Aliotta
Artificial Intelligence, Data and Competition SCHREPEL June 2024 OECD dis...
Artificial Intelligence, Data and Competition SCHREPEL June 2024 OECD dis...
OECD Directorate for Financial and Enterprise Affairs
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
How to Leverage AI to Boost Employee Wellness - Lydia Di Francesco - SocialHR...
SocialHRCamp
2024 State of Marketing Report by Hubspot
2024 State of Marketing Report by Hubspot
Marius Sescu
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
Expeed Software
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
Skeleton Culture Code
Skeleton Culture Code
Skeleton Technologies
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
contently
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
Albert Qian
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
SpeakerHub
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
Getting into the tech field. what next
Getting into the tech field. what next
Tessa Mero
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
How to have difficult conversations
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
Introduction to Data Science
Introduction to Data Science
Christy Abraham Joy
Time Management & Productivity - Best Practices
Time Management & Productivity - Best Practices
Vit Horky
The six step guide to practical project management
The six step guide to practical project management
MindGenius
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
RachelPearson36
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Applitools
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
GetSmarter

More Related Content

Featured (20)

Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
Skeleton Culture Code
Skeleton Culture Code
Skeleton Technologies
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
contently
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
Albert Qian
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
SpeakerHub
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
Getting into the tech field. what next
Getting into the tech field. what next
Tessa Mero
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
How to have difficult conversations
How to have difficult conversations
Rajiv Jayarajah, MAppComm, ACC
Introduction to Data Science
Introduction to Data Science
Christy Abraham Joy
Time Management & Productivity - Best Practices
Time Management & Productivity - Best Practices
Vit Horky
The six step guide to practical project management
The six step guide to practical project management
MindGenius
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
RachelPearson36
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Applitools
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
GetSmarter
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
Pixeldarts
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
ThinkNow
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
marketingartwork
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
Neil Kimberley
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
contently
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
Albert Qian
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
Kurio // The Social Media Age(ncy)
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
Search Engine Journal
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
SpeakerHub
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
Clark Boyd
Getting into the tech field. what next
Getting into the tech field. what next
Tessa Mero
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Lily Ray
Time Management & Productivity - Best Practices
Time Management & Productivity - Best Practices
Vit Horky
The six step guide to practical project management
The six step guide to practical project management
MindGenius
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
RachelPearson36
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Applitools
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
GetSmarter

Not the rocket science

  • 1. Not the Rocket Science 亳从舒 亟舒仄礌, 仍 舒舒仂于 丿-2016nika.adamian@parisdescartes.fr
  • 2. 仍仂舒 仆舒从舒 仆亠 弍亠亰于亠亟仆舒 仍仂仂亠 亳仍亠亟仂于舒仆亳亠 仂: - 亠仄 亳 亠, 仗仂舒亠仆仆亠 仆舒 亳仂亟仆仂亠 亳仍亠亟仂于舒仆亳亠 - (亠仄 亳 亠)*2, 仗仂舒亠仆仆亠 仆舒 仂仗仂于亠亢亠仆亳亠 亳仂亟仆仂亞仂 亳仍亠亟仂于舒仆亳 - 丕于亠仍亳亠仆亳亠 仆舒仆仂亞仂 仄舒 - C仆亳亢亠仆亳亠 亟仂于亠亳亠 从 仂弍仍舒亳 亳仍亠亟仂于舒仆亳亶 亳 仆舒从亠 于 亠仍仂仄
  • 3. 仂亰仄仂亢仆仂 亟亠仍舒 仂仂 仆舒从 亠 于亠 亅仂 仆亠 于仂仗仂 亳仆舒仆亳仂于舒仆亳 亅仂 仆亠 于仂仗仂 亳仆舒从 亅仂 于仂仗仂 亳仆仂仄亳仂于舒仆仆仂亳, 仂于亠于亠仆仆仂亳 亳 亢亠仍舒仆亳
  • 4. 舒从仂于舒 于仂仗仂亳亰于仂亟亳仄仂 仗亳仂仍仂亞亳亠从亳 亳仍亠亟仂于舒仆亳亶? Nosek et al. (a lot of al!), 2015 亰 100 亠仗仍亳亳仂于舒仆仆 亳仍亠亟仂于舒仆亳亶 弍仂仍亠亠 仗仂仍仂于亳仆 仆亠 仗仂亟于亠亟亳仍亳 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 亠从舒 丼亠仄 弍仂仍亠 舒亰仄亠 亠从舒 仂亳亞亳仆舒仍仆仂亞仂 亳仍亠亟仂于舒仆亳, 亠仄 于亠 于亠仂仆仂 仗亠仆仂亞仂 于仂仗仂亳亰于亠亟亠仆亳 亠亰仍舒仂于
  • 5. Neuroskeptic, 2010 1. 亳仄弍 2. 弌仍仂仆 亳亰 仄亳 3. 仂亳 仗亳亟仄舒仆舒 亰舒亟仆亳仄 亳仍仂仄 4. 仂舒 仆舒 p 5. 亠舒亳于仆亠 于弍仂 6. 仍舒亞亳舒 7. 亠-仗弍仍亳从舒亳 8. 丼舒亳仆舒 仗弍仍亳从舒亳 9. 个舒仍亳亳从舒亳
  • 7. 舒于舒亶亠 仗仂仄仂亢亠仄 仗亳仂仍仂亞舒仄 仆舒亶亳 仗舒于亳仍仆亶 从亞 舒亟舒!
  • 9. 亅从仗亠亳仄亠仆 1: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 亟亠从亳 仗亠亠仆 仆舒 弍亠从亳于仆亶 于仂亰舒? : 亟亠从舒 亳仍亳 仂弍仆舒 仗亠仆 : 弍亠从亳于仆亶 于仂亰舒 (5 于舒亳舒仆仂于 仂于亠舒) 仂于舒亳舒舒: 于仂亰舒 仂舒 弍仂从舒: 30 c亟亠仆仂于 亠亰仍舒: 亟舒, 于仍亳磳! 亟亠从舒 仗亠仆 亰舒舒于仍磳 于于仂于舒 亠弍 舒亠 F(1, 27) = 5.06, p = .033
  • 10. 亅从仗亠亳仄亠仆 1: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 亟亠从亳 仗亠亠仆 仆舒 弍亠从亳于仆亶 于仂亰舒? : 亟亠从舒 亳仍亳 仂弍仆舒 仗亠仆 : 弍亠从亳于仆亶 于仂亰舒 (5 于舒亳舒仆仂于 仂于亠舒) 仂于舒亳舒舒: 于仂亰舒 仂舒 弍仂从舒: 30 c亟亠仆仂于 亠亰仍舒: 亟舒, 于仍亳磳! 亟亠从舒 仗亠仆 亰舒舒于仍磳 于于仂于舒 亠弍 舒亠 F(1, 27) = 5.06, p = .033 亅从仗亠亳仄亠仆 2: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 仗亠仆亳 仂 亰亠仍仂仄 于仂亰舒亠 仆舒 弌丐? : 亟亠从舒 仗亠仆 亳仍亳 Im 64 : 于仂亰舒 仂于舒亳舒舒: 于仂亰舒 仂舒 弍仂从舒: 20 c亟亠仆仂于
  • 11. 亅从仗亠亳仄亠仆 1: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 亟亠从亳 仗亠亠仆 仆舒 弍亠从亳于仆亶 于仂亰舒? : 亟亠从舒 亳仍亳 仂弍仆舒 仗亠仆 : 弍亠从亳于仆亶 于仂亰舒 (5 于舒亳舒仆仂于 仂于亠舒) 仂于舒亳舒舒: 于仂亰舒 仂舒 弍仂从舒: 30 c亟亠仆仂于 亠亰仍舒: 亟舒, 于仍亳磳! 亟亠从舒 仗亠仆 亰舒舒于仍磳 于于仂于舒 亠弍 舒亠 F(1, 27) = 5.06, p = .033 亅从仗亠亳仄亠仆 2: 仍亳磳 仍亳 仗仂仍亳于舒仆亳亠 仗亠仆亳 仂 亰亠仍仂仄 于仂亰舒亠 仆舒 弌丐? : 亟亠从舒 仗亠仆 亳仍亳 Im 64 : 于仂亰舒 仂于舒亳舒舒: 于仂亰舒 仂舒 弍仂从舒: 20 c亟亠仆仂于 亠亰仍舒: 弌弌丶亊!!!
  • 13. 仗仂仍亰 仂 亢亠 亟亳亰舒亶仆 仂 亳 亅从仗亠亳仄亠仆 1, 仄 亟舒于舒仍亳 20 34 亟亠仆舒仄 丕仆亳于亠亳亠舒 亠仆仆亳仍于舒仆亳亳 仗仂仍舒 仗亠仆 Calimba 仍亳弍仂 I am Sixty-Four 仍亳弍仂 Hot Potato. 舒仆舒仍亳亰亳仂于舒仍亳 亟舒仆仆亠 仗仂仍亠 从舒亢亟 10 仆舒弍仍ミ莞黍出湖. 舒亠仄, 于 仆亠 仂仆仂亠仄 从 仗亠仆亠 仂仗仂仆亳从亠, 亟亠仆 从舒亰于舒仍亳 于仂亶 于仂亰舒, 于仂亶 弍亠从亳于仆亶 于仂亰舒, 于仂亰舒 于仂亠亞仂 仂舒, 于仂亰舒 于仂亠亶 仄舒亠亳, 仂亠仍亳 弍 仂仆亳 仗仂亢亳仆舒 于 从舒亠, 从于舒亟舒仆亶 从仂亠仆 100, 仂亞仍舒仆 仍亳 仂仆亳 于亠亢亟亠仆亳亠仄, 仂 从仂仄仗ム亠 - 仍仂亢仆舒 仄舒亳仆舒, 仗仂仍亰ム 仍亳 仂仆亳 从亳亟从舒仄亳 仆舒 舒仆仆亳亠 仗仂从仗从亳, 于仂亳 仗仂仍亳亳亠从亳亠 于亰亞仍磲, 于仂亶 亞亠仆亟亠, 舒仂 仍亳 仂仆亳 仂仗亳于舒ム 仗仂仍仂亠 从舒从 舒仂亠 亟仂弍仂亠 亳 从仂 亳亰 从舒仆舒亟从亳 仗仂仍亰舒亳仆亳从仂于 仗仂 亳 仄仆亠仆亳 仗仂仍亳仍 仆舒亞舒亟. ANCOVA 于磦亳仍舒 仂亢亳亟舒亠仄亶 亠从: 仗仂仍亠 仗仂仍亳于舒仆亳 仗亠仆亳 Beatles 亳仗亠仄亠 弍仍亳 仆舒 仗仂仍仂舒 亞仂亟舒 仄仂仍仂亢亠 (adjusted M = 20.1) , 亠仄 仗仂仍亠 仗仂仍亳于舒仆亳 亟亠从仂亶 仗亠仆亳 (adjusted M = 21.5), F(1,17) = 4.92, p = .040. 亠亰 从仂仆仂仍 于仂亰舒舒 仂亟亳亠仍, 舒亰仆亳舒 弍仍舒 仄亠仆亠 亳 仆亠 亟仂亳亞仍舒 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 (M = 20.3 亳 21.2, 仂仂于亠于亠仆仆仂), F(1,18) = 1.01, p = .33.
  • 14. 仗仂仍亰 仂 亢亠 亟亳亰舒亶仆 仂 亳 亅从仗亠亳仄亠仆 1, 仄 亟舒于舒仍亳 20 34 亟亠仆舒仄 丕仆亳于亠亳亠舒 亠仆仆亳仍于舒仆亳亳 仗仂仍舒 仗亠仆 Calimba 仍亳弍仂 I am Sixty-Four 仍亳弍仂 Hot Potato. 舒仆舒仍亳亰亳仂于舒仍亳 亟舒仆仆亠 仗仂仍亠 从舒亢亟 10 仆舒弍仍ミ莞黍出湖. 舒亠仄, 于 仆亠 仂仆仂亠仄 从 仗亠仆亠 仂仗仂仆亳从亠, 亟亠仆 从舒亰于舒仍亳 于仂亶 于仂亰舒, 于仂亶 弍亠从亳于仆亶 于仂亰舒, 于仂亰舒 于仂亠亞仂 仂舒, 于仂亰舒 于仂亠亶 仄舒亠亳, 仂亠仍亳 弍 仂仆亳 仗仂亢亳仆舒 于 从舒亠, 从于舒亟舒仆亶 从仂亠仆 100, 仂亞仍舒仆 仍亳 仂仆亳 于亠亢亟亠仆亳亠仄, 仂 从仂仄仗ム亠 - 仍仂亢仆舒 仄舒亳仆舒, 仗仂仍亰ム 仍亳 仂仆亳 从亳亟从舒仄亳 仆舒 舒仆仆亳亠 仗仂从仗从亳, 于仂亳 仗仂仍亳亳亠从亳亠 于亰亞仍磲, 于仂亶 亞亠仆亟亠, 舒仂 仍亳 仂仆亳 仂仗亳于舒ム 仗仂仍仂亠 从舒从 舒仂亠 亟仂弍仂亠 亳 从仂 亳亰 从舒仆舒亟从亳 仗仂仍亰舒亳仆亳从仂于 仗仂 亳 仄仆亠仆亳 仗仂仍亳仍 仆舒亞舒亟. ANCOVA 于磦亳仍舒 仂亢亳亟舒亠仄亶 亠从: 仗仂仍亠 仗仂仍亳于舒仆亳 仗亠仆亳 Beatles 亳仗亠仄亠 弍仍亳 仆舒 仗仂仍仂舒 亞仂亟舒 仄仂仍仂亢亠 (adjusted M = 20.1) , 亠仄 仗仂仍亠 仗仂仍亳于舒仆亳 亟亠从仂亶 仗亠仆亳 (adjusted M = 21.5), F(1,17) = 4.92, p = .040. 亠亰 从仂仆仂仍 于仂亰舒舒 仂亟亳亠仍, 舒亰仆亳舒 弍仍舒 仄亠仆亠 亳 仆亠 亟仂亳亞仍舒 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 (M = 20.3 亳 21.2, 仂仂于亠于亠仆仆仂), F(1,18) = 1.01, p = .33.
  • 15. 仗仂仍亰 仂 亢亠 亟亳亰舒亶仆 仂 亳 亅从仗亠亳仄亠仆 1, 仄 亟舒于舒仍亳 20 34 亟亠仆舒仄 丕仆亳于亠亳亠舒 亠仆仆亳仍于舒仆亳亳 仗仂仍舒 仗亠仆 Calimba 仍亳弍仂 I am Sixty-Four 仍亳弍仂 Hot Potato. 舒仆舒仍亳亰亳仂于舒仍亳 亟舒仆仆亠 仗仂仍亠 从舒亢亟 10 仆舒弍仍ミ莞黍出湖. 舒亠仄, 于 仆亠 仂仆仂亠仄 从 仗亠仆亠 仂仗仂仆亳从亠, 亟亠仆 从舒亰于舒仍亳 于仂亶 于仂亰舒, 于仂亶 弍亠从亳于仆亶 于仂亰舒, 于仂亰舒 于仂亠亞仂 仂舒, 于仂亰舒 于仂亠亶 仄舒亠亳, 仂亠仍亳 弍 仂仆亳 仗仂亢亳仆舒 于 从舒亠, 从于舒亟舒仆亶 从仂亠仆 100, 仂亞仍舒仆 仍亳 仂仆亳 于亠亢亟亠仆亳亠仄, 仂 从仂仄仗ム亠 - 仍仂亢仆舒 仄舒亳仆舒, 仗仂仍亰ム 仍亳 仂仆亳 从亳亟从舒仄亳 仆舒 舒仆仆亳亠 仗仂从仗从亳, 于仂亳 仗仂仍亳亳亠从亳亠 于亰亞仍磲, 于仂亶 亞亠仆亟亠, 舒仂 仍亳 仂仆亳 仂仗亳于舒ム 仗仂仍仂亠 从舒从 舒仂亠 亟仂弍仂亠 亳 从仂 亳亰 从舒仆舒亟从亳 仗仂仍亰舒亳仆亳从仂于 仗仂 亳 仄仆亠仆亳 仗仂仍亳仍 仆舒亞舒亟. ANCOVA 于磦亳仍舒 仂亢亳亟舒亠仄亶 亠从: 仗仂仍亠 仗仂仍亳于舒仆亳 仗亠仆亳 Beatles 亳仗亠仄亠 弍仍亳 仆舒 仗仂仍仂舒 亞仂亟舒 仄仂仍仂亢亠 (adjusted M = 20.1) , 亠仄 仗仂仍亠 仗仂仍亳于舒仆亳 亟亠从仂亶 仗亠仆亳 (adjusted M = 21.5), F(1,17) = 4.92, p = .040. 亠亰 从仂仆仂仍 于仂亰舒舒 仂亟亳亠仍, 舒亰仆亳舒 弍仍舒 仄亠仆亠 亳 仆亠 亟仂亳亞仍舒 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 (M = 20.3 亳 21.2, 仂仂于亠于亠仆仆仂), F(1,18) = 1.01, p = .33. 丐仂, 仂 弍仍仂 亟亠仍舒仆仂, 仂仍亳舒亠 仂 仂亞仂, 仂 仂仗亳舒仆仂, 仆仂 亠亰仍舒 仂弍亠仗亠亳于舒ム 仗亠于仄, 舒 仆亠 于仂仄.
  • 16. - 亠亠仆亳 仗亳仆亳仄舒ム 于 仗仂亠亠 仗仂于亠亟亠仆亳 亳仍亠亟仂于舒仆亳. 丼亠仄 仍仂亢仆亠亠 亟亳亰舒亶仆 亳 仄亠仂亟 舒仆舒仍亳亰舒 亠仄 弍仂仍亠 亠仗亠仆亠亶 于仂弍仂亟 (仆舒仗亳仄亠, 7000 从仂仄弍亳仆舒亳亶 仗舒舒仄亠仂于 亟仍 舒仆舒仍亳亰舒 丐(Carp, 2012). - 亠 亠从亳 仗舒于亳仍 (于 仍亠仄 仍舒亠 从仂仆于亠仆亳亳) - 仍亠亟仂于舒亠仍 仂亠 仗仂仍亳 舒亳亳亠从亳 亰仆舒亳仄亶 亠亰仍舒 (仗仂 仄仆仂亞亳仄 仗亳亳仆舒仄) 从亟舒 弍亠 仗仂弍仍亠仄
  • 17. 亠亠仆亳亠: 仗亠亟亠仍亠仆亳亠 舒亰仄亠舒 于弍仂从亳 a priori 弌亠从于亠仆亳仂仆仆亠 舒亳亳亠从亳亠 仄亠仂亟 亠从仂仍从仂 仗仂仂弍仂于 仂仗亠亟亠仍亳 舒亰仄亠 于弍仂从亳: - 舒亳舒 仆舒 仂仆仂于亠 仄仂仆仂亳 亠从舒 (仂仂仂 从仂亞亟舒 于仂亰仄仂亢仆仂) - 仗仂仍亰仂于舒 从仂仆于亠仆亳仂仆舒仍仆亠 >n 亳亰仄亠亠仆亳亶 仆舒 亠亶从 (meh) - 亰 从仂仆于亠仆亳仂仆舒仍仆仂亠 亰仆舒亠仆亳亠 亳 仂弍舒 于亟于仂亠 弍仂仍亠 亟舒仆仆 (not bad) 仍ミ頴笑 仍舒亠, 亞仍舒于仆仂亠 仆亠 仂舒仆舒于仍亳于舒 弍仂 亟舒仆仆 仗仂仂 仗仂仂仄 仂 仂弍仆舒亢亳仍亳 亰仆舒亳仄亠 舒亰仍亳亳 仂亠仄 舒从 于舒亢亠仆 舒亰仄亠 于弍仂从亳
  • 18. C仂亞仍舒仆仂 仗弍仍亳从舒亳礆, 舒亰仆亳舒 弍于舒亠: 仆舒 仂于仆亠 舒亳亳亠从仂亶 亠仆亟亠仆亳亳 亳仍亳 仗舒从亳亠从亳 亟仂亳亞仍舒 仂于仆 舒亳亳亠从仂亶 亰仆舒亳仄仂亳 亳仍亳 舒亳亳亠从亳 仆亠 亰仆舒亳仄舒 于 亰从仂仄 仗仂仆亳仄舒仆亳亳 亳仍亳 仆亠 仗仂仍仆仂 亰仆舒亳仄舒. 舒亠仄 仗仂于仂亟亳 亠, 亠仍亳 亠亞仂 亠亰仍舒 仆亠 于仍亳磳 仆舒 亳仆亠仗亠舒亳 亟舒仆仆? 仂仆亠仆仂, 弍仂亞 仍ミ頴狐 .06 仗仂亳 舒从 亢亠 从舒从 .05
  • 19. 弌仍从亳 仆舒 仗仂仍亠亰仆亠 亠: G*Power: http://www.gpower.hhu.de/ en.html 亟亠舒仍仆亶 t-test . 舒从亠仆舒: https://github.com/Lakens/Perfect-t- test 仆舒仍亳亰 p-亰仆舒亠仆亳亶 仆舒 仂仆仂于亠 仗亳于亠亟亠仆仆 舒亳亳从 http://shinyapps.org/apps/p-checker/
  • 20. 仂仍仆亶 亟亳亰舒亶仆 亳仍亠亟仂于舒仆亳 仍亠亟仂于舒亠仍从亳亠 于仂仗仂 亳仗仂亠亰 (仆舒仗舒于仍亠仆仆亠 亳仍亳 仆亠仆舒仗舒于仍亠仆仆亠?) 仗亠仄亠 (亰亟仂仂于亠 于亰仂仍亠? 亟亠亳? 仗舒亳亠仆? 亢亳于仂仆亠? 仄亠仆亠亟亢亠? 仂从亟舒 仂仆亳 亰仆舒ム 仗仂 亳仍亠亟仂于舒仆亳亠? 仂 仂仆亳 仗仂仍舒 亰舒 舒亳亠?) 弍亠仄 于弍仂从亳 亳 亠亞仂 仂弍仂仆仂于舒仆亳亠 (舒仆舒仍亳亰 仄仂仆仂亳, 仆舒仍亳亳亠 亠仂于, 亟仂仗仆仂) 亳/亳仍亳 仗舒于亳仍仂 仂舒仆仂于从亳 亠 仗亠亠仄亠仆仆亠 - 亳亰仄亠磳仄亠 亳 于舒亳亠仄亠 弌仗仂仂弍 舒仆亟仂仄亳亰舒亳亳 舒于亳仍舒 亳从仍ム亠仆亳 仆舒弍仍ミ莞黍出湖 亳 亰舒仗仂仍仆亠仆亳 仗仂仗亠仆仆 亰仆舒亠仆亳亶 仍舒仆亳亠仄亠 舒仆仂仄舒亳亳 亟舒仆仆 亳 仗亠仗仂亠亳仆亞 仍舒仆亳亠仄亠 舒亳亳亠从亳亠 亠 亳亟亠舒仍亠, 仗亠于舒 舒 仂亠舒 仂弍 亳仍亠亟仂于舒仆亳亳 亟仂仍亢仆舒 仆舒 100% 仂仂于亠于仂于舒 仂仄, 仂 弍仍仂 亰舒仗仍舒仆亳仂于舒仆仂. 亠, 仂 仆亠 于仂亟亳仍仂 于 仗仍舒仆, 磦仍磳 从仗仍仂舒仂仆仂亶 舒 亳仍亠亟仂于舒仆亳, 仂 仂亢亠 亳仆亠亠仆仂, 仆仂 亟仂仍亢仆仂 弍 仂亟亠仍亠仆仂 仂 从仂仆亳仄舒仂仆仂亶 舒亳.
  • 21. http://fivethirtyeight.com/features/science-isnt-broken/ https://osf.io/gvm2z/ 亠 亳 于舒亳舒仆 舒仆舒仍亳亰舒 于仗仂仍仆亠仆 仗舒于亳仍仆仂 仂仍亳 仆亠从亳亶 亠亰仍舒 亞仂舒亰亟仂 仗仂亠, 亠仄 仗仂仆, 仂 仗仂亳仂亟亳 仆舒 舒仄仂仄 亟亠仍亠
  • 22. 舒从 弍 仄 仆亳 舒舒仍亳, 仆舒从舒 仂舒亠 亟仂于仂仍仆仂 亞磶仆仄 亟亠仍仂仄 亢仆仂 仗亳仆, 仂 仍ミ頴笑 亠亰仍舒 于亠仄亠仆仆亶, 从舒从 亳 仍ミ頴委 亠仂亳 亅仂 仆亠 亰仆舒亳, 仂 亟舒仆仆亠 仆亢仆仂 于仂仗亳仆亳仄舒 从舒从 亳仍仍ム舒亳 从 从舒亳仆亠 仄亳舒 仆仂亞仂 亟舒仆仆亠 仆亢仆仂 仍舒, 舒舒 仗仂弍仂仂 于仂亠 亠仄仍亠仆亳亠 仗仂亟于亠亟亳 仂弍于亠仆仆 亞亳仗仂亠亰
  • 23. https://cos.io/prereg/ Attention, Perception & Psychophysics Cognition & Emotion Comparative Political Studies Comprehensive Results in Social Psychology Cortex Drug and Alcohol Dependence eLife European Journal of Neuroscience Experimental Psychology Human Movement Science Journal of Business and Psychology Journal of Media Psychology Journal of Personnel Psychology Perspectives on Psychological Science Royal Society Open Science Social Psychology Stress & Health Working, Aging and Retirement 亠亠亞亳舒亳 仂亟亠仍仆仂 仂 仗弍仍亳从舒亳亳 亠亠仆亰亳 仆舒 亳亟亠: - 亠仂亳 - 亞亳仗仂亠亰 - 仄亠仂亟 - 舒仆舒仍亳亰 亳仆亳仗亳舒仍仆仂亠 仂亞仍舒亳亠 仆舒 仗弍仍亳从舒亳 (于 仍舒亠 亠仍亳 舒于仂 弍亟亠 仍亠亟仂于舒 于亠亢亟亠仆仆仂仄 仗仍舒仆 亠亠仆亰亳 仆舒 舒 - 于舒亢仆仂 仂仂于亠于ム 仍亳 于于仂亟 亠亰仍舒舒仄 - 仆亠 亳仄亠亠 亰仆舒亠仆亳 仂仂亳亶 仍亳 亠亰仍舒 PROFIT!
  • 24. 舒亳舒仆 舒亰于亳亳 仆舒 仗亳仄亠亠 仂亟仆仂亶 仍舒弍仂舒仂亳亳 https://sites.google.com/site/todorovicana/musings/crisis_report 1) 弍仍亳从仂于舒 亟舒仆仆亠 亳 从亳仗 亟仍 舒仆舒仍亳亰舒 (OSF, Zenodo) 于亠仂仆仂 从舒亢亳 亟舒仆仆 仆舒仄仆仂亞仂 仄亠仆亠 于亠仂仆仂亳 仂亟仆亳亠于舒 + 仄仂亳于舒亳 亟亠亢舒 舒亶仍 于 仗仂磲从亠 2) 亠亠亟亠仍于舒 舒仆舒仍亳亰 亟亞 亰舒 亟亞仂仄 于仍亠仗 3) 亠亞亟舒 仂仗亳于舒 仂 弍 仂亟亳仆 仆亠亟舒于亳亶 舒仆舒仍亳亰 于 舒亠 亳仍亳 仗亳从仍舒亟于舒 仆亠亟舒于亳亠 亠亰仍舒 于 从舒亠于亠 亟仂仗仂仍仆亳亠仍仆 仄舒亠亳舒仍仂于
  • 27. 丐亳仗亳仆亠 亠舒从亳亳 仆舒 仗仂弍 仗仂从舒亰舒 亟舒仆仆亠 亳 从仂亟 仂亳 亟舒仆仆亠? 舒, 于仂 仗舒仗从舒 仗亠于仄 仗亳仍仂舒亢亠仄, 于仂 仗舒仗从 仂舒于亳仍舒 亟亠仆从舒, 仆仂 仂仆舒 舒从 亳 仆亠 亰舒从仂仆亳仍舒 于 仂弍亠仄, 仆亠 仂于亠仄 仗仂仄仆, 从舒从亳亠 亟舒仆仆亠 亳仗仂仍亰仂于舒仍亳, 仆舒亟仂 仗仂仄仂亠 仂亟仂亢亟亳, 仄亠仆 亞亟亠-仂 于 从亠仍亠 弍仍舒 舒弍仍亳舒 仂 仄仂亶 从亳仗 于 SPSS! 丕 亠弍 仆亠 SPSS? 舒从 舒从 亢亳于亠. 亊 舒从 亟仂仍亞仂 亞仂仂于亳仍(舒) 仗亠亰亠仆舒亳, 舒 亠仗亠 仄仆亠 仗仂亳仍亳 亟仂弍舒 于弍仂从, 于亠 亞舒亳从亳 仗亳亟亠 仗亠亠亳仂于于舒 仂 舒亳于 仂 于亠仄亳 从亳仗舒仄亳 仗仂 仂仄 仗仂亠从. 丐舒仄 仆亳亠亞仂 仆亠仗仂仆仆仂 亳 仆亠 从仂仄仄亠仆舒亳亠于, 仆仂 仆舒亟亠ム 仗舒于亳=). 丼仂, 仂仆仂于仆仂亶 从亳仗 仆亠 舒弍仂舒亠? , 仗仂仆仆仂, 亠弍亠 仆亢仆仂 仂从仂仄仄亠仆亳仂于舒 亰亟亠, 舒仄 亳 , 亳 亳仗舒于亳 仄亳仆 仆舒 仗仍ム 于 仂从亠 157
  • 29. 亞舒仆亳亰舒亳 亳仍亠亟仂于舒仆亳 舒于亳仍仂: 亟亠仍舒 于亠 舒从, 仂弍 亠弍亠 弍仍仂 仂 仗仂仆仆仂 亠亠亰 5 仍亠. 丐仂亞亟舒 仂 弍亟亠 仗仂仆仆仂 亳 亟亞仂仄 亠亶舒. 丐亳仗亳仆舒 仂亞舒仆亳亰舒亳 舒亶仍仂于: - 仍亳亠舒舒 - 亟亳亰舒亶仆 (+ 亟仂仗仂仍仆亳亠仍仆亠 仄舒亠亳舒仍, 仆从亳亳, etc) - 亟舒仆仆亠 - 舒仆舒仍亳亰 - 仗弍仍亳从舒亳, 仗仂亠, 舒弍舒从
  • 32. 仆仄亠仆 亟仍 仂亰亟舒仆亳 从仗亠亳仄亠仆仂于 仂仗亳亠舒仆亶, 亰舒仂 舒弍仂舒亠 亳亰 从仂仂弍从亳 舒亳, 舒弍仂舒亠 于 Octave (仂从舒 舒仍亠仆舒亳于舒 Matlab) 亠 仂亞仍舒舒亶亠 仆舒 仂 亠仗仍仂舒 亠亟舒 从仆仂仗仂从舒仄亳, 仂从仂 亠仗仍舒仆仂, 仂从仂, 亟仂仗仆仂 亟仍 亳亰亠仆亳
  • 33. 弌仗亠亳舒仍仆亠 亳仆仄亠仆 亟仍 舒亳亳亠从仂亞仂 舒仆舒仍亳亰舒 JASP JASP +: 仂从亶, 亟仂弍仆亶, 仗仂仂亶, 仄亠亠 弍舒亶亠仂于从亳亠 舒亳亳从亳 -: 仆亠 仂舒仆磳 从亳仗, 仆亠 仄舒仆亳仗仍亳亠 亟舒仆仆仄亳 SPSS +: 仆舒 亠仄 舒, 仄仂亢仆仂 仂舒仆亳 从亳仗 -: 亟仂仂亞仂亶, 仄亠亟仍亠仆仆亶, 礀亠仍亶, 仗仂仗亳亠舒仆亶, 舒仆亠仆从亳亶 R +: 仂从亶, 仄仂仆亶, 舒从亳于仆仂 舒亰舒弍舒于舒亠, 亠 从 (亟舒亢亠 仆舒 从仂仄 磶从亠), 亟仂舒仂仆仂 仆亳亰从亳亶 仗仂仂亞 于仂亢亟亠仆亳, 亳仂于舒 于 ggplot 仂亟仆仂 亟仂于仂仍于亳亠 -: 仗亳 亠亟从仂仄 亳仗仂仍亰仂于舒仆亳亳 仆舒于从 亠磳
  • 34. 亠亠仆亳 亟仍 于亠亟亠仆亳 仍仂亞仂于 Jupyter notebooks: 弍舒亰亠仆亶, 仄仆仂亞仂仆从亳仂仆舒仍仆亶, 仂 仍亠 于亠亞仂 仗仂亟仂亟亳 亟仍 仂从仂于 亳 亳仆从亳亶. 亠仆 亟仂弍亠仆 于 仍舒, 从仂亞亟舒 仆亢仆仂 从仂仆仂仍亳仂于舒 舒弍仂 仆亠弍仂仍亳 从仂从仂于 从仂亟舒. Rmarkdown: 亟仂弍仆仂 亟仍 于亠亞仂 仂 亟亠仍舒亠 于 R, 仂 亟仂于仂仍仆仂 弍仂 舒亰亟于舒亠. 丕亟仂弍仆仂 亞仂仂于亳 仗仂仄亠亢仂仆亠 仂亠. OneNote, Evernote etc 仆亠亟仂弍仆仂 舒仆亳 从仂亟, 仂 仗仂亟仂亟亳 亟仍 从舒亳仆仂从 亳 亠从舒. ミ英亠 于舒亳舒仆 从仂仆仂仍亠仄 于亠亳亶 亠亠亰 GitHub 仂仍亳仆仂, 仆仂 仆亢仆仂 仗亳于从仆. 弌从仂亠亠 仂仄舒 仗仂亠仗亠仆仆仂亞仂 仍亠仆亳 仆亠亢亠仍亳 仂仆仂仍仂亞亳亳.
  • 35. 从舒 仆舒从舒 亰仂仆亳仆亶 亠仄亳仆 亟仍 亟于亳亢亠仆亳, 亠仍 从仂仂仂亞仂 亟亠仍舒 仆舒仆亠 亳仍亠亟仂于舒仆亳, 亟舒仆仆亠 亳 亳 舒仗仂舒仆亠仆亳亠 亟仂仗仆仄亳 亟仍 于亠 仂于仆亠亶 亰舒亳仆亠亠仂于舒仆仆仂亞仂 仂弍亠于舒, 弍亟 仂 仍ミ頴狐亠仍亳 亳仍亳 仗仂亠亳仂仆舒仍. 亳仆亳仗 仂从仂亶 仆舒从亳 从亠 仄亠仂亟 Open source 从亠 亟舒仆仆亠 从亶 亟仂仗 从 仆舒仆仄 亠亰仍舒舒仄 从仂亠 亠亠仆亰亳仂于舒仆亳亠 从亠 仂弍舒亰仂于舒亠仍仆亠 亠
  • 36. 亠仂亠于亳亟仆亶, 仆仂 仗仂仍亠亰仆亶 仗仂弍仂仆亶 仗仂亟从 仂从仂亶 仆舒从亳 仂从仂亠 仂弍亠仆亳亠 仆舒从亠. 丐仂, 亠仄 舒仆亠 仆亢仆仂 弍仍仂 亳 于 仗亠亳亢仆 仄亠舒 于 仆亠仗仂亠亟于亠仆仆仂仄 从仂仆舒从亠 舒于仂舒仄亳, 亠亶舒 舒仂 仆舒仂亟亳 于 仂从仂仄 亟仂仗亠. 丕仂从亳 亳 亳仆从亳亳 (仗仂亞舒仄仄亳仂于舒仆亳亠, 舒仆舒仍亳亰 亟舒仆仆) 仂亟 亳仍亠亟仂于舒亠仍从亳 仗仂亠从仂于 舒亰仍亳仆亠 亳仗 亟舒仆仆
  • 38. 舒从 仂亳舒仍仆亠 仄亠亟亳舒 从仂亳仍亳 仆舒从
  • 39. 仂-仗弍仍亳从舒亳仂仆仆亠 亠亠仆亰亳亳 亳 HIBAR (亊!) 仍亳仆舒 于仂亰仄仂亢仆仂 于亳亟亠 舒亰仆亠 仂从亳 亰亠仆亳 舒 亠舒从亳 仆舒 仗弍仍亳从舒亳亳 (仗仂 舒于仆亠仆亳 仗亳仄仂仄 亠亟舒从仂 25 舒于亞舒: 于仂亟 仂仆仍舒亶仆 舒亳 Sadness Impairs Color Perception, 仗亠-亠仍亳亰 于 仆亠从仂仍从亳 从仗仆 亳亰亟舒仆亳, 仆亠亟仂仄亠仆仆舒 亟亳从亳 于 于亳亠亠 仂弍仆舒亢亠仆舒 仂亠于亳亟仆舒 仄亠仂亟亳亠从舒 仂亳弍从舒 4 亠仆磡: 仗亠于亶 从仂仄仄亠仆舒亳亶 PubPeer 仂仗亳舒仆亳亠仄 仂亳弍从亳 12 亠仆磡: 仂弍仆舒亢亠仆 亠亠 仂亟亳仆 仆亠亟仂亠, 于磶舒仆仆亶 仂从亞仍亠仆亳亠仄 亟舒仆仆 于仆 5 仆仂磡: 舒于仂 仂亰于舒ム 舒 25 仆仂磡: 仗亠仗亳仆 仗仂亟仂弍仆仄 舒仆舒仍亳亰仂仄 从亠亶舒 亳 仆亠亟仂亠仂于
  • 40. 舒从 仆舒仂亟亳 亳仆亠亠仆仂亠 - 亠亠亰 亟亰亠亶 仗仂仂亢亳仄亳 亳仆亠亠舒仄亳 - 亠亠亰 亳亰于亠仆 于 仗仂.仂仂弍亠于亠 仗仂仍亰仂于舒亠仍亠亶 - 亠亠亰 仗仂亳从 - 亠亠亰 亠亠亞亳 (#ECRchat, #PhDchat) 亠仄 仗亳舒 于亳 - 仗仂仍仆仂 于舒亠 亟亠仍仂 - 亠仍亳 仂亳亠 仂弍仂仆仂于舒 于 仆舒仆仂仄 于亳亠-仄亳亠 仗仂 于仂亳 仆舒仆亠 仆舒仂亟从亳, 仗仂 仂, 亠仄 于 亰舒仆亳仄舒亠亠, 亳仆亠亠仆亠 舒亳 亳亰 于舒亠亶 亠, 亢亳于亠 仍亠仆 从仂仆亠亠仆亳亶 舒从 仗亠于舒 亳舒 - 仂舒仆亠仆亳亠 亟仍亳仆仆 亠从仂于 仆舒 仗仂仂仄 仍亳弍仂 仗仂仄仂 从仆仂仗从亳 favourite 从仂仂舒 仆亠亟舒于仆仂 舒仍舒 从仆仂仗从仂亶 like, 仍亳弍仂 仗仂仄仂 仂仂仆仆亳 亠于亳仂于 亳仗舒 Pocket 亠仗仂亟舒于舒亠仍亳 丿 于 丐于亳亠亠: @nikuss , @ilia_zaharov , @lovakov, @cogdevelopment 亳 仄仆仂亞亳亠 亟亞亳亠!
  • 41. - 亢仆舒仍 亳 亳 亰舒亞仂仍仂于从亳 - 仗仂亠亳仂仆舒仍仆亠 仂仂弍亠于舒 - 仆舒仆亠 弍仍仂亞亳 - 仂从仂仍仂仆舒仆亠 弍仍仂亞亳 舒于亠亟亳亠 Feedly 亳仍亳 TheOldReader 亳 亟仂弍舒于亠 仆仂于仂亳 仍ミ頴湖煮 弍仍仂亞仂于 亳 亢仆舒仍仂于
  • 43. 弌仂舒于仂 仆亢仆 仂 弍 亟仍 仂亞仂 仂弍 亳舒 亠仆仂于亳从亳
  • 45. 弌仂亟仆亳亠于仂 弍亳亶 仗仂仂从仂仍 舒亰仆亠 舒仂于亠 仗仂舒 亳亞亳亠仆舒 舒弍仂亠亶 仗仂
  • 46. 弌仂亟仆亳亠于仂: 亟舒仆仆亠 仆亳仄舒仆亳亠 从 仄亠仍仂舒仄 (仆舒亰于舒仆亳 舒亶仍仂于, 亰舒仄亠从亳 于 仂亟亠 从仗亠亳仄亠仆舒, etc.) 弍舒 弍舒亰舒 + data dictionary
  • 50. 仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亠舒仍亳亰亠仄仂 https://www.mturk.com/mturk/welcome
  • 51. ?Yale University, Yale School of Medicine University of South Florida Stanford University University of California at San Francisco University of Iowa College of Public Health University of Alabama, Birmingham 仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 从舒从 仆亠 仆舒亟仂
  • 53. http://www.eternagame.org/web/about/ 仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亳仆亠亠仆仂 http://brain鍖ight.org/ http://fold.it/portal/info/about#folditpub http://eyewire.org/explore
  • 57. http://calhoun.nps.edu/bitstream/handle/10945/44013/14Sep_Tellioglu_Umit.pdf? sequence=3&isAllowed=y 仍亠亟仂于舒仆亳 于 亳仆亠仆亠亠: 亳仆亠亠仆仂 舒从 仗亳于仍亠从舒 束从亳仂于?損 90 % 12,000 Phylo top 20 players solved more than 700 puzzles each
  • 58. 舒从 舒弍仂舒 仍ミ観仄亳
  • 60. 仍舒亳 仍亳 亳仗亠仄仄? 仍亳 亠 于仂亰仄仂亢仆仂, 仂 亟舒.
  • 63. 1. Build replications into current study designs. Start with looking for an effect that is already published, then build on additional manipulations. That way nobody needs to dedicate their time exclusively to replications, while published results will still be routinely checked.
  • 64. 2. If you are unable to come up with strong, precise, fully worked out hypotheses about all the possible and impossible things the brain might do in response to your experimental manipulations, then make this a two-step process. Start out with some broad hypotheses about large scale neural activity, then stop the data analysis and reassess. Think about mutually exclusive interpretations of your data, then try to come up with additional, targeted hypotheses about the nature of the neural activity underlying your effects.
  • 65. 3. Publish the results of all your studies, if you think your experiments were methodologically and technically sound. These wont all get into journals with high impact factors, but still write them up with care. It is incredibly important for others to know what does and doesnt work. Always give exact p-values for nonsigni鍖cant results. The difference between 0.05 and 0.12 might be negligible; the difference between 0.12 and 0.9 is not.
  • 66. 4. Always plot the raw data in your manuscripts (a measure of central tendency and a measure of dispersion). Do not just show t-maps, model 鍖ts, correlations with indices, difference plots. Show what neural activity looks like for each experimental condition. This makes it easier to compare results across studies, and gives others a clearer insight into the data pattern underlying your effect. If at all possible, upload your data and scripts to a public repository.
  • 67. 5. Appreciate peoples research for more than their p-values. Hiring committees will mostly care about that, but we can behave differently. Give people's failed experiments the attention they deserve. Failed experiments make us think, and thinking is a good thing.
  • 68. 1. Build replications into current study designs. Start with looking for an effect that is already published, then build on additional manipulations. That way nobody needs to dedicate their time exclusively to replications, while published results will still be routinely checked. 2. If you are unable to come up with strong, precise, fully worked out hypotheses about all the possible and impossible things the brain might do in response to your experimental manipulations, then make this a two-step process. Start out with some broad hypotheses about large scale neural activity, then stop the data analysis and reassess. Think about mutually exclusive interpretations of your data, then try to come up with additional, targeted hypotheses about the nature of the neural activity underlying your effects. 3. Publish the results of all your studies, if you think your experiments were methodologically and technically sound. These wont all get into journals with high impact factors, but still write them up with care. It is incredibly important for others to know what does and doesnt work. Always give exact p-values for nonsigni鍖cant results. The difference between 0.05 and 0.12 might be negligible; the difference between 0.12 and 0.9 is not. 4. Always plot the raw data in your manuscripts (a measure of central tendency and a measure of dispersion). Do not just show t-maps, model 鍖ts, correlations with indices, difference plots. Show what neural activity looks like for each experimental condition. This makes it easier to compare results across studies, and gives others a clearer insight into the data pattern underlying your effect. If at all possible, upload your data and scripts to a public repository. 5. Appreciate peoples research for more than their p-values. Hiring committees will mostly care about that, but we can behave differently. Give people's failed experiments the attention they deserve. Failed experiments make us think, and thinking is a good thing.