際際滷

際際滷Share a Scribd company logo
DEVELOPING
A MAPREDUCE
APPLICATION
CHAPTER 5
13	 8	 11
13	 8	 11
13	 8	 11
13	 8	 11
13	 8	 11
れ 螳 API
 貉危碁 れ API襯
牛 れ 螳ロ.
Con鍖guration 企る 
螻 螳 讌.
螳 煙 String 企, 螳
    .
13	 8	 11
襴 蟆壱蠍
13	 8	 11
れ 
れ ろ  覦 るジ 焔れ    .
13	 8	 11
螳覦 蟆 れ - POM
Maven POM 牛 
譟伎 れ.
hadoop-core
hamcrest-all
mrunit
13	 8	 11
れ 蟯襴
 螳覦 襦貉(pseudodistributed), 企ろ磯ゼ 覲蟆渚覃
讌.
れ 殊  れ 襴 碁 螻,
°螳 覲 .
13	 8	 11
れ 
hadoop-local.xml
- Filesystem螻 Jobtracker  吴 れ.
hadoop-localhost.xml
- 襦貉 れ碁 ″碁貉 れ.
hadoop-cluster.xml
- 企ろ磯 れ碁 ″碁貉 れ.
13	 8	 11
 $HADOOP_INSTALL れ.
Standalone or pseudodistributed
13	 8	 11
HELPER 企
GenericOptionsParser
- 貉るЖ殊 伎螻 Con鍖guration れ .
- Tool, ToolRunner襯  蟆.
Tool, ToolRunner
-
13	 8	 11
MRUNIT
13	 8	 11
13	 8	 11
REDUCER
13	 8	 11
襦貉 蠍
13	 8	 11
13	 8	 11
13	 8	 11
襦貉 JOB 蠍
13	 8	 11
13	 8	 11
13	 8	 11
企ろ一 蠍
襦貉  JVM Job 螻,
覈 企り 企 れ 朱襦,  .
覿一れ,
Job 企る JAR 朱 豪
企ろ磯 ″伎 .
setJarByClass() 覃 企   殊企
 企ろれ JAR殊 蟆覩襦 ′ job
JAR襯 谿城.
13	 8	 11
Ant  Maven 螳 觜伎 伎伎 JAR 殊 .
% mvn package -DskipTests
JAR   job る, JAR  manifest main
企り 襦 伎 .
main 企り manifest 譟伎讌 朱, 貉るЖ殊語
讌伎 .
13	 8	 11
 譬 JAR 殊 job JAR 殊 lib 觚
襴 豪  .
襴 殊 classes 觚襴 豪.
13	 8	 11
JOB 螳蠍
焔 螳 伎
襦狩蟇磯 牛磯伎蠍一 誤伎 
豌危襴ろ
Mapper    Mapper襦 る 襦
Reducers  Reduce Slot 覲企 蟆 Reducers 襯 讌
Combiners
一危 ′ 譴願鍵 
Combiner襯 伎   讌 蟆
Custom
serialization
Writable  comparator襯 貉れろ磯伎る,
RawComparator襯 蟲 蟆.
Shu鍖e tweaks
MapReduce Shu鍖e
覃覈襴 蟯 焔レ 讀螳 .
13	 8	 11
ろ 襦朱
襦貉 Job  ろ襯 襦朱  蟆 暑.
る 襦貉螻 企ろ磯
 覦 谿願 朱襦 譯殊伎 .
HPROF Pro鍖ler
13	 8	 11

More Related Content

Hadoop ch5