際際滷

際際滷Share a Scribd company logo
Apache Sqoop
蠖
Cecil
13 10 7
企語 豢豌: siliconweek, <http://www.siliconweek.es/noticias/apache-sqoop-se-convierte-en-proyecto-prioritario-para-big-data-21558>
♀骸 RDBMS 伎 一危磯ゼ ″蠍  Tool
Import Export
13 10 7
Import
13 10 7
Import Flow
1. JDBC襯 伎伎 誤 企 蟆
2. 貊 貉企 企 
3. 襷給Μ  ろ
 襷 ろ 貎朱Μ襯 ろ螻 貉企 企るゼ 
伎 語ろ伎る 讌
13 10 7
貉企 企
public class widgets extends SqoopRecord implements DBWritable, Writable {
...
public void readFields(ResultSet __dbResults) throws SQLException { // Importing
this.__cur_result_set = __dbResults;
this.id = JdbcWritableBridge.readInteger(1, __dbResults);
this.widget_name = JdbcWritableBridge.readString(2, __dbResults);
this.price = JdbcWritableBridge.readBigDecimal(3, __dbResults);
this.design_date = JdbcWritableBridge.readDate(4, __dbResults);
this.version = JdbcWritableBridge.readInteger(5, __dbResults);
this.design_comment = JdbcWritableBridge.readString(6, __dbResults);
}
// Exporting
public int write(PreparedStatement __dbStmt, int __off) throws SQLException {
JdbcWritableBridge.writeInteger(id, 1 + __off, 4, __dbStmt);
JdbcWritableBridge.writeString(widget_name, 2 + __off, 12, __dbStmt);
JdbcWritableBridge.writeBigDecimal(price, 3 + __off, 3, __dbStmt);
JdbcWritableBridge.writeDate(design_date, 4 + __off, 91, __dbStmt);
JdbcWritableBridge.writeInteger(version, 5 + __off, 4, __dbStmt);
JdbcWritableBridge.writeString(design_comment, 6 + __off, 12, __dbStmt);
return 6;
}
...
}
Sqoop 一危磯ゼ 讌/讌 貉企 企るゼ 燕
企襦覿 豢豢 貊襯 讌
13 10 7
焔レ  Map Task 覿
 焔レ 貎朱Μ襯 れ 碁 覿一貅 詞  
Sqoop 企  覃 一危磯ゼ  覿 蟆一
(DataDrivenDBInputFormat)
-m 1 旧 覃 1螳 襷 ろ襷 ろ .
Ex) 譯狩れ 豕/豕 螳 伎
0 ~ 99,999 螳 螳讌 ID 貉殊願, 5螳 襷牛ろ螳 ろ 蟆曙
螳螳 襷 ろ  螳 貎朱Μ襯 ろ
SELECT * FROM widgets WHERE id >=0 AND id < 20000;
SELECT * FROM widgets WHERE id >=20000 AND id < 40000;
:
13 10 7
ETC.
  危蠍
WHERE  豢螳 豌 企  朱襷  螳
 語 手
一危 語,  一危一 手 る血 蠏狩 蟆 譴. 企ゼ  
 蠍郁譴 企  襦語るゼ ろ 襷 蟆 
 讌 覈 
讌 覈襯   焔レ レ  . 企 讌 覈 一危
覯伎れ 讌 伎 (ex: mysqldump ...)
13 10 7
Export
13 10 7
Export Flow
1. JDBC襯 伎伎 企 蟆
2. 貊 貉企 企 
3. 襷給Μ  ろ
 INSET 覓語 襷れ伎  企 れ 貊襯 豢螳
13 10 7
ETC.
 旧ろ語 碁
襦語れ 覲煙朱 誤 旧ろ碁   朱 企讌 .
( ろ 蟆郁骸 るジ ろ螳 蠍  谿語^  )
企ゼ  襾殊  企 旧ろ , ′ 譬襭   碁朱
覈 企襦 蟾 (staging-table 旧)
 讌 覈 旧ろ
讌 覈襯  旧 焔レ レ  . 企 讌 覈 一危 覯
伎れ 讌 伎 (ex: mysqlimport ...)
13 10 7
References
 Tom White (2013).  覯所企. (蠍, 蟾, 蟾). : 觜覩碁. (豢
 2012)
13 10 7

More Related Content

What's hot (20)

Hadoop administration
Hadoop administrationHadoop administration
Hadoop administration
Ryan Guhnguk Ahn
20141029 2.5 hiveれ 覦
20141029 2.5 hiveれ 覦 20141029 2.5 hiveれ 覦
20141029 2.5 hiveれ 覦
Tae Young Lee
SW1谿 襦 Hive 豕譬覦
SW1谿 襦 Hive 豕譬覦SW1谿 襦 Hive 豕譬覦
SW1谿 襦 Hive 豕譬覦
Sinhyub Kim
矧♀感帝Μ
矧♀感帝Μ矧♀感帝Μ
矧♀感帝Μ
Choonghyun Yang
= 梶a求求= 襷覲旧曙
= 梶a求求= 襷覲旧曙 = 梶a求求= 襷覲旧曙
= 梶a求求= 襷覲旧曙
覩殊 覩殊
螻 襷
 螻 襷 螻 襷
螻 襷
讌 覦
Hadoop 譯朱
Hadoop 譯朱Hadoop 譯朱
Hadoop 譯朱
DaeHeon Oh
Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)
Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)
Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)
Matthew ()
introduce of Hadoop map reduce
introduce of Hadoop map reduceintroduce of Hadoop map reduce
introduce of Hadoop map reduce
Daeyong Shin
Tajo and SQL-on-Hadoop in Tech Planet 2013
Tajo and SQL-on-Hadoop in Tech Planet 2013Tajo and SQL-on-Hadoop in Tech Planet 2013
Tajo and SQL-on-Hadoop in Tech Planet 2013
Gruter
豌 Oozie Workflow, Coordinator
豌  Oozie Workflow, Coordinator豌  Oozie Workflow, Coordinator
豌 Oozie Workflow, Coordinator
Kim Log
(Hadoop) 覦 蟯蠍一 企慨蠍
 (Hadoop) 覦 蟯蠍一 企慨蠍 (Hadoop) 覦 蟯蠍一 企慨蠍
(Hadoop) 覦 蟯蠍一 企慨蠍
beom kyun choi
SPARK SQL
SPARK SQLSPARK SQL
SPARK SQL
Juhui Park
襷給Μ 企慨蠍
 襷給Μ 企慨蠍 襷給Μ 企慨蠍
襷給Μ 企慨蠍
beom kyun choi
[Pgday.Seoul 2018] Greenplum 碁 覿 り
[Pgday.Seoul 2018]  Greenplum 碁 覿 り[Pgday.Seoul 2018]  Greenplum 碁 覿 り
[Pgday.Seoul 2018] Greenplum 碁 覿 り
PgDay.Seoul
れ(覿磯)
 れ(覿磯) れ(覿磯)
れ(覿磯)
Kwangyoung Jeon
Map reduce 蠍磯蓋 る
Map reduce 蠍磯蓋 るMap reduce 蠍磯蓋 る
Map reduce 蠍磯蓋 る
Jinho Yoo
HDFS Overview
HDFS OverviewHDFS Overview
HDFS Overview
JEONGPHIL HAN
覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop
 覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop 覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop
覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop
SeungYong Baek
Expanding Your Data Warehouse with Tajo
Expanding Your Data Warehouse with TajoExpanding Your Data Warehouse with Tajo
Expanding Your Data Warehouse with Tajo
Matthew ()
20141029 2.5 hiveれ 覦
20141029 2.5 hiveれ 覦 20141029 2.5 hiveれ 覦
20141029 2.5 hiveれ 覦
Tae Young Lee
SW1谿 襦 Hive 豕譬覦
SW1谿 襦 Hive 豕譬覦SW1谿 襦 Hive 豕譬覦
SW1谿 襦 Hive 豕譬覦
Sinhyub Kim
= 梶a求求= 襷覲旧曙
= 梶a求求= 襷覲旧曙 = 梶a求求= 襷覲旧曙
= 梶a求求= 襷覲旧曙
覩殊 覩殊
螻 襷
 螻 襷 螻 襷
螻 襷
讌 覦
Hadoop 譯朱
Hadoop 譯朱Hadoop 譯朱
Hadoop 譯朱
DaeHeon Oh
Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)
Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)
Hadoop螻 SQL-on-Hadoop (A short intro to Hadoop and SQL-on-Hadoop)
Matthew ()
introduce of Hadoop map reduce
introduce of Hadoop map reduceintroduce of Hadoop map reduce
introduce of Hadoop map reduce
Daeyong Shin
Tajo and SQL-on-Hadoop in Tech Planet 2013
Tajo and SQL-on-Hadoop in Tech Planet 2013Tajo and SQL-on-Hadoop in Tech Planet 2013
Tajo and SQL-on-Hadoop in Tech Planet 2013
Gruter
豌 Oozie Workflow, Coordinator
豌  Oozie Workflow, Coordinator豌  Oozie Workflow, Coordinator
豌 Oozie Workflow, Coordinator
Kim Log
(Hadoop) 覦 蟯蠍一 企慨蠍
 (Hadoop) 覦 蟯蠍一 企慨蠍 (Hadoop) 覦 蟯蠍一 企慨蠍
(Hadoop) 覦 蟯蠍一 企慨蠍
beom kyun choi
襷給Μ 企慨蠍
 襷給Μ 企慨蠍 襷給Μ 企慨蠍
襷給Μ 企慨蠍
beom kyun choi
[Pgday.Seoul 2018] Greenplum 碁 覿 り
[Pgday.Seoul 2018]  Greenplum 碁 覿 り[Pgday.Seoul 2018]  Greenplum 碁 覿 り
[Pgday.Seoul 2018] Greenplum 碁 覿 り
PgDay.Seoul
Map reduce 蠍磯蓋 る
Map reduce 蠍磯蓋 るMap reduce 蠍磯蓋 る
Map reduce 蠍磯蓋 る
Jinho Yoo
覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop
 覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop 覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop
覲願鍵(Learn about Hadoop basic), NetApp FAS NFS Connector for Hadoop
SeungYong Baek
Expanding Your Data Warehouse with Tajo
Expanding Your Data Warehouse with TajoExpanding Your Data Warehouse with Tajo
Expanding Your Data Warehouse with Tajo
Matthew ()

Viewers also liked (20)

Erlang
ErlangErlang
Erlang
HyeonSeok Choi
Logstash, ElasticSearch, Kibana
Logstash, ElasticSearch, KibanaLogstash, ElasticSearch, Kibana
Logstash, ElasticSearch, Kibana
HyeonSeok Choi
Anomy chat platform
Anomy chat platformAnomy chat platform
Anomy chat platform
豌 覦
Intro to r & hadoop
Intro to r & hadoopIntro to r & hadoop
Intro to r & hadoop
Seong-Bok Lee
Deep learning as_WaveExtractor
Deep learning as_WaveExtractorDeep learning as_WaveExtractor
Deep learning as_WaveExtractor
IT trends (2015 1H) by 10 keywords
IT trends (2015 1H) by 10 keywordsIT trends (2015 1H) by 10 keywords
IT trends (2015 1H) by 10 keywords
SangSu Jeon
Mining the social web 6
Mining the social web 6Mining the social web 6
Mining the social web 6
HyeonSeok Choi
Code 11 朱Μ 蟆危
Code 11 朱Μ 蟆危Code 11 朱Μ 蟆危
Code 11 朱Μ 蟆危
HyeonSeok Choi
梶梶≡メ =梶 メ Ch14
梶梶≡メ =梶 メ Ch14梶梶≡メ =梶 メ Ch14
梶梶≡メ =梶 メ Ch14
HyeonSeok Choi
SICP_2.5 朱 一一ろ
SICP_2.5 朱 一一ろSICP_2.5 朱 一一ろ
SICP_2.5 朱 一一ろ
HyeonSeok Choi
覯誤朱ゼ讌仰燕窮蠍一3喝2喝3
覯誤朱ゼ讌仰燕窮蠍一3喝2喝3覯誤朱ゼ讌仰燕窮蠍一3喝2喝3
覯誤朱ゼ讌仰燕窮蠍一3喝2喝3
HyeonSeok Choi
Domain driven design ch1
Domain driven design ch1Domain driven design ch1
Domain driven design ch1
HyeonSeok Choi
Refactoring 覃 語
Refactoring 覃 語 Refactoring 覃 語
Refactoring 覃 語
HyeonSeok Choi
覦 覲 襦蠏碁覦 ch9
覦 覲 襦蠏碁覦 ch9覦 覲 襦蠏碁覦 ch9
覦 覲 襦蠏碁覦 ch9
HyeonSeok Choi
Domain driven design ch9
Domain driven design ch9Domain driven design ch9
Domain driven design ch9
HyeonSeok Choi
MiningTheSocialWeb.Ch2.Microformat
MiningTheSocialWeb.Ch2.MicroformatMiningTheSocialWeb.Ch2.Microformat
MiningTheSocialWeb.Ch2.Microformat
HyeonSeok Choi
Erlang梶 求釈= swap メ
Erlang梶 求釈= swap メErlang梶 求釈= swap メ
Erlang梶 求釈= swap メ
Jaejin Yun
Logstash, ElasticSearch, Kibana
Logstash, ElasticSearch, KibanaLogstash, ElasticSearch, Kibana
Logstash, ElasticSearch, Kibana
HyeonSeok Choi
Anomy chat platform
Anomy chat platformAnomy chat platform
Anomy chat platform
豌 覦
Intro to r & hadoop
Intro to r & hadoopIntro to r & hadoop
Intro to r & hadoop
Seong-Bok Lee
Deep learning as_WaveExtractor
Deep learning as_WaveExtractorDeep learning as_WaveExtractor
Deep learning as_WaveExtractor
IT trends (2015 1H) by 10 keywords
IT trends (2015 1H) by 10 keywordsIT trends (2015 1H) by 10 keywords
IT trends (2015 1H) by 10 keywords
SangSu Jeon
Mining the social web 6
Mining the social web 6Mining the social web 6
Mining the social web 6
HyeonSeok Choi
Code 11 朱Μ 蟆危
Code 11 朱Μ 蟆危Code 11 朱Μ 蟆危
Code 11 朱Μ 蟆危
HyeonSeok Choi
梶梶≡メ =梶 メ Ch14
梶梶≡メ =梶 メ Ch14梶梶≡メ =梶 メ Ch14
梶梶≡メ =梶 メ Ch14
HyeonSeok Choi
SICP_2.5 朱 一一ろ
SICP_2.5 朱 一一ろSICP_2.5 朱 一一ろ
SICP_2.5 朱 一一ろ
HyeonSeok Choi
覯誤朱ゼ讌仰燕窮蠍一3喝2喝3
覯誤朱ゼ讌仰燕窮蠍一3喝2喝3覯誤朱ゼ讌仰燕窮蠍一3喝2喝3
覯誤朱ゼ讌仰燕窮蠍一3喝2喝3
HyeonSeok Choi
Domain driven design ch1
Domain driven design ch1Domain driven design ch1
Domain driven design ch1
HyeonSeok Choi
Refactoring 覃 語
Refactoring 覃 語 Refactoring 覃 語
Refactoring 覃 語
HyeonSeok Choi
覦 覲 襦蠏碁覦 ch9
覦 覲 襦蠏碁覦 ch9覦 覲 襦蠏碁覦 ch9
覦 覲 襦蠏碁覦 ch9
HyeonSeok Choi
Domain driven design ch9
Domain driven design ch9Domain driven design ch9
Domain driven design ch9
HyeonSeok Choi
MiningTheSocialWeb.Ch2.Microformat
MiningTheSocialWeb.Ch2.MicroformatMiningTheSocialWeb.Ch2.Microformat
MiningTheSocialWeb.Ch2.Microformat
HyeonSeok Choi
Erlang梶 求釈= swap メ
Erlang梶 求釈= swap メErlang梶 求釈= swap メ
Erlang梶 求釈= swap メ
Jaejin Yun

Similar to Apache sqoop (20)

From MSSQL to MySQL
From MSSQL to MySQLFrom MSSQL to MySQL
From MSSQL to MySQL
I Goo Lee
Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1 覓願鍵(譯) 豕 20170912
Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1  覓願鍵(譯) 豕 20170912Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1  覓願鍵(譯) 豕 20170912
Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1 覓願鍵(譯) 豕 20170912
Yooseok Choi
Big data analysis with R and Apache Tajo (in Korean)
Big data analysis with R and Apache Tajo (in Korean)Big data analysis with R and Apache Tajo (in Korean)
Big data analysis with R and Apache Tajo (in Korean)
Gruter
Spring portfolio2
Spring portfolio2Spring portfolio2
Spring portfolio2
ssuser25d7ff
4-3. jquery
4-3. jquery4-3. jquery
4-3. jquery
JinKyoungHeo
MySQL 覃讌 覿 覦
MySQL  覃讌 覿 覦 MySQL  覃讌 覿 覦
MySQL 覃讌 覿 覦
I Goo Lee
02.ろ蟆 蟲♀(一危一襴)
02.ろ蟆 蟲♀(一危一襴)02.ろ蟆 蟲♀(一危一襴)
02.ろ蟆 蟲♀(一危一襴)
Hankyo
7螳讌 覈 れろ豌
7螳讌  覈  れろ豌7螳讌  覈  れろ豌
7螳讌 覈 れろ豌
Sunggon Song
Nodejs, PhantomJS, casperJs, YSlow, expressjs
Nodejs, PhantomJS, casperJs, YSlow, expressjsNodejs, PhantomJS, casperJs, YSlow, expressjs
Nodejs, PhantomJS, casperJs, YSlow, expressjs
蠍磯
[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍
[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍
[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍
豌 譟
Front-end Development Process - 企蟾讌 螳
Front-end Development Process - 企蟾讌 螳  Front-end Development Process - 企蟾讌 螳
Front-end Development Process - 企蟾讌 螳
JeongHun Byeon
android_thread
android_threadandroid_thread
android_thread
handfoot
Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...
Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...
Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...
Kyuhyun Byun
Db襦蠏碁覦 蟆 れ(131062 ロ)
Db襦蠏碁覦 蟆 れ(131062 ロ)Db襦蠏碁覦 蟆 れ(131062 ロ)
Db襦蠏碁覦 蟆 れ(131062 ロ)
TaekSoon Jang
Presto User & Admin Guide
Presto User & Admin GuidePresto User & Admin Guide
Presto User & Admin Guide
JEONGPHIL HAN
Ji 螳覦 襴觀 (襴狩襦蠏碁襾)
Ji 螳覦 襴觀 (襴狩襦蠏碁襾)Ji 螳覦 襴觀 (襴狩襦蠏碁襾)
Ji 螳覦 襴觀 (襴狩襦蠏碁襾)
beom kyun choi
Secrets of the JavaScript Ninja - Chapter 12. DOM modification
Secrets of the JavaScript Ninja - Chapter 12. DOM modificationSecrets of the JavaScript Ninja - Chapter 12. DOM modification
Secrets of the JavaScript Ninja - Chapter 12. DOM modification
Hyuncheol Jeon
1 Tech Net Sql Server 2005 T Sql Enhancements
1 Tech Net Sql Server 2005 T Sql Enhancements1 Tech Net Sql Server 2005 T Sql Enhancements
1 Tech Net Sql Server 2005 T Sql Enhancements
beamofhope
Spark sql
Spark sqlSpark sql
Spark sql
Internship backend
Internship backendInternship backend
Internship backend
Yein Sim
From MSSQL to MySQL
From MSSQL to MySQLFrom MSSQL to MySQL
From MSSQL to MySQL
I Goo Lee
Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1 覓願鍵(譯) 豕 20170912
Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1  覓願鍵(譯) 豕 20170912Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1  覓願鍵(譯) 豕 20170912
Bigquery airflow襯 伎 一危 覿 ろ 蟲豢 v1 覓願鍵(譯) 豕 20170912
Yooseok Choi
Big data analysis with R and Apache Tajo (in Korean)
Big data analysis with R and Apache Tajo (in Korean)Big data analysis with R and Apache Tajo (in Korean)
Big data analysis with R and Apache Tajo (in Korean)
Gruter
Spring portfolio2
Spring portfolio2Spring portfolio2
Spring portfolio2
ssuser25d7ff
MySQL 覃讌 覿 覦
MySQL  覃讌 覿 覦 MySQL  覃讌 覿 覦
MySQL 覃讌 覿 覦
I Goo Lee
02.ろ蟆 蟲♀(一危一襴)
02.ろ蟆 蟲♀(一危一襴)02.ろ蟆 蟲♀(一危一襴)
02.ろ蟆 蟲♀(一危一襴)
Hankyo
7螳讌 覈 れろ豌
7螳讌  覈  れろ豌7螳讌  覈  れろ豌
7螳讌 覈 れろ豌
Sunggon Song
Nodejs, PhantomJS, casperJs, YSlow, expressjs
Nodejs, PhantomJS, casperJs, YSlow, expressjsNodejs, PhantomJS, casperJs, YSlow, expressjs
Nodejs, PhantomJS, casperJs, YSlow, expressjs
蠍磯
[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍
[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍
[NDC17] Unreal.js - 覦ろ襴渚碁 所 觜襯 UE4 螳覦蠍
豌 譟
Front-end Development Process - 企蟾讌 螳
Front-end Development Process - 企蟾讌 螳  Front-end Development Process - 企蟾讌 螳
Front-end Development Process - 企蟾讌 螳
JeongHun Byeon
android_thread
android_threadandroid_thread
android_thread
handfoot
Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...
Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...
Golang Project Guide from A to Z: From Feature Development to Enterprise Appl...
Kyuhyun Byun
Db襦蠏碁覦 蟆 れ(131062 ロ)
Db襦蠏碁覦 蟆 れ(131062 ロ)Db襦蠏碁覦 蟆 れ(131062 ロ)
Db襦蠏碁覦 蟆 れ(131062 ロ)
TaekSoon Jang
Presto User & Admin Guide
Presto User & Admin GuidePresto User & Admin Guide
Presto User & Admin Guide
JEONGPHIL HAN
Ji 螳覦 襴觀 (襴狩襦蠏碁襾)
Ji 螳覦 襴觀 (襴狩襦蠏碁襾)Ji 螳覦 襴觀 (襴狩襦蠏碁襾)
Ji 螳覦 襴觀 (襴狩襦蠏碁襾)
beom kyun choi
Secrets of the JavaScript Ninja - Chapter 12. DOM modification
Secrets of the JavaScript Ninja - Chapter 12. DOM modificationSecrets of the JavaScript Ninja - Chapter 12. DOM modification
Secrets of the JavaScript Ninja - Chapter 12. DOM modification
Hyuncheol Jeon
1 Tech Net Sql Server 2005 T Sql Enhancements
1 Tech Net Sql Server 2005 T Sql Enhancements1 Tech Net Sql Server 2005 T Sql Enhancements
1 Tech Net Sql Server 2005 T Sql Enhancements
beamofhope
Spark sql
Spark sqlSpark sql
Spark sql
Internship backend
Internship backendInternship backend
Internship backend
Yein Sim

More from HyeonSeok Choi (20)

求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05
HyeonSeok Choi
求==メ求==梶求午メ求 Ch2
求==メ求==梶求午メ求 Ch2求==メ求==梶求午メ求 Ch2
求==メ求==梶求午メ求 Ch2
HyeonSeok Choi
悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2
悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2
悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2
HyeonSeok Choi
=求梶 釈求戟 メ求メ求 =求 Ch04
=求梶 釈求戟 メ求メ求 =求 Ch04=求梶 釈求戟 メ求メ求 =求 Ch04
=求梶 釈求戟 メ求メ求 =求 Ch04
HyeonSeok Choi
求午メ求 ≡求== Ch04
求午メ求 ≡求== Ch04求午メ求 ≡求== Ch04
求午メ求 ≡求== Ch04
HyeonSeok Choi
求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05
HyeonSeok Choi
螻 2
 螻 2 螻 2
螻 2
HyeonSeok Choi
7螳讌 覈 - 一危 覲
7螳讌  覈 - 一危 覲7螳讌  覈 - 一危 覲
7螳讌 覈 - 一危 覲
HyeonSeok Choi
7螳讌 覈 4
7螳讌  覈 47螳讌  覈 4
7螳讌 覈 4
HyeonSeok Choi
Bounded Context
Bounded ContextBounded Context
Bounded Context
HyeonSeok Choi
DDD Repository
DDD RepositoryDDD Repository
DDD Repository
HyeonSeok Choi
DDD Start Ch#3
DDD Start Ch#3DDD Start Ch#3
DDD Start Ch#3
HyeonSeok Choi
求 ≡梶 求梶 メ釈梶 メ Ch8
求 ≡梶 求梶 メ釈梶 メ Ch8求 ≡梶 求梶 メ釈梶 メ Ch8
求 ≡梶 求梶 メ釈梶 メ Ch8
HyeonSeok Choi
求 ≡梶 求梶 メ釈梶 メ Ch7
求 ≡梶 求梶 メ釈梶 メ Ch7求 ≡梶 求梶 メ釈梶 メ Ch7
求 ≡梶 求梶 メ釈梶 メ Ch7
HyeonSeok Choi
る企 覦一磯 ろ 焔 豕 Ch6
る企 覦一磯 ろ 焔 豕 Ch6る企 覦一磯 ろ 焔 豕 Ch6
る企 覦一磯 ろ 焔 豕 Ch6
HyeonSeok Choi
求≡梶求梶戟メ釈梶釈メ Ch1
求≡梶求梶戟メ釈梶釈メ Ch1求≡梶求梶戟メ釈梶釈メ Ch1
求≡梶求梶戟メ釈梶釈メ Ch1
HyeonSeok Choi
HTTP 覯所企 21
HTTP 覯所企 21HTTP 覯所企 21
HTTP 覯所企 21
HyeonSeok Choi
HTTP 覯所企 16
HTTP 覯所企 16HTTP 覯所企 16
HTTP 覯所企 16
HyeonSeok Choi
HTTPS
HTTPSHTTPS
HTTPS
HyeonSeok Choi
HTTP 覯所企 6.
HTTP 覯所企 6.HTTP 覯所企 6.
HTTP 覯所企 6.
HyeonSeok Choi
求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05
HyeonSeok Choi
求==メ求==梶求午メ求 Ch2
求==メ求==梶求午メ求 Ch2求==メ求==梶求午メ求 Ch2
求==メ求==梶求午メ求 Ch2
HyeonSeok Choi
悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2
悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2
悌劃悌仰估梶估≡估メ估梶悌営=估メ悌п釈蔭估≡估估=1.2
HyeonSeok Choi
=求梶 釈求戟 メ求メ求 =求 Ch04
=求梶 釈求戟 メ求メ求 =求 Ch04=求梶 釈求戟 メ求メ求 =求 Ch04
=求梶 釈求戟 メ求メ求 =求 Ch04
HyeonSeok Choi
求午メ求 ≡求== Ch04
求午メ求 ≡求== Ch04求午メ求 ≡求== Ch04
求午メ求 ≡求== Ch04
HyeonSeok Choi
求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05求==メ求==梶求午メ求 Ch05
求==メ求==梶求午メ求 Ch05
HyeonSeok Choi
7螳讌 覈 - 一危 覲
7螳讌  覈 - 一危 覲7螳讌  覈 - 一危 覲
7螳讌 覈 - 一危 覲
HyeonSeok Choi
求 ≡梶 求梶 メ釈梶 メ Ch8
求 ≡梶 求梶 メ釈梶 メ Ch8求 ≡梶 求梶 メ釈梶 メ Ch8
求 ≡梶 求梶 メ釈梶 メ Ch8
HyeonSeok Choi
求 ≡梶 求梶 メ釈梶 メ Ch7
求 ≡梶 求梶 メ釈梶 メ Ch7求 ≡梶 求梶 メ釈梶 メ Ch7
求 ≡梶 求梶 メ釈梶 メ Ch7
HyeonSeok Choi
る企 覦一磯 ろ 焔 豕 Ch6
る企 覦一磯 ろ 焔 豕 Ch6る企 覦一磯 ろ 焔 豕 Ch6
る企 覦一磯 ろ 焔 豕 Ch6
HyeonSeok Choi
求≡梶求梶戟メ釈梶釈メ Ch1
求≡梶求梶戟メ釈梶釈メ Ch1求≡梶求梶戟メ釈梶釈メ Ch1
求≡梶求梶戟メ釈梶釈メ Ch1
HyeonSeok Choi

Apache sqoop

  • 2. 企語 豢豌: siliconweek, <http://www.siliconweek.es/noticias/apache-sqoop-se-convierte-en-proyecto-prioritario-para-big-data-21558> ♀骸 RDBMS 伎 一危磯ゼ ″蠍 Tool Import Export 13 10 7
  • 4. Import Flow 1. JDBC襯 伎伎 誤 企 蟆 2. 貊 貉企 企 3. 襷給Μ ろ 襷 ろ 貎朱Μ襯 ろ螻 貉企 企るゼ 伎 語ろ伎る 讌 13 10 7
  • 5. 貉企 企 public class widgets extends SqoopRecord implements DBWritable, Writable { ... public void readFields(ResultSet __dbResults) throws SQLException { // Importing this.__cur_result_set = __dbResults; this.id = JdbcWritableBridge.readInteger(1, __dbResults); this.widget_name = JdbcWritableBridge.readString(2, __dbResults); this.price = JdbcWritableBridge.readBigDecimal(3, __dbResults); this.design_date = JdbcWritableBridge.readDate(4, __dbResults); this.version = JdbcWritableBridge.readInteger(5, __dbResults); this.design_comment = JdbcWritableBridge.readString(6, __dbResults); } // Exporting public int write(PreparedStatement __dbStmt, int __off) throws SQLException { JdbcWritableBridge.writeInteger(id, 1 + __off, 4, __dbStmt); JdbcWritableBridge.writeString(widget_name, 2 + __off, 12, __dbStmt); JdbcWritableBridge.writeBigDecimal(price, 3 + __off, 3, __dbStmt); JdbcWritableBridge.writeDate(design_date, 4 + __off, 91, __dbStmt); JdbcWritableBridge.writeInteger(version, 5 + __off, 4, __dbStmt); JdbcWritableBridge.writeString(design_comment, 6 + __off, 12, __dbStmt); return 6; } ... } Sqoop 一危磯ゼ 讌/讌 貉企 企るゼ 燕 企襦覿 豢豢 貊襯 讌 13 10 7
  • 6. 焔レ Map Task 覿 焔レ 貎朱Μ襯 れ 碁 覿一貅 詞 Sqoop 企 覃 一危磯ゼ 覿 蟆一 (DataDrivenDBInputFormat) -m 1 旧 覃 1螳 襷 ろ襷 ろ . Ex) 譯狩れ 豕/豕 螳 伎 0 ~ 99,999 螳 螳讌 ID 貉殊願, 5螳 襷牛ろ螳 ろ 蟆曙 螳螳 襷 ろ 螳 貎朱Μ襯 ろ SELECT * FROM widgets WHERE id >=0 AND id < 20000; SELECT * FROM widgets WHERE id >=20000 AND id < 40000; : 13 10 7
  • 7. ETC. 危蠍 WHERE 豢螳 豌 企 朱襷 螳 語 手 一危 語, 一危一 手 る血 蠏狩 蟆 譴. 企ゼ 蠍郁譴 企 襦語るゼ ろ 襷 蟆 讌 覈 讌 覈襯 焔レ レ . 企 讌 覈 一危 覯伎れ 讌 伎 (ex: mysqldump ...) 13 10 7
  • 9. Export Flow 1. JDBC襯 伎伎 企 蟆 2. 貊 貉企 企 3. 襷給Μ ろ INSET 覓語 襷れ伎 企 れ 貊襯 豢螳 13 10 7
  • 10. ETC. 旧ろ語 碁 襦語れ 覲煙朱 誤 旧ろ碁 朱 企讌 . ( ろ 蟆郁骸 るジ ろ螳 蠍 谿語^ ) 企ゼ 襾殊 企 旧ろ , ′ 譬襭 碁朱 覈 企襦 蟾 (staging-table 旧) 讌 覈 旧ろ 讌 覈襯 旧 焔レ レ . 企 讌 覈 一危 覯 伎れ 讌 伎 (ex: mysqlimport ...) 13 10 7
  • 11. References Tom White (2013). 覯所企. (蠍, 蟾, 蟾). : 觜覩碁. (豢 2012) 13 10 7