際際滷

際際滷Share a Scribd company logo
SDEC2011 Rapidant
S/W 蠍磯 螻   
(Rapidant)




rapidant@samsung.com


 2011.6.




                       Copyright  2010 Samsung SDS Co., Ltd. All rights reserved
螻   競?
磯Μ讌 誤磯血 蟯貅企企殊
100Mbps 螳 る謂




      100Mbps 1豐  12MB 殊 れ企
れ  螳 3.77 MB/sec 覦
れ る ?
豌  ′螳
 ш ?
覘螳 覓語蠍碁?
- 覯 螻朱矧
覘螳 覓語蠍碁?
- 覯 螻朱矧
- ろ語  覈 覈
覘螳 覓語蠍碁?
- 覯 螻朱矧
- ろ語  覈 覈
- TCP/IP 襦貊 覓語
朱一: Aspera
TCP 襦貊 RTT  Packet Loss 螳  蟆讌螳 旧 伎
朱 譬讌  焔レ 覲伎碁


 RTT (Round Trip Time)
TCP螳 ?
- AIMD
  (Additive Increase /
    Multiplicative Decrease)
Congestion Control



A


        Congestion Control
                             Internet

B                                       D

        Congestion Control


    C
企ゼ 願屋蠍  蠍一ヾ 覦覯
-  蠍磯 WAN 螳蠍
- 貉る  FastTCP 
- CDN襷 
-  蟲豢
SDEC2011 Rapidant
蠍一ヾ覦覯           轟              レ              


 蠍磯         蠍磯 螳      一危             れ觜 
WAN 螳蠍         螳            Deduplication   Cache讌  貉豸
                                螳             伎 螳焔レ
                                               伎
貉る  FastTCP   貉る 豌伎      TCP friendly    讌  ル(
                                             覯,企殊伎誤)  
                                               覃願豌 觜企

CDN襷         螳 蟇一覲 edge覯襯   蟇一覲 覯襯         螻螳 企
               螻 貉豸 覿覦       牛 覓朱Μ         譯朱 Cache 貉豸襯
                               ′螳 豢         朱 

 蟲豢          螳 襷     襷 磯ジ         螻螳
               蟲豢               襷         れ螳  覈詞
                                              覓語 蠏碁襦 譟伎
磯Μ 蠏
- ろ語 蟲豢 觜 襦!
-  蟲 觜 襦!
- OS 貉る   れ 觜 襦!
- 觜 豕 企慨!
S/W 蠍磯 螻 
 (Rapidant)
Hardware based accelerator




                 Internet




                            No Hardware !!
-  觜譬  襦貊 豢蟲
Parallel TCP
 - 一危 ′  TCP豈 , 
  豈   ° 
       W/2               W/(2N)




貉 :   豕 ろ語 
觜 1螳 :  TCP豈   覈
Parallel TCP
  Single Channel TCP(蠍一ヾ覦)                      Parallel TCP

 Sender               Receiver         Sender                  Receiver


- 一危    豈                   - 一危   れ 豈 
- 蟇磯Μ ろ語                         - 蟇磯Μ ろ語 
  (RTT 紊, Packet Loss 紊)  TCP 螻     (RTT 紊, Packet Loss 紊)  殊
   殊′ 螻襴讀   殊                  覦 ′襯 譴企 觜
  覦   覯                         N螳 れ豈 蟆曙 1/(2N) 
  (Congestion Window)  遜  ′       伎 朱 蠍一ヾ覦 觜
   譴                                 ろ語 殊 覦 °一危磯ゼ
-磯殊, ′(Throughput)                譴企 觜 
 れ 螳   觜                 - 磯殊, ′(Throughput)
 覈詩                                   れ 螳      蟆
                                      螳ロ
Reliable UDP
- 一危 襤一 覦 殊 (Congestion
Control)  UDP 一危 襤一 豢螳
覦 螻 ′ 螳ロ 殊″ 螻襴讀
朱 讌 蟲
Reliable UDP
- 一危  襤一 螻
   : る 血  蠍磯レ 螳讌.
    (UDP 蠍磯蓋朱  血  螻 )

- Rate-based   螻襴讀 
   : ろ語  磯 朱 ° 危.
   (ろ語 殊′ 狩 ,  朱 蟆 .)
   : TCP  螻 殊′ 螻襴讀 磯ゴ讌 朱襦 襦
        螳

- Fairness 螻
   :   螻旧 碁所 fairness襯 螻ろ.
    ( 碁曙  觜ろ 襷  螳)
Parallel TCP                   Reliable UDP
- 蠍磯蓋 殊′ 螻襴讀朱 AIMD     - TCP 覦 觜 碁 殊′ 螳
  襯 覩襦 朱 UDP
  觜伎 TCP Friendly        -覲 郁屋 覩襦 朱 Parallel
  ( TCP 碁 ′ 螳ロ 覯     TCP 蟆曙 觜 覃覈襴  
   覲伎)
                            -UDP 螻 轟煙朱 誤 朱
-TCP 蠍磯企襦 HTTP 煙 牛      TCP 碁曙  譬 Aggressive
 朱 覦覯 糾骸 襴               ( TCP 碁曙   る
                              襯 )
-UDP 覦 觜 碁 殊′ 覃貉る
 讀 蟲蠍                 -朱 譟郁唄 TCP 觜 觜襴
                             (, ろ語 蟆曙 磯 殊  )
-朱 譟郁唄 UDP 觜 襴
 (, ろ語 蟆曙 磯 殊  ) - 覦覯 糾骸 朱 覿襴
襷 S/W襷 れ覃 
螳 觜殊蟾 ?
蟯 蠍一 
 襭
- Aspera
-讌豁 BI.DAN-GUN


ろ 襦
- UDT4
- RBUDP
- FDT
- GridFTP
Congestion Control

Queuing Delay based
RTT 覲襯 牛 Congestion 螻
Bottleneck  伎 覲襯 豸″  
′^  覦覯


Packet Loss based
  れ Congestion覿  讌襦
手  ′ 譟一 覦覯
螳 襭 覲 觜蟲
襭 覈      °逢       殊′            觜螻

Aspera     UDP        Queuing Delay   ろ語 Fairness螻
                                      
UDT4       UDP        Packet Loss     TCP 殊′ 襷
                                      貉る讀 
RBUDP      UDP        N/A             ろ語 Fairness
                                      螻 
GridFTP    TCP        Parallel TCP    ろ語 Fairness
                                      TCP螻襴讀 磯
Rapidant   UDP, TCP   Packet Loss     ろ語 Fairness
                      Parallel TCP    螻,  襴曙
                                      り
 Avatar 覲  




        FTP 觜 豕 ′ 谿 30覦
          : 2TB
         FTP : 0.187MB/s (131 days)
         Aspera : 5.6MB/s (4 days)

                           Aspera
High Energy Physics Experiment

                        1 覦危 ′ FTP襦
                        9譯


Cern, れ




 : 1TB
FTP : 0.195MB/s (62 days)
GridFTP : 6MB/s (2 days)            GridFTP
 覿 一危



                        碁 800蠍郁 覦危


伎 lab




 : 1TB
FTP : 1.82MB/s (6.6)
Rapidant : 9.74MB/s (1.2)     Rapidant
S/W蠍磯 螻′ 一 
  企瑚?
Digital Media
-Broadcast & Entertainment Media
-Multimedia Publishing


Game & Software Development
-Global Software Development
-Rapid Game Development

Cloud Computing
-Content Aggregation, Distribution
-Database Hosting

Global Enterprise
-Data Processing Outsourcing
-High Speed Remote Backups
-Digital Asset Distribution

Life Sciences
Intelligence & Defense
Rapidant 焔レ 企蟾?
ろ 蟆
-WAN 覡危
(Packet Loss: 0.1%, 1.0%, 5%
 RTT: 100 ms, 300 ms, 100MB)
- 蟆 ろ
( -> 覩瑚記 North Virginia 
襷譟 EC2, 100MB, 1G )
襦貊覲 ′焔 觜蟲 [WAN Simulator : RTT 100ms, 100MB ]


                                                                        3,311豐
         FTP                              1,234豐
                            423豐

                                 681豐
         UDT          203豐
                    56豐
                                                                           Packet loss
                    19豐
     ASPERA         32豐                                                          5%
                     55豐                                                         1%
                                                                                 0.1%
                      206豐
 Rapidant-TCP       78豐
                    50豐

                    18豐
Rapidant-UDP        16豐
                    13豐


                0          500     1000    1500    2000   2500   3000   3500 螳(豐)
襦貊覲 ′焔 觜蟲 [WAN Simulator : RTT 300ms, 100MB]


                                                           8,925豐
         FTP                        3,482豐
                          1,338豐

                         1,173豐
         UDT         291豐
                    59豐
                                                                    Packet loss
                    25豐
     ASPERA         22豐                                                5%
                    48豐                                                1%

                      383豐                                             0.1%
 Rapidant-TCP        225豐
                    74豐

                    35豐
Rapidant-UDP        29豐
                    63豐


                0            2000   4000     6000   8000    10000    螳(豐)
襦貊覲 ′焔 觜蟲 [->EC2 : RTT 240ms]


                                                        1,028豐
        FTP
                     99豐


                                      500豐
      Aspera
                   52豐                                           ′

                                                                   1GB
                                       553豐                        100MB
Rapidant-UDP
                    57豐


                         130豐
Rapidant-TCP
                   20豐


               0         200    400    600    800   1,000   1,200 螳(豐)

       Seoul, Korea Rep. to North Virginia, US. ( RTT : 240ms )
朱 TCP Architecture
朱  




                  WAN 蟲螳 螳
Edge Server
                              Edge Server
 HDFS
                               HDFS
Contents Server
                              Contents Server
れ 襭 覦
     覯       覯



     S/W れ


              覯
PC


蟇一 ろ 誤壱伎 覦




              朱 覈 S/W磯(Open API)
DEMO

FTP / Rapidant 100MB    觜蟲
(貊 -> 覩瑚記 North Virginia  )
螳
rapidant@samsung.com
Ad

Recommended

ろ語 蠍磯蓋
ろ語 蠍磯蓋
TOAST_NHNent
ろ碁Μ覦 襦貊
ろ碁Μ覦 襦貊
greenday96
[2018] Java襯 , Java 蟲
[2018] Java襯 , Java 蟲
NHN FORWARD
弮一2013 workflow蠍磯 れ螳 ろ碁Μ覦一危 讌 覦 覿 覦襭
弮一2013 workflow蠍磯 れ螳 ろ碁Μ覦一危 讌 覦 覿 覦襭
choi kyumin
Wire shark 覯 覦 ろ語 螳襦 伎 る
Wire shark 覯 覦 ろ語 螳襦 伎 る
[2018] NHN 覈磯 覩碁 for 誤 讌
[2018] NHN 覈磯 覩碁 for 誤 讌
NHN FORWARD
蠍襦覯 覈覦 ろ語 蟆 危 Understanding global mobile network situation
蠍襦覯 覈覦 ろ語 蟆 危 Understanding global mobile network situation
Jonghyon Sohn
覯 誤朱ゼ讌燕蠍一(1.3,1.4)
覯 誤朱ゼ讌燕蠍一(1.3,1.4)
Choonghyun Yang
晦4蟲′襭
晦4蟲′襭
guesta6ecae
KGC 2014: 企殊伎誤 螳覦襯 貉危 ろ語 蠍一 覦壱讌
KGC 2014: 企殊伎誤 螳覦襯 貉危 ろ語 蠍一 覦壱讌
Hyunjik Bae
[242]open stack neutron dataplane п
[242]open stack neutron dataplane п
NAVER D2
[梶] TCP, 求梶 求氏=!?
[梶] TCP, 求梶 求氏=!?
覩 覦
[2018] 壱語 焔 豕
[2018] 壱語 焔 豕
NHN FORWARD
Kafka 襭 v0.1
Kafka 襭 v0.1
Hyosang Hong
Ch01 ろ語+貅+襦蠏碁覦+[誤+覈]
Ch01 ろ語+貅+襦蠏碁覦+[誤+覈]
讌 蟾
Before OTD EDU Assignments
Before OTD EDU Assignments
Beom Lee
KGC 2014: 覿 蟆 覯 蟲譟磯
KGC 2014: 覿 蟆 覯 蟲譟磯
Hyunjik Bae
血 螻殊
血 螻殊
煙 蟾
GOTHAM 梶 梶求 梶梶衣 ≡求
GOTHAM 梶 梶求 梶梶衣 ≡求
Kyunghee Univ
TCP/IP 覦襭 - 蟾一
TCP/IP 覦襭 - 蟾一
Yeon Soo Kim
Aspera product introduce
Aspera product introduce
bds2
る誤 殊 蟆 螻ろ伎 蟆
る誤 殊 蟆 螻ろ伎 蟆
Hyunjik Bae
蠍襦覯 蟆 一広螻 Cdn .pdf
蠍襦覯 蟆 一広螻 Cdn .pdf
Hana Lee
No trade-offs: 螻, 觜襯願, ろ語 蟲豢蠍 / Building secure, fast, and reliabl...
No trade-offs: 螻, 觜襯願, ろ語 蟲豢蠍 / Building secure, fast, and reliabl...
Jean Ryu
=≡ Web proxy_≡=_2006п11_pas_ktf
=≡ Web proxy_≡=_2006п11_pas_ktf
Daehee Han
襷譴襴曙 螳譬 : 4螳 (螳ル)
襷譴襴曙 螳譬 : 4螳 (螳ル)
nnforum
AWS 蟆 觜 豕 覦 :: 覦 :: AWS Summit Seoul 2016
AWS 蟆 觜 豕 覦 :: 覦 :: AWS Summit Seoul 2016
Amazon Web Services Korea
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
NAT and Hole Punching_SYS4U I&C
NAT and Hole Punching_SYS4U I&C
sys4u

More Related Content

What's hot (12)

晦4蟲′襭
晦4蟲′襭
guesta6ecae
KGC 2014: 企殊伎誤 螳覦襯 貉危 ろ語 蠍一 覦壱讌
KGC 2014: 企殊伎誤 螳覦襯 貉危 ろ語 蠍一 覦壱讌
Hyunjik Bae
[242]open stack neutron dataplane п
[242]open stack neutron dataplane п
NAVER D2
[梶] TCP, 求梶 求氏=!?
[梶] TCP, 求梶 求氏=!?
覩 覦
[2018] 壱語 焔 豕
[2018] 壱語 焔 豕
NHN FORWARD
Kafka 襭 v0.1
Kafka 襭 v0.1
Hyosang Hong
Ch01 ろ語+貅+襦蠏碁覦+[誤+覈]
Ch01 ろ語+貅+襦蠏碁覦+[誤+覈]
讌 蟾
Before OTD EDU Assignments
Before OTD EDU Assignments
Beom Lee
KGC 2014: 覿 蟆 覯 蟲譟磯
KGC 2014: 覿 蟆 覯 蟲譟磯
Hyunjik Bae
血 螻殊
血 螻殊
煙 蟾
GOTHAM 梶 梶求 梶梶衣 ≡求
GOTHAM 梶 梶求 梶梶衣 ≡求
Kyunghee Univ
TCP/IP 覦襭 - 蟾一
TCP/IP 覦襭 - 蟾一
Yeon Soo Kim
晦4蟲′襭
晦4蟲′襭
guesta6ecae
KGC 2014: 企殊伎誤 螳覦襯 貉危 ろ語 蠍一 覦壱讌
KGC 2014: 企殊伎誤 螳覦襯 貉危 ろ語 蠍一 覦壱讌
Hyunjik Bae
[242]open stack neutron dataplane п
[242]open stack neutron dataplane п
NAVER D2
[梶] TCP, 求梶 求氏=!?
[梶] TCP, 求梶 求氏=!?
覩 覦
[2018] 壱語 焔 豕
[2018] 壱語 焔 豕
NHN FORWARD
Ch01 ろ語+貅+襦蠏碁覦+[誤+覈]
Ch01 ろ語+貅+襦蠏碁覦+[誤+覈]
讌 蟾
Before OTD EDU Assignments
Before OTD EDU Assignments
Beom Lee
KGC 2014: 覿 蟆 覯 蟲譟磯
KGC 2014: 覿 蟆 覯 蟲譟磯
Hyunjik Bae
血 螻殊
血 螻殊
煙 蟾
GOTHAM 梶 梶求 梶梶衣 ≡求
GOTHAM 梶 梶求 梶梶衣 ≡求
Kyunghee Univ
TCP/IP 覦襭 - 蟾一
TCP/IP 覦襭 - 蟾一
Yeon Soo Kim

Similar to SDEC2011 Rapidant (20)

Aspera product introduce
Aspera product introduce
bds2
る誤 殊 蟆 螻ろ伎 蟆
る誤 殊 蟆 螻ろ伎 蟆
Hyunjik Bae
蠍襦覯 蟆 一広螻 Cdn .pdf
蠍襦覯 蟆 一広螻 Cdn .pdf
Hana Lee
No trade-offs: 螻, 觜襯願, ろ語 蟲豢蠍 / Building secure, fast, and reliabl...
No trade-offs: 螻, 觜襯願, ろ語 蟲豢蠍 / Building secure, fast, and reliabl...
Jean Ryu
=≡ Web proxy_≡=_2006п11_pas_ktf
=≡ Web proxy_≡=_2006п11_pas_ktf
Daehee Han
襷譴襴曙 螳譬 : 4螳 (螳ル)
襷譴襴曙 螳譬 : 4螳 (螳ル)
nnforum
AWS 蟆 觜 豕 覦 :: 覦 :: AWS Summit Seoul 2016
AWS 蟆 觜 豕 覦 :: 覦 :: AWS Summit Seoul 2016
Amazon Web Services Korea
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
NAT and Hole Punching_SYS4U I&C
NAT and Hole Punching_SYS4U I&C
sys4u
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
[ろれ雑ろ]朱酔 on AWS
[ろれ雑ろ]朱酔 on AWS
Ji-Woong Choi
Quality of Service
Quality of Service
ろ語 蠍磯 旧 覦 螻豸 蟲譟_Wh apm
ろ語 蠍磯 旧 覦 螻豸 蟲譟_Wh apm
LTM
LTM
itian-f5
濠鍵覦蟆螳 2010 CPD
濠鍵覦蟆螳 2010 CPD
! AWS 觜, 襴″ AWS 觜 蟆一企襴暑. - 譴 谿, NDS :: AWS Summit Seoul 2019
! AWS 觜, 襴″ AWS 觜 蟆一企襴暑. - 譴 谿, NDS :: AWS Summit Seoul 2019
Amazon Web Services Korea
殊 覦 螻旧 覓 襭 - CrushFTP (SFTP 覯) (old version)
殊 覦 螻旧 覓 襭 - CrushFTP (SFTP 覯) (old version)
レ讀
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
ShieldOne UTM + 覓伎AP 螳 v1.0
ShieldOne UTM + 覓伎AP 螳 v1.0
PLUS-i_dev
Aspera product introduce
Aspera product introduce
bds2
る誤 殊 蟆 螻ろ伎 蟆
る誤 殊 蟆 螻ろ伎 蟆
Hyunjik Bae
蠍襦覯 蟆 一広螻 Cdn .pdf
蠍襦覯 蟆 一広螻 Cdn .pdf
Hana Lee
No trade-offs: 螻, 觜襯願, ろ語 蟲豢蠍 / Building secure, fast, and reliabl...
No trade-offs: 螻, 觜襯願, ろ語 蟲豢蠍 / Building secure, fast, and reliabl...
Jean Ryu
=≡ Web proxy_≡=_2006п11_pas_ktf
=≡ Web proxy_≡=_2006п11_pas_ktf
Daehee Han
襷譴襴曙 螳譬 : 4螳 (螳ル)
襷譴襴曙 螳譬 : 4螳 (螳ル)
nnforum
AWS 蟆 觜 豕 覦 :: 覦 :: AWS Summit Seoul 2016
AWS 蟆 觜 豕 覦 :: 覦 :: AWS Summit Seoul 2016
Amazon Web Services Korea
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
NAT and Hole Punching_SYS4U I&C
NAT and Hole Punching_SYS4U I&C
sys4u
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
[ろれ雑ろ]朱酔 on AWS
[ろれ雑ろ]朱酔 on AWS
Ji-Woong Choi
Quality of Service
Quality of Service
ろ語 蠍磯 旧 覦 螻豸 蟲譟_Wh apm
ろ語 蠍磯 旧 覦 螻豸 蟲譟_Wh apm
濠鍵覦蟆螳 2010 CPD
濠鍵覦蟆螳 2010 CPD
! AWS 觜, 襴″ AWS 觜 蟆一企襴暑. - 譴 谿, NDS :: AWS Summit Seoul 2019
! AWS 觜, 襴″ AWS 觜 蟆一企襴暑. - 譴 谿, NDS :: AWS Summit Seoul 2019
Amazon Web Services Korea
殊 覦 螻旧 覓 襭 - CrushFTP (SFTP 覯) (old version)
殊 覦 螻旧 覓 襭 - CrushFTP (SFTP 覯) (old version)
レ讀
SFTP 覯 襭 - CrushFTP - old version
SFTP 覯 襭 - CrushFTP - old version
レ讀
ShieldOne UTM + 覓伎AP 螳 v1.0
ShieldOne UTM + 覓伎AP 螳 v1.0
PLUS-i_dev
Ad

More from Korea Sdec (16)

SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuer
Korea Sdec
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestion
Korea Sdec
SDEC2011 Introducing Hadoop
SDEC2011 Introducing Hadoop
Korea Sdec
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoop
Korea Sdec
SDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modelling
Korea Sdec
SDEC2011 Essentials of Pig
SDEC2011 Essentials of Pig
Korea Sdec
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of Mahout
Korea Sdec
SDEC2011 Essentials of Hive
SDEC2011 Essentials of Hive
Korea Sdec
SDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and models
Korea Sdec
Sdec2011 Introducing Hadoop
Sdec2011 Introducing Hadoop
Korea Sdec
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
Korea Sdec
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the why
Korea Sdec
SDEC2011 Going by TACC
SDEC2011 Going by TACC
Korea Sdec
SDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & Experiences
Korea Sdec
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speed
Korea Sdec
SDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloud
Korea Sdec
SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuer
Korea Sdec
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestion
Korea Sdec
SDEC2011 Introducing Hadoop
SDEC2011 Introducing Hadoop
Korea Sdec
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoop
Korea Sdec
SDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modelling
Korea Sdec
SDEC2011 Essentials of Pig
SDEC2011 Essentials of Pig
Korea Sdec
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of Mahout
Korea Sdec
SDEC2011 Essentials of Hive
SDEC2011 Essentials of Hive
Korea Sdec
SDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and models
Korea Sdec
Sdec2011 Introducing Hadoop
Sdec2011 Introducing Hadoop
Korea Sdec
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
Korea Sdec
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the why
Korea Sdec
SDEC2011 Going by TACC
SDEC2011 Going by TACC
Korea Sdec
SDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & Experiences
Korea Sdec
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speed
Korea Sdec
SDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloud
Korea Sdec
Ad

SDEC2011 Rapidant

  • 2. S/W 蠍磯 螻 (Rapidant) rapidant@samsung.com 2011.6. Copyright 2010 Samsung SDS Co., Ltd. All rights reserved
  • 3. 競?
  • 4. 磯Μ讌 誤磯血 蟯貅企企殊 100Mbps 螳 る謂 100Mbps 1豐 12MB 殊 れ企
  • 5. れ 螳 3.77 MB/sec 覦 れ る ?
  • 6. 豌 ′螳 ш ?
  • 8. 覘螳 覓語蠍碁? - 覯 螻朱矧 - ろ語 覈 覈
  • 9. 覘螳 覓語蠍碁? - 覯 螻朱矧 - ろ語 覈 覈 - TCP/IP 襦貊 覓語
  • 10. 朱一: Aspera TCP 襦貊 RTT Packet Loss 螳 蟆讌螳 旧 伎 朱 譬讌 焔レ 覲伎碁 RTT (Round Trip Time)
  • 11. TCP螳 ? - AIMD (Additive Increase / Multiplicative Decrease)
  • 12. Congestion Control A Congestion Control Internet B D Congestion Control C
  • 13. 企ゼ 願屋蠍 蠍一ヾ 覦覯 - 蠍磯 WAN 螳蠍 - 貉る FastTCP - CDN襷 - 蟲豢
  • 15. 蠍一ヾ覦覯 轟 レ 蠍磯 蠍磯 螳 一危 れ觜 WAN 螳蠍 螳 Deduplication Cache讌 貉豸 螳 伎 螳焔レ 伎 貉る FastTCP 貉る 豌伎 TCP friendly 讌 ル( 覯,企殊伎誤) 覃願豌 觜企 CDN襷 螳 蟇一覲 edge覯襯 蟇一覲 覯襯 螻螳 企 螻 貉豸 覿覦 牛 覓朱Μ 譯朱 Cache 貉豸襯 ′螳 豢 朱 蟲豢 螳 襷 襷 磯ジ 螻螳 蟲豢 襷 れ螳 覈詞 覓語 蠏碁襦 譟伎
  • 16. 磯Μ 蠏 - ろ語 蟲豢 觜 襦! - 蟲 觜 襦! - OS 貉る れ 觜 襦! - 觜 豕 企慨!
  • 17. S/W 蠍磯 螻 (Rapidant)
  • 18. Hardware based accelerator Internet No Hardware !!
  • 19. - 觜譬 襦貊 豢蟲
  • 20. Parallel TCP - 一危 ′ TCP豈 , 豈 ° W/2 W/(2N) 貉 : 豕 ろ語 觜 1螳 : TCP豈 覈
  • 21. Parallel TCP Single Channel TCP(蠍一ヾ覦) Parallel TCP Sender Receiver Sender Receiver - 一危 豈 - 一危 れ 豈 - 蟇磯Μ ろ語 - 蟇磯Μ ろ語 (RTT 紊, Packet Loss 紊) TCP 螻 (RTT 紊, Packet Loss 紊) 殊 殊′ 螻襴讀 殊 覦 ′襯 譴企 觜 覦 覯 N螳 れ豈 蟆曙 1/(2N) (Congestion Window) 遜 ′ 伎 朱 蠍一ヾ覦 觜 譴 ろ語 殊 覦 °一危磯ゼ -磯殊, ′(Throughput) 譴企 觜 れ 螳 觜 - 磯殊, ′(Throughput) 覈詩 れ 螳 蟆 螳ロ
  • 22. Reliable UDP - 一危 襤一 覦 殊 (Congestion Control) UDP 一危 襤一 豢螳 覦 螻 ′ 螳ロ 殊″ 螻襴讀 朱 讌 蟲
  • 23. Reliable UDP - 一危 襤一 螻 : る 血 蠍磯レ 螳讌. (UDP 蠍磯蓋朱 血 螻 ) - Rate-based 螻襴讀 : ろ語 磯 朱 ° 危. (ろ語 殊′ 狩 , 朱 蟆 .) : TCP 螻 殊′ 螻襴讀 磯ゴ讌 朱襦 襦 螳 - Fairness 螻 : 螻旧 碁所 fairness襯 螻ろ. ( 碁曙 觜ろ 襷 螳)
  • 24. Parallel TCP Reliable UDP - 蠍磯蓋 殊′ 螻襴讀朱 AIMD - TCP 覦 觜 碁 殊′ 螳 襯 覩襦 朱 UDP 觜伎 TCP Friendly -覲 郁屋 覩襦 朱 Parallel ( TCP 碁 ′ 螳ロ 覯 TCP 蟆曙 觜 覃覈襴 覲伎) -UDP 螻 轟煙朱 誤 朱 -TCP 蠍磯企襦 HTTP 煙 牛 TCP 碁曙 譬 Aggressive 朱 覦覯 糾骸 襴 ( TCP 碁曙 る 襯 ) -UDP 覦 觜 碁 殊′ 覃貉る 讀 蟲蠍 -朱 譟郁唄 TCP 觜 觜襴 (, ろ語 蟆曙 磯 殊 ) -朱 譟郁唄 UDP 觜 襴 (, ろ語 蟆曙 磯 殊 ) - 覦覯 糾骸 朱 覿襴
  • 25. 襷 S/W襷 れ覃 螳 觜殊蟾 ?
  • 26. 蟯 蠍一 襭 - Aspera -讌豁 BI.DAN-GUN ろ 襦 - UDT4 - RBUDP - FDT - GridFTP
  • 27. Congestion Control Queuing Delay based RTT 覲襯 牛 Congestion 螻 Bottleneck 伎 覲襯 豸″ ′^ 覦覯 Packet Loss based れ Congestion覿 讌襦 手 ′ 譟一 覦覯
  • 28. 螳 襭 覲 觜蟲 襭 覈 °逢 殊′ 觜螻 Aspera UDP Queuing Delay ろ語 Fairness螻 UDT4 UDP Packet Loss TCP 殊′ 襷 貉る讀 RBUDP UDP N/A ろ語 Fairness 螻 GridFTP TCP Parallel TCP ろ語 Fairness TCP螻襴讀 磯 Rapidant UDP, TCP Packet Loss ろ語 Fairness Parallel TCP 螻, 襴曙 り
  • 29. Avatar 覲 FTP 觜 豕 ′ 谿 30覦 : 2TB FTP : 0.187MB/s (131 days) Aspera : 5.6MB/s (4 days) Aspera
  • 30. High Energy Physics Experiment 1 覦危 ′ FTP襦 9譯 Cern, れ : 1TB FTP : 0.195MB/s (62 days) GridFTP : 6MB/s (2 days) GridFTP
  • 31. 覿 一危 碁 800蠍郁 覦危 伎 lab : 1TB FTP : 1.82MB/s (6.6) Rapidant : 9.74MB/s (1.2) Rapidant
  • 33. Digital Media -Broadcast & Entertainment Media -Multimedia Publishing Game & Software Development -Global Software Development -Rapid Game Development Cloud Computing -Content Aggregation, Distribution -Database Hosting Global Enterprise -Data Processing Outsourcing -High Speed Remote Backups -Digital Asset Distribution Life Sciences Intelligence & Defense
  • 35. ろ 蟆 -WAN 覡危 (Packet Loss: 0.1%, 1.0%, 5% RTT: 100 ms, 300 ms, 100MB) - 蟆 ろ ( -> 覩瑚記 North Virginia 襷譟 EC2, 100MB, 1G )
  • 36. 襦貊覲 ′焔 觜蟲 [WAN Simulator : RTT 100ms, 100MB ] 3,311豐 FTP 1,234豐 423豐 681豐 UDT 203豐 56豐 Packet loss 19豐 ASPERA 32豐 5% 55豐 1% 0.1% 206豐 Rapidant-TCP 78豐 50豐 18豐 Rapidant-UDP 16豐 13豐 0 500 1000 1500 2000 2500 3000 3500 螳(豐)
  • 37. 襦貊覲 ′焔 觜蟲 [WAN Simulator : RTT 300ms, 100MB] 8,925豐 FTP 3,482豐 1,338豐 1,173豐 UDT 291豐 59豐 Packet loss 25豐 ASPERA 22豐 5% 48豐 1% 383豐 0.1% Rapidant-TCP 225豐 74豐 35豐 Rapidant-UDP 29豐 63豐 0 2000 4000 6000 8000 10000 螳(豐)
  • 38. 襦貊覲 ′焔 觜蟲 [->EC2 : RTT 240ms] 1,028豐 FTP 99豐 500豐 Aspera 52豐 ′ 1GB 553豐 100MB Rapidant-UDP 57豐 130豐 Rapidant-TCP 20豐 0 200 400 600 800 1,000 1,200 螳(豐) Seoul, Korea Rep. to North Virginia, US. ( RTT : 240ms )
  • 40. WAN 蟲螳 螳 Edge Server Edge Server HDFS HDFS Contents Server Contents Server
  • 41. れ 襭 覦 覯 覯 S/W れ 覯 PC 蟇一 ろ 誤壱伎 覦 朱 覈 S/W磯(Open API)
  • 42. DEMO FTP / Rapidant 100MB 觜蟲 (貊 -> 覩瑚記 North Virginia )