端端舝

0Copyright?2015 NTT corp. All Rights Reserved.
嗨捩嗨鬼卞方月詢厒戊件氾瓜生永玄伐奈平件弘
2017/10/31
゜掀秷珩
Lagopus User Community
0

? 議奶矛件玄卞化
゜掀☆斮�卅氏匹允互ㄛDPDK毛勾井勻凶戊件氾瓜失皿伉毛妏勻化月源勻化仍湔
眭卅中匹允井ˋ★
ゴ痰今氏☆卅氏匹允井公木ˋ★
゜掀☆DPDK勻化中丹生永玄伐奈弁毛詢厒趙允月仿奶皮仿伉互丐勻化ㄛ扂〝匹嶱
逃仄化中月末白玄它尼失旦奶永民互公及DPDK匹戊件氾瓜卞勾卅互月氏匹允互ㄛ
戊件氾瓜匹DPDK妏勻化月��凶仇午卅中及匹抻仄化中月氏匹允★
ゴ痰今氏☆��仄日卅中及匹Container SIG匹逃桶仄引六氏井ˋ★
゜掀☆云�★
踏゜及逃桶及磊�

Lagopus
?OpenFlow旦奶永民及末白玄它尼失灍蚾
?𡘙蚚x86扔奈田匹�釬褫夔
?OSS午仄化鼠嶱 (2014爛1堎 0.1.x 鼠嶱, 2015爛8堎 0.2.x 鼠嶱)
?詢厒卅由弗永玄�I燴午盟𣷣中皿伕玄戊伙卞�𡛟
?> 10Gbps
?OpenFlow1.3ㄚtunneling
OpenFlow 戊件玄伕奈仿
戊件玄伕奈伙皿伊奈件
OpenFlow
皿伕玄戊伙
OpenFlow 旦奶永民
犯奈正皿伊奈件
Flow Table
白伕奈由正奈件失弁扑亦件
白伕奈由正奈件失弁扑亦件市它件正奈
市它件正奈
Flow
Table
#2
Flow
Table
#3
Flow
Table
#4

俶夔啐�
? �g�卅禾奈玄白巧伐奈玉毛灍囥仄凶�磁及旦伙奈皿永玄毛䛐隅
CPU
E5-2697v2
2.70GHz
NIC Intel X520
丟乒伉 64GB OS Ubuntu 14.04LTS
CPU
E5-2667v3
3.20GHz
NIC Intel XL710
丟乒伉 64GB OS Ubuntu 14.04LTS
? 10GbE
? 䛐隅虐噫
? 䛐隅磐彆
? 40GbE
? 䛐隅虐噫
? 䛐隅磐彆
6.66
8.65
9.28 9.49 9.63 9.77 9.83 9.85 9.86
0
1
2
3
4
5
6
7
8
9
10
0 200 400 600 800 1000 1200 1400
Throughput(Gbps)
Packet size (byte)
Lagopus
Wire-rate
7.7
15.5
26.5
34.2
39.2 39.5
0
5
10
15
20
25
30
35
40
0 200 400 600 800 1000 1200 1400
Throughput(Gbps)
Packet size (byte)
Lagopus
Wire-rate

? DPDK午反
? DPDK卞方月�砑虐噫午及諉適
? �砑穴扑件
? 戊件氾瓜
? DPDK�𡛟及末白玄它尼失旦奶永民午戊件氾瓜諉適
Agenda

? 詢俶夔籵陓毛褫夔午允月由弗永玄�I燴白伊奈丞伐奈弁
? 暫湔白伊奈丞伐奈弁卞方月�冞及示玄伙生永弁毛賤秏
? 丟乒伉戊疋奈
? 賃曰煋心
? 戊件氾平旦玄旦奶永民
? TLB立旦
? ㄗCPU core及ㄘ平乓永扑亙立旦
DPDK (Data Plane Development Kit)
↙ 市奈生伙毛田奶由旦
↙ 禾奈伉件弘�釬
↙ 戊失毛�衄今六月
↙ Hugepage及瞳蚚
↙ 黃赻及丟乒伉奪燴辻�

市奈生伙田奶由旦
NIC
skb_buf
Ethernet Driver API
Socket API
vswitch
packet
buffer
Data plane
1. Interrupt
& DMA
2. system call (read)
User
space
Kernel space
Driver
4. DMA
3. system call (write)
NIC
Ethernet Driver API
Socket API
vswitch
packet
buffer
agentagent
1. DMA
Write
2. DMA
READ
DPDK
Data plane
Userspace
packet processing (Event-based)
DPDK apps
(polling-based)

# of packet to be proceeded for 10Gbps
with 1 CPU core
0
2,000,000
4,000,000
6,000,000
8,000,000
10,000,000
12,000,000
14,000,000
16,000,000
0 256 512 768 1024 1280
#ofpacketsperseconds
Packet size (Byte)
Short packet 64Byte
14.88 MPPS, 67.2 ns
? 2Ghz: 134 clocks
? 3Ghz: 201 clocks
Computer packet 1KByte
1.2MPPS, 835 ns
? 2Ghz: 1670 clocks
? 3Ghz: 2505 clocks

? 末白玄它尼失伙奈正/旦奶永民
? Lagopus Switch/Router
? Open vSwitch
? VPP
? 玄仿白奴永弁氾旦正
? DPDK Pktgen
? TREX
? DPI脹
? Snort
? 生永玄伐奈弁矛件母及�砑趙庨ⅲ
DPDK毛瞳蚚仄凶失皿伉弗奈扑亦件(瞰)

? 末白玄它尼失伙奈正/旦奶永民
? Lagopus Switch/Router, Open vSwitch, VPP
? 玄仿白奴永弁斥尼生伊奈正
? DPDK Pktgen, TRex
? DPI脹
? Snort
? 仿奶皮仿伉
? mTCP, mOS
? 生永玄伐奈弁矛件母及�砑趙庨ⅲ
DPDK毛瞳蚚仄凶失皿伉弗奈扑亦件脹

? DPDK午反
? �砑穴扑件
? 戊件氾瓜
Agenda

DPDK卞方月�砑虐噫午及諉適ㄗVMㄘ
? NFV及示玄伙生永弁匹丐月�砑生永玄伐奈弁午昜燴生永玄伐奈弁
及諉適毛詢厒趙
Linux
Lagopus
KVM(Hypervisor)
NFV NFV NFV
昜燴生永玄伐奈弁
GuestHost
User
Kernel
Lagopus NFV
Kernel Kernel
GuestHost
User
Kernel
Lagopus NFV
Kernel Kernel
𣶹懂源宒
詢厒趙

? vhost-user PMD
DPDK卞方月�砑虐噫午及諉適ㄗVMㄘ
竘蚚: http://events.linuxfoundation.org/sites/events/files/slides/Scalable%20high-
performance%20userland%20container%20networking%20for%20NFV.pdf

犯白巧伙玄及諉適ㄗ戊件氾瓜ㄘ
竘蚚: /Docker/docker-networking-deep-dive

? SR-IOV or virtio-user
DPDK卞方月�砑虐噫午及諉適ㄗ戊件氾瓜ㄘ
竘蚚: http://dpdk.org/doc/guides/howto/virtio_user_for_container_networking.html#figure-use-
models-for-running-dpdk-in-containers

DPDK卞方月�砑虐噫午及諉適ㄗ戊件氾瓜ㄘ
竘蚚: http://dpdk.org/doc/guides/howto/virtio_user_for_container_networking.html#figure-use-
models-for-running-dpdk-in-containers
? virtio-user pmd

? 由弗永玄及霜木
? pktgen -> 昜燴 -> vswitch -> Container(L2Fwd) -> vswitch -> 昜燴 -> pktgen
俶夔啐�
Lagopus or docker0
Server
Container
L2Fwd or Linux Bridge
Container
pktgen-dpdk
OS: Ubuntu 16.04.1
CPU: Xeon E5-2697 v2 @ 2.70GHz
丟乒伉: 64GB

俶夔啐�

? DPDK午反
? �砑穴扑件
? 戊件氾瓜
Agenda

戊件氾瓜嶲諉適

諉適瞰
Lagopus
Server
Container
Testpmd

? Docker, Lagopus及奶件旦玄奈伙
? 吽謹
? Hugepages及偞隅
? 吽謹ㄝhugepagesize反 1G 斛�ㄝ
? hugetlbfs及穴它件玄
? /etc/fstab毛�摩
? 石旦玄蚚ㄛ跪戊件氾瓜蚚公木冗木匹穴它件玄允月
忒�ㄗ𨃨�ㄘ
# for host
none /mnt/huge hugetlbfs pagesize=1G,size=4G 0 0
# for container
none /mnt/huge_c0 hugetlbfs pagesize=1G,size=1G 0 0

? Docker奶丟奈斥
? testpmd及docker奶丟奈斥
? Lagopus及偞隅
? Interface毛�砑穴扑件諉適媆午肮元仁ㄛvhost-user匹蚚砩允月ㄝ
? 統蕉ㄩhttp://www.slideshare.net/tomoyahibi/lagopusl3-lagopus
忒�ㄗDockerㄛLagopusㄘ
channel channel01 create -dst-addr 127.0.0.1 -protocol tcp
controller controller01 create -channel channel01 -role equal -connection-type main
interface interface01 create -type ethernet-dpdk-phy -device eth_vhost0,iface=/tmp/dpdk/sock0
interface interface02 create -type ethernet-dpdk-phy -device eth_vhost1,iface=/tmp/dpdk/sock1
port port01 create -interface interface01
port port02 create -interface interface02
bridge bridge01 create -controller controller01 -port port01 1 -port port02 2 -dpid 0x1
bridge bridge01 enable
flow bridge01 add in_port=1 apply_actions=output:2
flow bridge01 add in_port=2 apply_actions=output:1

? Lagopus及お�
? Docker及お�
忒�ㄗお�ㄘ
$ sudo lagopus -d -- -c 0xc -n 2 -m 1024 --
$ docker run -it --rm -v /mnt/huge_c0:/mnt/huge_c0 -v /tmp/dpdk:/tmp/dpdk dpdk-docker
testpmd --no-pci --vdev=virtio_user0,path=/tmp/dpdk/sock0 --
vdev=virtio_user1,path=/tmp/dpdk/sock1 -c 0x3 -n 2 -m 1024 -- --disable-hw-vlan-filter -i

? DPDK反戊失毛�衄允月
? virtio-user毛勾井戶月及反DPDK失皿伉及心
? 戊件氾瓜匹妏丹Hugepages反ㄧ矢奈斥眕狟仄井妏尹卅中
? CPU毛恚杅末弗永玄手勾�磁ㄛDocker匹妏蚚允月用奈玉毛隴尨腔卞
硌隅允月斛猁互丐月
? �砩丐月戊件氾瓜毛妏歹卅中
禾奶件玄

? lagopus/doc/how-to-use-virtio-user.md
? https://github.com/lagopus/lagopus/pull/106/files
? DPDK HowTo Guides
? http://dpdk.org/doc/guides/howto/virtio_user_for_container_network
ing.html#figure-use-models-for-running-dpdk-in-containers
? Scalable High-Performance User Space Interface/Stack
for Containers in NFV - Jianfeng Tan & Zhihong Wang,
Intel
? http://events.linuxfoundation.org/sites/events/files/slides/Scalable%2
0high-
performance%20userland%20container%20networking%20for%20NF
V.pdf
統蕉揃蹋

? DPDK午反
? �砑穴扑件
? 戊件氾瓜
? 云引仃
Agenda

? Lagopus Switch 井日 Lagopus Router卞
? OpenFlow Switch匹嶱逃仄凶⺥�卅白伕奈𨈘坰午�I燴卞樓尹ㄛ�〝卅生永玄
伐奈弁秶郘炵失皿伉支左奈弗旦玄伊奈扑亦件午窣觓褫夔午允月
? 伙奈正及�尹月㻢𨃨腔卅皿伕玄戊伙秶郘辻夔
? 左奈田奈伊奶生永玄伐奈弁毛灍政允月VxLAN支GRE
? 做瘍趙ㄗIPsec)及皺傷辻夔
陔Lagopus

Lagopus router及杻釾
? 暫湔奶件白仿尺及爀⻌毛⺍眢午允月SDN�𡛟末白玄它尼失伙奈正
? 伙奈正午仄化及價掛辻夔(磊繚蝠𡥼﹜VRF﹜⺜墿趙﹜奪燴/屠�奶件
正白尼奈旦卅升)毛�尹﹜API毛瞳蚚仄化辻夔��手⺍眢
SDN戊件玄伕奈仿
磊繚
蝠𡥼
⺜墿趙
奪燴
屠�
枑鼎仄凶中
扔奈申旦
SDN旦奶永民
SDN戊件玄伕奈仿
枑鼎仄凶中扔奈申旦
Lagopus
磊繚
蝠𡥼
暫湔奶件白仿尺及諉適及凶戶�〝卅
失皿伉弗奈扑亦件及灍蚾互斛猁
?枑鼎仄凶中扔奈申旦失皿伉及心灍蚾
?旦奶永民尺及⺥�卅辻夔��

? 由弗永玄�I燴窒ㄛ�傖ロ�奪燴
辻�ㄛ皿伕玄戊伙巨奈斥尼件玄
毛浩磐磁匹諉適
? 皿伕玄戊伙�I燴秶郘蚚及API毛皿
伕玄戊伙黱卞枑鼎
? ��反鼠嶱笢
? http://www.lagopus.org/lagopus
2-design-book/ja/
Lagopus Router 失奈平氾弁民乓
Lagopus伙奈正
Routing
agent
(BGP/OSPF脹
及磊繚蝠𡥼)
VRRP agent
(⺜墿�傖及
秶郘)
IKE agent
(做瘍趙及凶
戶及潬蝠𡥼)
SNMP agent
(偞隅﹜緙�
ロ�及枑鼎)
Dataplane
Dataplane framework
Network
Interface
L2
(Bridging)
L3
(Routing)
IPsec
(做瘍/覧瘍)
Config datastore
(偞隅ロ�及緙磁奪燴)
SDN controller/Orchestrator CLI

? Lagopus
? https://lagopus.org
? Github
? https://github.com/lagopus/lagopus
? Lagopus books (荎惤)
? http://www.lagopus.org/lagopus-book/en/html/
? Mailing list (荎惤ㄛ嶱逃氪砃仃)
? https://lists.sourceforge.net/lists/listinfo/lagopus-devel
? Slack
? https://lagopus-project-slack.herokuapp.com/
統蕉

?仍ラ�丐曰互午丹仍介中引仄凶
32
########
## ;;;; ##
## #### ##
#### ##
## ## ####
##### ######## ##
############## ## ##
### ######## ## ##
#### ## ## ## #### ##
#### ## ## ## ## ##
###### #### ####
#### #### ##########
####################
mmmm ##
##########

端端舝

嗨捩嗨鬼卞方月詢厒戊件氾瓜生永玄伐奈平件弘

Recommended

More Related Content

What's hot (20)

Viewers also liked (13)

Similar to 嗨捩嗨鬼卞方月詢厒戊件氾瓜生永玄伐奈平件弘 (20)

More from Tomoya Hibi (8)

Recently uploaded (13)

嗨捩嗨鬼卞方月詢厒戊件氾瓜生永玄伐奈平件弘