Projet

Général

Profil

AtelierPPS2012 » Historique » Version 81

Laurent GUERBY, 02/05/2014 16:46

1 1 Laurent GUERBY
{{>toc}}
2 1 Laurent GUERBY
3 1 Laurent GUERBY
h1. AtelierPPS2012
4 1 Laurent GUERBY
5 32 Laurent GUERBY
Une attaque sur le réseau gitoyen a eu lieu le 18 juin et une sur tetaneutral.net le 29 juin, ces deux attaques etaient en "paquet par seconde" (PPS) avec de petits paquets de 50-60 byte qui saturent les CPU des routeurs logiciels.
6 1 Laurent GUERBY
7 32 Laurent GUERBY
L'idée est d'étudier via des recherches sur le web et des laboratoires/ateliers le comportement des routeurs logiciels dans ce cas la : limites atteintes en fonction du paramétrage et du matériel (carte réseau, CPU et fréquence).
8 1 Laurent GUERBY
9 81 Laurent GUERBY
Pour 2014 voir [[DPDK]]
10 81 Laurent GUERBY
11 1 Laurent GUERBY
h2. Liens
12 1 Laurent GUERBY
13 16 Laurent GUERBY
14 2 Laurent GUERBY
* http://lists.tetaneutral.net/pipermail/technique/2012-July/000406.html
15 2 Laurent GUERBY
* http://guerby.org/ftp/dos-tetaneutral-20120629-12h33-13h03-pps.png
16 24 Laurent GUERBY
* http://networkstatic.net/the-sdn-impact-on-net-neutrality/
17 16 Laurent GUERBY
* http://blog.exceliance.fr/2012/04/24/hypervisors-virtual-network-performance-comparison-from-a-virtualized-load-balancer-point-of-view/
18 3 Laurent GUERBY
* http://www.spinics.net/lists/netdev/msg206077.html
19 3 Laurent GUERBY
** So with your patch, Eric's patch, and this most recent patch we are now at 11.8Mpps with 8 or 9 queues.  At this point I am staring to hit the hardware limits since 82599 will typically max out at about 12Mpps w/ 9 queues.
20 3 Laurent GUERBY
** 12e6 * 64 byte * 8  = 6.1 Gbit/s
21 18 Laurent GUERBY
** PATCH Remove the ipv4 routing cache http://www.spinics.net/lists/netdev/msg205545.html
22 32 Laurent GUERBY
* Intel® 82599 10 Gigabit Ethernet Controller http://ark.intel.com/products/series/32609
23 4 Laurent GUERBY
* more interrupts (lower performance) in bare-metal compared with running VM https://lkml.org/lkml/2012/7/27/490
24 3 Laurent GUERBY
25 3 Laurent GUERBY
100 Mbit/s = 195312 frames de 64 byte/s
26 3 Laurent GUERBY
1000 Mbit/s = 1953125 frames de 64 byte/s
27 31 Laurent GUERBY
* http://dpdk.org/ml/archives/dev/2013-May/000102.html
28 31 Laurent GUERBY
** In case of 64 byte packets (with Ethernet CRC), (64+20)*8 = 672 bits. So line rate is 10000/672 = 14.88 Mpps.
29 39 Laurent GUERBY
** Intel Data Plane Development Kit (Intel® DPDK) Overview Packet Processing on Intel® Architecture  http://www.intel.com/content/dam/www/public/us/en/documents/presentation/dpdk-packet-processing-ia-overview-presentation.pdf
30 35 Laurent GUERBY
* http://www.intel.com/content/www/us/en/intelligent-systems/intel-technology/packet-processing-is-enhanced-with-software-from-intel-dpdk.html
31 35 Laurent GUERBY
** 80 Mpps par processeur Xeon
32 35 Laurent GUERBY
** http://www.intel.com/content/www/us/en/communications/communications-packet-processing-brief.html
33 5 Laurent GUERBY
* discussion choix d'un routeur et attaque PPS : http://www.mail-archive.com/frnog@frnog.org/msg19673.html
34 10 Laurent GUERBY
* projet netmap http://info.iet.unipi.it/~luigi/netmap/
35 10 Laurent GUERBY
** http://lwn.net/Articles/484323/
36 6 Laurent GUERBY
** http://info.iet.unipi.it/~luigi/papers/20120503-netmap-atc12.pdf
37 7 Laurent GUERBY
*** "In our prototype, a single core running at 900 MHz can send or receive 14.88 Mpps (the peak packet rate on 10 Gbit/s links). This is more than 20 times faster than conventional APIs."
38 8 Laurent GUERBY
** http://info.iet.unipi.it/~luigi/netmap/20110729-rizzo-infocom.pdf
39 8 Laurent GUERBY
** VALE, a Virtual Local Ethernet http://info.iet.unipi.it/~luigi/vale/
40 1 Laurent GUERBY
*** http://info.iet.unipi.it/~luigi/papers/20120608-vale.pdf
41 1 Laurent GUERBY
*** " Our architecture, called VALE, implements a Virtual Local Ethernet that can be used by virtual machines such as QEMU, KVM and others, as well as regular processes, to achieve over 17 million packets per second (Mpps) between host processes, and over 2 Mpps between QEMU instances, without any hardware assistance"
42 1 Laurent GUERBY
** Towards a Billion Routing Lookups per Second in Software http://info.iet.unipi.it/~luigi/papers/20120601-dxr.pdf
43 13 Laurent GUERBY
** http://info.iet.unipi.it/~luigi/netmap/talk-hp.html
44 13 Laurent GUERBY
** http://marc.info/?a=133836981100006&r=1&w=4
45 14 Laurent GUERBY
** 10 Gbit/s Line Rate Packet Processing Using Commodity Hardware: Survey and new Proposals http://luca.ntop.org/10g.pdf
46 10 Laurent GUERBY
* http://www.intel.com/content/www/us/en/ethernet-controllers/82599-10-gbe-controller-datasheet.html
47 10 Laurent GUERBY
* ipfw 9-10 Mpps http://lists.freebsd.org/pipermail/freebsd-net/2012-July/032869.html
48 19 Laurent GUERBY
* projet PFQ
49 19 Laurent GUERBY
** http://netgroup.iet.unipi.it/software/pfq/index.html
50 17 Laurent GUERBY
* Ubiquity EdgeMax router
51 17 Laurent GUERBY
** http://www.ubnt.com/edgemax
52 17 Laurent GUERBY
** http://forum.ubnt.com/showthread.php?t=59312
53 17 Laurent GUERBY
** http://dl.ubnt.com/Tolly212127UbiquitiEdgeRouterLitePricePerformance.pdf
54 17 Laurent GUERBY
** http://dl.ubnt.com/Tolly212128UbiquitiEdgeRouterLitePricePerformanceVsMikroTik.pdf
55 25 Laurent GUERBY
* http://dpdk.org/
56 25 Laurent GUERBY
** Intel DPDK: Data Plane Development Kit
57 25 Laurent GUERBY
** Intel DPDK is a set of libraries and drivers for fast packet processing on x86 platforms. It runs mostly in Linux userland.
58 26 Laurent GUERBY
* http://www.slideshare.net/shemminger/uio-final
59 26 Laurent GUERBY
** Networking in Userspace : Living on the edge
60 27 Laurent GUERBY
* http://tech.slashdot.org/story/13/04/17/2014206/vint-cerf-sdn-is-a-model-for-a-better-internet
61 27 Laurent GUERBY
** http://slashdot.org/topic/datacenter/vint-cerf-sdn-is-a-model-for-a-better-internet/
62 28 Laurent GUERBY
* http://www.opendaylight.org/
63 28 Laurent GUERBY
** OpenDaylight's mission is to facilitate a community-led, industry-supported open source framework, including code and architecture, to accelerate and advance a common, robust Software-Defined Networking platform
64 10 Laurent GUERBY
65 30 Laurent GUERBY
* http://www.packetdam.com/
66 30 Laurent GUERBY
67 10 Laurent GUERBY
* http://www.cisco.com/web/partners/downloads/765/tools/quickreference/routerperformance.pdf
68 8 Laurent GUERBY
69 11 Laurent GUERBY
* http://osdir.com/ml/linux.drivers.e1000.devel/2007-05/msg00182.html
70 11 Laurent GUERBY
** "The network cards are perfectly capable of achieving much higher numbers than  135k pps. The linux network stack however is currently not."
71 11 Laurent GUERBY
* http://code.google.com/p/openpgm/
72 12 Laurent GUERBY
* http://afresh1.com/OpenBSD_49_Throughput_Latency/
73 5 Laurent GUERBY
74 20 Laurent GUERBY
* http://code.ettus.com/redmine/ettus/projects/public/wiki/Latency
75 20 Laurent GUERBY
76 32 Laurent GUERBY
* 10Gbps Open Source Routing » de Bengt Gördén, Olof Hagsand et Robert Olsson http://www.iis.se/docs/10G-OS-router_2_.pdf
77 22 Laurent GUERBY
* http://fr.slideshare.net/brouer/linuxcon2009-10gbits-bidirectional-routing-on-standard-hardware-running-linux
78 22 Laurent GUERBY
* 10 Gbit Hardware Packet Filtering Using Commodity Network Adapters http://ripe61.ripe.net/presentations/138-Deri_RIPE_61.pdf
79 23 Laurent GUERBY
* https://wiki.freebsd.org/NetworkPerformanceTuning
80 1 Laurent GUERBY
81 21 Laurent GUERBY
*  http://wiki.networksecuritytoolkit.org/nstwiki/index.php/LAN_Ethernet_Maximum_Rates,_Generation,_Capturing_%26_Monitoring
82 1 Laurent GUERBY
* http://www.cisco.com/web/about/security/intelligence/network_performance_metrics.html
83 1 Laurent GUERBY
84 32 Laurent GUERBY
* http://blog.erratasec.com/2013/12/ccc-100-gbps-and-your-own-private-shodan.html
85 33 Laurent GUERBY
* https://github.com/robertdavidgraham/masscan
86 32 Laurent GUERBY
* http://www.ntop.org/products/pf_ring/
87 29 Laurent GUERBY
88 34 Laurent GUERBY
* http://routebricks.org/pubs.html
89 34 Laurent GUERBY
90 36 Laurent GUERBY
* http://lwn.net/Articles/542643/
91 36 Laurent GUERBY
** Chelsio's T5 asic moves the architecture into 40GbE speeds. T5 is a 10/40GbE controller with full offload support of a complete Unified Wire solution comprising NIC, Virtualization, TOE, iWARP RDMA and FCoE.
92 36 Laurent GUERBY
** http://dpdk.org/ml/archives/dev/2014-January/001111.html fix atomic and out of order	execution
93 36 Laurent GUERBY
94 37 Laurent GUERBY
* http://blog.erratasec.com/2013/10/whats-max-speed-on-ethernet.html
95 37 Laurent GUERBY
** What's the max speed on Ethernet?
96 38 Laurent GUERBY
* http://bsdrp.net/documentation/examples/forwarding_performance_lab_of_a_superserver_5018a-ftn4
97 37 Laurent GUERBY
98 32 Laurent GUERBY
h2. Personnes interessées
99 32 Laurent GUERBY
100 1 Laurent GUERBY
# Laurent GUERBY
101 32 Laurent GUERBY
# Obinou (qui a déjà utilisé PF-RING et NTOP)
102 1 Laurent GUERBY
103 1 Laurent GUERBY
A priori il suffit de deux machines pour pouvoir commencer chez soi.
104 11 Laurent GUERBY
105 11 Laurent GUERBY
h2. Tests
106 11 Laurent GUERBY
107 11 Laurent GUERBY
e1000e D2500CC (squeeze) et core i5 DQ67SW (squeeze + kernel 3.2bpo)
108 11 Laurent GUERBY
iperf plafonne a 120-130k pps