[WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
jens
jens at viisauksena.de
Wed Aug 3 18:14:44 CEST 2016
On 03.08.2016 08:48, René van Dorst wrote:
> ...
> I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a
> Atheros AR9132 400MHz cpu.
> Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager.
so you do not observe crashing of the router like we do with the tp-link
wr841Nv11 -
do you also test iperf with udp packets , around 200 Mbit or so ?
acording to openwrt wiki say that 1043v1.xx runs even slower cpu , but
have 8Mb of flash
TL-WR1043ND v1-v1.11 Atheros AR9132 400 8 32 Atheros AR9100
(integrated) b/g/n 5 1x 2.0 Yes
as far as i understand is the lan also on the wifi chip, so this differs
..
for the 841v11 it should be QCA9533-AL3A running with 560 MHz with 32 MB
Ram Zentel A3S56D40GTP-50L. switch QCA9533-BL3A built-in
https://wiki.openwrt.org/toh/TP-Link/tl-wr841nd
https://wiki.openwrt.org/toh/TP-Link/tl-wr1043nd
sidenode tplink name convention (to prevent confusion): mainly important
is running number like 1043 or 841 and the hardware revision like v11,
the N or ND are only antenna related, the .123 are factory firmware
revision of the specific hardware revision - which is more important for
us here
On 03.08.2016 08:48, René van Dorst wrote:
> Hi Jens,
>
> I would like to share my results on a MIPS cpu.
>
> I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a
> Atheros AR9132 400MHz cpu.
> Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager.
> For my test I run wireguard and iperf3 on the same device on both sides.
> Other side is a AMD A6-5400 with debian unstable running inside KVM.
> Both connected to a gigabit switch.
>
> My results iperf:
> - Plain ~100MBits
> - WG ~24Mbits (TCP test)
>
> Greats,
>
> René van Dorst.
>
> Quoting jens <jens at viisauksena.de>:
>
>> On 27.07.2016 13:05, Jason A. Donenfeld wrote:
>>
>>> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena
>>> <jens at viisauksena.de> wrote:
>>>> It should however not lead to netifd outofmemory, load of 2.6 and the
>>>> oomkiller berserking around at all... even if its not directly wg
>>>> fault.
>>> One thing to try would be removing these lines from src/socket.c:
>>>
>>> socket.c
>>> 386: sk_clear_memalloc(sock);
>>> 394: sk_set_memalloc(sock->sk);
>>>
>>> I'd be interested to learn if that fixes things.
>>
>> sorry if you waited for answers ..
>> we redo the testing with latest kernel
>> [ 0.000000] Linux version 4.4.15 (fuzzle at builder) (gcc version 5.4.0
>> (LEDE GCC 5.4.0 r1119) ) #3 Thu Jul 28 01:05:08 UTC 2016
>> build from latest trunk by ourselve, before we use default packages and
>> lede like this
>> [ 0.000000] Linux version 4.4.15 (buildbot at builds) (gcc version 5.4.0
>> (LEDE GCC 5.4.0 r1114) ) #2 Tue Jul 26 17:57:45 UTC 2016
>>
>> and with wireguard source from 27.7. also including your suggestions.
>>
>> still the same
>>
>> more detailed :
>>
>> we got out of memory and big cpuload when testing iperf with udp
>> packets, (we forget to notice that before in our first testings which
>> mode killed all the memory)
>> and from the heavy load and low memory lede/openwrt shut down stuff and
>> things broke apart
>> (Reminder, Lede/Openwrt on TP link 841 v11 with 650 Mhz CPU and 32Mb
>> Ram)
>>
>> with tcp traffic we got this time stable 16 Mbit, which sounds like a
>> reasonable limit for this kind of small cpu without any optimzation.
>> Also cpu load was lower.
>>
>> we wonder how to use more sophisticated tools on our testsetup with 2
>> real tplink routers connected + behind each one laptop to measure
>> throughput with iperf3. this maybe is not possible at all without
>> getting serial console access
>>
>> 2 lessons learned: 1. problem arises with upd traffic and result quickly
>> in out of memory (with transmission peak at the beginning higher than
>> the 15 mbit with tcp packets)) 2. tcp is stable with 15-16 Mbit
>> some more thoughts: all this could maybe slightly increased by code
>> optimization, slightly different cipher, maybe encrypting is harder than
>> decrypting, which means download will be faster - while encryption is
>> happen on big servers in Net
>>
>> to compare again with fastd - this are the numbers we could get fastd
>> through the cpu/wire (we didnt did that testing in this special setup,
>> maybe some time soon - at least i am curious)
>>
>>
>>
>>
>>
>> ### just the dmesg before crashing
>> [ 0.000000] MyLoader: sysp=9fb7db5d, boardp=d56f3f67, parts=bfae9f0c
>> [ 0.000000] bootconsole [early0] enabled
>> [ 0.000000] CPU0 revision is: 00019374 (MIPS 24Kc)
>> [ 0.000000] SoC: Qualcomm Atheros QCA9533 ver 2 rev 0
>> [ 0.000000] Determined physical RAM map:
>> [ 0.000000] memory: 02000000 @ 00000000 (usable)
>> [ 0.000000] Initrd not found or empty - disabling initrd
>> [ 0.000000] No valid device tree found, continuing without
>> [ 0.000000] Zone ranges:
>> [ 0.000000] Normal [mem 0x0000000000000000-0x0000000001ffffff]
>> [ 0.000000] Movable zone start for each node
>> [ 0.000000] Early memory node ranges
>> [ 0.000000] node 0: [mem 0x0000000000000000-0x0000000001ffffff]
>> [ 0.000000] Initmem setup node 0 [mem
>> 0x0000000000000000-0x0000000001ffffff]
>> [ 0.000000] On node 0 totalpages: 8192
>> [ 0.000000] free_area_init_node: node 0, pgdat 804003d0, node_mem_map
>> 81000000
>> [ 0.000000] Normal zone: 64 pages used for memmap
>> [ 0.000000] Normal zone: 0 pages reserved
>> [ 0.000000] Normal zone: 8192 pages, LIFO batch:0
>> [ 0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32
>> bytes.
>> [ 0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases,
>> linesize 32 bytes
>> [ 0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
>> [ 0.000000] pcpu-alloc: [0] 0
>> [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on.
>> Total pages: 8128
>> [ 0.000000] Kernel command line: board=TL-WR841N-v11
>> console=ttyS0,115200 rootfstype=squashfs,jffs2 noinitrd
>> [ 0.000000] PID hash table entries: 128 (order: -3, 512 bytes)
>> [ 0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384
>> bytes)
>> [ 0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192
>> bytes)
>> [ 0.000000] Writing ErrCtl register=00000000
>> [ 0.000000] Readback ErrCtl register=00000000
>> [ 0.000000] Memory: 27740K/32768K available (2933K kernel code, 151K
>> rwdata, 744K rodata, 260K init, 200K bss, 5028K reserved, 0K
>> cma-reserved)
>> [ 0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1,
>> Nodes=1
>> [ 0.000000] NR_IRQS:51
>> [ 0.000000] Clocks: CPU:650.000MHz, DDR:393.066MHz, AHB:216.666MHz,
>> Ref:25.000MHz
>> [ 0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles:
>> 0xffffffff, max_idle_ns: 5880801374 ns
>> [ 0.000009] sched_clock: 32 bits at 325MHz, resolution 3ns, wraps
>> every 6607641598ns
>> [ 0.008234] Calibrating delay loop... 432.53 BogoMIPS (lpj=2162688)
>> [ 0.071106] pid_max: default: 32768 minimum: 301
>> [ 0.076110] Mount-cache hash table entries: 1024 (order: 0, 4096
>> bytes)
>> [ 0.083096] Mountpoint-cache hash table entries: 1024 (order: 0, 4096
>> bytes)
>> [ 0.093471] clocksource: jiffies: mask: 0xffffffff max_cycles:
>> 0xffffffff, max_idle_ns: 19112604462750000 ns
>> [ 0.104645] NET: Registered protocol family 16
>> [ 0.110870] MIPS: machine is TP-LINK TL-WR841N/ND v11
>> [ 0.568855] clocksource: Switched to clocksource MIPS
>> [ 0.575559] NET: Registered protocol family 2
>> [ 0.581064] TCP established hash table entries: 1024 (order: 0, 4096
>> bytes)
>> [ 0.588427] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
>> [ 0.595202] TCP: Hash tables configured (established 1024 bind 1024)
>> [ 0.602025] UDP hash table entries: 256 (order: 0, 4096 bytes)
>> [ 0.608200] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
>> [ 0.615203] NET: Registered protocol family 1
>> [ 0.619896] PCI: CLS 0 bytes, default 32
>> [ 0.620920] futex hash table entries: 256 (order: -1, 3072 bytes)
>> [ 0.644082] squashfs: version 4.0 (2009/01/31) Phillip Lougher
>> [ 0.650332] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME)
>> (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
>> [ 0.663484] io scheduler noop registered
>> [ 0.667635] io scheduler deadline registered (default)
>> [ 0.673325] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
>> [ 0.680545] console [ttyS0] disabled
>> [ 0.704475] serial8250.0: ttyS0 at MMIO 0x18020000 (irq = 11,
>> base_baud = 1562500) is a 16550A
>> [ 0.713586] console [ttyS0] enabled
>> [ 0.721147] bootconsole [early0] disabled
>> [ 0.732999] m25p80 spi0.0: found gd25q32, expected m25p80
>> [ 0.738601] m25p80 spi0.0: gd25q32 (4096 Kbytes)
>> [ 0.744708] 5 tp-link partitions found on MTD device spi0.0
>> [ 0.750531] Creating 5 MTD partitions on "spi0.0":
>> [ 0.755489] 0x000000000000-0x000000020000 : "u-boot"
>> [ 0.762184] 0x000000020000-0x000000162710 : "kernel"
>> [ 0.769118] 0x000000162710-0x0000003f0000 : "rootfs"
>> [ 0.775937] mtd: device 2 (rootfs) set to be root filesystem
>> [ 0.781932] 1 squashfs-split partitions found on MTD device rootfs
>> [ 0.788320] 0x000000340000-0x0000003f0000 : "rootfs_data"
>> [ 0.795617] 0x0000003f0000-0x000000400000 : "art"
>> [ 0.802259] 0x000000020000-0x0000003f0000 : "firmware"
>> [ 0.829961] libphy: ag71xx_mdio: probed
>> [ 1.421422] ag71xx-mdio.1: Found an AR934X built-in switch
>> [ 1.464748] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII
>> [ 2.061807] ag71xx ag71xx.0: connected to PHY at ag71xx-mdio.1:04
>> [uid=004dd042, driver=Generic PHY]
>> [ 2.072011] eth1: Atheros AG71xx at 0xb9000000, irq 4, mode:MII
>> [ 2.080973] NET: Registered protocol family 10
>> [ 2.090540] NET: Registered protocol family 17
>> [ 2.095219] bridge: automatic filtering via arp/ip/ip6tables has been
>> deprecated. Update your scripts to load br_netfilter if you need this.
>> [ 2.108444] 8021q: 802.1Q VLAN Support v1.8
>> [ 2.121115] VFS: Mounted root (squashfs filesystem) readonly on
>> device 31:2.
>> [ 2.130267] Freeing unused kernel memory: 260K (8041f000 - 80460000)
>> [ 3.221171] init: Console is alive
>> [ 3.224937] init: - watchdog -
>> [ 4.185893] init: - preinit -
>> [ 4.817211] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
>> [ 4.844857] random: procd urandom read with 7 bits of entropy
>> available
>> [ 6.910299] eth0: link up (1000Mbps/Full duplex)
>> [ 6.916280] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
>> [ 8.090413] jffs2_scan_eraseblock(): End of filesystem marker found
>> at 0x10000
>> [ 8.097897] jffs2_build_filesystem(): unlocking the mtd device...
>> done.
>> [ 8.104748] jffs2_build_filesystem(): erasing all blocks after the
>> end marker... done.
>> [ 10.739288] jffs2: notice: (349) jffs2_build_xattr_subsystem:
>> complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan)
>> and 0 of xref (0 dead, 0 orphan) found.
>> [ 10.756968] mount_root: overlay filesystem has not been fully
>> initialized yet
>> [ 10.768400] mount_root: switching to jffs2 overlay
>> [ 10.999300] urandom-seed: Seed file not found (/etc/urandom.seed)
>> [ 11.109948] eth0: link down
>> [ 11.125253] procd: - early -
>> [ 11.128356] procd: - watchdog -
>> [ 11.738352] procd: - ubus -
>> [ 11.793781] procd: - init -
>> [ 12.094265] tun: Universal TUN/TAP device driver, 1.6
>> [ 12.099567] tun: (C) 1999-2004 Max Krasnyansky <maxk at qualcomm.com>
>> [ 12.120149] wireguard: WireGuard loaded. See www.wireguard.io for
>> information.
>> [ 12.127621] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld
>> <Jason at zx2c4.com>. All Rights Reserved.
>> [ 12.140039] ip6_tables: (C) 2000-2006 Netfilter Core Team
>> [ 12.160019] Loading modules backported from Linux version
>> wt-2016-06-20-0-gbc17424
>> [ 12.167850] Backport generated by backports.git
>> backports-20160216-7-g5735958
>> [ 12.178703] ip_tables: (C) 2000-2006 Netfilter Core Team
>> [ 12.195189] nf_conntrack version 0.5.0 (437 buckets, 1748 max)
>> [ 12.244145] xt_time: kernel timezone is -0000
>> [ 12.314522] PPP generic driver version 2.4.2
>> [ 12.321763] NET: Registered protocol family 24
>> [ 12.376518] ath: EEPROM regdomain: 0x0
>> [ 12.376545] ath: EEPROM indicates default country code should be used
>> [ 12.376554] ath: doing EEPROM country->regdmn map search
>> [ 12.376576] ath: country maps to regdmn code: 0x3a
>> [ 12.376587] ath: Country alpha2 being used: US
>> [ 12.376595] ath: Regpair used: 0x3a
>> [ 12.388362] ieee80211 phy0: Selected rate control algorithm
>> 'minstrel_ht'
>> [ 12.392478] ieee80211 phy0: Atheros AR9531 Rev:2 mem=0xb8100000,
>> irq=47
>> [ 20.576096] device eth0 entered promiscuous mode
>> [ 20.599684] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
>> [ 20.645872] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
>> [ 22.270331] eth0: link up (1000Mbps/Full duplex)
>> [ 22.275169] br-lan: port 1(eth0) entered forwarding state
>> [ 22.280839] br-lan: port 1(eth0) entered forwarding state
>> [ 22.322565] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
>> [ 23.352464] eth1: link up (100Mbps/Full duplex)
>> [ 23.357197] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
>> [ 24.278939] br-lan: port 1(eth0) entered forwarding state
>> [ 77.338893] random: nonblocking pool is initialized
>> [ 2545.780086] eth0: link down
>> [ 2545.783413] br-lan: port 1(eth0) entered disabled state
>> [ 2547.280148] eth0: link up (1000Mbps/Full duplex)
>> [ 2547.284988] br-lan: port 1(eth0) entered forwarding state
>> [ 2547.290680] br-lan: port 1(eth0) entered forwarding state
>> [ 2549.288710] br-lan: port 1(eth0) entered forwarding state
>> [ 2751.342810] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0,
>> oom_score_adj=0
>> [ 2751.351333] CPU: 0 PID: 695 Comm: netifd Not tainted 4.4.15 #3
>> [ 2751.357358] Stack : 803ba2c4 00000000 00000001 80410000 8197ea80
>> 80400d63 8039b9e4 000002b7
>> [ 2751.357358] 80463798 80febd1c 00000000 00000006 00001b58
>> 800a6820 00000006 ffffffff
>> [ 2751.357358] 00000000 00000000 8039f45c 80febbbc 80466542
>> 800a47ec 804003d0 00000000
>> [ 2751.357358] 00000001 801ef300 00000000 00000000 00000000
>> 00000000 00000000 00000000
>> [ 2751.357358] 00000000 00000000 00000000 00000000 00000000
>> 00000000 00000000 00000000
>> [ 2751.357358] ...
>> [ 2751.396800] Call Trace:
>> [ 2751.399910] [<80071a20>] show_stack+0x50/0x84
>> [ 2751.404425] [<800d2ddc>] dump_header.isra.4+0x48/0x130
>> [ 2751.410546] [<800d31b0>] oom_kill_process+0x98/0x440
>> [ 2751.415683] [<800d38d0>] out_of_memory+0x2f4/0x330
>> [ 2751.421212] [<800d718c>] __alloc_pages_nodemask+0x67c/0x6e8
>> [ 2751.427014] [<800d21d0>] filemap_fault+0x254/0x454
>> [ 2751.432560] [<800ecafc>] __do_fault+0x3c/0xa8
>> [ 2751.437076] [<800efd28>] handle_mm_fault+0x4e0/0xb78
>> [ 2751.442797] [<80076638>] __do_page_fault+0x134/0x474
>> [ 2751.447940] [<80060820>] ret_from_exception+0x0/0x10
>> [ 2751.453625]
>> [ 2751.455172] Mem-Info:
>> [ 2751.457542] active_anon:246 inactive_anon:4 isolated_anon:0
>> [ 2751.457542] active_file:51 inactive_file:80 isolated_file:0
>> [ 2751.457542] unevictable:0 dirty:0 writeback:0 unstable:0
>> [ 2751.457542] slab_reclaimable:120 slab_unreclaimable:1272
>> [ 2751.457542] mapped:10 shmem:36 pagetables:39 bounce:0
>> [ 2751.457542] free:164 free_pcp:0 free_cma:0
>> [ 2751.490694] Normal free:660kB min:664kB low:828kB high:996kB
>> active_anon:984kB inactive_anon:16kB active_file:204kB
>> inactive_file:320kB unevictable:0kB isolated(anon):0kB
>> isolated(file):0kB present:32768kB managed:28000kB mlocked:0kB dirty:0kB
>> writeback:0kB mapped:40kB shmem:144kB slab_reclaimable:480kB
>> slab_unreclaimable:5088kB kernel_stack:304kB pagetables:156kB
>> unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
>> writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
>> [ 2751.535274] lowmem_reserve[]: 0 0
>> [ 2751.539269] Normal: 3*4kB (U) 41*8kB (UM) 20*16kB (U) 0*32kB 0*64kB
>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 660kB
>> [ 2751.551718] 167 total pagecache pages
>> [ 2751.555511] 0 pages in swap cache
>> [ 2751.559484] Swap cache stats: add 0, delete 0, find 0/0
>> [ 2751.564887] Free swap = 0kB
>> [ 2751.567862] Total swap = 0kB
>> [ 2751.571632] 8192 pages RAM
>> [ 2751.574438] 0 pages HighMem/MovableOnly
>> [ 2751.578399] 1192 pages reserved
>> [ 2751.582198] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds
>> swapents oom_score_adj name
>> [ 2751.591592] [ 395] 0 395 294 15 3
>> 0 0 0 ubusd
>> [ 2751.601044] [ 396] 0 396 223 10 3
>> 0 0 0 askfirst
>> [ 2751.610769] [ 659] 0 659 306 35 3
>> 0 0 0 logd
>> [ 2751.620386] [ 695] 0 695 408 40 4
>> 0 0 0 netifd
>> [ 2751.629944] [ 722] 0 722 320 21 3
>> 0 0 0 odhcpd
>> [ 2751.639492] [ 754] 0 754 264 10 3
>> 0 0 0 dropbear
>> [ 2751.648664] [ 856] 0 856 294 15 3
>> 0 0 0 ntpd
>> [ 2751.658041] [ 915] 453 915 262 18 4
>> 0 0 0 dnsmasq
>> [ 2751.667679] [ 1003] 0 1003 229 11 3
>> 0 0 0 odhcp6c
>> [ 2751.677561] [ 1051] 0 1051 281 25 3
>> 0 0 0 dropbear
>> [ 2751.687291] [ 1052] 0 1052 295 11 3
>> 0 0 0 ash
>> [ 2751.696563] Out of memory: Kill process 695 (netifd) score 6 or
>> sacrifice child
>> [ 2751.704694] Killed process 1003 (odhcp6c) total-vm:916kB,
>> anon-rss:40kB, file-rss:4kB
>> root at lede:/tmp# Connection to 192.168.1.1 closed.
>>
>> _______________________________________________
>> WireGuard mailing list
>> WireGuard at lists.zx2c4.com
>> http://lists.zx2c4.com/mailman/listinfo/wireguard
>
>
>
> _______________________________________________
> WireGuard mailing list
> WireGuard at lists.zx2c4.com
> http://lists.zx2c4.com/mailman/listinfo/wireguard
--
make the world nicer, please use PGP encryption
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.zx2c4.com/pipermail/wireguard/attachments/20160803/f3e495f5/attachment-0001.html>
More information about the WireGuard
mailing list