summaryrefslogtreecommitdiffstats
path: root/benchmarks.page
diff options
context:
space:
mode:
authorbnewbold <bnewbold@robocracy.org>2012-08-23 15:01:06 -0400
committerbnewbold <bnewbold@robocracy.org>2012-08-23 15:01:06 -0400
commitf4e91e70bb52e6328f0f46e5af5d242b19d3ba7d (patch)
tree09dbfa28cecb155783482c790e8a96c333158912 /benchmarks.page
parente671f21941906748d8d9e7c388aa12271d51d48a (diff)
downloadrooter_wiki-f4e91e70bb52e6328f0f46e5af5d242b19d3ba7d.tar.gz
rooter_wiki-f4e91e70bb52e6328f0f46e5af5d242b19d3ba7d.zip
benchmark data and summary table
Diffstat (limited to 'benchmarks.page')
-rw-r--r--benchmarks.page436
1 files changed, 76 insertions, 360 deletions
diff --git a/benchmarks.page b/benchmarks.page
index 8e87b5b..d5c0d22 100644
--- a/benchmarks.page
+++ b/benchmarks.page
@@ -1,362 +1,78 @@
-===============================================================================
-===============================================================================
-ziggy tests.
- LUKS (?) full disk encryption
- 4GB ram
- thinkpad X200s
- debian wheezy 64bit
- Intel® Core™2 Duo CPU L9400 @ 1.86GHz (dual core)
- Linux ziggy 3.2.0-2-amd64 #1 SMP Sat May 12 23:08:28 UTC 2012 x86_64 GNU/Linux
-
--------------------------------------------------------------------------------
-bnewbold@ziggy:~$ time gzip ugly.file
-
-real 0m3.285s
-user 0m3.172s
-sys 0m0.104s
-bnewbold@ziggy:~$ time gunzip ugly.file.gz
-
-real 0m0.513s
-user 0m0.404s
-sys 0m0.104s
-
-bnewbold@ziggy:~$ ls -lh ugly.file
--rw-r--r-- 1 bnewbold bnewbold 57M Jul 26 19:33 ugly.file
-
--------------------------------------------------------------------------------
-bonnie++ (some other programs running):
-Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
-Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
-Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
-ziggy 8G 472 97 46677 21 29797 4 2064 98 90512 7 9399 137
-Latency 26847us 18071ms 10863ms 9410us 13520us 8601us
-Version 1.96 ------Sequential Create------ --------Random Create--------
-ziggy -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
- 16 23352 51 +++++ +++ +++++ +++ 29194 62 +++++ +++ +++++ +++
- Latency 460us 607us 872us 692us 285us 1680us
- 1.96,1.96,ziggy,1,1343350564,8G,,472,97,46677,21,29797,4,2064,98,90512,7,9399,137,16,,,,,23352,51,+++++,+++,+++++,+++,29194,62,+++++,+++,+++++,+++,26847us,18071ms,10863ms,9410us,13520us,8601us,460us,607us,872us,692us,285us,1680us
-
--------------------------------------------------------------------------------
-bnewbold@ziggy:~$ sysbench --test=cpu run
-sysbench 0.4.12: multi-threaded system evaluation benchmark
-
-Running the test with following options:
-Number of threads: 1
-
-Doing CPU performance benchmark
-
-Threads started!
-Done.
-
-Maximum prime number checked in CPU test: 10000
-
-
-Test execution summary:
- total time: 12.3204s
- total number of events: 10000
- total time taken by event execution: 12.3096
- per-request statistics:
- min: 1.20ms
- avg: 1.23ms
- max: 3.35ms
- approx. 95 percentile: 1.36ms
-
-Threads fairness:
- events (avg/stddev): 10000.0000/0.00
- execution time (avg/stddev): 12.3096/0.00
-
--------------------------------------------------------------------------------
-bnewbold@ziggy:~$ sysbench --test=memory run --memory-total-size=10G
-sysbench 0.4.12: multi-threaded system evaluation benchmark
-
-Running the test with following options:
-Number of threads: 1
-
-Doing memory operations speed test
-Memory block size: 1K
-
-Memory transfer size: 10240M
-
-Memory operations type: write
-Memory scope type: global
-Threads started!
-Done.
-
-Operations performed: 10485760 (253039.39 ops/sec)
-
-10240.00 MB transferred (247.11 MB/sec)
-
-
-Test execution summary:
- total time: 41.4392s
- total number of events: 10485760
- total time taken by event execution: 30.5720
- per-request statistics:
- min: 0.00ms
- avg: 0.00ms
- max: 4.52ms
- approx. 95 percentile: 0.00ms
-
-Threads fairness:
- events (avg/stddev): 10485760.0000/0.00
- execution time (avg/stddev): 30.5720/0.00
-
-
-===============================================================================
-===============================================================================
-soekris test in kFreeBSD
- 1GHz intel atom processor
- 1GB ram
- 60GB SSD, no encryption
- FreeBSD pfSense.localdomain 8.3-RELEASE-p3 FreeBSD 8.3-RELEASE-p3 #1: Sun Jul 22 09:37:43 EDT 2012 root@FreeBSD_8.3_pfSense_2.1.snaps.pfsense.org:/usr/obj./usr/pfSensesrc/src/sys/pfSense_wrap.8.i386 i386
-
-bonnie++:
-Version 1.96 ------Sequential Output------ --Sequential Input- --Random-
-Concurrency 1 -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
-Machine Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
-guest0.rooter.is 2G 67 99 20303 30 14147 24 127 99 61345 53 2543 359
-Latency 208ms 126ms 306ms 98529us 46941us 284ms
-Version 1.96 ------Sequential Create------ --------Random Create--------
-guest0.rooter.is -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
- files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
- 16 524 64 19545 99 1737 43 536 65 1179 99 1021 63
-Latency 27014us 954us 22059us 40939us 19333us 39809us
-1.96,1.96,guest0.rooter.is,1,1343349753,2G,,67,99,20303,30,14147,24,127,99,61345,53,2543,359,16,,,,,524,64,19545,99,1737,43,536,65,1179,99,1021,63,208ms,126ms,306ms,98529us,46941us,284ms,27014us,954us,22059us,40939us,19333us,39809us
-
--------------------------------------------------------------------------------
-root@guest0:~# sysbench --test=memory run --memory-total-size=10G
-sysbench 0.4.12: multi-threaded system evaluation benchmark
-
-Running the test with following options:
-Number of threads: 1
-
-Doing memory operations speed test
-Memory block size: 1K
-
-Memory transfer size: 2048M
-
-Memory operations type: write
-Memory scope type: global
-Threads started!
-Done.
-
-Operations performed: 2097152 (29370.32 ops/sec)
-
-2048.00 MB transferred (28.68 MB/sec)
-
-
-Test execution summary:
- total time: 71.4038s
- total number of events: 2097152
- total time taken by event execution: 54.3145
- per-request statistics:
- min: 0.02ms
- avg: 0.03ms
- max: 18.51ms
- approx. 95 percentile: 0.01ms
-
-Threads fairness:
- events (avg/stddev): 2097152.0000/0.00
- execution time (avg/stddev): 54.3145/0.00
-
--------------------------------------------------------------------------------
-root@guest0:~# sysbench --test=cpu run
-sysbench 0.4.12: multi-threaded system evaluation benchmark
-
-Running the test with following options:
-Number of threads: 1
-
-Doing CPU performance benchmark
-
-Threads started!
-Done.
-
-Maximum prime number checked in CPU test: 10000
-
-
-Test execution summary:
- total time: 185.6217s
- total number of events: 10000
- total time taken by event execution: 185.5302
- per-request statistics:
- min: 18.21ms
- avg: 18.55ms
- max: 84.04ms
- approx. 95 percentile: 22.44ms
-
-Threads fairness:
- events (avg/stddev): 10000.0000/0.00
- execution time (avg/stddev): 185.5302/0.00
-
--------------------------------------------------------------------------------
-root@guest0:~# time gzip ugly.file
-
-real 0m24.713s
-user 0m23.242s
-sys 0m1.107s
-root@guest0:~# time gunzip ugly.file.gz
-
-real 0m3.718s
-user 0m2.627s
-sys 0m0.966s
-
-root@guest0:~# ls -lh ugly.file
--rw-r--r-- 1 root root 57M Jul 27 02:34 ugly.file
-
--------------------------------------------------------------------------------
-[2.1-BETA0][root@pfSense.localdomain]/root(52): uname -a
-FreeBSD pfSense.localdomain 8.3-RELEASE-p3 FreeBSD 8.3-RELEASE-p3 #1: Sun Jul 22 09:37:43 EDT 2012 root@FreeBSD_8.3_pfSense_2.1.snaps.pfsense.org:/usr/obj./usr/pfSensesrc/src/sys/pfSense_wrap.8.i386 i386
-
--------------------------------------------------------------------------------
-networking (from ziggy, ~5ft fancy cable):
-
-[2.1-BETA0][root@pfSense.localdomain]/root(48): ifconfig em1
-em1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
- options=4209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,VLAN_HTSO>
- ether 00:00:24:ce:7f:a5
- inet6 fe80::200:24ff:fece:7fa5%em1 prefixlen 64 scopeid 0xa
- inet 192.168.5.1 netmask 0xffffff00 broadcast 192.168.5.255
- inet6 fe80::1:1%em1 prefixlen 64 scopeid 0xa
- inet 192.168.1.201 netmask 0xffffffff broadcast 192.168.1.201
- inet 192.168.5.5 netmask 0xffffffff broadcast 192.168.5.5
- nd6 options=1<PERFORMNUD>
- media: Ethernet autoselect (1000baseT <full-duplex>)
- status: active
-
-(to nginx inside kFreeBSD)
-bnewbold@ziggy:/tmp$ wget 192.168.5.5:8888/ugly.file
---2012-07-26 19:49:38-- http://192.168.5.5:8888/ugly.file
-Connecting to 192.168.5.5:8888... connected.
-HTTP request sent, awaiting response... 200 OK
-Length: 59604992 (57M) [application/octet-stream]
-Saving to: `ugly.file.1'
-
-100%[======================================>] 59,604,992 16.8M/s in 3.4s
-
-2012-07-26 19:49:41 (16.8 MB/s) - `ugly.file.1' saved [59604992/59604992]
-
-(iperf to pfSense; vanilla)
-bnewbold@ziggy:/tmp$ iperf -u -c 192.168.5.1
-------------------------------------------------------------
-Client connecting to 192.168.5.1, UDP port 5001
-Sending 1470 byte datagrams
-UDP buffer size: 224 KByte (default)
-------------------------------------------------------------
-[ 3] local 192.168.5.99 port 54078 connected with 192.168.5.1 port 5001
-[ ID] Interval Transfer Bandwidth
-[ 3] 0.0-10.0 sec 1.25 MBytes 1.05 Mbits/sec
-[ 3] Sent 893 datagrams
-[ 3] Server Report:
-[ 3] 0.0-10.0 sec 1.25 MBytes 1.05 Mbits/sec 0.005 ms 0/ 893 (0%)
-
-
-
-bnewbold@ziggy:/tmp$ iperf -i 3 -t 300 -w 256k -d -c 192.168.5.1
-WARNING: option -d is not valid for server mode
-------------------------------------------------------------
-Client connecting to 192.168.5.1, TCP port 5001
-TCP window size: 256 KByte (WARNING: requested 256 KByte)
-------------------------------------------------------------
-[ 3] local 192.168.5.99 port 35401 connected with 192.168.5.1 port 5001
-[ ID] Interval Transfer Bandwidth
-[ 3] 0.0- 3.0 sec 51.6 MBytes 144 Mbits/sec
-[ 3] 3.0- 6.0 sec 51.6 MBytes 144 Mbits/sec
-[ 3] 6.0- 9.0 sec 52.2 MBytes 146 Mbits/sec
-[ 3] 9.0-12.0 sec 52.0 MBytes 145 Mbits/sec
-[ 3] 12.0-15.0 sec 51.8 MBytes 145 Mbits/sec
-
-------------------------------------------------------------
-Client connecting to 192.168.5.1, TCP port 5001
-TCP window size: 23.5 KByte (default)
-------------------------------------------------------------
-[ 3] local 192.168.5.99 port 35386 connected with 192.168.5.1 port 5001
-[ ID] Interval Transfer Bandwidth
-[ 3] 0.0-10.0 sec 174 MBytes 146 Mbits/sec
-
-bnewbold@ziggy:/tmp$ ping 192.168.5.1
-PING 192.168.5.1 (192.168.5.1) 56(84) bytes of data.
-64 bytes from 192.168.5.1: icmp_req=1 ttl=64 time=0.287 ms
-64 bytes from 192.168.5.1: icmp_req=2 ttl=64 time=0.137 ms
-64 bytes from 192.168.5.1: icmp_req=3 ttl=64 time=0.235 ms
-64 bytes from 192.168.5.1: icmp_req=4 ttl=64 time=0.229 ms
-64 bytes from 192.168.5.1: icmp_req=5 ttl=64 time=0.144 ms
-64 bytes from 192.168.5.1: icmp_req=6 ttl=64 time=0.246 ms
-64 bytes from 192.168.5.1: icmp_req=7 ttl=64 time=0.175 ms
-64 bytes from 192.168.5.1: icmp_req=8 ttl=64 time=0.329 ms
-64 bytes from 192.168.5.1: icmp_req=9 ttl=64 time=0.242 ms
-64 bytes from 192.168.5.1: icmp_req=10 ttl=64 time=0.174 ms
-^C
---- 192.168.5.1 ping statistics ---
-10 packets transmitted, 10 received, 0% packet loss, time 9001ms
-rtt min/avg/max/mdev = 0.137/0.219/0.329/0.061 ms
-
-===============================================================================
-===============================================================================
-soekris test in debian wheezy
- 1GHz intel atom processor
- 1GB ram
- 60GB SSD, no encryption
- Linux debian 3.2.0-2-686-pae #1 SMP Mon Apr 30 05:59:35 UTC 2012 i686 GNU/Linux
-
-networks from ziggy, with ~5ft fancy cable
-
-bnewbold@ziggy:~$ ping 192.168.5.1
-PING 192.168.5.1 (192.168.5.1) 56(84) bytes of data.
-64 bytes from 192.168.5.1: icmp_req=1 ttl=64 time=0.156 ms
-64 bytes from 192.168.5.1: icmp_req=2 ttl=64 time=0.213 ms
-64 bytes from 192.168.5.1: icmp_req=3 ttl=64 time=0.177 ms
-64 bytes from 192.168.5.1: icmp_req=4 ttl=64 time=0.141 ms
-64 bytes from 192.168.5.1: icmp_req=5 ttl=64 time=0.147 ms
-64 bytes from 192.168.5.1: icmp_req=6 ttl=64 time=0.233 ms
-64 bytes from 192.168.5.1: icmp_req=7 ttl=64 time=0.135 ms
-64 bytes from 192.168.5.1: icmp_req=8 ttl=64 time=0.224 ms
-64 bytes from 192.168.5.1: icmp_req=9 ttl=64 time=0.155 ms
-64 bytes from 192.168.5.1: icmp_req=10 ttl=64 time=0.202 ms
-64 bytes from 192.168.5.1: icmp_req=11 ttl=64 time=0.180 ms
-
-bnewbold@ziggy:~$ iperf -i 3 -t 300 -w 256k -d -c 192.168.5.1
-WARNING: option -d is not valid for server mode
-------------------------------------------------------------
-Client connecting to 192.168.5.1, TCP port 5001
-TCP window size: 256 KByte (WARNING: requested 256 KByte)
-------------------------------------------------------------
-[ 3] local 192.168.5.99 port 43558 connected with 192.168.5.1 port 5001
-[ ID] Interval Transfer Bandwidth
-[ 3] 0.0- 3.0 sec 285 MBytes 797 Mbits/sec
-[ 3] 3.0- 6.0 sec 288 MBytes 805 Mbits/sec
-[ 3] 6.0- 9.0 sec 290 MBytes 810 Mbits/sec
-[ 3] 9.0-12.0 sec 289 MBytes 808 Mbits/sec
-[ 3] 12.0-15.0 sec 289 MBytes 808 Mbits/sec
-
-bnewbold@ziggy:~$ iperf -u -c 192.168.5.1
-------------------------------------------------------------
-Client connecting to 192.168.5.1, UDP port 5001
-Sending 1470 byte datagrams
-UDP buffer size: 224 KByte (default)
-------------------------------------------------------------
-[ 3] local 192.168.5.99 port 42197 connected with 192.168.5.1 port 5001
-[ ID] Interval Transfer Bandwidth
-[ 3] 0.0-10.0 sec 1.25 MBytes 1.05 Mbits/sec
-[ 3] Sent 893 datagrams
-[ 3] Server Report:
-[ 3] 0.0-10.0 sec 1.25 MBytes 1.05 Mbits/sec 1.205 ms 0/ 893 (0%)
-
-scp:
-ugly.file 100% 57MB 3.8MB/s 00:15
-
-root@debian:~# time gzip ugly.file
-
-real 0m27.074s
-user 0m26.146s
-sys 0m0.920s
-root@debian:~# time gunzip ugly.file
-
-real 0m4.424s
-user 0m3.556s
-sys 0m0.864s
-
-root@debian:~# ls -lh ugly.file
--rw-r--r-- 1 root root 57M Jul 27 19:55 ugly.file
+An overview of motley benchmarks run against various hardware and operating
+systems run in August, 2012... see the [benchmarks.txt](benchmarks.txt) file
+for exact command outputs:
+
+<table>
+ <tr />
+ <th />Device
+ <th />OS
+ <th />gzip (sec)
+ <th />disk latency (ms)
+ <th />cpu test (ms)
+ <th />memory throughput
+ <th />iperf TCP
+ <th />iperf UDP
+ <th />ping latency (ms)
+ <th />nginx GET
+ <th />scp throuput
+ <tr />
+ <td />Thinkpad x200s
+ <td />wheezy amd64 (linux 3.2)
+ <td />3.172
+ <td />8.6
+ <td />1.36
+ <td />247.11 MB/sec
+ <td />
+ <td />
+ <td />
+ <td />
+ <tr />
+ <td />Soekris net6501
+ <td />pfSense i386 (FreeBSD)
+ <td />
+ <td />
+ <td />
+ <td />146 Mbits/sec
+ <td />1.05 Mbits/sec
+ <td />
+ <td />
+ <td />
+ <tr />
+ <td />Soekris net6501
+ <td />kFreeBSD jail guest
+ <td />23.242
+ <td />0.28
+ <td />22.44
+ <td />28.68 MB/sec
+ <td />
+ <td />
+ <td />0.219 ms
+ <td />16.8 MB/s
+ <td />
+ <tr />
+ <td />Soekris net6501
+ <td />wheezy i386 (linux 3.2)
+ <td />26.146
+ <td />
+ <td />
+ <td />808 Mbits/sec
+ <td />1.05 Mbits/sec
+ <td />
+ <td />~0.202 ms
+ <td />
+ <td />3.8MB/s
+ <tr />
+ <td />DreamPlug
+ <td />wheezy armv5tel (linux 3.2)
+ <td />24.790
+ <td />50.323
+ <td />73.98ms
+ <td />91.98 MB/sec
+ <td />569 Mbits/sec
+ <td />
+ <td />0.131 ms
+ <td />
+ <td />6.3MB/s
+</table>