Fli
11-16-2014, 06:43 PM
Hello, can You please share any good command or script which does quick hdd benchmark test in linux command line?
I mean so it does as much disk parameters and as much readable friendly output as possible.
Basic details about amounts of data being read/written and transactions (tps) can be obtained by utilities from "sysstat" package:
iostat 2
iostat -x 2
(good to watch "tps", "%wa" and "%util" value which can indicate transactions per second, system waiting on the HDD, utilization.
But more convenient/readable output is by utility "glances"
There are a few tests on this page. Titles are highlighted in red color.
------
First command (long test because it include internet speed testing, only basic sequential disk performance):
wget --no-check-certificate https://web.archive.org/web/20190405002852/https://freevps.us/downloads/bench.sh -O - -o /dev/null | bash;apt install speedtest-cli 2>/dev/null||yum install speedtest-cli 2>/dev/null;speedtest-cli --bytes --share
..no command output available
Network, CPU, disk tests (15 minute) can be done using:
curl -LsO bench.monster/speedtest.sh; bash speedtest.sh
Or customize the test: https://bench.monster/
Or basic seq. IO and several network speed tests: https://raw.githubusercontent.com/teddysun/across/master/bench.sh
Network speed test:
curl -s https://raw.githubusercontent.com/sivel/speedtest-cli/master/speedtest.py | python -
Second test for HDD speed (read/write)
start=$(date +%s);pamac install ioping --no-confirm 2>/dev/null||yum install ioping -y -q 2>/dev/null||apt-get install ioping -y -q 2>/dev/null;echo -e "\n\n---------------- TESTS BELOW ----------------";echo "==== Disk sequential Writing speed: ====";dd if=/dev/zero of=speedtest bs=64k count=3200 conv=fdatasync;echo "==== Disk sequential Reading speed ====";dd if=/dev/zero of=./speedtest bs=64k count=3200 oflag=direct;echo "==== Measure disk seek rate (iops, avg): ====";echo -e "\n/dev/sda ioping test (dedicated server, it may not test SW RAID array speed, only single drive or HW raid i guess):";sudo ioping -R $(pwd);echo -e "\n/ ioping test:";echo "";echo "CPU name: $( awk -F: '/model name/ {name=$2} END {print name}' /proc/cpuinfo )";echo "CPU frequency: $( awk -F: ' /cpu MHz/ {freq=$2} END {print freq}' /proc/cpuinfo )Mhz x $( awk -F: '/model name/ {core++} END {print core}' /proc/cpuinfo ) cores";echo "Total RAM: $( free | awk 'NR==2 {print $2}' )";echo "Total SWAP: $( free | awk 'NR==3 {print $2}' )";rm -f speedtest;echo "Total testing runtime: $(($(date +%s)-start)) seconds";
Sample output on 7200rpm HDD:
---------------- TESTS BELOW ----------------
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 3.11317 s, 67.4 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 2.03164 s, 103 MB/s
==== Measure disk seek rate (iops, avg): ====
/dev/sda ioping test:
ioping: stat "/dev/sda" failed: No such file or directory
/ ioping test:
--- / (simfs /vz/private/860) ioping statistics ---
74 requests completed in 3.0 s, 24 iops, 98.0 KiB/s
min/avg/max/mdev = 730 us / 40.8 ms / 292.1 ms / 54.3 ms
CPU name: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz
CPU frequency: 1596.000Mhz x 11 cores
Total RAM: 18432
Total SWAP: 2048
Download speed from LeaseWeb Netherlands (100Mb): 5.50MB/s
Download speed from CacheFly USA (100Mb): 37.3MB/s
Total testing runtime: 14 seconds
Sample output on 7200rpm HDD:
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 7.7133 seconds, 27.2 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 14.6936 seconds, 14.3 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 1.8 TiB) ioping statistics ---
110 requests completed in 3.0 s, 36 iops, 145.5 KiB/s
min/avg/max/mdev=8.5 ms / 27.5 ms / 476.0 ms / 44.8 ms
CPU name: Intel(R) Xeon(R) CPU L5520 @ 2.27GHz
CPU frequency: 2266.812Mhz x 16 cores
Total RAM: 24047
Total SWAP: 26111
Testing download speed... (320Mb)
Download speed from OVH France (100Mb): 5.83MB/s
Download speed from LeaseWeb Netherlands (100Mb): 9.53MB/s
Download speed from CacheFly USA (100Mb): 11.3MB/s
Download speed from CacheFly USA (10Mb): 11.2MB/s
Download speed from GoogleCode.com USA (10Mb): 10.4MB/s
Total testing runtime: 65 seconds
Sample output on Seagate Constellations 2x1TB HDD in HW Raid 1
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.66874 s, 126 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 28.4612 s, 7.4 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 931.3 GiB) ioping statistics ---
254 requests completed in 3.0 s, 85 iops, 342.7 KiB/s
min/avg/max/mdev = 1.8 ms / 11.7 ms / 30.7 ms / 5.0 ms
CPU name: Intel(R) Xeon(R) CPU L5520 @ 2.27GHz
CPU frequency: 2266.749Mhz x 16 cores
Total RAM: 23966
Total SWAP: 12079
Testing download speed... (320Mb)
Download speed from OVH France (100Mb):
Download speed from LeaseWeb Netherlands (100Mb): 8.15MB/s
Download speed from CacheFly USA (100Mb): 96.0MB/s
--2015-03-21 19:30:41-- http://cachefly.cachefly.net/10mb.test2
Resolving cachefly.cachefly.net... 205.234.175.175
Connecting to cachefly.cachefly.net|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2015-03-21 19:30:42 ERROR 404: Not Found.
Download speed from CacheFly USA (10Mb):
Download speed from GoogleCode.com USA (10Mb): 15.4MB/s
Total testing runtime: 49 seconds
(this server provider is not recommended and is ClanComs (http://clancoms.com/accounts/aff.php?aff=035))
Sample output on 6x Dell SSD MZ5EA200HMDR-000D3 @ 200GB HW Raid 10 no BBU, no cache
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.458952 s, 457 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.15862 s, 181 MB/s
==== Measure disk seek rate (iops, avg): ====
/dev/sda ioping test (dedicated server, it may not test SW RAID array speed, only single drive or HW raid i guess):
--- /dev/sda (block device 556.0 GiB) ioping statistics ---
9.13 k requests completed in 2.89 s, 35.7 MiB read, 3.16 k iops, 12.3 MiB/s
generated 9.13 k requests in 3.00 s, 35.7 MiB, 3.04 k iops, 11.9 MiB/s
min/avg/max/mdev = 97.5 us / 316.4 us / 1.25 ms / 34.7 us
/ ioping test:
--- / (ext4 /dev/sda3) ioping statistics ---
9.60 k requests completed in 2.96 s, 37.5 MiB read, 3.25 k iops, 12.7 MiB/s
generated 9.60 k requests in 3.00 s, 37.5 MiB, 3.20 k iops, 12.5 MiB/s
min/avg/max/mdev = 72.8 us / 308.0 us / 3.96 ms / 266.2 us
CPU name: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
CPU frequency: 1509.148Mhz x 32 cores
Total RAM: 64166
Total SWAP:
Download speed from LeaseWeb Netherlands (100Mb):
Download speed from CacheFly USA (100Mb): 77.3MB/s
Total testing runtime: 12 seconds
Server was idle, from SC; raid 0 returned only increased sequential read to around 787MB/s, ioping same
Sample output on WDC WD5000LPVX-00V0TT0
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 2.10324 s, 99.7 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.73663 s, 121 MB/s
==== Measure disk seek rate (iops, avg): ====
-bash: ioping: command not found
CPU name: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz
CPU frequency: 2499.683Mhz x 8 cores
Total RAM: 8004
Total SWAP: 16379
Testing download speed... (320Mb)
Download speed from OVH France (100Mb):
Download speed from LeaseWeb Netherlands (100Mb): 15.5MB/s
Download speed from CacheFly USA (100Mb): 70.4MB/s
--2015-05-19 10:19:47-- http://cachefly.cachefly.net/10mb.test2
Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2015-05-19 10:19:47 ERROR 404: Not Found.
Download speed from CacheFly USA (10Mb):
Download speed from GoogleCode.com USA (10Mb):
Total testing runtime: 15 seconds
fio, test showing RANDOM read and write iops and bandwidth
pamac install ioping fio --no-confirm 2>/dev/null||yum install ioping fio -y -q 2>/dev/null||apt-get install ioping fio -y -q 2>/dev/null;sudo fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=2G --readwrite=randrw --rwmixread=75;rm test
Sample output on 6x Dell SSD MZ5EA200HMDR-000D3 @ 200GB HW Raid 0 no BBU, no cache
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [m(1)] [100.0% done] [68684KB/22712KB/0KB /s] [17.2K/5678/0 iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=108284: Mon Aug 7 00:15:57 2017
read : io=3071.7MB, bw=164087KB/s, iops=41021, runt= 19169msec
write: io=1024.4MB, bw=54719KB/s, iops=13679, runt= 19169msec
cpu : usr=8.18%, sys=28.11%, ctx=368061, majf=0, minf=346
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=786347/w=262229/d=0, short=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=164087KB/s, minb=164087KB/s, maxb=164087KB/s, mint=19169msec, maxt=19169msec
WRITE: io=1024.4MB, aggrb=54719KB/s, minb=54719KB/s, maxb=54719KB/s, mint=19169msec, maxt=19169msec
Disk stats (read/write):
sda: ios=782553/261686, merge=2775/387, ticks=967972/230108, in_queue=1198664, util=99.55%
No testfile downloads, just DD and ioping
cd /mount/point/to/test/;pamac install ioping --no-confirm 2>/dev/null||yum install ioping -y -q 2>/dev/null||apt-get install ioping -y -q 2>/dev/null;echo "======== TESTS BELOW ========";echo "==== Disk sequential Writing speed: ====";sudo dd if=/dev/zero of=speedtest bs=64k count=3200;echo "==== Disk sequential Reading speed ====";sudo dd if=/dev/zero of=/var/log/wtmp bs=64k count=3200 oflag=direct;echo "==== Measure disk seek rate (iops, avg): ====";sudo ioping -R /dev/sda;
Note that on WH raid 1, instead of /dev/sda i used /dev/sda1 . Sda1 had double performance because of raid.
Sample output: (Samsung 840 EVO 120GB SSD)
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.3512 seconds, 597 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.607669 seconds, 345 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 111.8 GiB) ioping statistics ---
71.1 k requests completed in 3.0 s, 29.3 k iops, 114.5 MiB/s
min/avg/max/mdev=24 us / 34 us / 1.2 ms / 17 us
Sample output: (6x Dell SSD MZ5EA200HMDR-000D3 @ 200GB, HW Raid 10 LSI 9210-8i RAID Controller (no BBU, no cache))
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.393423 s, 533 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.37238 s, 153 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (block device 556.0 GiB) ioping statistics ---
8.74 k requests completed in 2.90 s, 34.1 MiB read, 3.01 k iops, 11.8 MiB/s
generated 8.74 k requests in 3.00 s, 34.1 MiB, 2.91 k iops, 11.4 MiB/s
min/avg/max/mdev = 239.5 us / 332.1 us / 17.3 ms / 306.2 us
Sample output2: (TOSHIBA DT01ACA200 2Tb, 7200 rpm)
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.548378 seconds, 382 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 27.7615 seconds, 7.6 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 1.8 TiB) ioping statistics ---
4 requests completed in 3.9 s, 1 iops, 4.1 KiB/s
min/avg/max/mdev=21.0 ms / 980.3 ms / 2.1 s / 747.5 ms
Sample output3: (7.2K RPM Seagate Constellation.2 ST91000640NS in HW Raid 1)
$ sudo ioping -R /dev/sda1
--- /dev/sda1 (device 250.0 MiB) ioping statistics ---
289 requests completed in 3.0 s, 97 iops, 391.9 KiB/s
min/avg/max/mdev = 304 us / 10.2 ms / 261.5 ms / 19.8 ms
usually 130-180 iops reading while raid was also approx. 20% bussy with other things. (unsure if ioping gets HDD priority)
Sample output4: (WDC WD5000LPVX-00V0TT0)
======== TESTS BELOW ========
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.63104 s, 129 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 2.03459 s, 103 MB/s
==== Measure disk seek rate (iops, avg): ====
-bash: ioping: command not found
Only disk IOPS/TPS
echo "Can take a few seconds..";fio --bs=4k --size=1m --direct=1 --runtime=5 --rw=randread --numjobs=3 --group_reporting --name=1m|grep iops|awk '{print $5}';rm -f 1m.*
(requires "fio" be installed - yum install fio/apt-get install fio)
OR do it in loop to see continuous IOPS (IOPS can be low sometimes because of other server processes eating its own drive resources):
while true;do sleep 1 && sudo fio --bs=4k --size=1m --direct=1 --runtime=5 --rw=randread --numjobs=3 --group_reporting --name=1m|grep iops|awk '{print $5}' && rm -f 1m.*;done
note that these commands may return inadequate wrong values, as i do not understand these commands, if anyone do, please share proper command. This command is also mentioned in this (https://internetlifeforum.com/linux-forums/7860-how-discover-drive-hdd-disk-performance-iops-case-linux-server-vps/) topic.
Sample output (OpenVZ VPS limitted to 30IOPS)
Can take a few seconds..
iops=45,
Sample output (OpenVZ VPS unlimitted IOPS)
iops=2064
iops=2053
iops=691
iops=2133
iops=886
iops=2577
iops=2400
Sample output (OpenVZ VPS host server/unlimitted IOPS)
iops=2493
iops=3413
iops=1072
iops=2844
iops=3173
3 above mentioned iops/tps outputs are made on the 7.2K RPM HDD Seagate Constellation.2 ST91000640NS in HW Raid 1 while drive is already utilized by roughly 20-80%. If anyone knows how to get more acurate results of the IOPS/tps, please kindly reply this topic.
Sample output (idle virtuozzo host server with 6x Dell SSD MZ5EA200HMDR-000D3 HW raid 10, no cache)
iops=1733,
iops=1964,
iops=2104,
iops=1969,
iops=2048,
iops=1877,
iops=2042,
Only disk DD (without iops)
echo "==== Disk sequential Writing speed: ====";dd if=/dev/zero of=speedtest bs=64k count=3200;echo "==== Disk sequential Reading speed ====";dd if=/dev/zero of=/var/log/wtmp bs=64k count=3200 oflag=direct;
Sample output (Samsung EVO 840 SSD):
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.363577 seconds, 577 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.597386 seconds, 351 MB/s
Sample output (7,2k rpm Toshiba)
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.52583 seconds, 137 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 31.3309 seconds, 6.7 MB/s
----- HDD HEALTH STATUS ------
re/install smartl and check disc status:
yum reinstall smartctl -y;smartctl -a /dev/sda
or debian linux:
aptitude install smartmontools;smartctl -a /dev/sda
=== START OF INFORMATION SECTION ===
Device Model: Samsung SSD 840 EVO 120GB
Serial Number: S1D5NSAF296722B
LU WWN Device Id: 5 002538 8a0250d98
Firmware Version: EXT0BB6Q
User Capacity: 120,034,123,776 bytes [120 GB]
Sector Size: 512 bytes logical/physical
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: 8
ATA Standard is: ATA-8-ACS revision 4c
Local Time is: Thu Sep 25 22:27:42 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
...
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
9 Power_On_Hours 0x0032 099 099 000 Old_age Always - 4311
12 Power_Cycle_Count 0x0032 099 099 000 Old_age Always - 225
177 Wear_Leveling_Count 0x0013 099 099 000 Pre-fail Always - 10
179 Used_Rsvd_Blk_Cnt_Tot 0x0013 100 100 010 Pre-fail Always - 0
181 Program_Fail_Cnt_Total 0x0032 100 100 010 Old_age Always - 0
182 Erase_Fail_Count_Total 0x0032 100 100 010 Old_age Always - 0
183 Runtime_Bad_Block 0x0013 100 100 010 Pre-fail Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0032 071 060 000 Old_age Always - 29
195 Hardware_ECC_Recovered 0x001a 200 200 000 Old_age Always - 0
199 UDMA_CRC_Error_Count 0x003e 100 100 000 Old_age Always - 0
235 Unknown_Attribute 0x0012 099 099 000 Old_age Always - 224
241 Total_LBAs_Written 0x0032 099 099 000 Old_age Always - 2149804445
I mean so it does as much disk parameters and as much readable friendly output as possible.
Basic details about amounts of data being read/written and transactions (tps) can be obtained by utilities from "sysstat" package:
iostat 2
iostat -x 2
(good to watch "tps", "%wa" and "%util" value which can indicate transactions per second, system waiting on the HDD, utilization.
But more convenient/readable output is by utility "glances"
There are a few tests on this page. Titles are highlighted in red color.
------
First command (long test because it include internet speed testing, only basic sequential disk performance):
wget --no-check-certificate https://web.archive.org/web/20190405002852/https://freevps.us/downloads/bench.sh -O - -o /dev/null | bash;apt install speedtest-cli 2>/dev/null||yum install speedtest-cli 2>/dev/null;speedtest-cli --bytes --share
..no command output available
Network, CPU, disk tests (15 minute) can be done using:
curl -LsO bench.monster/speedtest.sh; bash speedtest.sh
Or customize the test: https://bench.monster/
Or basic seq. IO and several network speed tests: https://raw.githubusercontent.com/teddysun/across/master/bench.sh
Network speed test:
curl -s https://raw.githubusercontent.com/sivel/speedtest-cli/master/speedtest.py | python -
Second test for HDD speed (read/write)
start=$(date +%s);pamac install ioping --no-confirm 2>/dev/null||yum install ioping -y -q 2>/dev/null||apt-get install ioping -y -q 2>/dev/null;echo -e "\n\n---------------- TESTS BELOW ----------------";echo "==== Disk sequential Writing speed: ====";dd if=/dev/zero of=speedtest bs=64k count=3200 conv=fdatasync;echo "==== Disk sequential Reading speed ====";dd if=/dev/zero of=./speedtest bs=64k count=3200 oflag=direct;echo "==== Measure disk seek rate (iops, avg): ====";echo -e "\n/dev/sda ioping test (dedicated server, it may not test SW RAID array speed, only single drive or HW raid i guess):";sudo ioping -R $(pwd);echo -e "\n/ ioping test:";echo "";echo "CPU name: $( awk -F: '/model name/ {name=$2} END {print name}' /proc/cpuinfo )";echo "CPU frequency: $( awk -F: ' /cpu MHz/ {freq=$2} END {print freq}' /proc/cpuinfo )Mhz x $( awk -F: '/model name/ {core++} END {print core}' /proc/cpuinfo ) cores";echo "Total RAM: $( free | awk 'NR==2 {print $2}' )";echo "Total SWAP: $( free | awk 'NR==3 {print $2}' )";rm -f speedtest;echo "Total testing runtime: $(($(date +%s)-start)) seconds";
Sample output on 7200rpm HDD:
---------------- TESTS BELOW ----------------
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 3.11317 s, 67.4 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 2.03164 s, 103 MB/s
==== Measure disk seek rate (iops, avg): ====
/dev/sda ioping test:
ioping: stat "/dev/sda" failed: No such file or directory
/ ioping test:
--- / (simfs /vz/private/860) ioping statistics ---
74 requests completed in 3.0 s, 24 iops, 98.0 KiB/s
min/avg/max/mdev = 730 us / 40.8 ms / 292.1 ms / 54.3 ms
CPU name: Intel(R) Xeon(R) CPU X5650 @ 2.67GHz
CPU frequency: 1596.000Mhz x 11 cores
Total RAM: 18432
Total SWAP: 2048
Download speed from LeaseWeb Netherlands (100Mb): 5.50MB/s
Download speed from CacheFly USA (100Mb): 37.3MB/s
Total testing runtime: 14 seconds
Sample output on 7200rpm HDD:
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 7.7133 seconds, 27.2 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 14.6936 seconds, 14.3 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 1.8 TiB) ioping statistics ---
110 requests completed in 3.0 s, 36 iops, 145.5 KiB/s
min/avg/max/mdev=8.5 ms / 27.5 ms / 476.0 ms / 44.8 ms
CPU name: Intel(R) Xeon(R) CPU L5520 @ 2.27GHz
CPU frequency: 2266.812Mhz x 16 cores
Total RAM: 24047
Total SWAP: 26111
Testing download speed... (320Mb)
Download speed from OVH France (100Mb): 5.83MB/s
Download speed from LeaseWeb Netherlands (100Mb): 9.53MB/s
Download speed from CacheFly USA (100Mb): 11.3MB/s
Download speed from CacheFly USA (10Mb): 11.2MB/s
Download speed from GoogleCode.com USA (10Mb): 10.4MB/s
Total testing runtime: 65 seconds
Sample output on Seagate Constellations 2x1TB HDD in HW Raid 1
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.66874 s, 126 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 28.4612 s, 7.4 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 931.3 GiB) ioping statistics ---
254 requests completed in 3.0 s, 85 iops, 342.7 KiB/s
min/avg/max/mdev = 1.8 ms / 11.7 ms / 30.7 ms / 5.0 ms
CPU name: Intel(R) Xeon(R) CPU L5520 @ 2.27GHz
CPU frequency: 2266.749Mhz x 16 cores
Total RAM: 23966
Total SWAP: 12079
Testing download speed... (320Mb)
Download speed from OVH France (100Mb):
Download speed from LeaseWeb Netherlands (100Mb): 8.15MB/s
Download speed from CacheFly USA (100Mb): 96.0MB/s
--2015-03-21 19:30:41-- http://cachefly.cachefly.net/10mb.test2
Resolving cachefly.cachefly.net... 205.234.175.175
Connecting to cachefly.cachefly.net|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2015-03-21 19:30:42 ERROR 404: Not Found.
Download speed from CacheFly USA (10Mb):
Download speed from GoogleCode.com USA (10Mb): 15.4MB/s
Total testing runtime: 49 seconds
(this server provider is not recommended and is ClanComs (http://clancoms.com/accounts/aff.php?aff=035))
Sample output on 6x Dell SSD MZ5EA200HMDR-000D3 @ 200GB HW Raid 10 no BBU, no cache
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.458952 s, 457 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.15862 s, 181 MB/s
==== Measure disk seek rate (iops, avg): ====
/dev/sda ioping test (dedicated server, it may not test SW RAID array speed, only single drive or HW raid i guess):
--- /dev/sda (block device 556.0 GiB) ioping statistics ---
9.13 k requests completed in 2.89 s, 35.7 MiB read, 3.16 k iops, 12.3 MiB/s
generated 9.13 k requests in 3.00 s, 35.7 MiB, 3.04 k iops, 11.9 MiB/s
min/avg/max/mdev = 97.5 us / 316.4 us / 1.25 ms / 34.7 us
/ ioping test:
--- / (ext4 /dev/sda3) ioping statistics ---
9.60 k requests completed in 2.96 s, 37.5 MiB read, 3.25 k iops, 12.7 MiB/s
generated 9.60 k requests in 3.00 s, 37.5 MiB, 3.20 k iops, 12.5 MiB/s
min/avg/max/mdev = 72.8 us / 308.0 us / 3.96 ms / 266.2 us
CPU name: Intel(R) Xeon(R) CPU E5-2660 0 @ 2.20GHz
CPU frequency: 1509.148Mhz x 32 cores
Total RAM: 64166
Total SWAP:
Download speed from LeaseWeb Netherlands (100Mb):
Download speed from CacheFly USA (100Mb): 77.3MB/s
Total testing runtime: 12 seconds
Server was idle, from SC; raid 0 returned only increased sequential read to around 787MB/s, ioping same
Sample output on WDC WD5000LPVX-00V0TT0
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 2.10324 s, 99.7 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.73663 s, 121 MB/s
==== Measure disk seek rate (iops, avg): ====
-bash: ioping: command not found
CPU name: Intel(R) Xeon(R) CPU E5420 @ 2.50GHz
CPU frequency: 2499.683Mhz x 8 cores
Total RAM: 8004
Total SWAP: 16379
Testing download speed... (320Mb)
Download speed from OVH France (100Mb):
Download speed from LeaseWeb Netherlands (100Mb): 15.5MB/s
Download speed from CacheFly USA (100Mb): 70.4MB/s
--2015-05-19 10:19:47-- http://cachefly.cachefly.net/10mb.test2
Resolving cachefly.cachefly.net (cachefly.cachefly.net)... 205.234.175.175
Connecting to cachefly.cachefly.net (cachefly.cachefly.net)|205.234.175.175|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
2015-05-19 10:19:47 ERROR 404: Not Found.
Download speed from CacheFly USA (10Mb):
Download speed from GoogleCode.com USA (10Mb):
Total testing runtime: 15 seconds
fio, test showing RANDOM read and write iops and bandwidth
pamac install ioping fio --no-confirm 2>/dev/null||yum install ioping fio -y -q 2>/dev/null||apt-get install ioping fio -y -q 2>/dev/null;sudo fio --randrepeat=1 --ioengine=libaio --direct=1 --gtod_reduce=1 --name=test --filename=test --bs=4k --iodepth=64 --size=2G --readwrite=randrw --rwmixread=75;rm test
Sample output on 6x Dell SSD MZ5EA200HMDR-000D3 @ 200GB HW Raid 0 no BBU, no cache
Starting 1 process
test: Laying out IO file(s) (1 file(s) / 4096MB)
Jobs: 1 (f=1): [m(1)] [100.0% done] [68684KB/22712KB/0KB /s] [17.2K/5678/0 iops] [eta 00m:00s]
test: (groupid=0, jobs=1): err= 0: pid=108284: Mon Aug 7 00:15:57 2017
read : io=3071.7MB, bw=164087KB/s, iops=41021, runt= 19169msec
write: io=1024.4MB, bw=54719KB/s, iops=13679, runt= 19169msec
cpu : usr=8.18%, sys=28.11%, ctx=368061, majf=0, minf=346
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
issued : total=r=786347/w=262229/d=0, short=r=0/w=0/d=0
latency : target=0, window=0, percentile=100.00%, depth=64
Run status group 0 (all jobs):
READ: io=3071.7MB, aggrb=164087KB/s, minb=164087KB/s, maxb=164087KB/s, mint=19169msec, maxt=19169msec
WRITE: io=1024.4MB, aggrb=54719KB/s, minb=54719KB/s, maxb=54719KB/s, mint=19169msec, maxt=19169msec
Disk stats (read/write):
sda: ios=782553/261686, merge=2775/387, ticks=967972/230108, in_queue=1198664, util=99.55%
No testfile downloads, just DD and ioping
cd /mount/point/to/test/;pamac install ioping --no-confirm 2>/dev/null||yum install ioping -y -q 2>/dev/null||apt-get install ioping -y -q 2>/dev/null;echo "======== TESTS BELOW ========";echo "==== Disk sequential Writing speed: ====";sudo dd if=/dev/zero of=speedtest bs=64k count=3200;echo "==== Disk sequential Reading speed ====";sudo dd if=/dev/zero of=/var/log/wtmp bs=64k count=3200 oflag=direct;echo "==== Measure disk seek rate (iops, avg): ====";sudo ioping -R /dev/sda;
Note that on WH raid 1, instead of /dev/sda i used /dev/sda1 . Sda1 had double performance because of raid.
Sample output: (Samsung 840 EVO 120GB SSD)
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.3512 seconds, 597 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.607669 seconds, 345 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 111.8 GiB) ioping statistics ---
71.1 k requests completed in 3.0 s, 29.3 k iops, 114.5 MiB/s
min/avg/max/mdev=24 us / 34 us / 1.2 ms / 17 us
Sample output: (6x Dell SSD MZ5EA200HMDR-000D3 @ 200GB, HW Raid 10 LSI 9210-8i RAID Controller (no BBU, no cache))
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.393423 s, 533 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.37238 s, 153 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (block device 556.0 GiB) ioping statistics ---
8.74 k requests completed in 2.90 s, 34.1 MiB read, 3.01 k iops, 11.8 MiB/s
generated 8.74 k requests in 3.00 s, 34.1 MiB, 2.91 k iops, 11.4 MiB/s
min/avg/max/mdev = 239.5 us / 332.1 us / 17.3 ms / 306.2 us
Sample output2: (TOSHIBA DT01ACA200 2Tb, 7200 rpm)
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.548378 seconds, 382 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 27.7615 seconds, 7.6 MB/s
==== Measure disk seek rate (iops, avg): ====
--- /dev/sda (device 1.8 TiB) ioping statistics ---
4 requests completed in 3.9 s, 1 iops, 4.1 KiB/s
min/avg/max/mdev=21.0 ms / 980.3 ms / 2.1 s / 747.5 ms
Sample output3: (7.2K RPM Seagate Constellation.2 ST91000640NS in HW Raid 1)
$ sudo ioping -R /dev/sda1
--- /dev/sda1 (device 250.0 MiB) ioping statistics ---
289 requests completed in 3.0 s, 97 iops, 391.9 KiB/s
min/avg/max/mdev = 304 us / 10.2 ms / 261.5 ms / 19.8 ms
usually 130-180 iops reading while raid was also approx. 20% bussy with other things. (unsure if ioping gets HDD priority)
Sample output4: (WDC WD5000LPVX-00V0TT0)
======== TESTS BELOW ========
==== Disk sequential Writing speed: ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.63104 s, 129 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 2.03459 s, 103 MB/s
==== Measure disk seek rate (iops, avg): ====
-bash: ioping: command not found
Only disk IOPS/TPS
echo "Can take a few seconds..";fio --bs=4k --size=1m --direct=1 --runtime=5 --rw=randread --numjobs=3 --group_reporting --name=1m|grep iops|awk '{print $5}';rm -f 1m.*
(requires "fio" be installed - yum install fio/apt-get install fio)
OR do it in loop to see continuous IOPS (IOPS can be low sometimes because of other server processes eating its own drive resources):
while true;do sleep 1 && sudo fio --bs=4k --size=1m --direct=1 --runtime=5 --rw=randread --numjobs=3 --group_reporting --name=1m|grep iops|awk '{print $5}' && rm -f 1m.*;done
note that these commands may return inadequate wrong values, as i do not understand these commands, if anyone do, please share proper command. This command is also mentioned in this (https://internetlifeforum.com/linux-forums/7860-how-discover-drive-hdd-disk-performance-iops-case-linux-server-vps/) topic.
Sample output (OpenVZ VPS limitted to 30IOPS)
Can take a few seconds..
iops=45,
Sample output (OpenVZ VPS unlimitted IOPS)
iops=2064
iops=2053
iops=691
iops=2133
iops=886
iops=2577
iops=2400
Sample output (OpenVZ VPS host server/unlimitted IOPS)
iops=2493
iops=3413
iops=1072
iops=2844
iops=3173
3 above mentioned iops/tps outputs are made on the 7.2K RPM HDD Seagate Constellation.2 ST91000640NS in HW Raid 1 while drive is already utilized by roughly 20-80%. If anyone knows how to get more acurate results of the IOPS/tps, please kindly reply this topic.
Sample output (idle virtuozzo host server with 6x Dell SSD MZ5EA200HMDR-000D3 HW raid 10, no cache)
iops=1733,
iops=1964,
iops=2104,
iops=1969,
iops=2048,
iops=1877,
iops=2042,
Only disk DD (without iops)
echo "==== Disk sequential Writing speed: ====";dd if=/dev/zero of=speedtest bs=64k count=3200;echo "==== Disk sequential Reading speed ====";dd if=/dev/zero of=/var/log/wtmp bs=64k count=3200 oflag=direct;
Sample output (Samsung EVO 840 SSD):
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.363577 seconds, 577 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 0.597386 seconds, 351 MB/s
Sample output (7,2k rpm Toshiba)
==== Disk sequential Writing speed: ====3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 1.52583 seconds, 137 MB/s
==== Disk sequential Reading speed ====
3200+0 records in
3200+0 records out
209715200 bytes (210 MB) copied, 31.3309 seconds, 6.7 MB/s
----- HDD HEALTH STATUS ------
re/install smartl and check disc status:
yum reinstall smartctl -y;smartctl -a /dev/sda
or debian linux:
aptitude install smartmontools;smartctl -a /dev/sda
=== START OF INFORMATION SECTION ===
Device Model: Samsung SSD 840 EVO 120GB
Serial Number: S1D5NSAF296722B
LU WWN Device Id: 5 002538 8a0250d98
Firmware Version: EXT0BB6Q
User Capacity: 120,034,123,776 bytes [120 GB]
Sector Size: 512 bytes logical/physical
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: 8
ATA Standard is: ATA-8-ACS revision 4c
Local Time is: Thu Sep 25 22:27:42 2014 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
...
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
9 Power_On_Hours 0x0032 099 099 000 Old_age Always - 4311
12 Power_Cycle_Count 0x0032 099 099 000 Old_age Always - 225
177 Wear_Leveling_Count 0x0013 099 099 000 Pre-fail Always - 10
179 Used_Rsvd_Blk_Cnt_Tot 0x0013 100 100 010 Pre-fail Always - 0
181 Program_Fail_Cnt_Total 0x0032 100 100 010 Old_age Always - 0
182 Erase_Fail_Count_Total 0x0032 100 100 010 Old_age Always - 0
183 Runtime_Bad_Block 0x0013 100 100 010 Pre-fail Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0032 071 060 000 Old_age Always - 29
195 Hardware_ECC_Recovered 0x001a 200 200 000 Old_age Always - 0
199 UDMA_CRC_Error_Count 0x003e 100 100 000 Old_age Always - 0
235 Unknown_Attribute 0x0012 099 099 000 Old_age Always - 224
241 Total_LBAs_Written 0x0032 099 099 000 Old_age Always - 2149804445