Low IOPS on Volumes

Hello,

I am trying to host an Ethereum node for development, and I need 500GB of SSD.

The Volumes IOPS is extremely low, 600 IOPS Write, and 200 IOPS Read.

fiotest: (groupid=0, jobs=1): err= 0: pid=47634: Thu Jul 22 08:08:37 2021
  read: IOPS=605, BW=2422KiB/s (2480kB/s)(688MiB/290734msec)
   bw (  KiB/s): min= 1312, max= 5053, per=100.00%, avg=2421.80, stdev=1391.35, samples=581
   iops        : min=  328, max= 1263, avg=605.43, stdev=347.82, samples=581
  write: IOPS=201, BW=808KiB/s (827kB/s)(229MiB/290734msec); 0 zone resets
   bw (  KiB/s): min=  344, max= 2051, per=100.00%, avg=808.28, stdev=467.97, samples=581
   iops        : min=   86, max=  512, avg=202.02, stdev=117.02, samples=581
  cpu          : usr=0.61%, sys=2.39%, ctx=223296, majf=0, minf=10
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=176005,58727,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Meanwhile the OS Disk is higher:

fiotest: (groupid=0, jobs=1): err= 0: pid=45587: Thu Jul 22 08:02:41 2021
  read: IOPS=40.9k, BW=160MiB/s (168MB/s)(6141MiB/38438msec)
   bw (  KiB/s): min=83528, max=239616, per=100.00%, avg=163810.66, stdev=27576.03, samples=76
   iops        : min=20882, max=59904, avg=40952.71, stdev=6894.03, samples=76
  write: IOPS=13.7k, BW=53.4MiB/s (55.9MB/s)(2051MiB/38438msec); 0 zone resets
   bw (  KiB/s): min=27928, max=79440, per=100.00%, avg=54700.62, stdev=9201.17, samples=76
   iops        : min= 6982, max=19860, avg=13675.14, stdev=2300.29, samples=76
  cpu          : usr=7.44%, sys=44.25%, ctx=141481, majf=0, minf=9
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0%
     issued rwts: total=1572145,525007,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=64

Is there a way to make the IOPS faster for Volumes

2 Replies

It's worth noting that Volume performance is expected to be slower than local performance due to the differences in hardware they run on (HDD VS. SSD). The quickest speeds will always reside on your OS disk, so if you end up needing a large amount of space, your best bet is to go with a higher-end plan that natively includes larger amounts of storage. Furthermore, a dedicated CPU plan (as opposed to a shared plan) would ensure that you don't run into performance contention with neighboring servers.

All that to say, those numbers do seem a bit low; you can usually expect up to 150MB/s and up to 5K IOPS on Block Storage Volumes. If you'd like us to check out the host performance internally, I'd recommend opening up a Support ticket and including the output of the following commands so we can get a better idea of your performance:

# benchmark for write speeds
dd if=/dev/zero of=blockstorage.test bs=4M count=4000

# benchmark for read speeds
dd if=blockstorage.test of=/tmp/blockstorage.test bs=4M

# general system stats
iostat 1 10

I also want to mention that upgrades to Block Storage hardware are on the way. I don't have a timeline to share, but it's something to keep an eye out for moving forward.

The system OS disk has a good IOPS, but now I am stuck in cross roads with which VM provider to choose.

All I care about is 4 CPU Cores, 8GB Ram, and 500GB NVME/SSD + 1TB HDD. With Linode, it is very limited that I am forced to go with 8 CPU Cores, and 32GB RAM to get that 500GB NVME/SSD. Which is getting more expensive to run my open source hobby.

Is there a way for me to get half the cores and half the memory with same amount of NVME/SSD?

Reply

Please enter an answer
Tips:

You can mention users to notify them: @username

You can use Markdown to format your question. For more examples see the Markdown Cheatsheet.

> I’m a blockquote.

I’m a blockquote.

[I'm a link] (https://www.google.com)

I'm a link

**I am bold** I am bold

*I am italicized* I am italicized

Community Code of Conduct