IO values for i7ie.2xlarge are identical to i7ie.xlarge

[mykaul]

i7ie.xlarge:
  read_iops: 117257
  read_bandwidth: 1148572714
  write_iops: 94180
  write_bandwidth: 505684885
i7ie.2xlarge:
  read_iops: 117257
  read_bandwidth: 1148572714
  write_iops: 94180
  write_bandwidth: 505684885

Whereas https://docs.aws.amazon.com/ec2/latest/instancetypes/so.html#so_instance-store says:

i7ie.large	1 x 1250 GB	NVMe SSD	54,166 / 43,333		✓
i7ie.xlarge	1 x 2500 GB	NVMe SSD	108,333 / 86,666		✓
i7ie.2xlarge	2 x 2500 GB	NVMe SSD	216,666 / 173,332		✓

So double the performance between them.

Originally posted by @mykaul in #559

[roydahan]

@syuu1228 is it just a copy-paste error or these are the values we get for i7ie.2xlarge?

[syuu1228]

Here are raw values of i7ie iotune results, it executed 3 times on each instances, and averages are shown at the bottom.
It seems i7ie.large uses slowest SSD, i7ie.xlarge and i7ie.2xlarge using medium speed SSD, and larger instances (3xlarge, 6xlarge, 12xlarge...) using fastest SSD.
So I decided copy i7ie.xlarge parameters to i7ie.2xlarge.

instance_type   read_iops       read_bandwidth  write_iops      write_bandwidth
i7ie.large.0    58450   574886272       47148   253077216
i7ie.large.1    58447   574871872       47144   253152960
i7ie.large.2    58452   574805824       47145   253168576
i7ie.xlarge.0   117261  1148629760      94184   505675680
i7ie.xlarge.1   117253  1148723072      94177   505678784
i7ie.xlarge.2   117257  1148365312      94181   505700192
i7ie.2xlarge.0  117266  1148608256      94166   505745536
i7ie.2xlarge.1  117270  1148134016      94161   505677120
i7ie.2xlarge.2  117266  1148369024      94177   505698688
i7ie.3xlarge.0  352843  3422118400      119127  1526412672
i7ie.3xlarge.1  352844  3421702144      118973  1526431104
i7ie.3xlarge.2  352817  3424049152      119881  1526483456
i7ie.6xlarge.0  352813  3432191232      118808  1526523520
i7ie.6xlarge.1  352837  3424704512      119741  1526485376
i7ie.6xlarge.2  352822  3428499456      119246  1526491136
i7ie.12xlarge.0 352835  3422241280      119566  1526699136
i7ie.12xlarge.1 352829  3425162240      119214  1526719872
i7ie.12xlarge.2 352832  3424160000      118033  1526715776
i7ie.18xlarge.0 352825  3425764608      119544  1526821376
i7ie.18xlarge.1 352816  3425155072      119555  1526833664
i7ie.18xlarge.2 352815  3428421120      119518  1526809088
i7ie.24xlarge.0 352824  3424752128      119147  1526504320
i7ie.24xlarge.1 352832  3422750976      119154  1526500992
i7ie.24xlarge.2 352826  3424811008      119535  1526532480
i7ie.48xlarge.0 352834  3423049728      119516  1526578176
i7ie.48xlarge.1 352831  3424246016      119574  1526628352
i7ie.48xlarge.2 352815  3428381440      119226  1526603392

i7ie.large      58449   574854656       47145   253132917
i7ie.xlarge     117257  1148572714      94180   505684885
i7ie.2xlarge    117267  1148370432      94168   505707114
i7ie.3xlarge    352834  3422623232      119327  1526442410
i7ie.6xlarge    352824  3428465066      119265  1526500010
i7ie.12xlarge   352832  3423854506      118937  1526711594
i7ie.18xlarge   352818  3426446933      119539  1526821376
i7ie.24xlarge   352827  3424104704      119278  1526512597
i7ie.48xlarge   352826  3425225728      119438  1526603306

I just ran iotune on i7ie.2xlarge again to make sure current parameter is correct, result was:

disks:
  - mountpoint: /var/lib/scylla
    read_iops: 117258
    read_bandwidth: 1150152192
    write_iops: 94138
    write_bandwidth: 508599840

Seems like result is unchanged, it almost same performance as i7ie.xlarge.

These results don't seem to match Amazon's documentation, but isn't the parameters that Amazon's documentation indicates are the sum of all drives?
If it correct, probably it seems to match our measurements.

[roydahan]

Sounds ok to me.
We will know the real effect only when running performance tests on these instance types, but I don't think it's necessary right now.
we may want @avikivity or @xemul to approve that.

[mykaul]

Can we run fio to re-verify? It makes little sense. And we can open a support issue with AWS to clarify that.

[syuu1228]

Here's fio benchmark result on i7ie instances.
I used this script to run fio benchmark, which is borrowed from Alibaba Cloud document, and I added settings to run 4k random read, 4k random write, 1024k sequential read, 1024k sequential write.

Below are results.
It seems write IOPS on larger nodes are faster than iotune, but rest of them are almost same.

instance_type   read_iops       read_bandwidth  write_iops      write_bandwidth
i7ie.large.0    57358.897444    529908613       46014.93184     259432856
i7ie.large.1    57425.290804    530048639       46048.393548    259363116
i7ie.large.2    57363.097024    529908987       46013.29867     259441124
i7ie.xlarge.0   114826.156512   1059567362      91784.735877    519619300
i7ie.xlarge.1   114901.779763   1059531011      91780.403266    519585084
i7ie.xlarge.2   114817.590988   1059636413      91773.752791    519619610
i7ie.2xlarge.0  114499.933351   1060448511      91714.704608    519484064
i7ie.2xlarge.1  114628.811357   1060098813      91753.59035     519242601
i7ie.2xlarge.2  114634.264196   1059995135      91749.3336      519415015
i7ie.3xlarge.0  341885.356262   3164666192      271560.887822   1591678703
i7ie.3xlarge.1  341857.15714    3164807604      271270.670177   1592670126
i7ie.3xlarge.2  341912.547909   3164877365      271464.740385   1592007490
i7ie.6xlarge.0  341806.064645   3163721089      271102.225776   1592563132
i7ie.6xlarge.1  341803.378649   3163337088      271409.52254    1591173459
i7ie.6xlarge.2  341627.54898    3164103311      271284.876553   1591975327
i7ie.12xlarge.0 341811.719244   3162599725      271509.075166   1589655775
i7ie.12xlarge.1 341687.506245   3162152063      271441.783787   1590894341
i7ie.12xlarge.2 341788.307795   3161216516      271374.100719   1590740381
i7ie.18xlarge.0 341754.229386   3161028367      271493.025269   1590387473
i7ie.18xlarge.1 341806.79964    3161857281      271453.425661   1591915683
i7ie.18xlarge.2 341805.860806   3161339210      271366.006326   1589874483
i7ie.24xlarge.0 341971.82911    3159988937      271577.088258   1593055793
i7ie.24xlarge.1 341996.970201   3161060380      271490.462399   1589832572
i7ie.24xlarge.2 341951.683261   3160438313      271478.476546   1590657273
i7ie.48xlarge.0 342012.549933   3157185206      271378.191259   1590598469
i7ie.48xlarge.1 342010.387189   3160187071      271492.643632   1590283562
i7ie.48xlarge.2 341819.746347   3161257346      271371.080487   1590534718

i7ie.large      57382   529955413       46025   259412365
i7ie.xlarge     114848  1059578262      91779   519607998
i7ie.2xlarge    114587  1060180819      91739   519380560
i7ie.3xlarge    341885  3164783720      271432  1592118773
i7ie.6xlarge    341745  3163720496      271265  1591903972
i7ie.12xlarge   341762  3161989434      271441  1590430165
i7ie.18xlarge   341788  3161408286      271437  1590725879
i7ie.24xlarge   341973  3160495876      271515  1591181879
i7ie.48xlarge   341947  3159543207      271413  1590472249

(RAW result files are here)

[syuu1228]

And we can open a support issue with AWS to clarify that.

I tried to open an issue in AWS support but I got "You don't have the necessary IAM permissions to view that support case".
Can anyone else who have enough permission to open the issue?

[avikivity]

Please file a ticket with IT@scylladb.com to give you permissions to engage with AWS support.

[roydahan]

@syuu1228 I have direct contacts to the storage team working on i7ie and i7i.
I'll forward you their information, please CC me on email thread to them.