Slow write speeds with SSD Cache and 10GB network

[First part SOLVED]

When trying to upgrade to 6.2 rc2 from 6.2 beta23 I am getting this:

plugin: updating: unRAIDServer.plg

plugin: downloading: https://s3.amazonaws.com/dnld.lime-technology.com/beta/unRAIDServer-6.2.0-rc2-x86_64.zip ... done

plugin: downloading: https://s3.amazonaws.com/dnld.lime-technology.com/beta/unRAIDServer-6.2.0-rc2-x86_64.md5 ... done

Archive: /tmp/unRAIDServer.zip

inflating: /tmp/unRAIDServer/bzimage

inflating: /tmp/unRAIDServer/bzroot

inflating: /tmp/unRAIDServer/bzroot-gui

inflating: /tmp/unRAIDServer/changes.txt

creating: /tmp/unRAIDServer/config/

extracting: /tmp/unRAIDServer/config/go

inflating: /tmp/unRAIDServer/config/network.cfg

extracting: /tmp/unRAIDServer/config/domain.cfg

extracting: /tmp/unRAIDServer/config/docker.cfg

inflating: /tmp/unRAIDServer/config/ident.cfg

creating: /tmp/unRAIDServer/config/plugins/

creating: /tmp/unRAIDServer/config/plugins/dockerMan/

extracting: /tmp/unRAIDServer/config/plugins/dockerMan/template-repos

inflating: /tmp/unRAIDServer/license.txt

inflating: /tmp/unRAIDServer/make_bootable.bat

inflating: /tmp/unRAIDServer/make_bootable_mac

inflating: /tmp/unRAIDServer/memtest

creating: /tmp/unRAIDServer/syslinux/

inflating: /tmp/unRAIDServer/syslinux/menu.c32

inflating: /tmp/unRAIDServer/syslinux/ldlinux.c32

inflating: /tmp/unRAIDServer/syslinux/syslinux.cfg-

inflating: /tmp/unRAIDServer/syslinux/mbr.bin

inflating: /tmp/unRAIDServer/syslinux/mboot.c32

inflating: /tmp/unRAIDServer/syslinux/syslinux.cfg

inflating: /tmp/unRAIDServer/syslinux/syslinux.exe

inflating: /tmp/unRAIDServer/syslinux/syslinux

inflating: /tmp/unRAIDServer/syslinux/libutil.c32

inflating: /tmp/unRAIDServer/syslinux/libcom32.c32

inflating: /tmp/unRAIDServer/syslinux/make_bootable_mac.sh

boot device shows 63096 free but upgrade needs 142060

plugin: run failed: /bin/bash retval: 1

On the main page the flash drive also shows up as only 64mb. (It is an 8gb flash drive)

Flash DataTraveler_SE9 - 7.80 GB (sdc) * 103 34 0 vfat 206 MB 141 MB 64.6 MB

How do I expand the file system on the flash drive so that I can use the full space (and upgrade to this new version)?

[This is not Solved]

Another totally unrelated question/ concern: (Feel free to move to more appropriate discussion board if need be)

I am using 10gb/e between my unRaid system and my main computer, 2x 240gb SSD cache drives, and 5 6TB Seagate Enterprise capacity hard drives as my main array drives.

So why am seeing a huge drop off in write speeds after the first few seconds?

The SSD I am copying from has a Speed Test result of around 511Mb/s read, and the SSD's in the unRaid system are rated for around 400Mb/s as well, so that really shouldn't be the bottleneck. And the transfer is very fast for the first part of the transfer, but drops off quite rapidly, so it seems the network isn't the limitation either. (I am using Mellanox ConnectX2 SPF+ adapters on both ends. Thanks for adding native support for those with the 6.2 beta 23  )

I have tried just about every setting I could find, but am stuck on what to do at this point. ( I even changed the array into Turbo mode even though I am aware that that shouldn't change cache drive speeds)

And before anyone asks, Yes I do have cache drives enabled for this share:

My read speeds are also way slower than i was expecting them to be.

As mentioned, I am using Seagate Enterprise Capacity drives (Same as linus used in his servers), but am only seeing about 80-85Mb/s read speeds. (Linus in his storinator video mentioned that for read he would be limited to the native speed of a single drive, or about 200Mb/s) So I'm not sure what I am doing wrong or if this is just a natural limitation of unRaid.

In this image I am copying from the unRaid share to my 1tb internal SSD

Any answers or guidance in the right direction would be appreciated.

Thanks. 

The first problem is that somehow the boot flash was prepared incorrectly.  You'll want to back it up, then reformat it to its full size.  You may need to remove all of the existing partitions first.

I don't know the answer to the second issue, but it would help if we had your diagnostics.  Please see Need help? Read me first!, and attach the diagnostics zip.

Here are the Diagnostics Files.

tower-diagnostics-20160713-2017.zip

A few observations:

Write:

-speed drop off after a few seconds is normal, first few seconds are being written to RAM cache, after that you get your device write speed.

-announced SSD write speed are usually for compressible data, write speed for uncompressible data is usually considerably lower, I tested several SSDs with unRAID and best I can get is usually 225/250MB/s.

-having said that your write speed, if indeed using the SSD still seems rather low, make sure you're using the Dynamix trim plugin or the write speed degrades over time.

Read:

-200MB/s is the maximum read speed of your disks, only in the outer cylinders, it will get considerably lower as the disk fills up, ending a little above 100Mb/s.

-You're copying a folder with many (small?) files, bigger files should give better results.

-Try to copy something from the SSD cache to your desktop, speeds should be much higher, ruling out any network/unRAID problem, I get ~450MB/s using a single SSD and the same Mellanox ConnectX-2.