Skip file calculation

[FluffyDiscord]

I have folder in share that has 14TB of images, so there are literally dozens of millions files. Scanning step take take up to several weeks. This is, lightly taken, not wanted behavior. I just want to transfer files from one drive to second one until it hits some percentage of used space that I can set in Unbalance settings.

[jbrodriguez]

yea, ive had the idea of having "algorithm" plugins, so that the transfer logic could be switched as needed

not there yet :)

however, i still think any algorithm should read the amount of data to be copied/moved, in order to know if it fits or not on the target (unless im missing something in your scenario)

[FluffyDiscord]

unraid is somehow able to tell how much of a drive is used (in the UI, on my array/share). This could be used instead of scanning folders, if one can tap it.

[jbrodriguez]

right, but even knowing the free space on the target, if we just copy/move without sizing the source, how would the logic know if a file fits on the target or not if it doesnt know the file size ?

[FluffyDiscord]

oh, right, I get what are you trying to say. Since we are under a single array/share, this does not matter, no? Just check every X files or every few seconds the current free space on target drive, that unraid reports, and copy/move files there until it runs out. There could be simple current_**file**_size < (target_drive_free_space - some_kind_of_reserved_space_we_want), directories don't take space, and when on the same share/array, they are shared anyway, so you don't have to move whole folder, no?