(reported by @Dk-Qumulo))
in some cases, a file or folder larger than [bucket size] gets tacked onto the last bucket of a qsplit, making the parallelized rsync transfers very uneven.
If it is a discrete file that is larger than a bucket there is not much we can do with our current approach.
But if it is a directory with children, we should be able to split it across buckets as normal.
The investigation here is to determine why a directory is not being split.
(reported by @Dk-Qumulo))
in some cases, a file or folder larger than [bucket size] gets tacked onto the last bucket of a qsplit, making the parallelized rsync transfers very uneven.
If it is a discrete file that is larger than a bucket there is not much we can do with our current approach.
But if it is a directory with children, we should be able to split it across buckets as normal.
The investigation here is to determine why a directory is not being split.