I don't have a good way of reproducing this but filing an issue to at least document it.
Joseph Kuchar has found that when reading csv files from the boathouse mounted /minio folders, some files are returned prematurely. When accessing them in python, some 10000+ line csv files would return with maybe 60 lines and without a read error.
We don't know if this is just a boathouse-file+python problem, or a general problem (eg: not sure if we just did a wc -l on a file repeatedly if it would ever return smaller than it should). He's switched to using mc cp to copy files locally first and the issue has been resolved.
I don't have a good way of reproducing this but filing an issue to at least document it.
Joseph Kuchar has found that when reading csv files from the boathouse mounted
/miniofolders, some files are returned prematurely. When accessing them in python, some 10000+ line csv files would return with maybe 60 lines and without a read error.We don't know if this is just a boathouse-file+python problem, or a general problem (eg: not sure if we just did a
wc -lon a file repeatedly if it would ever return smaller than it should). He's switched to usingmc cpto copy files locally first and the issue has been resolved.