Not urgent: high mem usage with filter_documents()

[arupakaa]

Hi,

Your work has been a godsend! Just wanted to share a minor issue...

Im working on a relatively large dataset (final DTM is ~25MB).

When I run filter_documents(), mem usage balloons up to 40GB, after which R crashes.

I'm running the Microsoft/MRO (latest) release on Mac OSX (latest).

One work-around, for the min = 1 case at least, is: .[unique(.$i),] .

Runs super-fast and doesn't seem to introduce any undue weirdness.

Hope that helps.

[trinker]

Thanks you for submitting this. I'll look into it.