Out of memory - What are sensible upper bounds? #18
Description
I am using the NLP package for similarity search.
Input is a corpus of 300000 entries of []string, each consisting of about 10-50 words.
When I naively follow the example
https://pkg.go.dev/github.com/james-bowman/nlp#example-package
, this panics with Out of Memory.
I reduced the set to 10000 entries and FitTransform takes a very long time on my laptop (Minutes) to complete.
Am I doing something wrong or is this task not the correct way of using this package?