Spill OOM Protection

[madsbk]

Depend on rapidsai/rmm#1665

Introduce the spill_oom_protection option that uses managed memory when spilling-on-demand would otherwise crash with an OOM error.

This targets our CUDF_SPILL users, which have workflows that cudf-spilling can handle generally but might encounter memory hotspots that sometime trigger an OOM crash. With CUDF_SPILL_OOM_PROTECTION, these hotspots will now use managed memory. If there is no such hotspots that CUDF_SPILL cannot handle, this option does nothing.

The target is not heavy oversubscribing workflows, in such cases using manager memory with prefetching is preferable.

Checklist

• I am familiar with the Contributing Guidelines.
• New or existing tests cover these changes.
• Update docstrings
• The documentation is up to date with these changes.