Does Python's datatable package support out-of-memory datasets?
Asked Answered
R

0

0

datatable is a relatively fresh high performance DataFrame/data.table alternative for Python. The datatable documentation states:

It focuses on: big data support, high performance, both in-memory and out-of-memory datasets, and multi-threaded algorithms.

Still, haven't found operations related to caching or keeping a part of the data out-of-memory. In what sense does it support out-of-memory datasets?

Recto answered 13/6, 2019 at 1:6 Comment(2)
If you have big data , I recommend daskBlowsy
@WeNYoBen, my data first the memory of our servers for now, just curious what different frameworks can offer... I'm looking at dask and modin as well, thanks!Recto

© 2022 - 2024 — McMap. All rights reserved.