zstandard Questions

2

Solved

I have a 16gb compressed zst file. how would I decompress it on windows? I do not have the memory to handle the decompressed version, so it needs to be written straight to a file.
Benildas asked 10/1, 2020 at 4:56

4

i'm using pandas to convert dataframes to .parquet files using this command: df.to_parquet(file_name, engine='pyarrow', compression='gzip') I need to use zstandard as compression algorithm, but ...
Singultus asked 28/10, 2019 at 16:54

1

I have been trying to download this dataset through my Mac terminal. I know it's huge! https://zenodo.org/record/3606810 I have the tar.zst file, and when I try to decompress (using zstd -d pol_06...
Carlow asked 27/5, 2020 at 15:39

1

I'm trying through Windows terminal to decompress a large number of compressed files with zstd v1.4.0 and then 'ag' search over : zstd -dc -r . | ag -z -i "term" It gives me the following error w...
Mitchmitchael asked 31/7, 2019 at 10:12

1

Solved

I have been working for a long time with .bz2 files. To unpack/decompress .bz2 files into a specific folder I have been using the following function: destination_folder = 'unpacked/' def decompre...
Gauze asked 15/3, 2019 at 13:59

1

Solved

Apache Spark supposedly supports Facebook's Zstandard compression algorithm as of Spark 2.3.0 (https://issues.apache.org/jira/browse/SPARK-19112), but I am unable to actually read a Zstandard-compr...
Hodgkins asked 15/6, 2018 at 2:16
1

© 2022 - 2024 — McMap. All rights reserved.