I have a dataframe with columns of different datatypes including dates. No after doing some modifications, i want to save it a feather file so as to access it later. But i am getting the error on t...

I have feather format file sales.feather that I am using for exchanging data between python and R. In R I use the following command: df = arrow::read_feather("sales.feather", as_data_fra...

Is there a way to append to a .feather format file using pd.to_feather? I am also curious if anyone knows some of the limitations in terms of max file size, and whether it is possible to query for...

I have a pandas dataframe dfwin. And I save it to feather format hoping I can read it in R. But R always throws the error "Error in openFeather(path): Invalid: Not a feather file Traceback: ...

Both are columnar (disk-)storage formats for use in data analysis systems. Both are integrated within Apache Arrow (pyarrow package for python) and are designed to correspond with Arrow as a colum...

I have a (daily growing) list of around 100 big excel files, which I analyse in Python. As I have to run several loops over all the files, my analysis are getting slower and slower. Therefore I'd l...

What is the difference between Arrow IPC and Feather? The official Arrow documentation has this to say about Feather: Version 2 (V2), the default version, which is exactly represented as the Arrow...

I am processing a huge dataset (50 million rows) in CSV. I am trying to slice it and save it as Feather Format in order to save some memory while loading the feather format later. As a workaround,...

I have a data frame, let's say: import pandas as pd df = pd.DataFrame({'a': [1, 4], 'b': [1, 3]}) I want to save it as a feather file to s3 but I can't find a working way to do it. I tried to use ...

As I'm given to understand due to the search of issues in the Feather Github, as well as questions in stackoverflow such as What are the differences between feather and parquet?, the Feather format...

I'm working with both R and Python and I want to write one of my pandas DataFrames as a feather so I can work with it more easily in R. However, when I try to write it as a feather, I get the follo...

I'd like to use .ftr files to quickly analyze hundreds of tables. Unfortunately I have some problems with decimal and thousands separator, similar to that post, just that read_feather does not allo...

Using the IO tools in pandas it is possible to convert a DataFrame to an in-memory feather buffer: import pandas as pd from io import BytesIO df = pd.DataFrame({'a': [1,2], 'b': [3.0,4.0]}) b...

I'm exploring file storage format options for Python and stumbled on feather. I noticed the last release was back in 2017 and was concerned about its long term existence. Web searches are pulling ...

With a folder with many .feather files, I would like to load all of them into dask in python. So far, I have tried the following sourced from a similar question on GitHub https://github.com/dask/d...

I have a large Pandas dataframe (~15GB, 83m rows) that I am interested in saving as an h5 (or feather) file. One column contains long ID strings of numbers, which should have string/object type. Bu...

My workflow typically involves loading some data, typically from CSV files, into a pandas dataframe, cleansing it, defining what the right data type for each column is, then exporting it to a SQL s...

I tried saving a dataframe to feather format but while loading back I got the error os.makedirs('tmp', exist_ok=True) df_hist.to_feather('tmp/historical-raw') Here's the loading back into the da...

Is it possible to export data-frame from Apache Spark to feather (https://github.com/wesm/feather) file?

I am converting a csv file to feather type using the code as below, import pandas as pd import feather df = pd.read_csv('myfile.csv') feather.write_dataframe(df, 'myfile.feather') myfile.csv is...

I would like to save to disk a tibble that has list-columns (for later use inside R only). Ideally I'd like a fast binary format like feather, however, it doesn't seem to support list cols: test &...

I am getting the following error after attempting to read in an xlsx file, write it to a dataframe using feather, then read in that same dataframe using feather and display the results using df.hea...

When using the feather package (http://blog.cloudera.com/blog/2016/03/feather-a-fast-on-disk-format-for-data-frames-for-r-and-python-powered-by-apache-arrow/) to try and write a simple 20x20 datafr...