Why does pickle.dumps({}.items()) fail with TypeError: can't pickle dict_items objects in Python 3.5.2 but not in Python 2.7.12? "Pickling" the dictionary with pickle.dumps({}) works in both...

Problem Let's say I have this module named custom_module: class CustomClass: pass And I use this class in a script that serializes an object of the class I defined in custom_module: import cl...

I am using gunicorn with multiple workers for my machine learning project. But the problem is when I send a train request only the worker getting the training request gets updated with the latest m...

My program was killed while serializing data (a dict) to disk with dill. I cannot open the partially-written file now. Is it possible to partially or fully recover the data? If so, how? Here's ...

I have a pickling problem. I want to serialize a function in my main script, then load it and run it in another script. To demonstrate this, I've made 2 scripts: Attempt 1: The naive way: dill_p...

For me what I do is detect what is unpickable and make it into a string (I guess I could have deleted it too but then it will falsely tell me that field didn't exist but I'd rather have it exist bu...

We intend to use dill to generate a hash of a function. Our previous approach was using bytecode, but it is slower and it is an extra unnecessary step if we decide to unpickle the function in the f...

I was getting PicklingError: Can't pickle <type 'obj'> while using multiprocessing so I switched from multiprocessing to pathos. My code looks like this: from pathos.multiprocessing import Pr...

I would like to use the multiprocessing library in Python. Sadly multiprocessing uses pickle which doesn't support functions with closures, lambdas, or functions in __main__. All three of these are...

My module contains a class which should be pickleable, both instance and definition I have the following structure: MyModule |-Submodule |-MyClass In other questions on SO I have already found ...

I have seen numerous answers stating to use dill for saving the current state of the kernel; import dill # save dill.dump_session('notebook_env.db') # load dill.load_session('notebook_env.db') No...

I have a large object in my Python3 code which, when tried to be pickled with the pickle module throws the following error: TypeError: cannot serialize '_io.BufferedReader' object However, dill....

I'm looking to use lime's explainer within a udf on pyspark. I've previously trained the tabular explainer, and stored is as a dill model as suggested in link loaded_explainer = dill.load(open('lo...

See updates at the bottom -- A similar question was asked here, but never resolved: pickling and unpickling user-defined class I'm working on a project which necessitates pickling user defined c...

I have dill installed in my python 2.7 but when I try to unpickle my model it says "No module named dill". The pickled file contains pandas series. EDIT : Here's the snapshot of the traceback on E...

I'm using Python 2.7 and NumPy 1.11.2, as well as the latest versions of dill ( I just did the pip install dill) , on Ubuntu 16.04. When storing a NumPy array using pickle, I find that pickle is ...

Using dill pickling of lambda functions work fine in Python 2, but not in Python 3, is there any alternative? Python 3: import dill import pickle pickle.dumps(lambda x: x**2) pickle.Pickling...

How can I pickle a python object which contains lambdas? Can't pickle local object 'BaseDiscretizer.__init__.<locals>.<lambda>' is the error I get when trying to pickle https://githu...

Consider the following MWE: #import dill as pickle # Dill exhibits similar behavior import pickle class B: def __init__(self): self.links = set() class A: def __init__(self, base: B): self.b...

I'd like to replace MPI4PY's built-in Pickle-serialization with dill. According to the doc the class _p_Pickle should have 2 attributes called dumps and loads. However, python says there are no suc...

I have a bunch of objects created from classes imported with module = imp.load_source(packageName, packagePath) that I need to pickle. It all works perfectly, as long as packagePath is directly ...

The question may seem a little basic, but wasn't able to find anything that I understood in the internet. How do I store something that I pickled with dill? I have come this far for saving my cons...

I am trying to serialize thousands of objects and some of these objects are lambda objects. Since cPickle doesn't work for lambdas, I tried using dill. However, the drop in computational speed is ...

I need to serialise scikit-learn/statsmodels models such that all the dependencies (code + data) are packaged in an artefact and this artefact can be used to initialise the model and make predictio...

In the example below, I have placed the class Foo inside its own module foo. Why is the external class dumped by ref? The instance ff is not being dumped with its source code. I am using Python ...