Dropdown menu in the top-right of the UI on a local machine (PC): Kernel-> Change kernel-> Python 2 (on a local PC) Python 3 (on a local PC) My new kernel (on a remote PC)

I am using the ipyparallel module to speed up an all by all list comparison but I am having issues with huge memory consumption. Here is a simplified version of the script that I am running: From a...

I just started using a Mac, so please forgive me if this sounds too naive. I'm trying to install Interactive Parallel. From https://github.com/ipython/ipyparallel, it says I need to find jupyter_n...

I have the need to use my model to do predictions in batches and in parallel in python. If I load the model and create the data frames in a regular for loop and use the predict function it works wi...

I have copied all the codes to the work directory on all my engine machines. And my code are: my_test.py my_startegy.py main.py So, main.py will be ran on Client Machine, the codes in main.py ar...

I am running the same simulation in a loop with different parameters. Each simulation makes use a pandas DataFrame (data) which is only read, never modified. Using ipyparallel (IPython parallel), I...

I am trying to start a ipyparallel cluster using MPI. The ipcluster_config has following lines modified as such: c.MPILauncher.mpi_cmd = ['mpiexec'] c.MPIControllerLauncher.controller_args = ['-...

I have the following: ipyparallel (5.0.0) ipython (4.0.3) I have enabled ipcluster by typing in the command line: ipcluster nbextension enable I'm trying to create a new cluster on the IPyth...

This issue may be related to https://github.com/ipython/ipyparallel/issues/207 which is also not marked as solved, yet. I also opened this issue here https://github.com/ipython/ipyparallel/issues/...

I'm trying to parallelize the GridSearchCV of scikit-learn. It's running on a jupyter (hub) notebook environment. After some research I found this code: from sklearn.externals.joblib import Parall...

There're docs scattered under Jupyter or ipyparallel, but there's no a single piece document illustrating the entire process from beginning to end. I am really confused. Can anyone has experience t...

Is there any reason to use Ipyparallel for common python script (not ipython notebook)?

I am attempting to run a job using the ipyparallel system with lru_cache and am running into issues. From the terminal: ipcluster start -n 2 In an ipython notebook: from ipyparallel import Cl...

How do I force the remote kernels to restart when I am using IPython.parallel? For example in the normal IPython notebook, I can restart a kernel right from the tool bar. My question is when I hav...

I'm using Ipython parallel in an optimisation algorithm that loops a large number of times. Parallelism is invoked in the loop using the map method of a LoadBalancedView (twice), a DirectView's dic...

From the IPython Architecture Overview documentation we know that ... The IPython engine is a Python instance that takes Python commands over a network connection. Given that it is a Python in...

I have IPython 3 installed for Python 3 in order to work with Jupyterhub. Now I'm able to use notebooks with a Python2 kernel, because I created /usr/local/share/jupyter/kernels/python2/kernel.jso...

I am trying to setup logging when using IPython parallel. Specifically, I would like to redirect log messages from the engines to the client. So, rather than each of the engines logging individuall...

I've been playing around with IPython.parallel and I wanted to use some custom modules of my own, but haven't been able to do it as explained on the cookbook using dview.sync_imports(). The only th...

I've run into a minor HPC problem after running some tests on a 80core (160HT) nehalem architecture with 2Tb DRAM: A server with more than 2 sockets starts to stall a lot (delay) as each thread st...

I am experimenting with IPython.parallel and just want to launch several shell command on different engines. I have the following Notebook: Cell 0: from IPython.parallel import Client client = C...

I'm new to IPython and would like to print intermediate results to stdout while running IPython parallel cluster functions. (I'm aware that with multiple processes, this might mangle the output, bu...