pool Questions
6
Solved
I am trying to create a copy of a CMSampleBuffer as returned by captureOutput in a AVCaptureVideoDataOutputSampleBufferDelegate.
Since the CMSampleBuffers come from a preallocated pool of (15) buff...
Nevers asked 12/7, 2016 at 17:24
3
I'm having this problem in python:
I have a queue of URLs that I need to check from time to time
if the queue is filled up, I need to process each item in the queue
Each item in the queue must be...
Knowling asked 21/6, 2013 at 18:7
3
I'm getting ActiveRecord::ConnectionTimeoutError in a daemon that runs independently from the rails app. I'm using Passenger with Apache and MySQL as the database.
Passenger's default pool size is...
Snazzy asked 14/11, 2011 at 18:43
11
This question has been asked a couple of times in SO and many times in other sites. But I didn't get any satisfiable answer.
My problem:
I have a java web application which uses simple JDBC to co...
Infusive asked 19/12, 2012 at 10:39
2
Solved
We have a number of Python Databricks jobs that all use the same underlying Wheel package to install their dependencies. Installing this Wheel package even with a node that has been idling in a Poo...
Babysitter asked 4/12, 2021 at 21:51
5
Solved
I have the following function:
def copy_file(source_file, target_dir):
pass
Now I would like to use multiprocessing to execute this function at once:
p = Pool(12)
p.map(lambda x: copy_file(x,t...
Aribold asked 28/1, 2011 at 10:57
2
I am trying to use multiprocessing and the idea is to get the links from the result of the Bing Search, but changing one of the configurations (cep configuration) using selenium. I have all the cep...
Borderer asked 14/7, 2020 at 20:56
4
Solved
I would like to use Pool within a class, but there seems to be a problem. My code is long, I created a small-demo variant to illustrated the problem. It would be great if you can give me a variant ...
Fourfold asked 31/8, 2015 at 23:19
14
Solved
I'm trying to use multiprocessing's Pool.map() function to divide out work simultaneously. When I use the following code, it works fine:
import multiprocessing
def f(x):
return x*x
def go():
p...
Pulsate asked 29/11, 2009 at 22:8
5
Solved
I was wondering if my requests is stopped by the website and I need to set a proxy.I first try to close the http's connection ,bu I failed.I also try to test my code but now it seems no outputs.Myb...
Coronograph asked 13/9, 2017 at 3:18
10
Solved
Would it be possible to create a python Pool that is non-daemonic? I want a pool to be able to call a function that has another pool inside.
I want this because deamon processes cannot create proc...
Florey asked 7/8, 2011 at 18:8
2
So I'm trying to speed up my computation time by doing a little bit multiprocessing
I'm trying to use the pool workers.
At the top of my code I have
import Singal as s
import multiprocessing as...
Orchid asked 3/3, 2014 at 21:35
5
Solved
I get an IOError: bad message length when passing large arguments to the map function. How can I avoid this?
The error occurs when I set N=1500 or bigger.
The code is:
import numpy as np
import m...
Rounded asked 14/6, 2015 at 20:23
2
Solved
I'm using python 2.7, and trying to run some CPU heavy tasks in their own processes. I would like to be able to send messages back to the parent process to keep it informed of the current status of...
Lavonnelaw asked 30/9, 2010 at 1:22
4
Solved
I have a Tomcat installation where I suspect the thread pool may be decreasing over time due to threads not being properly released. I get an error in catalina.out when maxthreads is reached, but I...
Braid asked 7/9, 2011 at 12:16
3
Solved
I am trying to use multiprocessing.Pool to run my code in parallel. To instantiate Pool, you have to set the number of processes. I am trying to figure out how many I should set for this. I underst...
Equine asked 11/2, 2022 at 9:41
6
Here's the program:
#!/usr/bin/python
import multiprocessing
def dummy_func(r):
pass
def worker():
pass
if __name__ == '__main__':
pool = multiprocessing.Pool(processes=16)
for index in ra...
Molybdate asked 24/8, 2013 at 1:28
2
Solved
I am running a multiprocessing pool in python, where I have ~2000 tasks, being mapped to 24 workers with the pool.
each task creates a file based on some data analysis and webservices.
I want to ...
Chanel asked 19/5, 2015 at 4:16
1
I am using the multiprocessing.Pool class within an object and attempting the following:
from multiprocessing import Lock, Pool
class A:
def __init__(self):
self.lock = Lock()
self.file = open(...
Gastrostomy asked 10/11, 2021 at 2:52
1
I was getting PicklingError: Can't pickle <type 'obj'> while using multiprocessing so I switched from multiprocessing to pathos.
My code looks like this:
from pathos.multiprocessing import Pr...
2
Solved
I have a script that is essentially an API scraper, it runs perpetually. I strapped a map_async pool to it and its glorious, the pool was hiding some errors which I learned was pretty common. So I ...
Desecrate asked 24/9, 2021 at 19:51
11
Solved
How can I handle KeyboardInterrupt events with python's multiprocessing Pools? Here is a simple example:
from multiprocessing import Pool
from time import sleep
from sys import exit
def slowly_sq...
Strade asked 10/9, 2009 at 23:59
4
Solved
(This question is about how to make multiprocessing.Pool() run code faster. I finally solved it, and the final solution can be found at the bottom of the post.)
Original Question:
I'm trying to u...
Chivaree asked 22/12, 2013 at 7:52
4
Solved
When running a large number of tasks (with large parameters) using Pool.apply_async, the processes are allocated and go to a waiting state, and there is no limit for the number of waiting processes...
Harmattan asked 15/6, 2012 at 18:21
2
Solved
Does seeing the
urllib3.connectionpool WARNING - Connection pool is full, discarding connection
mean that I am effectively loosing data (because of lost connection)
OR
Does it mean that connec...
Moll asked 13/12, 2018 at 15:41
1 Next >
© 2022 - 2025 — McMap. All rights reserved.