snow Questions
1
Solved
Why are the workers failing to connect when calling `makePSOCKcluster` from an external `R` process?
I am experiencing a problem already raised before
here
and
here,
but in a different context.
Suppose I have an R script file called psock.R that contains the following
code:
cat("Setup cluster...
Ted asked 5/10, 2022 at 14:40
5
I'm trying to parallelize a code on 4 nodes(type = "SOCK"). Here is my code.
library(itertools)
library(foreach)
library(doParallel)
library(parallel)
workers <- ip address of 4 nodes
cl = mak...
Barbaric asked 1/8, 2014 at 11:44
5
I am loading the following packages into R:
library(foreach)
library(doParallel)
library(iterators)
I "parallelize" code for a long time, but lately I am getting INTERMITTENT stops while code is...
Powdery asked 10/6, 2013 at 0:46
3
Solved
I've written a function in Rcpp and compiled it with inline. Now, I want to run it in parallel on different cores, but I'm getting a strange error. Here's a minimal example, where the function funC...
2
Solved
I'm using the doSNOW package and more specifically the parLapply function to perform reclassification (and subsequently other operations) on a list of big raster datasets (OS: Windows x64).
The co...
Syrup asked 29/2, 2016 at 12:56
0
I use the following code to ...
1. create a parallel cluster
2. source test.R
3. and do some parallel work with functions defined in 'test.R'
library(parallel)
cl <- makeCluster(4)
clusterEvalQ...
Bethesda asked 4/5, 2016 at 13:2
2
Solved
The following (simplified) script works fine on the master node of a unix cluster (4 virtual cores).
library(foreach)
library(doParallel)
nc = detectCores()
cl = makeCluster(nc)
registerDoParalle...
Lisa asked 22/4, 2016 at 12:38
2
Solved
I'm using the snow package in R to execute a function on a SOCK cluster with multiple machines(3) running on Linux OS. I tried to run the code with both parLapply and clusterApply.
In case of any...
Apure asked 3/6, 2013 at 11:38
1
I need to run thousands* of models on 15 machines (each of 4 cores), all Windows. I started to learn parallel, snow and snowfall packages and read a bunch of intro's, but they mainly focus on the s...
Millard asked 24/3, 2014 at 9:19
1
Solved
The makeCluster function for the SNOW package has the different cluster types of "SOCK", "PVM", "MPI", and "NWS" but I'm not very clear on the differences among them, and more specifically which wo...
Carolus asked 25/9, 2013 at 20:13
1
Solved
I am using makeCluster function from R package snow from Linux machine to start a SOCK cluster on a remote Linux machine. All seems settled for the two machines to communicate succesfully (I am abl...
Coumarone asked 31/7, 2013 at 9:5
1
Solved
I've got two servers on a LAN with fresh installs of Centos 6.4 minimal and R 3.0.1. Both computers have doParallel, snow, and snowfall packages installed.
The servers can ssh to each other fine.
...
Waiver asked 29/7, 2013 at 11:50
1
Solved
I've got a Windows HPC Server running with some nodes in the backend. I would like to run Parallel R using multiple nodes from the backend. I think Parallel R might be using SNOW on Windows, but no...
Ruyter asked 9/7, 2013 at 12:19
1
Solved
How would I register a PSOCK cluster (created using package Parallel) with foreach? I'm currently using registerDoSNOW in the doSNOW package to register a snow SOCK cluster.
1
Solved
I'm attempting to run a parallel job in R using snow. I've been able to run extremely similar jobs with no trouble on older versions of R and snow. R package dependencies prevent me from reverting....
1
© 2022 - 2024 — McMap. All rights reserved.