What is the correct method for using multiple CPU cores with jax.pmap? The following example creates an environment variable for SPMD on CPU core backends, tests that JAX recognises the devices, an...

I am coding on a single-device laptop and I am using jax.pmap because my code will run on multiple TPUs. I would like to "fake" having multiple devices to test my code and try different t...

when I read the Julia document of multi-core parallel computing, I noticed there are both parallel map pmap and for-loop @distributed for. From the documentation, "Julia's pmap is designed for the...

I am wondering how to use pmap() function if I have more than 3 inputs as parameters to map into a function with other default inputs. Here is a reproducible example: a=c(5, 100, 900) b=c(1, 2, ...

I run the following simple program #include <stdio.h> #include <stdlib.h> int main() { malloc(1024*1024*32); getchar(); return 0; } htop gives this VIRT RES SHR 36684 312 240 ...

I'm trying to better understand how pmap() works within dataframes, and I get a surprising result when applying pmap() to compute means from several columns. mtcars %>% mutate(comp_var = pma...

I am trying to collate results from a simulation study using dplyr and purrr. My results are saved as a list of data frames with the results from several different classification algorithms, and I'...

JDK version is hotspot 8u_45 I researched native memory of my java process. The native memory even consumes more space than heap. However there are many native memory blocks which confuses me. The...

I have a java application running on Java 8 inside a docker container. The process starts a Jetty 9 server and a web application is being deployed. The following JVM options are passed: -Xms768m -X...

I have been working in Julia for a few months now and I am interested in writing some of my code in parallel. I am working on a problem where I use 1 model to generate data for several different re...

I have a docker container running a base image of alpine linux and when I exec into the docker container and run the command: pmap -x [pid] The headers that I see in the output are: Address K...

I am trying to port some of my R code to Julia; Basically I have rewritten the following R code in Julia: library(parallel) eps_1<-rnorm(1000000) eps_2<-rnorm(1000000) large_matrix<-ife...

I am building a microsimulation model in Julia. I have built the structure of my function and it runs great for for 1 "person". I'd like to write the script to run 100000+ people through the model ...

I'm testing out parallelism in Julia to see if there's a speedup on my machine (I'm picking a language to implement new algorithms with). I didn't want to dedicate a ton of time writing a huge exam...

I was trying to see memory map of a process on Linux x86-64 using pmap -x command. I got confused looking at the output of the pmap. Particularly for the entries for mapping dynamic libraries. Ther...

Why doesn't this do what I think it should: benjamin@benjamin-VirtualBox:~$ julia -p 3 julia> @everywhere(function foom(bar::Vector{Any}, k::Integer) println(repeat(bar[2],bar[1])); return bar;...

The documentation on the pmap function leaves me wondering how efficient it would be for something like fetching a collection of XML feeds over the web. I have no idea how many concurrent fetch ope...

I tested the clojure function map and pmap as show below, in cojure REPL. It make me confused: why the parallel pmap is slower than map? user=> (def lg (range 1 10000000)) user=> (time (def r...

What is difference between 'Shared Object Memory' and 'Heap Memory' in Java. Is it like 'Shared Object Memory' is superset of 'Heap Memory'? The source of this question is documentation of jmap. I...

I'm trying to locate where my memory has gone for a java process running in linux. Someone suggested I use pmap -x to see exactly what the memory is doing. The output is really long but basically...