I'm a new linux user. I'm getting this error during compilation. When I use the 'make' command within a build directory. Fatal Error: mpi.h No such file or directory I've installed OpenMpi using t...

I am trying to understand what are the basic difference between Tensorflow Mirror Strategy and Horovod Distribution Strategy. From the documentation and the source code investigation I found that ...

Suppose I have 3 processes, and each wants to send 3 arrays a0,a1,a2 to processes 0,1, and 2. Given the MPI_Alltoallv interface, that is, int MPI_Alltoallv(const void *sendbuf, const int *sendcount...

I having some synchronization issues using the OpenMPI implementation of MPI_Barrier: int rank; int nprocs; int rc = MPI_Init(&argc, &argv); if(rc != MPI_SUCCESS) { fprintf(stderr, "Una...

I want to create a generic MPI method, let's say a bcast for a specific object. but I need to convert primitive types to MPI_Data types ? any idea how I can do it ? template <typename T> voi...

I'm working on a little application that multiples an array with a Matrix. It works without any problem. I'm loking for measure the execution time of the application. I can find the individual time...

I have just upgraded my Kubuntu from 18.04 to 20.04. Unfortunately there is an error that keeps showing up everytime I use apt upgrade or installing something with apt. The error is: update-altern...

I have some code to print a 2D array to the standard output. The problem is that when I run it, every process writes to the output and the data overlaps, rendering it unusable. How can i build a c...

I have been searching for a way to use mpi on my mac but everything is very advanced. I have successfully installed open-mpi using brew install open-mpi I have .c files ready for compiling and ...

I have recently installed OpenMPI on my computer and when I try to run a simple Hello World program, it exits with the next error: ------------------------------------------------------- Primary j...

The MPI-3 standard introduces shared-memory, that can be read and written by all processes sharing this memory without using calls to the MPI library. While there are examples of one-sided communic...

Horovod is combining NCCL and MPI into an wrapper for Distributed Deep Learning in for example TensorFlow. I haven't heard of NCCL previously and was looking into its functionality. The following i...

-- I was able to solve this problem, see last edit below --- I am trying to use R on the computing cluster of my institute. For parallel computing issues, I would like to install the snow and the ...

I often (but not always) get the following error when running MPI jobs after switching wifi hosts. Fatal error in MPI_Init: Other MPI error, error stack: MPIR_Init_thread(498)..............: MPI...

I am developing an MPI application which requires to be run with a specific implementation of MPI (let's call it MPIvA). On my workstation, another implementation of MPI (let's call it MPIvB) is in...

I have defined a custom struct which I need to send over to another MPI process using the MPI_Bsend (or MPI_Send). Here is the struct: struct car{ int shifts; int topSpeed; }myCar; The issue...

I am writing a machine learning toolkit to run algorithm with different settings in parallel (each process run the algorithm for one setting). I am thinking about either to use mpi4py or python's b...

I had a quick look on the forums and I don't think this question has been asked already. I am currently working with an MPI/CUDA hybrid code, made by somebody else during his PhD. Each CPU has its...

I have a python script that depends on mpi4py implementation of MPI. This needs to be run through mpiexec (or mpirun). My Question is : How to run (and hopefully debug) a python script using mpiex...

I would like to run a job on the cluster. There are a different number of CPUs on different nodes and I have no idea which nodes will be assigned to me. What are the proper options so that the job ...

The problem I faced has been solved here: Loading shared library in open-mpi/ mpi-run I know not how, setting LD_LIBRARY_PATH or specifying -x LD_LIBRARY_PATH fixes the problem, when my installati...

I have a problem with running a python Hello World mpi4py code on a virtual machine. The hello.py code is: #!/usr/bin/python #hello.py from mpi4py import MPI comm = MPI.COMM_WORLD size = comm.G...

this is how we use MPI_Init function int main(int argc, char **argv) { MPI_Init(&argc, &argv); … } why does MPI_Init use pointers to argc and argv instead of values of argv?

Does anyone know if it is possible to compile MPI with gcc?. I need to use gcc, no mpicc.

Background I'm working on a C++ project in High Performance Computing using MPI. I have a function with a few different overloads, that I use to convert different types into strings: void append(...