gnu-parallel Questions
3
Solved
I want to lint all the files in the current (recursive) directory while printing out only files that have an error, and assign a variable to 1 to be used after the linting is finished.
#!/bin/bash...
Void asked 3/1, 2018 at 20:30
3
Solved
I'm trying to learn GNU Parallel because I have a case where I think I could easily parallelize a bash function. So in trying to learn, I went to the GNU Parallel manual where there is an example.....
Katabasis asked 22/5, 2014 at 18:15
2
Solved
I have a jq command which I am trying to parallelise using GNU parallel but for some reason I am not able to get it to work.
The vanilla jq query is:
jq --raw-output '._id as $id | ._source.Citatio...
Appertain asked 28/1, 2023 at 13:44
3
Solved
I am trying to process so text files with awk using the parallel command as a shell script, but haven't been able to get it to output each job to a different file
If i try:
seq 10 | parallel awk ...
Mellisamellisent asked 5/3, 2014 at 3:20
3
Solved
In the docker file:
from debian:latest
RUN apt-get install parallel
RUN parallel --citation <<< "will cite"
And the docker build simply does not complete because of this entry process...
Debase asked 12/5, 2020 at 21:21
2
Solved
I'm running a bunch of shell scripts like
parallel -a my_scripts bash
and at some point I decided I've run enough of them and would like to stop spawning new jobs, and simply let all the existing j...
Uchida asked 17/7, 2017 at 15:18
2
Solved
I want to unzip multiple files,
Using this answer, I found the following command.
find -name '*.zip' -exec sh -c 'unzip -d "${1%.*}" "$1"' _ {} \;
How do I use GNU Parallel with the above comman...
Criminology asked 24/12, 2019 at 10:40
4
Solved
Using GNU parallel: http://www.gnu.org/software/parallel/
I have a program that takes two arguments, e.g.
$ ./prog file1 file2
$ ./prog file2 file3
...
$ ./prog file23456 file23457
I'm using a ...
Baptlsta asked 6/6, 2011 at 16:45
7
Solved
I have a name.txt file of one column, e.g.
A
B
C
D
E
F
Then I have many files, e.g. x.txt, y.txt and z.txt
x.txt has
A 1
C 3
D 2
y.txt has
A 1
B 4
E 3
z.txt has
B 2
D 2
F 1
The desirable output...
Fluorosis asked 24/11, 2020 at 5:41
2
Solved
I want to run 3 jobs (A, B, C) on 2 cores of a machine with >2 cores. I know that:
runtime(A)>runtime(C)
runtime(B)>runtime(C)
It is unknown in advance if runtime(A)>runtime(B) or runti...
Hysterics asked 26/7, 2020 at 9:2
1
Here's a basic question. I'm curious as to
how do xargs and gnu parallel differ when parallelizing code?
And are there use cases in which you'd use one over the other?
I ask this because I have see...
Yardstick asked 22/6, 2020 at 9:24
1
Solved
I'd like to run several long-running processes on several inputs. E.g.:
solver_a problem_1
solver_b problem_1
...
solver_b problem_18
solver_c problem_18
I know how to run multiple arguments for...
Giga asked 28/4, 2020 at 14:52
4
Solved
How do I export a function from zsh, so that I can use it in gnu parallel?
example:
function my_func(){ echo $1;}
export -f my_func
parallel "my_func {}" ::: 1 2
in bash will output
1
2
whe...
Nejd asked 29/3, 2014 at 23:48
2
Solved
I was able to install GNU Parallel globally in git-bash by following this answer.
However, on running an example command as mentioned in the parallel-tutorial,
parallel -k echo ::: A B C > ab...
Spade asked 22/3, 2020 at 8:24
3
Solved
I want to install GNU parrallel on Centos 7
There is not much info to find. Can someone explain me how to do this?
This is some useful info I found
Fourpence asked 26/1, 2016 at 15:22
4
Solved
I have been trying to use GNU parallel for some time, but I have never been able to get it to function at all!
For example, running (in a non-empty directory!):
ls | parallel echo # Outputs singl...
Bespread asked 8/5, 2013 at 19:39
1
Solved
Suppose I am running gnu parallel on an array of items received from standard in, and split according to some criteria:
cat content | parallel -j 4 my_command
How do I access the job number such...
Lashanda asked 11/3, 2019 at 22:2
2
Solved
I have a bash script with a function that needs to run in parallel with different arguments.
I need to know if at least one of the executions failed (returned non-zero) - doesn't matter how many fa...
Kristelkristen asked 3/1, 2019 at 9:37
2
I have program (gawk) that outputs stream of data to its STDOUT.
The data processed is literally 10s of GBs.
I don't want to persist it in a single file but rather split it into chunks and potentia...
Subchaser asked 25/3, 2014 at 8:6
1
Solved
I am running an awk script which I want to parallelize through GNU parallel.
This script demultiplexes one input file to multiple output files depending on a value on each line. The code is the fo...
Melanous asked 18/10, 2018 at 16:10
1
Solved
Has anyone been able to successfully use GNU Parallel on Windows 10 with git-bash? Is it possible? - If so, how?
Background:
I'm having trouble installing GNU Parallel and using it, and it got m...
Nahtanha asked 18/9, 2018 at 20:3
2
Is it possible to set a -halt condition (or multiple -halt conditions?) such that all jobs will be halted if any of them fail, regardless of the exit code?
I want to monitor for an event (that I ju...
Bromal asked 8/3, 2017 at 19:32
2
Solved
I can see how easy it is to run a parallel job on multiple input but is there no other way to run the same job in parallel multiple times with putting the command in a file and repeating it many ti...
Turnkey asked 9/7, 2018 at 13:24
2
How do I use GNU Parallel to run shellcheck on all *.sh with a wrapper function?
This attempt has the correct target files, but Parallel seems to struggle with the subshell.
lint:sh() {
local ou...
Splendiferous asked 26/6, 2018 at 5:57
3
Solved
I've got a whole heap of files on a server, and I want to upload these onto S3. The files are stored with a .data extension, but really they're just a bunch of jpegs,pngs,zips or pdfs.
I've alread...
Unshroud asked 14/11, 2014 at 16:26
1 Next >
© 2022 - 2025 — McMap. All rights reserved.