batch-processing Questions
15
Solved
I have a large file that contains a list of items.
I would like to create a batch of items, make an HTTP request with this batch (all of the items are needed as parameters in the HTTP request). I ...
Cantatrice asked 4/6, 2015 at 10:27
1
Solved
Anyone here have experience about batch processing (e.g. spring batch) on kubernetes ? Is it good idea ? How to prevent batch processing process same data if we use kubernetes auto scaling feature ...
Certiorari asked 30/3, 2020 at 4:25
1
Solved
Is there a way to call gdb --batch --commands some_gdb_script some_executable and have it emit both the commands it executes, along with the command results? I do not want to install anything other...
Uitlander asked 28/3, 2020 at 22:52
5
Solved
The setting:
I have some hundred files, named something like input0.dat, input1.dat, ..., input150.dat, which I need to process using some command cmd (which basically merges the contents of all f...
Aretha asked 20/1, 2012 at 17:4
6
Solved
I'm currently writing a script that should map a network drive to the letter Z , i'm using the command
net use z: \\path , the thing is that if the user is already using this letter i won't be abl...
Faus asked 2/12, 2014 at 10:18
5
Solved
I have several training videos. All .MP4s.
I want to remove 3.5 seconds from the beginning and 4.5 seconds from the end of the entire folder of them...
I know of ffmpeg and ffprobe - but my knowl...
Heteropterous asked 6/8, 2015 at 17:55
3
Solved
I migrated from 1.9 to 2.2 and reading the documentation I was surprised to discover that is not possible to upsert during a bulk operation anymore, since operations don't allow options.
bulkOps.A...
Emu asked 28/2, 2016 at 19:53
3
I have a folder that contains thousands of .ai files and I want to batch convert them to .svg files using Mac terminal.
Until now I did it through Adobe Illustrator but it takes days to batch con...
Lilybelle asked 7/4, 2016 at 19:4
6
I want to call a Java class from a batch file.
How can I do that?
Totipalmate asked 4/11, 2010 at 7:2
3
Solved
I am trying to create a file and store in it the results from my query. I have a batch file that contains the single query,
USE database1;
SELECT * FROM table WHERE name = "abc" INTO OUTFILE outp...
Bissonnette asked 8/1, 2013 at 21:20
2
Solved
could anyone please point out what's the cause of this active batches hanging there for many weeks and never being processed? Thanks a lot.
My guess is not enough executors, and more workers/execu...
Manamanacle asked 7/7, 2016 at 17:55
2
Solved
We're looking to begin using S3 for some of our storage needs and I'm looking for a way to perform a batch upload of 'N' files. I've already written code using the Java API to perform single file u...
Amphi asked 28/7, 2015 at 20:7
3
Solved
I have a bunch of individual files that I want to each run through Avisynth. However, an AVS file can only create one video. As far as I know, there is no way to declare a variable's value from the...
Masseter asked 29/1, 2014 at 18:48
2
Solved
Is it possible to batch convert a folder of JPEG images using jpegtran on Windows?
I normally use the following command for one file, but I'm not sure how to apply it to an entire directory of JPEG...
Exhalation asked 12/8, 2015 at 4:31
4
I'm writing a spring batch job and in one of my step I have the following code for the processor:
@Component
public class SubscriberProcessor implements ItemProcessor<NewsletterSubscriber, Acco...
Dichotomous asked 2/6, 2014 at 23:37
1
Solved
I got two arrays :
A
B
Array A contains a batch of RGB images, with shape:
[batch, Width, Height, 3]
whereas Array B contains coefficients needed for a "transformation-like" operation on imag...
Prediction asked 11/6, 2019 at 12:37
1
I am using spring cloud dataflow and have created a spring cloud task which contains a job. This job has a parameter called last_modified_date, which is optional. In the code, I have specified whic...
Absent asked 10/6, 2019 at 10:21
3
Solved
I have the following for loop:
for j in range(len(list_list_int)):
arr_1_, arr_2_, arr_3_ = foo(bar, list_of_ints[j])
arr_1[j,:] = arr_1_.data.numpy()
arr_2[j,:] = arr_2_.data.numpy()
arr_3[j,...
Unbound asked 15/5, 2019 at 5:2
3
Solved
I have a pandas DataFrame df for which I want to compute some statistics per batch of rows.
For example, let's say that I have a batch_size = 200000.
For each batch of batch_size rows I would l...
Bark asked 20/5, 2019 at 9:29
1
I need to connect with jpa repository from ItemReader using spring batch for Database to text file export. But as of now i tried using JdbcCursorItemReader class to retrieve the data from db. I nee...
Sweetscented asked 16/5, 2019 at 7:43
2
Solved
We have a 4 GPU nodes with 2 36-core CPUs and 200 GB of RAM available at our local cluster. When I'm trying to submit a job with the follwoing configuration:
#SBATCH --nodes=1
#SBATCH --ntasks=40
...
Katzen asked 21/3, 2019 at 23:13
6
When I execute screen -ls, I see the following. How can I kill all the detached sessions?
There are screens on:
84918.ttys002.ros-mbp (Detached)
84944.ttys008.ros-mbp (Detached)
84970.ttys013.ro...
Knickers asked 21/1, 2013 at 21:0
2
Solved
I previously trained a resnet34 model using the fastai library, and have the weights.h5 file saved. With the latest version of fastai, do I still need to have non-empty train and valid folders in o...
Evidently asked 11/11, 2018 at 21:2
2
Solved
I need to split a huge table in to chunks.
Fetching data from DB2 and processing in SSIS
iteration 1 : Get first 10 rows and process it
iteration 2 : Get next 10 rows(11-20) and process it ...
Carrefour asked 28/2, 2019 at 12:21
8
Solved
I'm looking for a simple way to test if an executable exists in the PATH environment variable from a Windows batch file.
Usage of external tools not provided by the OS is not allowed. The minimal...
Abductor asked 24/1, 2011 at 12:8
© 2022 - 2024 — McMap. All rights reserved.