batch-processing Questions

3

I need to use a command line on Windows OS to generate the base64 data of a specific file on the screen (without generating a file). I have see that on Unix system is sufficient to use cat <file...

6

Solved

i am trying to read the CIFAR10 datasets, given in batches from https://www.cs.toronto.edu/~kriz/cifar.html>. i am trying to put it in a data frame using pickle and read 'data' part of it. But i am...
Transience asked 29/5, 2016 at 16:29

2

I am confused about when to use executeBatch() and executeLargeBatch(). I went through the Java documents and the only difference I found is: executeLargeBatch() should be used when the returned...
Marlow asked 11/3, 2015 at 10:3

39

Solved

How do you convert an entire directory/folder with ffmpeg via command line or with a batch script?
Gastroenteritis asked 26/4, 2011 at 0:19

3

Awk processes the files line by line. Assuming each line operation has no dependency on other lines, is there any way to make awk process multiple lines at a time in parallel? Is there any other te...
Rossi asked 1/12, 2013 at 3:37

3

I have requirement where we need to update the row without holding the lock for the while updating. Here is the details of the requirements, we will be running a batch processing on a table every ...
Mona asked 19/4, 2019 at 4:54

4

Solved

I have a Java program that appends new builds information in the last two lines of a file. How can I read them in batch file?
Herby asked 11/12, 2014 at 5:59

2

There is the below API endpoint which returns info on a single repo given owner/repo names: https://developer.github.com/v3/repos/#get GET /repos/:owner/:repo Is there a way to batch-get info on...
Infestation asked 10/6, 2014 at 20:47

7

Solved

I'm kind of new to batch scripting. As a newbie I find both both of them useful while scripting What are the key differences between xcopy and robocopy?
Eileen asked 9/6, 2014 at 13:9

6

My team maintains an application (written on Java) which processes long running batch jobs. These jobs needs to be run on a defined sequence. Hence, the application starts a socket server on a pre-...
Chaeta asked 14/1, 2023 at 9:20

2

Solved

in the Tokenizer documentation from huggingface, the call fuction accepts List[List[str]] and says: text (str, List[str], List[List[str]], optional) — The sequence or batch of sequences to be enco...

11

Solved

I've got a batch file. After it finished running, i.e. all command lines have been executed, the cmd.exe window stays open. However, I'd like to have it closed right after the batch file finishes i...
Nerissa asked 31/1, 2013 at 12:47

3

Solved

I am new to tensorflow and Machine Learning. Recently I am working on a model. My model is like below, Character level Embedding Vector -> Embedding lookup -> LSTM1 Word level Embedding Vector->E...
Haematin asked 28/12, 2017 at 13:0

6

I've been looking into using iterators for batch processing in Doctrine (http://docs.doctrine-project.org/en/2.0.x/reference/batch-processing.html). I've got a database with 20,000 images which I w...
Palumbo asked 8/5, 2014 at 15:12

2

Solved

I have a file that contains multiple select queries. I run these on a weekly basis to generate internal company reports For example (these are not the actual queries): -- Select number of users SEL...
Henig asked 20/12, 2022 at 18:16

9

Solved

I have a batch job that takes a couple of hours to run. How can I run this in a serverless way on Google Cloud? AppEngine, Cloud Functions, and Cloud Run are limited to 10-15 minutes. I don't want...

3

Solved

I read a flat file (for example a .csv file with 1 line per User, Ex: UserId;Data1;Date2). But how to handle duplicated User item in the reader (where is no list of previus readed users...) stepB...
Zola asked 5/12, 2014 at 14:48

1

Solved

Assuming: there is AWS Lambda that processes messages in 10-elements batches from AWS SQS FIFO queue with 25 available message group ids (assign in a random fashion) the processing of a single mes...

3

I have a java 1.6 application which use batch insert for inserting records in Oracle db using jdbc driver. As you know on Statement object there is a method called executeBatch() which we use for b...
Depart asked 16/6, 2015 at 12:4

0

What I am looking for I want to put several images in a PDF file, with ImageMagick (preferably), as follows: One image per page, each page in the PDF must have A4 size, image size (in pixels) may ...

4

Solved

I have the following task to solve: Files are being sent at irregular times through an endpoint and stored locally. I need to trigger a DAG run for each of these files. For each file the same ta...

6

Solved

I was using AWS and am new to GCP. One feature I used heavily was AWS Batch, which automatically creates a VM when the job is submitted and deletes the VM when the job is done. Is there a GCP count...

9

I am trying to find an equivalent of Celery project for Java environment, I have looked at Spring Batch, but are there any better alternatives for distributed task queues. Thanks.
Sprung asked 6/3, 2012 at 2:12

4

I've started using mysql2 gem. I'm trying to figure out a few basic things - one of them is how to explicitly perform transactions (for batch operations, like multiple INSERT/UPDATE queries). In ...
Outwardbound asked 15/2, 2012 at 5:59

1

I have a RabbitMQ queue in which I post thousands of messages. I need a background Service that will: Retrieve the messages in batches of 100 messages Store those 100 messages in a Database Ack al...
Crutch asked 20/5, 2022 at 8:32

© 2022 - 2024 — McMap. All rights reserved.