I use a computing environment of 0-256 m3.medium on demand instances. My Job definition requires 1 CPU and 3 GB of Ram, which m3.medium has. What are possible reasons why AWS Batch Jobs are stuck ...

I am using a AWS Batch job , which triggers an ECR Image ( Docker Image containing python code) and the batch logs to Cloudwatch. As per the code inside Docker, I am using print command to log as s...

Consider piece of AWS batch job definition: MyJobDefinition: Type: "AWS::Batch::JobDefinition" Properties: Type: container Parameters: {} JobDefinitionName: "my-job-name" ContainerPropertie...

I cannot figure out how to run AWS Batch via Fargate platform. All I'm trying to do is a hello world echo and write the file to S3. I'm getting the following error: CannotPullContainerError: pull i...

From the console, I am invoking a lambda which submits a batch job. The batch job fails, indicating that ECS is unable to assume the role that is provided to execute the job definition. For the ro...

I have a multi-container (docker compose) application. I would like to scale it offline on AWS Batch for processing large volumes of data on S3. My .yml file for docker compose looks something like...

I have a long running batch job that am planning to move to AWS Batch. Since it takes couple of hours to run this job, I cant use AWS Lambda. But, one of the requirement is to trigger this job from...

I get the following error running an AWS batch job: ResourceInitializationError: unable to pull secrets or registry auth: execution resource retrieval failed: unable to retrieve ecr registry auth:...

I'm newbie to AWS Step Functions and AWS Batch. I'm trying to integrate AWS Batch Job with Step Function. AWS Batch Job executes simple python scripts which output string value (High level simplifi...

I have a Dockerfile with the following lines: FROM python COPY sysargs.py / CMD python sysargs.py --date Ref::date And my python file sysargs.py looks like this: import sys print('The command lin...

I am running my docker container in AWS ECS. When i try to execute the below command to read the logs from container, i am facing the below error. command: docker logs -f "Container ID" Error res...

What is the difference between AWS Batch and Sagemaker Training Job when using it for running docker image for Machine Learning training?

AWS Batch documentation says it is based on ECS. So why shouldn't we just use ECS? What pressing benefits does AWS Batch offer that are not available in ECS? Both offer autoscaling as well. Is queu...

I have been planning to migrate my Batch processing from Spring Batch to AWS Batch. Can someone give me the reasons to Choose AWS Batch over Spring Batch?

In aws batch Job queues dashboard, it shows all job status failed and succeeded job count for 24 hours. Is it possible to reset counter to zero?

I have three python scripts, 1.py, 2.py, and 3.py, each having 3 runtime arguments to be passed. All three python programs are independent of each other. All 3 may run in a sequential manner in a ...

I'm using AWS Batch and have started using Array Jobs. AWS_BATCH_JOB_ARRAY_INDEX is passed as an Environment Variable to the container. Is the array size passed in some way? It is mandatory to know...

Hi I've scheduled a Cloudwatch rule in order to run every Wednesday at 14.15 GTM by having as target an AWS Batch, which always returns FailedInvocation. I'm seeing the FailedInvocation event from ...

I'm trying to understand how long the details associated with an AWS Batch job are retained. For example, the Kinesis limits page describes how each stream defaults to a 24 hour retention period th...

Is there a direct integration point or a connector to integrate an AWS Batch job with DataDog? To retrieve the logs and infrastructure metrics? So far what I came across was the DataDog forwarder w...

I have a docker image. I would like to create a container periodically and execute as a job, say every 1 hour, by creating CloudWatch Rule. As we are using AWS cloud, I am looking at the AWS Batch ...

I'm using AWS Batch and I found the root volume size too low for my task. I tried creating a new computing environment/job queue but there's not any option to set volume size. I tried changing lau...

I am using AWSBatch Java client com.amazonaws.services.batch (AWS SDK for Java - 1.11.483) to submit jobs programmatically. However, our scientists keep updating the job definition. Every time the...

I have a docker image through which I make an aws batch job definition. Within the docker I am printing some statements. The job runs and there's a success message. But the logs aren't there in Clo...

How do I retrieve parameters from an AWS Batch job request? Suppose I have a job submitter app that sends a job request with the following code (in C#): SubmitJobRequest submitJobRequest = new Su...