I want to use django-storages to store my model files in Amazon S3 but I get Access Denied error. I have granted the user almost all S3 permission PutObject, ListBucketMultipartUploads, ListMultipa...

I am trying to learn python for aws using boto3 so I was trying to execute code given here https://boto3.readthedocs.io/en/latest/guide/s3-example-creating-buckets.html I got errors module boto3 no...

I need to add some custom headers to every boto3 request that is sent out. Is there a way to manage the connection itself to add these headers? For boto2, connection.AWSAuthConnection has a method...

Is there a way to concurrently download S3 files using boto3 in Python3? I am aware of the aiobotocore library, but I would like to know if there is a way to do it using the standard boto3 library....

I've just seen that my web applications docker image is enormous. A 600-MB reason is the packages I install for it. The biggest single offender is botocore with 77.7 MB. Apparently this is known be...

I am using docker compose with bitnami's airflow image as well as minio. I can get airflow to talk to AWS S3, but when I try to substitute Minio I am getting this error: File "/opt/bitnami/air...

I have a Python app running on an OpenWrt router (Chaos Calmer) that uses the boto3 package for creating and updating AWS IoT thing shadows. The app is packaged with its own Python and dependencies...

I'm trying to mock a singluar method from the boto3 s3 client object to throw an exception. But I need all other methods for this class to work as normal. This is so I can test a singular Exceptio...

Following the documentation, I'm trying to create an update statement that will update or add if not exists only one attribute in a dynamodb table. I'm trying this response = table.update_item( ...

I need to get the account-id of the 'current user' in a boto3 script. Up to now my best solution is to parse the current user arn: >>> import boto3 >>> account_id = boto3.resourc...

I was following the boto3 quickstart instructions and I can run import boto3, but when I try to execute any basic command like db = boto3.resource('dynamodb') I get Traceback (most recent call last...

I intend to perform some memory intensive operations on a very large csv file stored in S3 using Python with the intention of moving the script to AWS Lambda. I know I can read in the whole csv nto...

CircleCi returns the following error: No matching distribution found for botocore <1.22.0,> = 1.21.0 (from awsebcli). My config.yml file installs the following dependencies: sudo apt-get -y...

Yesterday the following cell sequence in Google Colab would work. (I am using colab-env to import environment variables from Google Drive.) This morning, when I run the same code, I get the ...

I'm hitting an error with code that connects to AWS using boto3. The error just started yesterday afternoon, and between the last time I didn't get the error and the first time I got the error I do...

I am using AWS Cognito to make OAuth server. I am now creating the exception handler in case use does not exist, but requests intended to get one ipdb> pk 'David' ipdb> res = self.cognito_cl...

OVERVIEW: I'm trying to override certain variables in boto3 using the configuration file (~/aws/confg). In my use case I want to use fakes3 service and send S3 requests to the localhost. EXAMPLE: I...

I executed command pip3 install awscli --upgrade --user on my MAC and got the following: boto3 1.8.8 has requirement botocore<1.12.0,>=1.11.8, but you'll have botocore 1.12.160 which is inco...

I am trying to download files from a s3 bucket by using the Access Key ID and Secret Access Key provided by https://db.humanconnectome.org. However, even though I am able to navigate the database a...

If I try to install the latest version of aiobotocore pip3 install aiobotocore==0.10.3 it says my version of botocore is incompatible and I need an older version of it. ERROR: aiobotocore 0.10.3 ...

I trying to find out the latest task and image used for ECS container service. I tried using AWS ECS cli, able to list services/tasks running but not able to find out running latest task ID and ima...

We are using a proxy + profile when using the aws s3 commands to browse our buckets in CLI. export HTTPS_PROXY=https://ourproxyhost.com:3128 aws s3 ls s3://our_bucket/.../ --profile dev And we c...

I use an Elastic Beanstalk environment for deploying a web application, and I've set up an IAM role for the instances the application will run on. Everything works flawlessy 99.99% of the time, ho...

I am using boto3 SQS client to receive messages from AWS SQS FIFO queue. def consume_msgs(): sqs = None try: sqs = boto3.client('sqs', region_name=S3_BUCKET_REGION, aws_access_key_id=AWS_ACCES...

Currently writing tests and trying to make use of the Stubber provided by botocore. I'm trying: client = boto3.client("s3") response = {'Body': 'content'} expected_params = {'Bucket': 'a_bucket_n...