I have a dataset in parquet in S3 partitioned by date (dt) with oldest date stored in AWS Glacier to save some money. For instance, we have... s3://my-bucket/my-dataset/dt=2017-07-01/ [in glacier]...

I'm looking to change some Python 3 code which currently copies an SSE-C encoded file from one S3 bucket to another. On the target S3 bucket, the file will be stored in Glacier Flexible Retrieval f...

How can I make files stored at AWS S3 Glacier available for retrieval recursively from CLI? I run the following command: aws s3 cp "s3://mybucket/remotepath/" localpath --recursive and g...

I changed the lifecycle for a bunch of my buckets on Amazon S3 so their storage class was set to Glacier. I did this using the online AWS Console. I now need those files again. I know how to rest...

I have about 50Gb worth of files that was stored in S3. Yesterday I stupidly added a lifecycle rule to transfer files that were more than 30 days old from S3 to Glacier not realising that this will...

sudo apt install awscli installs currently version 1.16.113-1 The official website (https://docs.aws.amazon.com/cli/latest/userguide/install-cliv2-linux.html) supports aarch64 but not armhf. Is the...

The goal: Upload large files to AWS Glacier without holding the whole file in memory. I'm currently uploading to glacier now using fs.readFileSync() and things are working. But, I need to handle f...

I'm wondering whether there is an easy way to permanently restore Glacier objects to S3. It seems that you can restore Glacier objects for the certain amount of time you provide when restoring to S...

I have simply enabled a file cycle policy on a bucket in Amazon S3. This is the configuration: root@iserver:~# aws s3api get-bucket-lifecycle-configuration --bucket ee-shares --profile s3toglacier...

I was trying to copy all the files from my S3 bucket to a local folder in VM and I am getting the following error: warning: Skipping file s3://bucket/object. Object is of storage class GLACIER. Una...

A few days back I was experimenting with S3 & Glacier and my data was archived so restoring it back I had to use their expedited service (which costs a lot). I want to move all of my content fr...

I am creating a PHP based web application using Amazon's S3 and glacier services. Now I want to give my site users a feature that they can choose any file and make it archive (means move file from...

When I restore glacier archive file in s3,I am facing with GlacierSelectNotAvailable error. I try to setting up the params of restoreObject but I keep getting that error. I use Nodejs AWS SDK. var...

I have a lot of files located in Amazon Glacier (the pre-S3 version, and have been uploading files using FastGlacier for years.) I would now like to move these files to the S3 Glacier Deep Archive ...

Fairly straightforward question. Do Amazon S3 lifecycle rules that I set get applied to data retroactively? If so, what sort of delay might I see before older data begins to be archived or deleted?...

This question might look like an easy/idiot/beginner question but I'm really confused between both of them. Why do I need to use Amazon S3 Glacier if I can use the normal S3 Bucket and just change ...

I'm looking for some advice or best practice to back up S3 bucket. The purpose of backing up data from S3 is to prevent data loss because of the following: S3 issue issue where I accidenta...

Amazon Athena Log Analysis Services with S3 Glacier We have petabytes of data in S3. We are https://www.pubnub.com/ and we store usage data in S3 of our network for billing purposes. We have tab d...

I am trying to upload some .tar.gz files to AWS S3 Glacier using the upload-archive command (docs). I ran the upload-archive command over one day ago on a 29 GB .tar.gz file like so: aws glacier ...

I need to delete files stored in a Glacier Vault, but AWS CLI needs the object id and I can't execute the correct command to obtain this id. Anyone knows the command to see the file id with AWS CL...

Does Amazon AWS S3 Glacier support some semblance of file hierarchy inside a Vault for Archives? For example, in AWS S3, objects are given hierarchy via /. For example: all_logs/some_sub_category/...

I have some s3 buckets which send their objects to glacier after x days of creation. When I go to retrieve those objects on the s3 interface, I need to keep reloading page to see when restoration h...

I'm trying to understand the complicated Amazon Glacier pricing model. I don't want to store a huge amount of data, a few GB's say 10. I hope never to download the files and if I did need to I don'...

I want to move some millions of s3 objects to glacier. path/to/object1/1.jpg path/to/object2/2.jpg ... So I will set s3 lifecyle rules like this. Rule 1 prefix: path/to/object1/1.jpg Rule 2 pr...

I have set a number of files for restore from glacier to S3 and I want to download it all – the whole bucket. When I browse the s3 bucket from the web console, I don’t see the glacier restored it...