How to delete a s3 version from a bucket using boto and python
Asked Answered
Y

1

12

When I try to delete a bucket using the lines:

conn = boto.connect_s3(AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY)

print conn.delete_Bucket('BucketNameHere').message

It tells me the bucket I tried to delete is not empty.

The bucket has no keys in it. But it does have versions.

How can I delete the versions?

I can see the list of versions using bucket.list_versions()

Java has a deleteVersion Method on its s3 connection. I found that code here:

http://bytecoded.blogspot.com/2011/01/recursive-delete-utility-for-version.html

He does this line to delete the version:

s3.deleteVersion(new DeleteVersionRequest(bucketName, keyName, versionId));

Is there anything comparable in boto?

Yammer answered 29/6, 2011 at 18:11 Comment(0)
D
22

Boto does support versioned buckets after version 1.9c. Here's how it works:

import boto

s3 = boto.connect_s3()

#Create a versioned bucket
bucket = s3.create_bucket("versioned.example.com")
bucket.configure_versioning(True)

#Create a new key and make a few versions
key = bucket.new_key("versioned_object")
key.set_contents_from_string("Version 1")
key.set_contents_from_string("Version 2")

#Try to delete bucket
bucket.delete()   ## FAILS with 409 Conflict

#Delete our key then try to delete our bucket again
bucket.delete_key("versioned_object")
bucket.delete()   ## STILL FAILS with 409 Conflict

#Let's see what's in there
list(bucket.list())   ## Returns empty list []

#What's in there including versions?
list(bucket.list_versions())   ## Returns list of keys and delete markers

#This time delete all versions including delete markers
for version in bucket.list_versions():
    #NOTE we're still using bucket.delete, we're just adding the version_id parameter
    bucket.delete_key(version.name, version_id = version.version_id)

#Now what's in there
list(bucket.list_versions())   ## Returns empty list []

#Ok, now delete the bucket
bucket.delete()   ## SUCCESS!!
Dragoon answered 8/7, 2011 at 16:12 Comment(3)
Just saved me a heap of hassle. Was driving me mad !Inesita
You should use delete_keys, not delete_key. it's super duper faster. See this for the equivalent solution, but using delete_keys: #29809605Retread
@Retread Good tip!Dragoon

© 2022 - 2024 — McMap. All rights reserved.