gsutil Questions

2

Solved

Is there a way to list all public links for all the objects stored into a Google Cloud Storage bucket (or a directory in a bucket) using Cloud SDK's gsutil or gcloud? Something like: $ gsutil ls ...
Cumbrance asked 21/9, 2016 at 6:59

3

Solved

I am running the following command to remove files from a gcs bucket prior to loading new files there. gsutil -m rm gs://mybucket/subbucket/* If there are no files in the bucket, it throws the ...
Lifton asked 21/3, 2017 at 16:18

2

One of our collaborators has made some data available on AWS and I was trying to get it into our google cloud bucket using gsutil (only some of the files are of use to us, so I don't want to use th...
Zoosporangium asked 30/10, 2017 at 22:44

3

I used google compute engine from Google Cloud Platform , and I want to store my data in googles storage, so I used the gsutil to send data from compute engine to google storage Before i updated p...

3

I want to use Google cloud storage in my next project. My aim is tracking various web sites and collecting some photos. As, I read the documentation for gsutil; I'm able download the file manually ...
Torpedo asked 26/2, 2015 at 18:2

2

I am transferring a folder containing 100+ heavy files (several hundred MB) gsutil to my google cloud storage (Nearline). I've made a mistake in path of the destination folder. So I am looking for ...
Julieannjulien asked 22/11, 2015 at 14:28

2

I'm trying to understand how to copy local files to cloud storage using gsutil so I can write a script to move files. I followed the next steps: C:\Program Files (x86)\Google\Cloud SDK>gsutil l...
Peephole asked 25/3, 2015 at 21:32

1

I have a large number of images (.jpg) stored in a Google Cloud Storage that I would like to use in Google Colab. For this I use (in google Colab) GCS_PATH = "gs://bucket/prefix" !gsutil -m cp -...
Outgrow asked 20/11, 2018 at 11:9

2

Solved

I'm attempting to use the mb command to create a bucket on Google Cloud Storage but am getting CommandException: The mb command requires a URL that specifies a bucket. The odd part is that whil...
Sweetscented asked 5/11, 2018 at 5:16

2

Solved

I am getting the below error message while trying to access my google cloud storage from one of my Google Compute Engine instance using gsutil command. Below is the command and error message. Comm...
Canyon asked 4/4, 2018 at 9:35

1

I want to set Content-Type metadata to image/jpeg for all objects of a Google Storage bucket. How to do this?
Akeylah asked 7/10, 2018 at 18:14

5

Solved

I've been using gcloud and gsutil for a while but now suddenly for any gsutil command I run I get errors: Traceback (most recent call last): File "/Users/julian/google-cloud-sdk/bin/bootstrapping...
Onrush asked 9/11, 2017 at 11:24

2

Solved

I can't rename an existing folder in GCS. How do I do this? As per the documentation, this should be: gsutil mv gs://my_bucket/olddir gs://my_bucket/newdir However, what happens is that olddir ...
Chalybite asked 20/8, 2018 at 9:24

2

Is there no way to get a file listing out from a Google Cloud Storage bucket that is sorted by date descending? This is very frustrating. I need to check the status of files that are uploaded and t...
Harberd asked 1/3, 2018 at 8:42

1

Solved

I have a large number of files that I need to upload to Google Cloud Storage and add content type to them. All file names don't have an extension, but content type is the same for all of them. I t...
Cornelison asked 10/7, 2018 at 22:40

1

Solved

I want to copy files between a directory on my local computer disk and my Google Cloud Storage bucket with the below conditions: 1) Copy all new files and folders. 2) Skip all existing files and ...
Kiblah asked 30/5, 2018 at 5:31

3

Solved

I am following the example in https://developers.google.com/storage/docs/gspythonlibrary#credentials I created client/secret pair by choosing in the dev. console "create new client id", "installed...
Reactance asked 29/6, 2014 at 14:10

4

Solved

I frequently use Google Cloud Storage with at least two accounts: [email protected] and [email protected]. I used gsutil config to create .boto files for both accounts, which I've renamed...
Reginaldreginauld asked 18/1, 2013 at 23:49

1

Solved

Using this command in my server from a php file: exec(gsutil cp /path/to/file/on/server/namefile.ext gs://nameBucket/dir/namefile.ext > /dev/null 2>&1) i got the namefile.ext on bucke...
Pride asked 11/4, 2018 at 10:12

2

Solved

I have a bucket in google cloud storage. I have a tmp folder in bucket. Thousands of files are being created each day in this directory. I want to delete files that are older than 1 day every night...
Unlikely asked 7/12, 2017 at 12:30

3

I would like to pragmatically check if object exist at a perticular google cloud storage bucket. Based on object availability i would perform further operations. I have gone through https://cloud...
Marginal asked 8/2, 2018 at 2:48

2

Solved

I'm trying to use the standalone gsutil tool from within a container running in a GKE cluster, but I cannot get it to work. I believe the cluster has adequate permissions (see below). However, runn...

2

Solved

I need to copy many (1000+) files to s3 from GCS to leverage an AWS lambda function. I have edited ~/.boto.cfg and commented out the 2 aws authentication parameters but a simple gsutil ls s3://mybu...
Burrus asked 21/12, 2017 at 17:29

2

Which is better to use with production transfers, gsutil, or the google cloud storage API?
Grooved asked 7/7, 2017 at 15:54

3

Solved

I am trying to upload many thousands of files to Google Cloud Storage, with the following command: gsutil -m cp *.json gs://mybucket/mydir But I get this error: -bash: Argument list too long ...
Dvandva asked 27/6, 2017 at 12:16

© 2022 - 2024 — McMap. All rights reserved.