AWS S3 Sync with JS/Node SDK

Question

Amazon Web Services - Command Line Interface (AWS-CLI) has a sync command. Unfortunately AWS CLI's sync method is a bit buggy. I'd like to sync to S3 using a gulp build process and Amazon's javascript/node SDK.

Unfortunately, the SDK doesn't seem to have a sync method, or does it?

What is the best way to sync whole directories in Node with AWS S3?

Febri

github.com/pgherveou/gulp-awspublish – Botnick

Has anyone found out why aws-sdk doesn't offer a sync method? Here is the list of methods, and sync isn't in there: docs.aws.amazon.com/AWSJavaScriptSDK/latest/AWS/S3.html – Reproduce

You could use High Level Amazon S3 Client node-package, it has a sync option: npmjs.com/package/s3 – Statistician

Answer 1

2022 Update:

aws s3 sync is still only available with CLI. Most of the AWS SDKs still don't implement s3 sync. I found an npm library which does a decent job. Please checkout s3-sync-client. There are many alternatives in javascript but they have their limitations w.r.t. sync. This package overcomes almost all of them.

Darien

Answer 2

The AWS CLI is more stable now. So, my solution:

gulp.task("sync-buckets", done => {
    let conf = loadConf();
    exec(`aws s3 sync --acl public-read bucket/www_static/ s3://${conf.BucketName}`, done);
});

Mccray