rand(Ø)

> beautiful code & photos

about <

Posts tagged: s3

Cross-region & cross-account AWS resources Terraform planning

By Joris Berthelot Published September 30th 2020 Tagged terraform, amazon aws, aws, aws ecs, deployment, work, trick, sys-admin, server, s3, protip, howto, hint, devops, development, code, english, infrastructure, cloud, cloud computing

Hey, it's been a while, right?

Lately, I'm leading some big changes in our infrastrure since I'm wrapping a Blue/Green deployment into another one. Uh?

Long story short: our product runs on AWS ECS Docker containers, and because we have one sub-domain per app instance, we use Apache wildcard sub-domains. Meaning a single container handles traffic from many clients/instances. We already have a Blue/Green deployment process in place but at the Docker container level, not at the client level. The idea is to entirely duplicate the whole stack (with all its flaws) and a sub-domain pointing to

> Continue Reading

S3: List objects using filters

By Joris Berthelot Published November 22nd 2017 Tagged english, s3, amazon aws, shell, sys-admin, howto, trick, aws, cli

One thing that really sucks about the Amazon S3 command is not being able to efficiently list objects using the exclude and include filters.

I recently had a case when I needed to list GZip archives from one of our S3 buckets but only the ones ending by .gzip.

Since the ls command doesn't support filters (yet?), I found another way to get that listing: use the cp command, but in dry-run mode:

#!/bin/bash
export AWS_ACCESS_KEY_ID=
export AWS_SECRET_ACCESS_KEY=

# Very important: DO NOT remove the --dryrun flag!
aws s3 cp s3://bucket-name . --recursive --no-progress
> Continue Reading