rand(Ø)

> beautiful code & photos

about <

Posts tagged: amazon aws

Cross-region & cross-account AWS resources Terraform planning

By Joris Berthelot Published September 30th 2020 Tagged terraform, amazon aws, aws, aws ecs, deployment, work, trick, sys-admin, server, s3, protip, howto, hint, devops, development, code, english, infrastructure, cloud, cloud computing

Hey, it's been a while, right?

Lately, I'm leading some big changes in our infrastrure since I'm wrapping a Blue/Green deployment into another one. Uh?

Long story short: our product runs on AWS ECS Docker containers, and because we have one sub-domain per app instance, we use Apache wildcard sub-domains. Meaning a single container handles traffic from many clients/instances. We already have a Blue/Green deployment process in place but at the Docker container level, not at the client level. The idea is to entirely duplicate the whole stack (with all its flaws) and a sub-domain pointing to

> Continue Reading

AWS ECS: seamlessly handle app versioning

By Joris Berthelot Published January 29th 2018 Tagged aws, amazon aws, docker, go, golang, versioning, ecs, container, aws ecs, semver, protip, cloudop, deployment, ci

Our latest project at work involved another Go API and in the effort of easing our debugging and issue tracking I'm used to inject the app version into the logs.
It helps a lot monitoring, especially when rolling out a new version (canary, 50% traffic deployment, etc.).

Preamble

Pre-2018, I hardcoded the version in an app constant which I would increment as part of my release process. It's easy, quick but the only issue is to not forget about it because you may lose versioning syncing over time.

Plus, considering this to be done before each new release, this adds

> Continue Reading

S3: List objects using filters

By Joris Berthelot Published November 22nd 2017 Tagged english, s3, amazon aws, shell, sys-admin, howto, trick, aws, cli

One thing that really sucks about the Amazon S3 command is not being able to efficiently list objects using the exclude and include filters.

I recently had a case when I needed to list GZip archives from one of our S3 buckets but only the ones ending by .gzip.

Since the ls command doesn't support filters (yet?), I found another way to get that listing: use the cp command, but in dry-run mode:

#!/bin/bash
export AWS_ACCESS_KEY_ID=
export AWS_SECRET_ACCESS_KEY=

# Very important: DO NOT remove the --dryrun flag!
aws s3 cp s3://bucket-name . --recursive --no-progress
> Continue Reading

OSX: Dealing with property list files

By Joris Berthelot Published May 3rd 2015 Tagged howto, amazon aws, trick, plist, sequel pro, favorite, ssh

During my last CareerBuilder Hackathon, I worked finished a project that will incredibly help our growing tech teams. If you ever worked in a consulting company, you know how painful it is to wait to gather server credentials and set up them on your machine to be fully operational.

My project is very simple but damn useful: it generates several type of configuration directly from our platform API. You need to have SSH access to servers or connect to database servers? No problems, you provide your SSH user/key path and I take care of generating the file for you

> Continue Reading

Wordpress to Ghost

By Joris Berthelot Published May 3rd 2014 Tagged ovh, php, script, wordpress, ghost, amazon aws, migration

Today For the past 2 weeks, I've been trying to move out from my beloved Wordpress blog to this new, shiny and hipsterish blog plateform called Ghost.

So, two big moves:

The longest part wasn't to have Ghost up and running but to import all my Wordpress shit into this baby's DB. Ha, a long story that involved automated and manual work.

Import WP data into Ghost

At first, I tried the Ghost Wordpress Plugin which exported well my WP data but I

> Continue Reading