{"time":"2024-04-26T10:53:43.291Z","type":null,"version":"0.0.1","data":[{"slug":"pg-forward-migrations","title":"So I Wrote a Database Migrations NPM","published_at":"2019-12-30T17:00:00.000Z","author":"Steven Ng","html":"

I've been working on making Docker containers of my personal Nodejs projects lately, and for those that rely on a relational database (namely Postgresql), I wanted to be able to run database migrations on them locally to make updates easier. To be clear, I'm not talking about data migrations, which are a completely different thing.

For database migrations outside of Ruby on Rails, I've been using Liquibase, and more recently, Flyway. They're both perfectly fine tools, but they also require Java, which means one may need to consider the implications of how Java licenses work.

As it relates to migrations, I subscribe to the forward migrations only philosophy, which means my requirements are relatively simple. All I need to do is scan a pre-specified directory of SQL files and run only the new SQL files. The onus is on me for providing clean, error-free SQL files, so I don't need to make a migration tool very smart.

I did look at existing libraries on NPMJS, but I didn't see any having a workflow similar to Flyway, which has been my tool of choice.

You might be getting the impression that I suffer from NIH (Not Invented Here) syndrome, and you could be right. But my experience with some software is that there are always some elements that I find incredibly frustrating or incompatible with the way I work, and I end up spending significantly more time working around those issues than I would have if I had just written something from scratch.

My NPM, named pg-forward-migrations is designed to do one very specific task well, and took a few hours to write. I spent more time figuring out how to use Liquibase the first time I used it, so in this particular case, the NIH concern is a wash.

All this NPM does is run sequence of SQL statements against a Postgresql database. The workflow is inspired by Flyway in that it uses an easy-to-remember naming convention, and it tracks completed migrations by writing to a migration table in the target database. That's it. It's not rocket science, nor is it attempting to be a replacement for a multi-platform, enterprise-class database migration tool.

At some point, I will probably use this NPM to create command line executable, but at the moment, it's not a priority.

In any case, if you've got a need for a forward migration tool for Postgresql/Node, give the NPM a whirl.

\n"},{"slug":"welcome-to-the-new-site","title":"Welcome to the New Site","published_at":"2019-12-29T17:00:00.000Z","author":"Steven Ng","html":"

Well it's been a while since the site has been updated. A long while, actually.

It's been a long time coming, but I forced myself over the holidays to revamp the site, and here it is.

Things are going to be rough for a little while, as this is a work in progress, and I've opted to go live with a buggy site as opposed to leaving a placeholder page up. This should force me to iterate more quickly and more often.

So before I rebuilt the site, I went through a lot of hand-wringing deciding how to publish this site.

Should I use a static generator like Jekyll? A GUI type tool like MarsEdit? Should I write my own tool? Wordpress (no f-ing way)? A hosted site like Squarespace?

I ended up choosing a hodgepodge of Svelte and Sapper, with some preprocessing using Gulp. I've already been immersing myself in Svelte for the past couple of months, so I figured I may as well stick with that for my site too. Once the site is somewhat stable, I'll try to write up a blog post on what I do to build this site. TLDR; I basically write my content as markdown posts, and have a script to process them into something consumable for my Svelte app.

The site's main focus is the blog, but I will have some evergreen content in the form of articles that can help boost your productivity. I plan to publish my list of "must have" software and services, among other things.

The blog will be mostly made up of a hodgepodge of technical topics, ranging from Cognos, Node, Database and other topics that I find interesting.

In the meantime, click on the RSS link at the bottom of the page to keep up with my new content.

Cheers!

\n"}]}

All Posts from 2019

So I Wrote a Database Migrations NPM

December 30, 2019

Welcome to the New Site

December 29, 2019