From https://www.openapis.org/about: The OpenAPI Initiative (OAI) was created by a consortium of forward-looking industry experts who recognize the immense value of standardizing on how APIs are described. As an open governance structure under the Linux Foundation, the OAI is focused on creating, evolving and promoting a vendor neutral description format…

Lately I’ve been working on an application based on Celery, our motivation was to create distributed workflows whose scale can be controlled by code. …

One day the IT in the organization came up to us and said: You have a lot of disks, do you really need all of them? I looked into the list and I realized that we have hundreds of 400 GB disks attached to Dataflow compute engines. Yikes. …

Data pipelines are a very common tool for data processing. After writing my code for Dataflow and testing it, I turned to the task of the continuous integration and deployment (aka CI/CD) of the pipeline jobs. This post will detail how I had done it with Github actions. Dataflow First, let’s…

In databases, change data capture (CDC) is a set of software design patterns used to determine and track changes in data so that action can be taken using the changed data. In March 2020 I was given a mission: Build a system that will synchronize data between local databases to…

In databases, change data capture (CDC) is a set of software design patterns used to determine and track changes in data so that action can be taken using the changed data. In March 2020 I was given a mission: Build a system that will synchronize data between local databases to…

In databases, change data capture (CDC) is a set of software design patterns used to determine and track changes in data so that action can be taken using the changed data. In March 2020 I was given a mission: Build a system that will synchronize data between local databases to…

In late 2018 I gave a workshop about Spring 5’s new features to Tikal’s full-stack community. The most talked-about feature in Spring 5 was Reactive Spring. As I was preparing the code samples and lessons for the workshop, I realized I was quite limited with the options for a database…

In databases, change data capture (CDC) is a set of software design patterns used to determine and track the data that has changed so that action can be taken using the changed data. Lately I’ve been working on a CDC (Change Data Capture) system, that tracks changes from Postgres-based databases…