Hello World!

You have probably heard the buzz about DBT in data engineering lately, but why was DBT even invented in the first place? I was struggling with pure SQL scripts but now I have been using it as my day-to-day work, let me share you how it’s revolutionizing the way we... [Read More]

There are various ways to conduct data ingestion, depending on the strategy we want to use the ingested data. Change Data Capture (CDC) is one approach to implement data ingestion at low latency, which is suitable for near real-time data consumption. [Read More]

Connection pooling is a simple technique that can significantly improve the performance of your application. However, to effectively apply and manage connection pooling, it is crucial to understand how it works and how it can be configured. [Read More]

In today’s data-driven world, the demand for machine learning models has skyrocketed, leading organizations to invest heavily in their AI capabilities. However, building and deploying machine learning models efficiently is not a straightforward task. This is where MLOps (Machine Learning Operations) engineers come into play. In this blog post, I... [Read More]

To rapidly progress in your engineering career, it is advisable to learn from other engineers in your professional circle, such as colleagues, seniors, and friends especially when you are working on some immature area like MLOps. However, many individuals, myself included, often wonder how engineers from diverse companies, organizations, and... [Read More]

We have been working with Machine Learning models, cooking raw data into golden features for the models. Including me, we have been doing stuff manually and we also have been questioning where to put cooked features properly, like in our local machine? We have heard there is a Feature Store... [Read More]

If you’ve been actively using git in your daily work, you might be familiar with the concept of Git commit convention. However, have you considered the potential benefits these messages hold for your future and the success of your team? In this article, I will explain how incorporating Git commit... [Read More]

Docker has revolutionized the way we build, package, and deploy applications. It provides a lightweight and portable platform that enables developers to create isolated containers, encapsulating applications and their dependencies. One of the key components of Docker is the Dockerfile, a simple yet powerful tool for defining and automating the... [Read More]