Blog

All Posts

Complete archive of my writings on technology, data, and distributed systems.

Latest Posts

Solving Docker Bind Mount Path Errors in Airflow: Portable Solutions

data engineering
docker
airflow
orchestration
airflow v3.0.0

How to use Docker in Docker (DinD) with Airflow to solve the mount path issue and enable seamless containerized task execution.

Mar 5, 2026

DataFrames in Spark: A Comprehensive Guide

data engineering
spark
dataframes

A comprehensive guide to understanding and working with DataFrames in Apache Spark, including their benefits, operations.

Feb 22, 2026

Data Warehousing and Japanese Philosophy of Housekeeping: A Unique Perspective

data engineering
7s
Personal Reflection

A reflection on how the Japanese concept of 7S used in factories could be related to modern Data warehousing principles.

Feb 15, 2026

A guide to resolving DNS issues in Docker containers when accessing external APIs.

data engineering
docker
networking

Description of DNS resolution issues in Docker and how to fix them using the –dns flag.

Feb 3, 2026

Query Optimization in Apache Spark: A Deep Dive

Spark
data engineering
distributed computing
pyspark
sparkSQL
spark optimization

Essentials of Spark Query Optimization Process.

Jan 26, 2026

Essentials of Spark Architecture

Spark
data engineering
distributed computing
pyspark
sparkSQL

Essentials of how Spark is constructed and inner mechanics of how a Spark job is executed.

Jan 14, 2026

Essentials of Apache Spark

distributed computing
data engineering
apache spark

A brief summary of Apache Spark and its core features.

Jan 5, 2026

Spark and Big data Engineering

distributed computing
data engineering
apache spark

Essentials of Big Data Engineering. In essence, all big data processing is distributed computing.

Dec 23, 2025

Portrait of Joseph Marie Jacquard woven in silk fabric using punched cards

Weaving Code: When the Loom Met the Algorithm

History of Computing
Personal Reflection

A reflection on how punched cards from 1801 evolved into modern AI, completing a perfect technological circle.

Nov 27, 2025

A Data Pipeline is a distributed system. Start Architecting It Like One

docker
data engineering
distributed computing
python

A Data pipeline is indeed a distributed system since it usually has more than one component. It must be orchestrated properly to be able to work everywhere. This article demonstrates a simple ETL pipeline that does not break when deployed in production.

Nov 8, 2025
No matching items

← Back to Home