Distributed Tracing using Correlation ID

Distributed tracing with a Correlation ID allows for seamless tracking of a request as it flows through different services. For instance, when an order processing issue occurs, the Correlation ID…

Microsoft Azure Databricks Best Practices v 1.0

In my last projects (a few months ago) we received a very hefty bill on our Azure Databricks spend in our second month. Almost 20K more than what we had…

Polling with Resource Location Pattern

In this post, I will elaborate on the Polling with Resource Location pattern, a crucial method for managing asynchronous processing in web applications. This pattern enables efficient handling of long-running…

Data Architecture Styles Reference Models

In this post, we explore several architectural patterns and their applications in data processing and analytics. Lambda Architecture is designed to combine batch and real-time processing, offering a comprehensive approach…

API Gateway Design Patterns: Proxy & Edge

Summary The API Proxy Pattern acts as a middleman for individual API calls. It enhances each interaction by adding features like rate limiting, logging, and security checks. This makes API…

Token Exchange Types

Token exchange is the process of exchanging one type of security token for another. It is a crucial aspect of authorization in modern web-based applications and services. There are several…

Securing Access Token Keys

Sometimes it’s not possible to hide access keys when making an API call. The suggestions below provide 20 ways to hide access keys when making API calls, such as using…

EIP – Idempotent Receivers

An idempotent receiver is a message receiver that ensures that the processing of a message is executed only once, even if the message is received multiple times. This is useful…

EIP – Control Bus Architecture

A Control Bus (CB) is a messaging architecture that enables enterprise integration by facilitating the exchange of control messages among different systems and applications. It acts as a mediator between…

EIP – Polling Consumer

A polling consumer design pattern is a software architecture pattern commonly used in messaging systems, where a client application polls a message queue or a data source periodically to check…