Post by: syed hussain in All Integration Design Patterns
AMQP 1.0 (Advanced Message Queuing Protocol) is an open-source, binary wire protocol designed to provide a messaging backbone for distributed applications. It is designed to provide reliable, secure and robust…
Post by: syed hussain in All Application Design Patterns
MapReduce is a programming model commonly used within the Hadoop framework to access big data stored in the Hadoop File System (HDFS). It consists of several phases: Map phase, Shuffle…
Post by: syed hussain in All Integration Design Patterns
Here is a quick snippet of code demonstrating how Point-to-point messaging works with Azure Service Bus and the Microsoft Dataverse. The Microsoft Dataverse emits a message that is pushed into…
Post by: syed hussain in All Application Design Patterns
The Ambassador design pattern is typically used in microservice architectures, however, the same concepts can be applied to non-microservice architectures. Legacy applications that have limited features may not have the…
Post by: syed hussain in All C# Integration Design Patterns
Some legacy applications often communicate messages in proprietary formats, or messages the Receiver application needs to translate to make sense of. EDIFACT, X12 are common formats that often require translation/transformation.…
The Observer design pattern is a useful pattern when combined with Event-driven architectures to create reactive systems. A source system emits a state change; this change is observed by methods…
It’s not possible to connect to the Microsoft Dataverse directly in Databricks. Some options include ingesting the Dataverse tables into Azure Data Lake and then retrieving them from inside a…
Post by: syed hussain in All Azure Data Factory Reference Architecture
There are various optimisation techniques available during the Dataflow Sink stage, in this post, I'm going to present some performance test results using various partition models. In this post, I…
Post by: syed hussain in All Integration Design Patterns
In this post, I’ve provided a sample Interface Definition Document.
Post by: syed hussain in All Reference Architecture Tips
The source file is a 126.48 MB CSV file which contains Postcodes and Local Authority data. In this post, I’ll be testing the file size of a transformation output to…