EIP – Competing Consumer Enterprise Integration Pattern for faster data processing

In this post I’ll demonstrate how to design an integration architecture that uses the tried and tested integration design pattern competing consumer. As always, I’ll demonstrate both “low-code” and code…

EIP – Request/Response Integration Pattern

Summary This post will summarise the various Message Construction patterns. This isn't a comprehensive list, but patterns that have been widely adopted by the integration community. Some of these Message…

Fatal: could not read Password for terminal prompts disabled

I was recently trying to write back remote changes carried out by a build agent as part of a CI-CD task. I came across the following error:

Find Duplicates using Azure Data Factory (two source files)

There are some scenarios where you need to combine different datasets with some similarities to find duplicates. In this post I demonstrate how to use Azure Data Factory and Dataflows…

Data import/export framework parameters – Directory c:\temp\dixf\ does not exist

I was working with the on-premise Dynamics 365 Finance & Operations instance, specifically the Virtual Machine when I came across an error setting up a BYOD.

Integration testing with Data Factory, Data Lake, Dynamics 365 Finance & Operation

Just for fun, I decided to play around with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) and Microsoft Dynamics 365 Finance & Operation VM. I wanted to see…

Dynamics Plug-in profiler does not show any logs

Summary Recently I started trying to debug a plug-in using the Plug-in Registration Tool and the 'Persist to Entity' feature. This feature allows debugging to occur without having to go…

Designing a Modern Data Warehouse – Available Options

I recently spent some time with Microsoft to look at the various options for building our big data pipelines. Here are the final options that exist for anyone considering doing…

Create a custom RBAC in Azure

This post demonstrates how to create a custom role. The best practice for creating custom roles is to base it on an existing role.

Azure SQL Server security first steps

This post is a summary of the Microsoft Azure Tutorial: Secure a single or pooled database.