Parameterise Dataverse tables using Azure Data Factory

Azure Data Factory has a great set of tools to manage data pipelines. One of those tools is the ability to create arrays and use the array properties as parameters.…

Best Practice when naming Azure Resources

When creating Azure resources, it's very easy to get lost in the volume of resources that often get created as part of a simple deployment like a new Virtual Machine.…

Schedule Azure Resource Deletion using Azure DevOps

Delete unwanted experimental or PoC work easily by using Azure DevOps build pipelines set on a scheduled trigger.

High-availability with on-premise data gateway and Azure Logic Apps

I previously mentioned that it's possible to retrieve on-premise Dynamics 365 CE data using Logic Apps and the Web API endpoint. I demonstrated this using a single On-premise Data Gateway.…

Priority Queue Pattern with Azure and Dynamics 365

This pattern explores the idea of prioritising message requests so that messages with a higher priority are processed differently to messages with a lower priority.

Content-Based Router (CBR) for bi-directional data synchronisation using Logic Apps

Message Router is an integration patterns that solves the challenge of routing a message to a particular endpoint. This pattern can be used to solve the bi-directional data synchronisation of…

SQL Insert or Update does not trigger Logic Apps

Logic Apps will not trigger for SQL record or updates if the table does not contain ROWVERSION and IDENTITY

Read & Write to Azure Blob Storage from Databricks

In this post I'll demonstrate how to Read & Write to Azure Blob Storage from within Databricks. Databricks can be either the Azure Databricks or the Community edition.

Azure Storage – select the best storage type for the job

In this post, I want to share some basic insights before selecting an Azure storage type. Before you provision Azure storage you're presented with several options. The most important configurations…

Find duplicate records with Azure Data Factory (same source file)

In this post I wanted to demonstrate how ADF can be used to filter out duplicate rows from a CSV file.