The Destination

Introduction

In the past articles in this case study, we went over the source systems and the middleware that comprise the data pipeline. Now we’ll discuss the destination components and how they communicate with the other parts to make up the end-to-end pipeline and complete the event-driven design. These components are the message broker, the consumer service, and the destination database (MongoDB).

Message Queues & Brokers

Message queues have been defined as “a form of asynchronous service-to-service communication used in serverless and microservices architecture”. In less buzz wordy terms, it’s a software component that acts as a hub…


The “Middleware”

Introduction

In the previous entry, I went over the source systems including Microsoft Dynamics and the database that sits under it. Due to it being 2021 and the cloud eating the world, the source systems were deployed on the Azure cloud and as such were easily configured to interact with certain services that we designed to transfer the data from the source to the message queue. Specifically, these services were Azure Logic Apps, Azure functions, and finally blob storage.

Azure Logic Apps

The Azure Logic Application service is offered on the Azure cloud and its billed as a…


Introduction

Recently, I worked on a client project that required us to track changes made on the client’s Microsoft Dynamics 365 Finance & Operations module and integrate those data changes on the destination application. As a team we learned quite a bit on how to design and implement a solution to this scenario and we wanted to share insights and tips for anyone needing to develop a pipeline similar to ours.

The Stack

For this project, we had a source system made up of a relational source database in MSSQL, sitting behind Microsoft Dynamics 365 and a destination system composed…


Image Source: Public Domain / Unsplash

We are in the midst of transformational times. The acceleration of several trends in various sectors due to COVID-19 has created an immediate need for building new services and products that can serve the new “normal.” One of the major trends gathering momentum prior to 2020 predicted to explode post-COVID is known as “micromobility”.

Although the word is self-explanatory at face-value, the micromobility movement has historically faced some obstacles because both consumers and businesses struggle to truly define the new model of transportation. Horace Dediu over at micromobility.io provided a concise definition: “micromobility is personal mobility whose utility is to…

Diego Veras

PM @systems, Product @arcvale

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store