
BIG DATA ANALYTICS SERIES – P4 – AZURE DATA FACTORY V2
Microsoft have now released a v2 of Data Factory. Though this is still in preview, it has the handy 'Author and Deply' tool; this includes the copy activity wizard to assist create a copy data pipeline. Most of this is the same as v1, however there are changes that...

Big Data Analytics Series – P3 – Service Account Authentication with Azure Hosting
A recent project required me to use the Google Analytics Core Reporting API for data ingestion. The API call was being made in an Azure function, which worked completely fine locally but failed during the service account authentication process when hosted in Azure...

BIG DATA ANALYTICS SERIES – P2 – Setting up a Mock (Local SQL Server) Data source for Data Management Gateway (DATA FACTORY)
This blog walks you through setting up a local instance of SQL Server on your machine in the aim to create a Mock Up Data Source. This blog has been written from a technical perspective so it is assumed here that you are tech friendly. This procedure is a sub part of...

All Things Cloud at Microsoft
Finally, I have managed to get around to this blog as its long overdue because of the Christmas and New Years, but as they say better late then never! If you are a regular reader of my blogs then you may recall me mentioning this a couple of times in my previous...

Big Data Analytics Series – P1 – SQL Error SQL71006 (Data Factory)
This year I plan to create a Series of posts on various technical topics, one of which is Big Data Analytics. These posts will be based on first hand experiences I have had on projects, and tricks and tips on coding for Big Data. Hope this series is helpful and...

Azure Resource Manager – Referencing with Linked Templates
Azure Resource Manager Templates (more commonly known as ARM Templates) serve as a very handy tool for Cloud Engineers. ARM Templates allow you to automate resource deployment in Azure in a “cookie-cutter” type of approach i.e. they are just scripts instructing Azure...

My first experience at Microsoft’s Future Decoded
‘There is a first time for everything’, as the saying goes. Last Wednesday it was my first time I attended a conference thanks to my company. Being a Gold Standard Microsoft Cloud Partner sure has its perks, not only because we can take part of the Microsoft Developer...

‘Refit’ – REST Library for .NET Standard
Most developers (if not all) have/will have to connect to API endpoints to retrieve some data to use in some shape or form. The same goes for us, recently, whilst developing some Azure functions for a client we had to get back data from my own API that had been...

Azure Function Tools: Now part of Azure development workload
Until now, it wasn’t possible to locally debug Azure Functions. However, with the release of Visual Studio v15.3, this has now become possible. As part of the Azure development workload, Microsoft have introduced ‘Azure Function Tools’ that lets you locally test your...

Async Azure Functions – How to bind Outputs
Recently, as part of one of our client projects, we used a combination of multiple Azure Functions to invoke various API’s for enhancing the client’s incoming streaming data. The data flow was such that the Azure functions picked up and pushed the enhanced data...

Dynamic Reference Data in Azure Stream Analytics
Stream Analytics is an on-the-fly service provided by Microsoft in their Azure platform, which allows real-time analytic computations on streaming data. It is more commonly referred to as ‘ASA’. Those familiar with ASA will be aware of it’s scalability and efficiency...
Photo Credit - The Waddling Penguins
© DB Chudasama 2021