Migrating from Azure Data Lake Gen1 to Gen2 – Step by Step
In the fast-changing technological world, addressing tech debt is a significant challenge. Not only does it entail a learning curve, but it also affects the feature release...
How to Effectively split a string using STRING_SPLIT function in SQL server
Even though it’s flashy and glamorous being a Data Engineer these days, it comes with its own set of challenges and opportunities. Approximately 80 percent time is spent on...
Build your Data Estate with Azure DataBricks – Part 3 – IoT
It is not the strongest of the species that survives, nor the most intelligent that survives. It is the one that is most adaptable to change~Charles Darwin With increasing clock...
DataBricks Part 2 – Big Data Lambda Architecture and Batch Processing
Let us talk about the Big Data Lambda Architecture. In this article, we are going to walk you through a sample scenario and explain the process. Also Read: Build your Data Estate...
Build your Data Estate with Azure Databricks-Part I-Motivating Big Data
In god we trust,all others must bring Data~W Edwards Deming Since the dawn of humanity, certain ideas/inventions/concepts changed the course of human progress irreversibly. From...
How To Use SSIS Lookup Transform To Perform Denormalization in SQL Server
‘The root cause of all problems is incomplete Knowledge.’ ‘Lookup’ by dictionary means ‘The action of systematic electronic information retrieval.’...
