Background With Azure Databricks, we can easily transform huge size of data in parallel and store the transformed data in different Azure services, one of them is Azure Synapse (formerly SQL DW). Azure Databricks has built-in connector which lets us read and write data easily from Azure Synapse. Prerequisite Azure Databricks Workspace …

Background In Azure Databricks, we can write code to perform data transformation on data stored in various Azure Services, e.g. Azure Blob Storage, Azure Synapse. …

Background AWS DynamoDB is a key-values database, every item in DynamoDB is associated an unique primary key which is required in almost all DynamoDB’s APIs, so having a good design on this primary key is crucial for your development. What’s primary key in DynamoDB A primary key is used to identity an item in DynamoDB uniquely…

Background Azure Data Lake Gen 2 offers fine-grained access control on your data, it allows you to customize permission, defines permission settings per container, folder or file be because of its hierarchical namespace. This article will cover below items Container Public Access Level Authorization Mechanisms Container, Folder and Files Level Permission…

Background Azure Data Factory allows us to add dynamic content in certain fields. Sometimes, we want to insert the value of variables, value of function or output of last activity into our string for dynamic content.

What is Geetest CAPTCHA? In today’s digital era, about 40% of network traffic is driven by bot. Usually, we only want human access our applications. For example, we want to prevent Ticket Bots for popular concerts. …

Background Microsoft’s Azure is one of the major cloud computing service, it is the second largest Public Cloud Service with about 19% of market share. Considering the growth in public cloud service, learning Azure definitely brings you more career opportunities and growth, you may earn 15% higher salary as reported by…

Microsoft Flow can connect to various cloud file systems which we are familiar with, e.g. OneDrive and SharePoint, but we often have some existing on-premise or local file system we would like to build some automation on. …