Azure Data lake Gen 2 · Azure Data Platform · Azure Logic Apps · Azure Services · Data Engineering · Real Scenario Logic's · SharePoint

PART 2 – File Movement from SharePoint to Azure Data Lake Storage Gen 2

Introduction This a Part-2 of the series File Movement from SharePoint to Azure Data Lake Storage Gen 2 In this blogpost, we will see the how to do movement of files at folder level in automatic way from SharePoint to ADLS Gen 2 via Azure Logic Apps. The use case we are going to see here is, moving… Continue reading PART 2 – File Movement from SharePoint to Azure Data Lake Storage Gen 2

Advertisement
Azure Data lake Gen 2 · Azure Data Platform · Azure Databricks · Azure Services · Data Engineering · Python

Checking ADLS Gen 2 accesses in Azure Databricks via Service principal

Introduction In this blogpost, we will see how easily we can test the Service Principal accesses like below for files and folders at ADLS gen 2 in dynamic way (within some secs) via re-runnable python script in notebook of Azure Databricks. We can also utilize the below code to test the working of Key Vaults… Continue reading Checking ADLS Gen 2 accesses in Azure Databricks via Service principal

Data Engineering · Data Management · Pandas · Python

Pandas Basic Commands

Introduction In this blogpost, we will see some of the Python's pandas library basic commands and its operations. For running below commands, here, I have used Azure Databricks Notebook with python language. Via magic commands(%python), we can use the same below commands under other language connected notebooks as well. Basic pandas commands 1. Importing pandas library… Continue reading Pandas Basic Commands