-
Mount an Azure Data Lake Gen 2 In Azure Databricks Using a Service Principal
Mounting an azure data lake in azure databricks can be done in several ways. But the most secure and recommended way of doing it is through a service principal that has its credentials stored in an azure key vault. In my attempt to set that up, I found information scattered in many different articles. So,… Read more
-
Power Portal Web API Helper – An XrmToolBox Plugin
Web API for Portals is a new feature where you can finally issue Web API calls from your portal to the CDS. This post doesn’t go in the details of this feature, everything you want to know can be found here. The summary is that when you want to enable an entity for web api… Read more
-
Run Same Databricks Notebook for Multiple Times In Parallel (Concurrently) Using Python
In this blog, I would like to discuss how you will be able to use Python to run a databricks notebook for multiple times in a parallel fashion. Noting that the whole purpose of a service like databricks is to execute code on multiple nodes called the workers in parallel fashion. But there are times… Read more
-
Mount a Blob Storage in Azure DataBricks Only if Not Mounted Already (Using Python)
As discussed in this article by Databricks that during your work in a notebook, you can mount a Blob Storage container or a folder inside a container to Databricks File System. The whole point of mounting to a blob storage container is simply to use an abbreviated link to your data using the databricks file system… Read more
-
Enable a Service Principal to Create Access Policies for an Azure Resource Using DevOps
If you got along well with your deployment strategy, you might got to the point where you are using a service principal in DevOps to do your deployments. One of the deployment tasks that I needed to do was to create an access policy using a service principal with Powershell. I simply wanted to do… Read more
-
Azure API Management and Dynamics 365 Web API
When you have SaaS systems and custom systems all over the place in your organization, there is a need for unification. The more systems you have over a long period of time, the less standardization you have among them. Other factors include different technologies and different architectural styles. If those system expose any kind of… Read more
-
Embed Power BI Visuals in Power App Portals for External Customers
Exposing a report or a dashboard tile from Power BI on a page in your Power App Portal is a supported feature. Not only, you will get the read-only visuals on your page, but you will also get a good amount of power like Natural Language Q/A, exporting data, drilling , filtering, slicing etc. PowerApp… Read more
-
Select Top n Records For Each Group In Python (Pandas)
Say that you have a dataframe in Pandas and you are interested in finding the top n records for each group. Depending on your need, top n can be defined based on a numeric column in your dataframe or it can simply be based on the count of occurrences for the rows in that group.… Read more
-
Your Fully Equipped and Most Simple Machine Learning Regression Template
In this blog, I would like to go through a full machine learning project using regression modeling and following common sense data cleaning and processing. This project should cover most of the checkpoints for any given machine learning project in real world utilizing one of the most powerful and commonly used regression algorithms, I will… Read more
-
Read a CSV file stored in blob container using python in DataBricks
Le’ts say that you have a csv file, a blob container and access to a DataBricks workspace. The purpose of this mini blog is to show how easy is the process from having a file on your local computer to reading the data into databricks. I will go through the process of uploading the csv… Read more
Follow My Blog
Get new content delivered directly to your inbox.
