You can check the version of Spark running on the cluster your notebook is attached to as follows – … and to check the Databricks
Month: October 2020
Default Apache Spark Variables in Azure Databricks Notebook
I came across some python code in one of my notebooks and realized that a variable called “sc” was referenced there which was not defined
Kusto Query Language (KQL) Cheatsheet
Case-Sensitive Query starts with table name or search keywords usually in lowercase | symbol to separate commands in the query SecurityEvent | take 10 can
How to Ensure Singleton Execution of ADF Pipeline
Many times we don’t think about it but in order to ensure the integrity and stability of our systems and data we pay attention to
Running ADF Pipelines Sequentially
Getting worried about that even after placing Execute Pipeline activities one after the another, sequence is still not followed? Dependency in terms of execution is
Azure Log Analytics Pricing and Data Retention Period
Few topics don’t need any briefing so let’s directly jump to the costing factors involved with Azure Log Analytics Workspace. You are charged for two
How to Get Path of Current Notebook
In an earlier post, we saw how to get the absolute path of a notebook in Azure Databricks by navigating GUI in the workspace. In
Azure IP Ranges
Interested in knowing the IP ranges of Azure data centers or some specific Azure Services (aka Service tags)? You can download a complete list of
Automatic Tuning – Azure SQL Database & Managed Instance
Azure SQL Database and Azure SQL Managed Instance both are Azure’s PaaS implementations whereby Microsoft takes care of all management tasks of underlying systems. Automatic
Python Cheatsheet
Something that I came across today, a useful consolidated view of python syntaxes so realized to share with everyone visiting Kloudspro. Could prove a handy
On-Premise to Azure SQL Database Migration
Starting from scratch on cloud platform is quite easier when you need to setup a database say on Azure but the moment discussions start happening
A Practical Guide to Failover Groups
Note: Practical guide here doesn’t mean a step-by-step approach to setup the service/feature but to mention the important points which are critical to understand for
A Practical Guide to Active Geo Replication
Active Geo Replication is a database-level feature specific to Azure SQL Databases. It creates a secondary replica of your primary database which can be used
Query Store Catalog Views
In the previous post we saw number of queries to analyze data captured by Query Store. In this post, we will present the data model
Query Store Sample Queries
We have seen so far in the previous posts about the key concepts of Query Store and its configuration. Let’s now look at the queries
