Introduction to Azure Data Lake Gen2
Azure Data Lake Storage Gen2 is Microsoft’s latest version of cloud-based big data storage. In the prior version of Azure Data Lake Storage, i.e.., Gen 1 the hot/cold storage tier and the redundant storage’s were not available. Though the blob storage in Azure...
AD Credentials Passthrough in Azure Databricks for implementing RBAC
Azure Databricks is a Unified Analytics Platform built by the creators of Apache Spark. Databricks is the first Unified Analytics Platform that can handle all your analytical needs from ETL to training AI models. Databricks is committed to security by taking a...
Cross Querying in Azure SQL Database
Azure supports cross querying in Azure SQL Database through elastic queries. Elastic queries allow us to run Transact-SQL that works with multiple Azure SQL Databases and can connect to Microsoft tools like Excel, PowerBI and other third-party tools like Tableau to...
Fetching Historical Data in Azure Data Factory
Triggers are like job schedulers for the execution of pipeline runs in the Azure Data Factory. Presently there are three types of triggers that are supported in ADF. Schedule trigger: A trigger that executes a pipeline on an absolute schedule Tumbling window trigger:...
User-Defined Schema in Databricks
If you’ve been working with CSV files in Databricks, you must be familiar with a very useful option called inferSchema while loading CSV files. It is the default option that is widely used by developers to identify the columns, data types, and nullability,...Related Blogs
