Apache Spark 3.0 support in Azure Synapse Analytics

Starting May 25th 2021, the Apache Spark 3.0 runtime is now available in Azure Synapse. This version builds on top of existing open source and Microsoft specific enhancements to include additional unique improvements listed below. The combination of these enhancements results in a significantly faster processing capability than the open-source Spark 3.0.2 and 2.4.

2021-06-02T14:29:59-04:00June 2nd, 2021|Data Platform|

Delta Lake Query in Synapse Serverless in Public Preview!!

Azure Synapse now enables you to query data stored in Apache Delta Lake format. One of the top feedback requests is now available in public preview. In this article you will learn how to run the T-SQL queries on a Delta Lake storage from your Synapse workspace.

2021-05-28T10:08:52-04:00May 28th, 2021|Data Platform|

Data Validation at Scale with Azure Synapse Analytics

In the world of Artificial Intelligence and Machine Learning, data quality is paramount in ensuring our models and algorithms perform correctly. By leveraging the power of Spark on Azure Synapse, we can perform detailed data validation at a tremendous scale for your data science workloads.

2021-04-26T12:32:06-04:00January 18th, 2021|Data Platform|
Go to Top