Apache Spark 3.0 support in Azure Synapse Analytics

Starting May 25th 2021, the Apache Spark 3.0 runtime is now available in Azure Synapse. This version builds on top of existing open source and Microsoft specific enhancements to include additional unique improvements listed below. The combination of these enhancements results in a significantly faster processing capability than the open-source Spark 3.0.2 and 2.4.

By |2023-12-21T18:29:52-05:00June 2nd, 2021|Data Platform|Comments Off on Apache Spark 3.0 support in Azure Synapse Analytics

Data Validation at Scale with Azure Synapse Analytics

In the world of Artificial Intelligence and Machine Learning, data quality is paramount in ensuring our models and algorithms perform correctly. By leveraging the power of Spark on Azure Synapse, we can perform detailed data validation at a tremendous scale for your data science workloads.

By |2023-12-21T18:30:28-05:00January 18th, 2021|Data Platform|Comments Off on Data Validation at Scale with Azure Synapse Analytics
Go to Top