Spark

Apache Spark 3.0 support in Azure Synapse Analytics
Gallery
Apache Spark 3.0 support in Azure Synapse Analytics
Data Platform

Apache Spark 3.0 support in Azure Synapse Analytics

Starting May 25th 2021, the Apache Spark 3.0 runtime is now available in Azure Synapse. This version builds on top of existing open source and Microsoft specific enhancements to include additional unique improvements listed below. The combination of these enhancements results in a significantly faster processing capability than the open-source Spark 3.0.2 and 2.4.

By Richard Mintz|2021-06-02T14:29:59-04:00June 2nd, 2021|Data Platform|0 Comments

Data Validation at Scale with Azure Synapse Analytics
Gallery
Data Validation at Scale with Azure Synapse Analytics
Data Platform

Data Validation at Scale with Azure Synapse Analytics

In the world of Artificial Intelligence and Machine Learning, data quality is paramount in ensuring our models and algorithms perform correctly. By leveraging the power of Spark on Azure Synapse, we can perform detailed data validation at a tremendous scale for your data science workloads.

By Richard Mintz|2021-04-26T12:32:06-04:00January 18th, 2021|Data Platform|Comments Off