Spark

Introducing Spark 3.3.2

Spark 3.3.2 release comes with a lot of exciting enhancements. Substantial improvements are in Bloom Filter Joins, Parquet Complex data types, Scale Pandas, Pandas API, and ANSI compliance.

Enhancements

• Improvements for the join query performance in Bloom Filter Joins.

• Faster query execution.

• Performance enhancements for the Parquet Complex data types.

• Optimization of default index for Scale Pandas.

• Coverage increases with new features for Pandas API.

• Improvement of the ANSI compliance.

• Support for dozens of new built-in functions.