![]() ![]() While being a maintence release we did still upgrade some dependencies in this release they are: : Deterministic flag is not handled for V2 functions.: Write session time zone in the Parquet file metadata so that rebase can use it instead of JVM timezone.: Skip diagnosis ob merged blocks from push-based shuffle.: Fix the performance bug when inferring constraints for Generate.: Fail query analysis earlier with invalid identifiers.: Support mapping Spark gpu/fpga resource types to custom YARN resource type.: Temp view didn’t collect temp function that registered with catalog API.: Python UDF after off-heap vectorized reader can cause crash due to use-after-free in writer thread.: Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry.: Disable two level of map for final hash aggregation by default.: array_intersect should handle Double.NaN and Float.NaN.: Bug fix for deadlock during the executor shutdown.: Add file commit time to metrics and shown in SQL Tab UI.: Python/Pandas UDF right after off-heap vectorized reader could cause executor crash.: Support IGNORE/RESPECT NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE.We strongly recommend all 3.2 users to upgrade to this stable release. This release is based on the branch-3.2 maintenance branch of Spark. Spark 3.2.1 is a maintenance release containing stability fixes.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |