Is your feature request related to a problem? Please describe.
Extend Parquet correctness tests (originally added for Spark 3.3 in #1816) to all other supported Spark versions.
Parent epic: #1745
Version-Specific Notes
- Spark 3.1: 8 Parquet suites unavailable (
ParquetColumnIndexSuite, ParquetFieldIdIOSuite, ParquetFieldIdSchemaSuite, ParquetRebaseDatetimeSuite, ParquetRebaseDatetimeV1Suite, ParquetRebaseDatetimeV2Suite, ParquetVectorizedSuite)
- Spark 3.2: 3 Parquet suites unavailable (
ParquetFieldIdIOSuite, ParquetFieldIdSchemaSuite, ParquetVectorizedSuite)
- Spark 3.4, 3.5, 4.0, 4.1: All 32 suites available
Versions
Describe the solution you'd like
Implement correctness testing
Describe alternatives you've considered
N/A
Additional context
N/A
Is your feature request related to a problem? Please describe.
Extend Parquet correctness tests (originally added for Spark 3.3 in #1816) to all other supported Spark versions.
Parent epic: #1745
Version-Specific Notes
ParquetColumnIndexSuite,ParquetFieldIdIOSuite,ParquetFieldIdSchemaSuite,ParquetRebaseDatetimeSuite,ParquetRebaseDatetimeV1Suite,ParquetRebaseDatetimeV2Suite,ParquetVectorizedSuite)ParquetFieldIdIOSuite,ParquetFieldIdSchemaSuite,ParquetVectorizedSuite)Versions
Describe the solution you'd like
Implement correctness testing
Describe alternatives you've considered
N/A
Additional context
N/A