Spark 2.4.8.0 - 2212 (EEP 6.4.0) Release Notes
This section provides reference information, including new features, patches, and known issues for Spark 2.4.8.
The notes below relate specifically to the Hewlett Packard Enterprise Distribution for Apache Hadoop. For more information, see open-source Spark 2.4.8 Release Notes.
These release notes contain only Hewlett Packard Enterprise specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.
| Spark Version | 2.4.8.0 |
| Release Date | December 2022 |
| MapR Version Interoperability | See Component Versions for Released EEPs and EEP Components and OS Support. |
| Source on GitHub | https://github.com/mapr/spark |
| GitHub Release Tag |
2.4.8.0-mapr-640 |
| Maven Artifacts | https://repository.mapr.com/maven/ |
| Package Names | Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names. |
IMPORTANT
- MapR 6.1.0 with EEP 6.0.0 and later support simplified security. If you enable security on your MapR cluster, MapR scripts automatically configure Spark security features.
Hive Support
This version of Spark supports integration with Hive, but has the following exceptions:
- Hive-on-Spark is not supported.
- Spark-SQL is supported, but is not fully compatible with Hive. See the Apache Spark documentation and the MapR Spark documentation for details.
New in This Release
- For a complete list of new features, see the open-source Spark 2.4.8 Release Notes.
Fixes
This HPE release includes the following new fixes since the latest data-fabric Spark release. For details, refer to the commit log for this project in GitHub.
| GitHub Commit Number | Date (YYYY/MM/DD) | HPE Fix Number and Description |
|---|---|---|
| 8a254a6 | 2022/07/18 | MapR [SPARK-1039] Update Spark to v2.4.8 at EEP 6.4.0 |
| 03e2bef | 2022/07/20 | MapR [SPARK-1066] Spark 2.4.8 fix KubernetesExecutorBuilderSuite |
| 025db47 | 2022/08/01 | [SPARK-38992][CORE] Avoid using bash -c in ShellBasedGroupsMappingProvider |
| aac5fa0 | 2022/08/24 | MapR [SPARK-1100] Spark 2.4.8 depends on mapr-hadoop-client |
| cb24af1 | 2022/08/29 | MapR [SPARK-1102] Spark can't create jam due to "Unrecognized option: --add-opens=java.base/java.lang=ALL-UNNAMED" |
| f2b8f7f | 2022/10/24 | MapR [SPARK-1119] Spark services can't start automatically |
| 3128022 | 2022/11/15 | MapR [SPARK-1126] Modify hbase_version for file compatibility.version |
Known Issues
- None.
Resolved Issues
- None.