What's New in EEP 8.0.0
Summarizes the new features and product updates in Ecosystem Pack (EEP) 8.0.0.
EEP 8.0.0 can be used only with core 6.2.0. For more information about EEP and core version support, see EEP Support and Lifecycle Status.
EEP 8.0.0 Versions and Features
| Component Group | Component | EEP 7.1.0 Version | EEP 8.0.0 Version |
|---|---|---|---|
| Hadoop | Hadoop | 2.7.5.0 | 2.7.6.100 |
| Kafka | Kafka Connect | 5.1.2.200 | 10.0.0.0 |
| Kafka REST | 5.1.2.200 | 6.0.0.0 | |
| Kafka Schema Registry | 5.1.2.200 | 6.0.0.0 | |
| Kafka Streams | 2.1.1.200 | 2.6.1.0 | |
| Monitoring | Collectd | 5.10.0.0 | 5.12.0.300 |
| Grafana | 7.5.2.200 | 7.5.10.300 | |
| Open TSDB | 2.4.0 | 2.4.1.300 | |
| S3 Gateway | S3 Gateway | 2.1.0.0 | 2.2.0.0 |
| Spark | Spark | 2.4.7.100 | 3.1.2.0 |
To compare the versions of various components in different EEPs, see Component Versions for Released EEPs.
Hadoop Updates
Hadoop 2.7.6.100 includes numerous fixes and enhancements contained in the Apache Hadoop base release. For more information, see Hadoop 2.7.6.100 - 2110 (EEP 8.0.0) Release Notes.
Kafka and Streams Updates
- Kafka and Streams
- MirrorMaker 2 support. For more information, see Mirroring Topics with HPE Ezmeral Data Fabric MirrorMaker 2.
- Consumers no longer read any topic data when the Consumer application calls
consumer.polland the timeout (request.timeout.ms) is set to 0. Previously, Consumers read one message.
- Kafka Schema Registry
- Support for JSON Schema and Protobuf formats in addition to Avro.
- Kafka REST Proxy
- REST Proxy API v3 HTTP Methods and URIs support. For more information, see API v3 HTTP Methods and URIs. Note that REST Proxy API v1 HTTP Methods and URIs are no longer supported in Kafka Rest 6.0.0.
For more information, see the Kafka release notes in Ecosystem Pack 8.0.0 Release Notes.
Monitoring (Collectd, Grafana, Open TSDB) Updates
Monitoring updates for EEP 8.0.0 keep the components up to date with recent open-source releases. Open TSDB added a fourth digit to its version to be consistent with other data-fabric component versions. For more information, see Monitoring Components - EEP 8.0.0 Release Notes.
S3 Gateway
The S3 Gateway, formerly called the Object Store with S3-Compatible API, includes various MinIO and LDAP updates. For more information, see S3 Gateway 2.2.0.0 - 2110 (EEP 8.0.0) Release Notes.
Spark Updates
- EEP 8.0.0 updates the Spark version to 3.x. For more information see Spark 3.1.2.0 - 2110 (EEP 8.0.0) Release Notes and Spark 3.1.2 Release Notes.
- Delta Lake support is available for Spark 3.1.2 on HPE Ezmeral Data Fabric. See Apache Spark Feature Support.
- For information about upgrading to Spark 3.x, see this page.
Terminology Changes
| Old Name | New Name |
|---|---|
| Ecosystem Pack (MEP)1 | Ezmeral Ecosystem Pack (EEP) |
| HPE Ezmeral Data Fabric XD Distributed File and Object Store | HPE Ezmeral Data Fabric File Store |
| Object Store with S3-Compatible API | S3 Gateway |
For more information about data-fabric terminology, see Documentation Enhancements in What's New in Release 7.0.0.
In Maintenance and End of Maintenance Ecosystem Components
Pig, Flume, and Sqoop are now In Maintenance, meaning that these components will be updated only for critical security flaws and will be discontinued within six months.
Impala and Sentry have transitioned to End of Maintenance, meaning that they are removed from EEP 8.0.0 and later for core 6.2.0. No maintenance is provided for End of Maintenance components.
For more information, see Discontinued Ecosystem Components and Understand the EEP Lifecycle.
Maven Artifact Version String
Beginning with EEP 8.0.0, eep replaces mapr in the Maven artifact version string. For example:
<groupId>org.apache.hive</groupId>
<artifactId>hive</artifactId>
<version>2.3.8-mapr-2104</version><groupId>org.apache.hive</groupId>
<artifactId>hive</artifactId>
<version>2.3.9-eep-2110</version>This change applies to EEP 8.0.0 and later EEPs and does not apply to previously published Maven artifacts.
Support for Ubuntu 18.04 (But Not Ubuntu 16.04)
EEP 8.0.0 can be used with core 6.2.0 on Ubuntu 18.04 but is not supported with core 6.2.0 on Ubuntu 16.04. For a list of the operating systems that each EEP can support, see EEP Components and OS Support. For a list of the operating systems that different versions of core can support, see Operating System Support Matrix.
Maintenance EEPs
At the release of EEP 8.0.0, EEPs 7.1.1 and 6.3.5 were released as maintenance EEPs. Maintenance EEPs provide defect repair and an upgrade path for previously released EEPs.
EEP 7.1.1 is identical to EEP 7.1.0 except for changes to the monitoring (Spyglass) components. For a list of monitoring fixes in EEP 7.1.1, see Monitoring Components - EEP 7.1.1 Release Notes. To compare ecosystem component versions, see Component Versions for Released EEPs. For reference information about specific EEPs, see Ecosystem Pack (EEP) Reference.
Installer Support for EEP 8.0.0
Installer 1.17.0.0 supports EEP 8.0.0 and maintenance EEPs 7.1.1 and 6.3.5, as well as previously released EEPs. For a list of the EEPs that are supported by different versions of the Installer, see Installer EEP Support.
Installer 1.17.0.0 cannot be used with older versions of Ubuntu. For more information, see Selecting an Installer Version to Use.
EEP Upgrades
The EEP 8.0.0 release includes EEP 8.0.0, EEP 7.1.1, and EEP 6.3.5, but no other EEP revisions. If your cluster is currently running EEP 5.x or 6.x, you can upgrade to Ecosystem Pack 6.3.5. If your cluster is running EEP 7.0.x or 7.1.x, you can upgrade to Ecosystem Pack 7.1.1 or 8.0.0.
For information about upgrading to core 6.2.0 and EEP 8.0.0, see Installation Notes (Release 7.0.0).
EEP 8.0.0 Ecosystem Components and Release Notes
For a list of the EEP 8.0.0 components and their release notes, see Ecosystem Pack 8.0.0 Release Notes.