What's New in Release 6.2.0

Release 6.2.0 of the HPE Ezmeral Data Fabric provides substantial new features for the components of the data platform. This page describes and provides links to more information about the new features.

For new features delivered as part of the Ezmeral Ecosystem Pack, see What's New in EEP 7.1.0.

New Repository for Data Fabric Software

On August 1, 2023, Hewlett Packard Enterprise introduced a new download repository for HPE Ezmeral Data Fabric core and ecosystem software packages. https://package.ezmeral.hpe.com/ is the new repository for HPE Ezmeral Data Fabric downloads. For all Data Fabric releases, https://package.ezmeral.hpe.com/ replaces two older repositories:
Description URL Authentication Required?
New repository https://package.ezmeral.hpe.com/ Yes
Old repositories https://package.mapr.com/

https://package.mapr.hpe.com/

Yes1
1Beginning October 2023, the old repositories are redirected to the new repository URL, which requires authentication.

The new repository requires you to provide the email and token for your HPE Passport account. Software that points to the old repositories must be updated to include your HPE Passport email and token. For more information about using the new repository, see Using the HPE Ezmeral Token-Authenticated Internet Repository.

If you plan to use the Data Fabric Installer, you must update the Installer to version 1.18.0.3 or later. Earlier versions of the Installer will not work with the new repository. See Updating the Installer.

Security and Governance Enhancements

Policy-Based Security
HPE Ezmeral Data Fabric supplies robust security. In release 6.2, you can leverage the new Policy-Based Security features to apply platform-level security across all data.
For an overview of data-fabric security features, see Security.
To learn about policy-based security, see Policy-Based Security.
External KMIP Keystore
Release 6.2 supports external keystores, through KMIP (Key Management Interoperability Protocol), to securely manage the CLDB and DARE master keys at the core platform layer. Release 6.2 supports KMIP versions 1.0 to 1.4 and has been tested with the Utimaco ESKM, Gemalto SafeNet KeySecure, and Vormetric DSM key management servers.
To learn about key management, see External KMIP Keystore Overview.
SSL Encryption for Server-to-Server Communication
In release 6.2.0, the ZooKeeper version is updated to 3.5.6. Version 3.5.6 supports SSL encryption for server-to-server communication. When you install a new release 6.2 secure cluster, SSL between ZooKeeper servers is enabled automatically. For more information, see configure.sh.
Resolved Security Vulnerabilities
For a list of vulnerabilities resolved in this release, see Resolved Issues.

Performance Fixes

MFS-11674
Added a -D|--crc option to gfsck to enable CRC to be verified without blocking operations on the frontend volume.
MFS-11809
Added a configuration parameter (cldb.tier.gw.balance.num.vols.per.batch) to set the number of volumes to balance at a time, rather than a default of 5 volumes.
MFS-11835
Fixed hangs in POSIX client when connections timeout after being inactive. Added a parameter fs.mapr.binding.inactive.threshold to configure timeout for inactive connections.

Operating System Support

CORE-623
HPE Ezmeral Data Fabric supports SLES 15. For a complete list of supported operating systems, see Operating System Support Matrix.

New Products and Features

Data Tiering Enhancements
Data tiering was introduced in release 6.1. With release 6.2, you have access to enhanced data-tiering functionality, including Storage Labels, Erasure Coding with Local Parity, and parallel offload with the MAST gateway.
You can use an erasure-coding scheme with local parity to reduce erasure-coding storage overhead without incurring high rebuild costs and longer rebuild times, while lowering the probability of data loss. For information about erasure coding, including erasure coding with local parity, and setting the scheme using the Control System, see Erasure Coding Scheme for Data Protection and Recovery.
Storage labels help you confine volumes to specific storage pools. You can establish and apply storage labels to meet desired objectives, such as low latency or easy removability. For examples and an overview, see Using Storage Labels.
You can enable multiple MAST gateways to offload volume data rapidly. See Enabling Tiering.
The following two features have been released through a patch. The earliest patches with these features are: mapr-apiserver-6.2.0.2.20210210081832-1.noarch.rpm and mapr-webserver-6.2.0.2.20210210081832-1.noarch.rpm. To leverage these features, download the latest patch from sftp.mapr.com (login as maprpatches without a password).

To apply a patch to the Control System, follow the instructions in this Knowledge Article: How do I apply HPE Ezmeral Data Fabric EBFs for mapr-apiserver and mapr-webserver packages?

For additional information on patch nomenclature, see this support article.
Ease of Data Management
Two new features support unlimited scale: Snapshot Restore and Last Access Time.
The Snapshot Restore optimization speeds up the restore operation when compared to manually copying the data to a new volume. See Restoring a Volume From a Snapshot.
Last Access Time (atime) is file metadata that is updated whenever a file is read. You can use atime for file management and governance decisions such as:
  • Reviewing access controls of files that have not been accessed recently to prevent data leakage
  • Tiering files (to warm or cold tier) that have not been accessed for a while
  • Migrating files that have not been accessed frequently
For more information, see Tuning Last Access Time.
The URL Sharing feature has been released through a patch. The earliest patches with this feature are: mapr-apiserver-6.2.0.2.20210210081832-1.noarch.rpm and mapr-webserver-6.2.0.2.20210210081832-1.noarch.rpm. Using this feature, you can share URLs with filter information to other users on the cluster, who can then login and view the results. This saves time having to repeatedly re-create the filter for any user who wants to use the same filtering.
Hadoop and YARN Delivered with Ecosystem Components
Beginning with core 6.2.0 and EEP 7.0.0, Hadoop and YARN services are no longer included in the HPE Ezmeral Data Fabric repository for core packages. They are provided as ecosystem components in the MEP(EEP) repository. This enables Hadoop and YARN to be upgraded separately from the HPE Ezmeral Data Fabric. To decouple Hadoop and YARN from core, the mapr-mapreduce2 package was removed, and some new packages were added. For more information, see Installing Hadoop and YARN.
Java / JDK 11 Support
Release 6.2 and the HPE Ezmeral Data Fabric ecosystem components take advantage of the new features and long-term support provided by JDK 11. For more information, see the JDK Support Matrix.
Controlling Metrics for JMX-Enabled Services
Release 6.2 enables you to control how metrics are collected from JMX-enabled services. For more information, see Controlling Access to JMX Metrics.
Monitoring
The Control System has been modified for Kubernetes environments. You will notice these modifications if you use the Control System with the HPE Ezmeral Container Platform. To learn more about the HPE Ezmeral Container Platform, see the 5.2 documentation.
NFSv4 Updated
Release 6.2 updates the NFSv4 package (mapr-nfsganesha) to version 3.3.
N+N EC Scheme Support
Release 6.2.x supports the N+N EC schemes.

Deprecated Products and Features

MapR Data Science Refinery
The MapR Data Science Refinery is not supported in Releases 6.2.0 and later, but continues to be supported in Releases 6.0.x and 6.1.0. For more information about data science tools and applications, see HPE Ezmeral ML Ops.
Metering Support Removed
Metering is not supported and the documentation for metering has been removed. The Metering feature was added to support consumption-based billing. Monitoring and metrics capabilities continue to be supported.

Documentation Enhancements

Quickly Navigate to the Same Topic in a Different Release
Most documentation pages now include buttons to enable navigation to the same topic in a different release. These buttons appear in the upper right corner of the page:

To display the buttons, the publishing system compares the directory and file name of the current topic with all current releases. If a button is not present, the topic is new or does not exist in other releases.
New Component Versions Matrix
A new matrix has been added to the list of Interoperability Matrices. The Component Versions for Released EEPs matrix lets you compare the versions of ecosystem and Monitoring components across different EEPs.
Revised Product Naming
Release 6.2 introduces a new name for the data platform:
In addition to the data platform, many former MapR products and features have new names. Product documentation and interfaces are being updated to reflect the new names.
Even though the product names are different:
  • The platform works the same.
  • Upgrades from MapR installations are supported unless noted otherwise.
  • HPE Ezmeral features are fully compatible with legacy MapR features unless noted otherwise.
  • Product versioning remains the same, with the exception of the four-digit versions used for core and patches. See Installation and Upgrade Notes (Release 6.2.0).
Some product interfaces continue to use the term MapR. These interfaces may or may not be updated. The following table shows key terms that are changing in the product documentation for release 6.2.0:
MapR Term HPE Ezmeral Data Fabric Term
MapR <release-number> release <release-number>
MapR Academy HPE Training
MapR admin data-fabric admin
MapR client data-fabric client
MapR cluster data-fabric cluster
MapR Container for Developers development environment for HPE Ezmeral Data Fabric
MapR Control System (MCS) control system (MCS)
MapR core core
MapR Data Access Gateway data-access gateway
MapR Data Platform HPE Ezmeral Data Fabric
MapR Data Platform for Kubernetes Kubernetes Interfaces for Data Fabric
MapR Database HPE Ezmeral Data Fabric Database
MapR Data Science Refinery Data Science Refinery*
MapR Distribution for Apache Hadoop HPE Ezmeral Data Fabric Distribution for Apache Hadoop
MapR Ecosystem Pack (MEP) Ezmeral Ecosystem Pack (EEP)
MapR Edge HPE Ezmeral Data Fabric Ege
MapR Event Store for Apache Kafka HPE Ezmeral Data Fabric Event Store
MapR Filesystem filesystem
MapR gateway data-fabric gateway
MapR Hadoop Hadoop for the HPE Ezmeral Data Fabric
MapR Installer Installer
MapR Installer Stanza Installer Stanza
MapR license HPE Ezmeral Data Fabric license
MapR loopbacknfs POSIX client loopbacknfs POSIX client
MapR Monitoring monitoring
MapR NFS NFS or NFS for the HPE Ezmeral Data Fabric
MapR package data-fabric package
MapR Object Store with S3-Compatible API S3 Gateway
MapR patch patch
MapR Persistent Application Container Client (PACC) Persistent Application Container Client (PACC)
MapR POSIX Client POSIX client
MapR Professional Services HPE Pointnext
MapR Sandbox sandbox
MapR server ticket server ticket
MapR services services
MapR software data-fabric software or HPE Ezmeral Data Fabric software
MapR Support HPE Support
MapR Technologies Hewlett Packard Enterprise Company
MapR ticket ticket
MapR user data-fabric user
MapR volume volume
MapR XD Distributed File and Object Store HPE Ezmeral Data Fabric File Store
MapR-SASL data-fabric SASL
MEP (MapR Ecosystem Pack) MEP (ecosystem pack)
*Deprecated for release 6.2.0. For more information, see "Deprecated Products and Features" earlier on this page.