Livy 0.7.0.050 - 2202 (EEP 7.1.2) Release Notes

The notes below relate specifically to the HPE Ezmeral Data Fabric Distribution for Apache Hadoop. You can find additional information on the Livy release notes page or Livy homepage.

These release notes contain only HPE-specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.

Version 0.7.0.050
Release Date March 2022
MapR Version Interoperability See EEP Components and OS Support
Source on GitHub https://github.com/mapr/livy/tree/0.7.0.050-mapr-712
GitHub Release Tag 0.7.0.050-mapr-712
Package Names

Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names

New in This Release

  • MLIVY-92: Updated dependencies in Livy to resolve CVE vulnerabilities.
  • MLIVY-100: Updated log4j 1.2.17 to log4j 1.3.1-mapr to resolve vulnerabilities.

Fixes

This HPE release includes the following fixes on the base release:

GitHub Commit Number Date (YYYY-MM-DD) HPE Fix Number and Description
4068bf1 2021-09-14 SPARK-884 Update Kryo version
9e57289 2021-09-14 SPARK-884 Backport changes for org.apache.livy.rsc.driver.SparkEntries from upstream
6677a0e 2021-09-15 MLIVY-90 No result after executing the script for sparkR (for MEP-7.1)
713c93a 2021-09-21 MLIVY-88 Remove sudo usage in Livy
1daea08 2021-12-09 MLIVY-96 Update dependencies to be compatible with Spark 3.2
96d6457 2021-12-24 Mock ast.Module to work with Python 3.8
78fc627 2022-01-04 MLIVY-70 Switch to log4j 1.3.0-mapr
7b018f7 2022-01-21 MLIVY-97 Fix Livy on FIPS-enabled cluster
f28d269 2022-01-24 MLIVY-99 Fix Livy for older cores
80417bf 2022-01-24 MLIVY-92 CVE fixes
4922f62 2022-01-25 MLIVY-92 Fix Livy after last round of CVE fixing
5c2abf2 2022-01-25 MLIVY-92 Resolve dependencies issues
ad6697d 2022-01-25 MLIVY-100 Update log4j v1 to the 1.3.1-mapr
700c1bb 2022-01-27 MLIVY-97 Change the way of enabling SCRAM-SHA-256 on FIPS setup
70263f8 2022-02-02 MLIVY-101 Build Livy ECO EEP 8.1.0 components with DF v 6.2.0
2431e84 2022-02-07 Use EEP-7.1 artifacts
For complete details, refer to the commit log for this project in GitHub.

Resolved issues

  • MLIVY-90: Executing SparkR script doesn't provide any result.
  • MLIVY-98: Fixed incompatibility of Livy Python modules with Python 3.8.

Known Issues and Limitations

  • Hive-compatible JDBC / ODBC server introduced in Livy 0.7 is not available in HPE distribution.