Hive 2.3.6 - 2104 (EEP 6.3.4) Release Notes

The notes below relate specifically to the HPE Ezmeral Data Fabric Distribution for Apache Hive.
Hive Version 2.3.6
Release Date April 2021
HPE Version Interoperability SeeHive and HCatalog Support Matrix andEcosystem Support Matrix and MEP Components and OS Support.
Source on GitHub https://github.com/mapr/hive
GitHub Release Tag 2.3.6-mapr-2104
Maven Artifacts See Maven Artifacts for MapR.
Package Names Navigate tohttp://package.ezmeral.hpe.com/releases/MEP/, and select your MEP and OS to view the list of package names.
ODBC/JDBC Drivers
Hive 2.3.6 works with the following MapR Hive drivers:

For additional driver information, seeConnecting to HiveServer2.

Feature support

The following list describes support of various components and functionality with Hive 2.3.6 - 2104:

  • Supports Hive-2.3.6 on Tez-0.9.1 For more information, see Tez 0.9.1-2104(MEP 6.3.4) Release Notes.

  • Does not support Hive on Spark, so you cannot use Spark as an execution engine for Hive. However, you can run Hive and Spark on the same cluster. You can also use Spark SQL and Drill to query Hive tables.

  • Does not support HDFS encryption in Hive tables.

  • Does not support LLAP with Hive-2.3.6 because Apache Slider is not a supported HPE ecosystem component.

  • Starting from Hive 2.1, Hive needs to run the schematool command as an initialization step.

Changes in default security configuration

The following list describes changes in default security for Hive 2.3.6 - 2104:
  • None.

New in This Release

Hive 2.3.6 - 2104 introduces the following enhancements or HPE platform-specific behavior changes:

  • Added configuration to view audit logs for connected, disconnected, and total connected users in HiveServer2.

Fixes

This HPE release includes the following fixes on the base release:
GitHub Commit Number Data (YYYY-MM-DD) HPE Fix Number and Description
a4e067b 2021-05-14 MAPR-HIVE-930: Cannot run join with Order by and Limit clause specified at the same time.
c108592 2021-05-14 Revert "MAPR-HIVE-725 : Avatica's unshaded Jackson (2.6) conflicts with Jackson 2.7+ through hive-exec dependency
d5141b22 2021-05-14 Revert "HIVE-15708 : Upgrade calcite version to 1.12 (Remus Rusanu via Ashutosh Chauhan)"
5fe63174 2021-04-19 MAPR-HIVE-920 : FAILURE! - in org.apache.hadoop.hive.maprdb.json.MapRDbJsonFetchByIdOptimizerPositiveTest
39751b9f 2021-04-13 MAPR-HIVE-923 : Incorrect timestamp result of SELECT with WHERE clause
942bc9be 2021-04-08 MAPR-HIVE-917 : FAILURE! - in org.apache.hadoop.hive.ql.io.parquet.TestHiveSchemaConverter
520908f73 2021-03-16 MAPR-HIVE-908 : FAILURE! - in org.apache.hadoop.hive.metastore.TestHiveMetaStoreTimeout
0f23428d1 2021-03-14 MAPR-HIVE-897 : CVE-2021-25329 Tomcat vulnerability
08b7f601c 2021-03-14 MAPR-HIVE-898 : Unable to connect hs2 through jdbc HiveConnection
29c7ef020 2021-02-25 MAPR-HIVE-882 : /opt/mapr/hive/hive-2.3/conf.backup.*_* : No such file or directory
633a5d14 2021-02-22 MAPR-HIVE-883 : Make parquet versions consistent in hive/drill/sqoop
cee60ee4 2021-02-18 MAPR-HIVE-873 : Add audit logs for connected, disconnected and total users
04c84b40 2021-02-16 MAPR-HIVE-879 : Update tomcat version to latest 10.0.2
d93a9f2a0 2021-02-16 MAPR-HIVE-878 : Refactor tomcat dependency management
621e47a3 2021-02-08 MAPR-HIVE-874 : CVE-2020-25649 Jackson databind vulnerability
53a0d475 2021-02-03 MAPR-HIVE-871 : Unable to create table in database created with specified location when storage based authorization is enabled
48d69f56 2021-02-02 MAPR-HIVE-869: missing Hive Queries page configuration while installing hive on tez via UI Installer
ee9ff0e5 2021-01-28 MAPR-HIVE-863 : Hive query executed in java code failing with ClassNotFoundException
3ad9582 2021-01-25 MAPR-HIVE-812 : The query does not work when hive.vectorized.execution.enabled is set to true
7ace643d 2021-01-22 MAPR-HIVE-864 : FAILURE! - in org.apache.hadoop.hive.serde2.avro.TestAvroSerializer
8542d3fd 2021-01-15 MAPR-HIVE-860: Multiple Vulnerabilities in Hive jars found
This release also includes the following back-ported issues. For complete details, refer to the commit log for this project in GitHub.
GitHub Commit Number Data (YYYY-MM-DD) HPE Fix Number and Description
e920e2340 2021-04-08 HIVE-22648: Upgrade Parquet to 1.11.0 (Marta Kuczora, reviewed by Adam Szita)
833e688d 2021-04-08 HIVE-19464: Upgrade Parquet to 1.10.0 (Jesus Camacho Rodriguez, reviewed by Prasanth Jayachandran)
89140ba6 2021-03-25 HIVE-22708: Fix for HttpTransport to replace String.equals (Naveen Gangam, reviewed by Peter Vary)
57e56458 2021-03-23 HIVE-20204: Type conversion during IN () comparisons is using different rules from other comparison operations (Jason Dere, reviewed by Ashutosh Chauhan)
653c1185 2021-03-17 HIVE-21455: Too verbose logging in AvroGenericRecordReader (Miklos Szurap, reviewed by David Mollitor and Peter Vary)
0a219a9d0 2021-03-11 HIVE-22891: Skip PartitionDesc Extraction In CombineHiveRecord For Non-LLAP Execution Mode (Syed Shameerur Rahman, reviewed by Ádám Szita)
6618d2190 2021-02-18 HIVE-21943 : Add audit log in HiveServer2
2f56ebff 2021-02-05 HIVE-15160: Can't order by an unselected column (Pengcheng Xiong, reviewed by Ashutosh Chauhan)
5956d7c47 2021-02-05 HIVE-16117: SortProjectTransposeRule should check for monotonicity preserving CAST (Jesus Camacho Rodriguez, reviewed by Ashutosh Chauhan)

Known Issues and Limitations

  • HIVE-19502 Unable to insert values into table stored by JdbcStorageHandler
  • HIVE-19286 NPE in MERGE operator on MR mode
Some SELECT queries can be converted to a single FETCH task minimizing latency. Currently, the query should be single sourced, not having any subquery, and should not have any aggregations or distincts (which incurs RS), lateral views or joins:
none : disable hive.fetch.task.conversion
minimal : SELECT star, filter on partition columns, LIMIT only
more :  SELECT, filter, LIMIT only (support TABLESAMPLE and virtual columns)

Resolved Issues

  • None.