Hive 2.3.6 - 2201 (EEP 6.3.6) Release Notes

The notes below relate specifically to the MapR Data Platform Distribution for Apache Hive. You may also be interested in the Apache Hive-2.3.6 Release Notes and the Apache Hive homepage.
Hive Version 2.3.6
Release Date January 2022
HPE Version Interoperability See Hive and HCatalog Support Matrix and Ecosystem Support Matrix and EEP Components and OS Support.
Source on GitHub https://github.com/mapr/hive
GitHub Release Tag 2.3.6-mapr-2201
Maven Artifacts https://repository.mapr.com/maven/
Package Names Navigate to http://package.ezmeral.hpe.com/releases/MEP/, and select your MEP and OS to view the list of package names.
ODBC/JDBC Drivers
Hive 2.3.6 works with the following MapR Hive drivers:

For additional driver information, see Connecting to HiveServer2.

Feature support

The following list describes support of various components and functionality with Hive 2.3.6 - 2201:

  • Supports Hive-2.3.6 on Tez-0.9.1 For more information, see Tez 0.9.1 - 2201 (EEP 6.3.6) Release Notes.

  • Does not support Hive on Spark, so you cannot use Spark as an execution engine for Hive. However, you can run Hive and Spark on the same cluster. You can also use Spark SQL and Drill to query Hive tables.

  • Does not support HDFS encryption in Hive tables.

  • Does not support LLAP with Hive-2.3.6 because Apache Slider is not a supported HPE ecosystem component.

  • Starting from Hive 2.1, Hive must run the schematool command as an initialization step.

Changes in default security configuration

The following list describes changes in default security for Hive 2.3.6 - 2201:
  • None.

New in This Release

Hive 2.3.6 - 2201 introduces the following enhancements or HPE platform-specific behavior changes:

  • Improved Describe table operator in terms of fetching statistics of partitions. Starting from EEP 6.3.5, you can fetch the partition information using the describe command with formatted or extended statements.
    Configure the hive.describe.partitionedtable.ignore.stats property to change the behaviour of fetching statistics of partitions. It is set to the default value of false.
    <property>
    <name>hive.describe.partitionedtable.ignore.stats</name>
    <value>false</value>
    <description>Enables partitioned table stats collection for 'DESCRIBE FORMATTED' or 'DESCRIBE EXTENDED' commands</description>
</property>
    <property>
    <name>hive.describe.partitionedtable.ignore.stats</name>
    <value>true</value>
    <description>Disables partitioned table stats collection for 'DESCRIBE FORMATTED' or 'DESCRIBE EXTENDED' commands</description>
 </property

Fixes

This HPE release includes the following fixes on the base release:
GitHub Commit Number Data (YYYY-MM-DD) HPE Fix Number and Description
21f6a46d26 2022-01-25 EEP-HIVE-1149: Upgrade Log4J version to '1.3.1-mapr'
db3c3fe39d 2022-01-19 EEP-HIVE-1145 : Add only necessary jars to Hive class path from Slider lib folder
c358c77ba0 2022-01-19 MAPR-HIVE-857 : Class path contains multiple SLF4J bindings
5310a60e7c 2022-01-19 EEP-HIVE-1138 : Add some org.apache.curator classes to container classpath
485c2dddb3 2022-01-19 EEP-HIVE-1137 : Add tez jars to containers folder app/install//lib/tez/
5c6a759068 2022-01-19 EEP-HIVE-1136 : Apply existing LLAP daemon security for kerberos only
8eb9d621b8 2022-01-10 EEP-HIVE-1129 : java.lang.ClassNotFoundException: org.apache.commons.logging.LogFactory
2bdd87c769 2022-01-06 EEP-HIVE-1065: CVE-2021-37136, CVE-2021-37137, WS-2020-0408, CVE-2021-21290: netty-*-4.1.55.Final.jar
8c97c3dad4 2022-01-05 EEP-HIVE-1062: CVE-2016-5007, CVE-2016-9878 ,CVE-2018-1271, CVE-2018-1272, CVE-2020-5421: spring-*-3.2.16.RELEASE.jar
e8824ff58b 2022-01-05 EEP-HIVE-1068: CVE-2020-9480: spark-network-common_2.11-2.3.0.jar, CVE-2018-17190: spark-core_2.11-2.3.0.jar
4b59b03b22 2022-01-05 EEP-HIVE-1123 : UnsupportedClassVersionError: com/beust/jcommander/ParameterException
0f3c07c5db 2022-01-04 EEP-HIVE-1117: Update log4j v2 to the latest available (to 2.17+)
62cde6b526 2022-01-04 EEP-HIVE-1116: Hive returns an incorrect number of columns
f3eb784483 2022-01-04 Revert "MAPR-HIVE-930: Cannot run join with Order by and Limit clause specified at the same time"
b7e98bc780 2021-12-30 EEP-HIVE-1119: com.fasterxml.jackson.annotation.JsonFormat.empty()Lcom/fasterxml/jackson/annotation/JsonFormat
b6c3e29c75 2021-12-24 EEP-HIVE-1064: CVE-2021-30639 ; CVE-2021-33037: tomcat-coyote-10.0.4.jar
bd35d3d8b0 2021-12-24 EEP-HIVE-1059: CVE-2019-10172, CVE-2019-10202: jackson-mapper-asl-1.9.13.jar, jackson-mapper-asl-1.9.2.jar
a7414780f7 2021-12-24 EEP-HIVE-1056: CVE-2021-35515, CVE-2021-35516, CVE-2021-35517, CVE-2021-36090: commons-compress-1.20.jar
b9b59431d8 2021-12-24 EEP-HIVE-1055: CVE fixes of bcprov-jdk15on-1.52.jar
c72f9e03b2 2021-12-24 EEP-HIVE-1054: WS-2021-0419: gson-2.2.4.jar
3b9477aa97 2021-12-22 MAPR-HIVE-1053 : Relative path in absolute URI: slider reads hdfs-site.xml from hadoop-hdfs.jar
1bcc87122e 2021-12-22 MAPR-HIVE-1036 : java.lang.NoClassDefFoundError: org/apache/commons/digester/Digester
f385e38ed5 2021-12-22 MAPR-HIVE-1025 : LLAP server expects tez.tar.gz archive in MapR FS
ce47408acc 2021-12-22 MAPR-HIVE-1033 : Add MapR slider dependency to Hive
307f5634f4 2021-12-15 MAPR-HIVE-919: FAILURE! - in org.apache.hadoop.hive.ql.metadata.TestHive
6a6adc1605 2021-12-14 EEP-HIVE-1097: CVE-2021-44228 - Log4j vulnerability
38f79750e5 2021-12-03 EEP-HIVE-1087: CAST gives NULL values during insert when vectorization enabled.
0c49ac7aa6 2021-11-11 MAPR-HIVE-1031 : logError: command not found if any error happens during configuring Hive
86fce467db 2021-11-11 MAPR-HIVE-1024 : Replace deprecated AuthMethod.DIGEST with AuthMethod.TOKEN in HadoopThriftAuthBridge25Sasl
5aa83575a3 2021-11-02 MAPR-HIVE-975: Customer request to investigate temporary hive session files cleanup improvements
5d17652c59 2021-10-13 MAPR-HIVE-1002 : Hive-2.3 does not remove old compressed logs
949a43e679 2021-10-11 MAPR-HIVE-1015 : Configure repositories for Jenkins job
This release also includes the following back-ported issues. For complete details, refer to the commit log for this project in GitHub.
GitHub Commit Number Data (YYYY-MM-DD) HPE Fix Number and Description
d1c4ee1ed3 2021-12-08 HIVE-17774: compaction may start with 0 splits and fail
e2f6d07cbf 2021-10-28 HIVE-20072 : Write access being requested when performing select on a table
be8520b3dc 2021-10-08 HIVE-16820 : TezTask may not shut down correctly before submit (Sergey Shelukhin, reviewed by Siddharth Seth)

Known Issues and Limitations

  • HIVE-19502 Unable to insert values into table stored by JdbcStorageHandler
  • HIVE-19286 NPE in MERGE operator on MR mode
Some SELECT queries can be converted to a single FETCH task minimizing latency. Currently, the query should be single sourced, not having any subquery, and should not have any aggregations or distincts (which incurs RS), lateral views or joins:
none : disable hive.fetch.task.conversion
minimal : SELECT star, filter on partition columns, LIMIT only
more :  SELECT, filter, LIMIT only (support TABLESAMPLE and virtual columns)

Resolved Issues

  • None.