Hive 3.1.3.0 - 2210 (EEP 9.0.0) Release Notes

The following notes relate specifically to the HPE Ezmeral Data Fabric Distribution for Apache Hive. You may also be interested in the

Hive Version	3.1.3.0
Release Date	October 2022
HPE Version Interoperability	See Hive and HCatalog Support Matrix and Ecosystem Support Matrix and EEP Components and OS Support.
Source on GitHub	https://github.com/mapr/hive
GitHub Release Tag	3.1.3.0-eep-900
Maven Artifacts	https://repository.mapr.com/maven/
Package Names	Navigate to http://package.ezmeral.hpe.com/releases/MEP/, and select your EEP(MEP) and OS to view the list of package names.
ODBC/JDBC Drivers	Hive 3.1.3 works with the following HPE Hive drivers: ODBC Drivers Mac OS X Linux 32-bit 64-bit Windows 32-bit 64-bit For additional driver information, see Connecting to HiveServer2.

Feature support

The following list describes support of various components and functionality with Hive 3.1.3 - 2210:

Supports Hive-3.1.3 on Tez-0.10.2 For more information, see Tez 0.10.2 - 2210 (EEP 9.0.0) Release Notes.
Does not support Hive on Spark. You cannot use Spark as a query engine for Hive. However, you can run Hive and Spark on the same cluster. You can also use Spark SQL and Drill to query Hive tables.
Does not support HDFS encryption in Hive tables.
Does not support LLAP with Hive-3.1.3 because Apache Slider is not an HPE supported ecosystem component.
Starting from Hive 2.1, Hive must run the schematool command as an initialization step.
Starting from EEP 9.0.0, Data Fabric supports Ranger, which can be integrated with HiveServer2. For more information, see Integrating HiveServer2 with Ranger.

New in This Release

Hive 3.1.3.0 - 2210 introduces the following enhancements or HPE platform-specific behavior changes:

Updated Thrift version to 0.16.0.
Added support for Ranger. See Ranger 2.3.0.0 - 2210 (EEP 9.0.0) Release Notes.
Added support for Hive Metatsore configuration properties. You can separately add configuration options for Hive Metastore in hivemetastore-site.xml file. However, configuration options in hive-site.xml file are still valid.
Removed hive.warehouse.subdir.inherit.perms Hive property.

Fixes

This HPE release includes the following fixes on the base release:

GitHub Commit Number	Data (YYYY-MM-DD)	HPE Fix Number and Description
f3fc0ea	2022-09-22	HIVE-21227: HIVE-20776 causes view access regression (Na Li reviewed by Karthik Manamcheri and Peter Vary)
7ee7c44	2022-09-22	HIVE-20776 : Run HMS filterHooks on server-side in addition to client-side (Na Li reviewed by Karthik, Sergio, Morio, Adam and Vihang Karajgaonkar)
09e3658	2022-09-20	HIVE-21844 : HMS schema Upgrade Script is failing with NPE. (Mahesh Kumar Behera reviewed by Sankar Hariappan)
a03408d	2022-09-17	HIVE-22645: Jline can break bash terminal behavior (László Bodor reviewed by Miklos Gergely, Zoltan Haindrich)
3a0ad371	2022-09-15	HIVE-20424: schematool shall not pollute beeline history (Daniel Dai, reviewed by Sankar Hariappan)
fbc8822	2022-09-17	HIVE-23339: SBA does not check permissions for DB location specified in Create database query (Shubham Chaurasia, reviewed by Miklos Gergely) (#1011)
4c762f3	2022-04-16	HIVE-20786 - Maven Build Failed with group id is too big (Szehon, reviewed by Vihang)
03a6478	2022-05-07	HIVE-21685: Wrong simplification in query with multiple IN clauses (Jesus Camacho Rodriguez, reviewed by Zoltan Haindrich)
7769ff0	2022-08-10	HIVE-25631: Initiator speed-up: only read compaction history once per loop (Denys Kuzmenko, reviewed by Karen Coppage)
db5f7a6	2022-08-10	HIVE-24602: Retry compaction after configured time (Peter Varga, reviewed by Karen Coppage)
a756bb1	2022-08-10	HIVE-23683: Add enqueue time to compaction (Peter Vary reviewed by Karen Coppage and Laszlo Pinter)
d315e4e	2022-08-10	HIVE-22729: Provide a failure reason for failed compactions (Laszlo Pinter reviewed by Karen Coppage, Denys Kuzmenko and Peter Vary)
a79531f	2022-08-10	HIVE-22627: Add schema changes introduced in HIVE-21443 to the schema upgrade scripts (Zoltan Chovan via Peter Vary)
f1c85b3	2022-08-10	HIVE-21443: Better usability for SHOW COMPACTIONS (Peter Vary reviewed by Gopal V and Marta Kuczora)
cfc5cb3	2022-08-10	HIVE-20607: TxnHandler should use PreparedStatement to execute direct SQL queries (Sankar Hariappan, reviewed by Daniel Dai)
b87f9bc	2022-08-10	HIVE-20264: Bootstrap repl dump with concurrent write and drop of ACID table makes target inconsistent (Sankar Hariappan, reviewed by Mahesh Kumar Behera, Anishek Agarwal)
498d751	2022-08-02	HIVE-25709: Upgrade netty to 4.1.69 in the hive/pom (Saihemanth via Naveen Gangam)
4760818	2022-08-02	HIVE-25312: Upgrade netty to 4.1.65.Final (Zoltan Haindrich reviewed by Panagiotis Garefalakis)
ac0d202	2022-08-02	HIVE-24138. Llap external client flow is broken due to netty shading. (#1491) (Ayush Saxena reviewed by Laszlo Bodor)
acf3c08	2022-08-02	HIVE-23073 : Shade netty and upgrade to netty 4.1.48.Final (Laszlo Bodor via Ashutosh Chauhan)
b2e55fd	2022-08-02	HIVE-25054: Upgrade `jodd-core` dependency to get rid of CVE-2018-21234 (Abhay Chennagiri, reviewed by Jesus Camacho Rodriguez)
5607fdd	2022-08-02	HIVE-22248 Fix statistics persisting issues (Miklos Gergely reviewed by Jesus Camacho Rodriguez)
fb5d356	2022-08-02	HIVE-19316: StatsTask fails due to ClassCastException (Jaume Marhuenda, reviewed by Jesus Camacho Rodriguez)
c6ff737	2022-08-02	HIVE-25635: Upgrade libthrift to 0.16.0
d8cfea6	2022-08-02	HIVE-25468: Authorization for Create/Drop functions in HMS(Saihemanth Gantasala via Naveen Gangam)
038936e	2022-08-02	HIVE-23786 HMS server side filter with Ranger (Sam An reviewed by Peter Vary)
2b89a55	2022-08-02	HIVE-24026: HMS/Ranger Spark view authorization plan (Sai Hemanth Gantasala reviewed by Vihang Karajgaonkar)
ecf1d55	2022-08-02	HIVE-21920: Extract command authorisation from the Driver (Miklos Gergely, reviewed by Jesus Camacho Rodriguez)
70893f1	2022-08-02	HIVE-21829: HiveMetaStore authorization issue with AlterTable and DropTable events (Ramesh Mani, reviewed by Daniel Dai)

Known Issues and Limitations

HIVE-1321: Unable to use Data Fabric SASL HiveServer2 authentication for data-fabric client in Hive 3 to connect from client to server. As a workaround, you can use PAM authentication.
HIVE-1315: Hive 3 on Tez 0.10.x is unable to run jobs by using S3 endpoint in HPE Ezmeral Data Fabric Object Store. There is no workaround for this issue in this release.
IN-3165: Unable to start Hive Metastore service because schema was not created in database. As a workaround, run the following schematool command as an initialization step:
```
/opt/mapr/hive/hive-<version>/bin/schematool -dbType mysql -initSchema 
```
For details, see Configuring MariaDB for the Hive Metastore.
HIVE-19502: Unable to insert values into table stored by JdbcStorageHandler
HIVE-19286: NPE in MERGE operator on MR mode

HIVE-760: [Hive-2.3] Could not start hive-metastore on Centos 8 MetaException(message:Version information not found in metastore)

Starting in EEP 7.0.0, use the MySQL driver with MariaDB.

<property>
    <name>javax.jdo.option.ConnectionURL</name>
    <value>jdbc:mysql://localhost:3306/hive?createDatabaseIfNotExist=true</value>
 </property>
 <property>
    <name>javax.jdo.option.ConnectionDriverName</name>
    <value>com.mysql.jdbc.Driver</value>
    <description>Driver class name for a JDBC metastore</description>
 </property>

Some SELECT queries can be converted to a single FETCH task minimizing latency. Currently, the query should be single sourced and should not have a subquery or any aggregations or distincts (which incurs RS), lateral views and joins:

none : disable hive.fetch.task.conversion
minimal : SELECT star, filter on partition columns, LIMIT only
more :  SELECT, filter, LIMIT only (support TABLESAMPLE and virtual columns)

Hive 3.1.3 in EEP 9.0.0 does not support standalone Metastore.