Hive 2.3.3-1901 (EEP 6.1.0 and EEP 6.0.1) Release Notes

Feature Support

• EEP 6.1.0 supports Hive-2.3.3 on Tez-0.9.

  For more information, see Tez 0.9.1-1901 (EEP 6.1.0 and EEP 6.0.1) Release Notes.

• EEP 6.1.0 does not support Hive on Spark, so you cannot use Spark as an execution engine for Hive.

  However, you can run Hive and Spark on the same cluster. You can also use Spark SQL and Drill to query Hive tables.

• EEP 6.1.0 does not support HDFS encryption in Hive tables.
• EEP 6.1.0 does not support HBase with Hive-2.3.3 starting from the 6.0.0 release.
• EEP 6.0.0 does not support LLAP with Hive-2.3.3, because Apache Slider is not a MapR ecosystem component.
• Hive 2.1 and later needs to run the schematool command as an initialization step.

New Features

• Implemented preserving warden configuration files during package update.
• Backported FallbackHiveAuthorizerFactory in scope of CVE-2018-11777. For more information, see Fallback Hive Authorizer.

Changes in Security with Default Configuration

• The following properties are added to the hive-site.xml configuration by default on a secured cluster:

  <property>
    <name>hive.users.in.admin.role</name>
    <value>mapr</value>
  </property>
  
  <property>
    <name>hive.conf.restricted.list</name>
    <value>hive.security.authenticator.manager,
      hive.security.authorization.manager,
      hive.security.metastore.authorization.manager,
      hive.security.metastore.authenticator.manager,
      hive.users.in.admin.role,
      hive.server2.xsrf.filter.enabled,
      hive.security.authorization.enabled,
      hive.server2.authentication.ldap.baseDN,
      hive.server2.authentication.ldap.url,
      hive.server2.authentication.ldap.Domain,
      hive.server2.authentication.ldap.groupDNPattern,
      hive.server2.authentication.ldap.groupFilter,
      hive.server2.authentication.ldap.userDNPattern,
      hive.server2.authentication.ldap.userFilter,
      hive.server2.authentication.ldap.groupMembershipKey,
      hive.server2.authentication.ldap.userMembershipKey,
      hive.server2.authentication.ldap.groupClassKey,
      hive.server2.authentication.ldap.customLDAPQuery,
      hive.exec.pre.hooks,
      hive.exec.post.hooks,
      hive.exec.failure.hooks,
      hive.exec.query.redactor.hooks,
      hive.semantic.analyzer.hook,
      hive.query.lifetime.hooks,
      hive.exec.driver.run.hooks,
      hive.server2.session.hook</value>
  </property>        
            
  <property>
    <name>hive.security.authorization.enabled</name>
    <value>true</value>
  </property>
            
  <property>
    <name>hive.security.authorization.manager</name>
    <value>org.apache.hadoop.hive.ql.security.authorization.plugin.fallback.FallbackHiveAuthorizerFactory</value>
  </property>
            
  <property>
    <name>hive.server2.metrics.enabled</name>
    <value>true</value>
  </property>
            
  <property>
    <name>hive.service.metrics.reporter</name>
    <value>JSON_FILE,JMX</value>
  </property>
            
  <property>
    <name>hive.service.metrics.file.location</name>
    <value>/tmp/hive_report.json</value>
  </property>

Known Issues

• In HIVE-19502, you cannot insert values into a table stored by JdbcStorageHandler.
• In HIVE-19286, NPE in MERGE operator on MR mode.
• In Bug 32349, [6.1RC1] Simple fetch from MapR Database JSON tables does not work. Workaround: Set hive.fetch.task.conversion=none in the hive-site.xml file or in the Hive CLI.
• Some select queries can be converted to single FETCH task minimizing latency. Currently the query should be single sourced not having any sub query and should not have any aggregations or distincts (which incurs RS), lateral views and joins:
  • none: Disable hive.fetch.task.conversion
  • minimal: SELECT star, filter on partition columns, LIMIT only
  • more: SELECT, filter, LIMIT only (support TABLESAMPLE and virtual columns)
• Vectorized execution is a new Hive feature that can show performance improvements in some cases and cause stability issues with others. The Hive vectorized execution feature has many bugs in Hive 2.x. It is recommended to turn off this feature at a system level and only use it for certain queries which work fine using it. You must evaluate the benefit of this feature against the potential stability issues on a case by case basis.

Fixes

This release includes the following fixes on the base Apache release. For complete details, refer to the commit log for this project in GitHub.

This release also includes the following backported issues. For complete details, refer to the commit log for this project in GitHub.

Related Links