Apache Hive官网安全更新（2022-11-16）

安全更新

<br/><br/> Release Notes - Hive - Version 4.0.0-alpha-2<br/> <br/> Sub-task<br/><br/><br/>[HIVE-17370] - Some tests are failing with java.io.FileNotFoundException: File file:/tmp/hadoop/mapred/...<br/><br/>[HIVE-17943] - select ROW__ID, t, si, i from over10k_orc_bucketed where b = 4294967363 and t &amp;lt; 100 order by ROW__ID fails on LLAP<br/><br/>[HIVE-19930] - Resolve explain.out differences introduced by transactional metastore statistics<br/><br/>[HIVE-20070] - ptest optimization - Replicate ACID/MM tables write operations.<br/><br/>[HIVE-20387] - Move non-server related methods from Warehouse to MetastoreUtils<br/><br/>[HIVE-20532] - One of the task , either move or add partition can be avoided in repl load flow<br/><br/>[HIVE-20564] - Remove Hive Server dependency on Metastore Server<br/><br/>[HIVE-21108] - Assign writeId for stats update for a converted transactional table<br/><br/>[HIVE-22417] - Remove stringifyException from MetaStore<br/><br/>[HIVE-22748] - Remove disabling of IdentityProjectRemover transformation for Return Path<br/><br/>[HIVE-23745] - Avoid copying userpayload in task communicator<br/><br/>[HIVE-24941] - [Evaluate] if ReplicationSpec is needed for DataConnectors.<br/><br/>[HIVE-25091] - Implement connector provider for MSSQL and Oracle<br/><br/>[HIVE-25446] - Wrong exception thrown if capacity&amp;lt;=0<br/><br/>[HIVE-25556] - Remove com.vlkan.flatbuffers dependency from serde<br/><br/>[HIVE-25921] - Overwrite table metadata for bootstraped tables<br/><br/>[HIVE-26045] - Detect timed out connections for providers and auto-reconnect<br/><br/>[HIVE-26118] - [Standalone Beeline] Jar name mismatch between build and assembly<br/><br/>[HIVE-26171] - HMSHandler get_all_tables method can not retrieve tables from remote database<br/><br/>[HIVE-26183] - Create delete writer for the UPDATE statemens<br/><br/>[HIVE-26223] - Integrate ESRI GeoSpatial UDFs <br/><br/>[HIVE-26224] - Add support for ESRI GeoSpatial SERDE formats<br/><br/>[HIVE-26240] - Add tests for Esri UDFs for Geospatial<br/><br/>[HIVE-26278] - Add unit tests for Hive#getPartitionsByNames using batching<br/><br/>[HIVE-26279] - Drop unused requests from TestHiveMetaStoreClientApiArgumentsChecker<br/><br/>[HIVE-26285] - Overwrite database metadata on original source in optimised failover.<br/><br/>[HIVE-26299] - Drop data connector with argument ifNotExists(true) should not throw NoSuchObjectException<br/><br/>[HIVE-26301] - Fix ACID tables bootstrap during reverse replication in unplanned failover.<br/><br/>[HIVE-26316] - Handle dangling open txns on both src &amp;amp; tgt in unplanned failover.<br/><br/>[HIVE-26319] - Iceberg integration: Perform update split early<br/><br/>[HIVE-26361] - Merge statement compile fails if split update is off<br/><br/>[HIVE-26365] - Remove column statistics collection task from merge statement plan <br/><br/>[HIVE-26448] - Improve UnsignedInt128.setV*()<br/><br/>[HIVE-26488] - Fix NPE in DDLSemanticAnalyzerFactory during compilation<br/><br/>[HIVE-26512] - ST_GeometryProcessing is incorrectly registered as function<br/><br/>[HIVE-26541] - WebHCatServer start fails with NPE<br/><br/>[HIVE-26549] - WebHCat servers fails to start due to authentication filter configuration<br/><br/><br/> <br/> Bug<br/><br/><br/>[HIVE-5134] - add tests to partition filter JDO pushdown for like and make sure it works, or remove it<br/><br/>[HIVE-14981] - Eliminate unnecessary MapJoin restriction in HIVE-11394<br/><br/>[HIVE-17162] - get rid of &amp;quot;skipCorrupt&amp;quot; flag<br/><br/>[HIVE-17539] - User impersonation failure is not propagated by server as a failure to client<br/><br/>[HIVE-18928] - HS2: Perflogger has a race condition<br/><br/>[HIVE-19093] - some parts of the Driver runs from the &amp;quot;Background-Pool&amp;quot; in HS2<br/><br/>[HIVE-19217] - Upgrade to Hadoop 3.1.0<br/><br/>[HIVE-19652] - Incorrect predicate pushdown for groupby with grouping sets<br/><br/>[HIVE-19887] - One item in pom.xml still has 3.1.0 causing Metastore releated tables related test failures. <br/><br/>[HIVE-19955] - ACID: Pre-filter the delete event registry using insert delta ranges<br/><br/>[HIVE-20001] - With doas set to true, running select query as hrt_qa user on external table fails due to permission denied to read /warehouse/tablespace/managed directory.<br/><br/>[HIVE-20304] - When hive.optimize.skewjoin and hive.auto.convert.join are both set to true, and the execution engine is mr, same stage may launch twice due to the wrong generated plan<br/><br/>[HIVE-20435] - Failed Dynamic Partition Insert into insert only table may loose transaction metadata<br/><br/>[HIVE-20470] - Runtime of QueryInfo should be initialized<br/><br/>[HIVE-20520] - length(CHAR) doesn&amp;#39;t consider trailing space<br/><br/>[HIVE-20870] - Metastore cache is accessed for transaction table stats<br/><br/>[HIVE-20901] - running compactor when there is nothing to do produces duplicate data<br/><br/>[HIVE-21086] - Fetch task and MR job give back different results when multiple partitions point to the same location<br/><br/>[HIVE-21106] - Potential NEP in VectorizedOrcAcidRowBatchReader.ColumnizedDeleteEventRegistry<br/><br/>[HIVE-21259] - HiveMetaStoreCilent.getNextNotification throws exception when no new events found<br/><br/>[HIVE-21450] - Buffer Reader is not closed during executeInitSql<br/><br/>[HIVE-21513] - ACID: Running merge concurrently with minor compaction causes a later select * to throw exception <br/><br/>[HIVE-21710] - Minor compaction writes delete records in unbucketed tables multiple times when we have multiple files &amp;lt;bucket_N&amp;gt;<br/><br/>[HIVE-21897] - Setting serde / serde properties for partitions<br/><br/>[HIVE-22056] - Beeline started with -f &amp;lt;script-file&amp;gt;, exit code is 0 even if unable to connect to HS2<br/><br/>[HIVE-22317] - Beeline-site parser does not handle the variable substitution correctly<br/><br/>[HIVE-22325] - variable expansion doesn&amp;#39;t work in beeline-site.xml<br/><br/>[HIVE-22368] - Hive JDBC Storage Handler: some mysql data type can not be cast to hive data type<br/><br/>[HIVE-22670] - ArrayIndexOutOfBoundsException when vectorized reader is used for reading a parquet file<br/><br/>[HIVE-22758] - Create database with permission error when doas set to true<br/><br/>[HIVE-22806] - Missing materialized view rewrite in case the filter is further narrowed<br/><br/>[HIVE-22956] - Fix checking if a table is used by a materialized view before dropping<br/><br/>[HIVE-22960] - Approximate TopN Key Operator<br/><br/>[HIVE-23056] - LLAP registry getAll doesn&amp;#39;t filter compute groups<br/><br/>[HIVE-23500] - [Kubernetes] Use Extend NodeId for LLAP registration<br/><br/>[HIVE-23583] - Upgrade to ant 1.10.9 due to CVEs<br/><br/>[HIVE-23968] - CTAS with TBLPROPERTIES (&amp;#39;transactional&amp;#39;=&amp;#39;false&amp;#39;) does not entertain translated table location<br/><br/>[HIVE-24070] - ObjectStore.cleanWriteNotificationEvents OutOfMemory on large number of pending events<br/><br/>[HIVE-24086] - CTAS with HMS translation enabled returns empty results.<br/><br/>[HIVE-24122] - When CBO is enable, CAST(STR as Bigint)IS NOT NULL result is wrong <br/><br/>[HIVE-24595] - Vectorization causing incorrect results for scalar subquery<br/><br/>[HIVE-24904] - CVE-2019-10172,CVE-2019-10202 vulnerabilities in jackson-mapper-asl-1.9.13.jar<br/><br/>[HIVE-25298] - LAG function get java.lang.ClassCastException: org.apache.hadoop.hive.common.type.HiveDecimal cannot be cast to org.apache.hadoop.hive.serde2.io.HiveDecimalWritable<br/><br/>[HIVE-25416] - Hive metastore memory leak because datanucleus-api-jdo bug<br/><br/>[HIVE-25421] - Fallback from vectorization when reading Iceberg&amp;#39;s time columns from ORC files<br/><br/>[HIVE-25437] - org.pentaho:pentaho-aggdesigner-algorithm has been sunset.<br/><br/>[HIVE-25492] - Major query-based compaction is skipped if partition is empty<br/><br/>[HIVE-25518] - CompactionTxHandler NPE if no CompactionInfo<br/><br/>[HIVE-25621] - Alter table partition compact/concatenate commands should send HivePrivilegeObjects for Authz<br/><br/>[HIVE-25758] - OOM due to recursive application of CBO rules<br/><br/>[HIVE-25798] - Update pom.xml<br/><br/>[HIVE-25802] - Log4j2 Vulnerability in Hive Storage API<br/><br/>[HIVE-25811] - Fix TestMiniLlapLocalCliDriver#testCliDriver[sysdb] caused by the HIVE-25737 <br/><br/>[HIVE-25813] - CREATE TABLE x LIKE storagehandler-based-source fails <br/><br/>[HIVE-25848] - Empty result for structs in point lookup optimization with vectorization on<br/><br/>[HIVE-25853] - Security Vulnerability CVE-2021-44832 log4j2 need upgrade to 2.17.1<br/><br/>[HIVE-25879] - MetaStoreDirectSql test query should not query the whole DBS table<br/><br/>[HIVE-25887] - Add external_table_concatenate.q to testconfiguration.properties<br/><br/>[HIVE-25907] - IOW Directory queries fails to write data to final path when query result cache is enabled<br/><br/>[HIVE-25976] - Cleaner may remove files being accessed from a fetch-task-converted reader<br/><br/>[HIVE-25993] - Query-based compaction doesn&amp;#39;t work when partition column type is boolean<br/><br/>[HIVE-26055] - Fix the HivePrivilegesObjects for Alter table rename command<br/><br/>[HIVE-26060] - Invalidate acid table directory cache on drop table<br/><br/>[HIVE-26061] - Do not add &amp;#39;from deserializer&amp;#39; comment upon alter commands for Iceberg tables<br/><br/>[HIVE-26074] - PTF Vectorization: BoundaryScanner for varchar<br/><br/>[HIVE-26096] - Select on single column MultiDelimitSerDe table throws AIOBE<br/><br/>[HIVE-26110] - Bulk insert into partitioned table creates lots of files in iceberg<br/><br/>[HIVE-26114] - Fix jdbc connection hiveserver2 using dfs command with prefix space will cause exception<br/><br/>[HIVE-26115] - LLAP cache utilization for Iceberg Parquet files<br/><br/>[HIVE-26116] - Fix handling of compaction requests originating from aborted dynamic partition queries in Initiator<br/><br/>[HIVE-26127] - INSERT OVERWRITE throws FileNotFound when destination partition is deleted <br/><br/>[HIVE-26131] - Incorrect OutputFormat when describing jdbc connector table <br/><br/>[HIVE-26135] - Invalid Anti join conversion may cause missing results<br/><br/>[HIVE-26139] - URL Encoding from HIVE-26015 was a bit too aggressive<br/><br/>[HIVE-26141] - Fix vector_ptf_part_simple_all_datatypes source file<br/><br/>[HIVE-26147] - OrcRawRecordMerger throws NPE when hive.acid.key.index is missing for an acid file<br/><br/>[HIVE-26158] - TRANSLATED_TO_EXTERNAL partition tables cannot query partition data after rename table<br/><br/>[HIVE-26161] - Use Hive&amp;#39;s ORC dependency version when producing file footer for Iceberg<br/><br/>[HIVE-26178] - Multiple version of woodstox jars found in spark class path <br/><br/>[HIVE-26180] - Change MySQLConnectorProvider driver from mariadb to mysql<br/><br/>[HIVE-26184] - COLLECT_SET with GROUP BY is very slow when some keys are highly skewed<br/><br/>[HIVE-26189] - Iceberg metadata query throws exceptions after partition evolution<br/><br/>[HIVE-26192] - JDBC data connector queries occur exception at cbo stage<br/><br/>[HIVE-26193] - Fix Iceberg partitioned tables null bucket handling<br/><br/>[HIVE-26197] - Hive - Upgrade Ant to 1.10.11 due to CVE-2021-36373 and CVE-2021-36374<br/><br/>[HIVE-26205] - Remove the incorrect org.slf4j dependency in kafka-handler<br/><br/>[HIVE-26210] - Fix tests for Cleaner failed attempt threshold<br/><br/>[HIVE-26231] - Generate insert notification events when dynamic partition insert is done on existing partitions<br/><br/>[HIVE-26233] - Problems reading back PARQUET timestamps above 10000 years<br/><br/>[HIVE-26235] - OR Condition on binary column is returning empty result<br/><br/>[HIVE-26249] - slow data processs<br/><br/>[HIVE-26264] - Iceberg integration: Fetch virtual columns on demand<br/><br/>[HIVE-26266] - Column information is not present in lineage for CTAS when custom location/translated location is used<br/><br/>[HIVE-26267] - Addendum to HIVE-26107: perpared statement is not working on Postgres<br/><br/>[HIVE-26268] - Upgrade snappy-java to 1.1.8.4<br/><br/>[HIVE-26270] - Wrong timestamps when reading Hive 3.1.x Parquet files with vectorized reader<br/><br/>[HIVE-26274] - No vectorization if query has upper case window function<br/><br/>[HIVE-26277] - NPEs and rounding issues in ColumnStatsAggregator classes<br/><br/>[HIVE-26288] - NPE in CompactionTxnHandler.markFailed()<br/><br/>[HIVE-26296] - RuntimeException when executing EXPLAIN CBO JOINCOST on query with JDBC tables<br/><br/>[HIVE-26298] - Selecting complex types on migrated iceberg table does not work<br/><br/>[HIVE-26300] - Upgrade Jackson databind version to 2.12.6.1+ to avoid CVE-2020-36518<br/><br/>[HIVE-26320] - Incorrect results for IN UDF on Parquet column of CHAR/VARCHAR type<br/><br/>[HIVE-26340] - Vectorized PTF operator fails if query has upper case window function<br/><br/>[HIVE-26349] - TestOperatorCmp/TestReOptimization fail silently due to incompatible configuration<br/><br/>[HIVE-26350] - IndexOutOfBoundsException when generating splits for external JDBC table with partition columns<br/><br/>[HIVE-26352] - Tez queue access check fails with GSS Exception on Compaction<br/><br/>[HIVE-26355] - Column compare should be case insensitive for name<br/><br/>[HIVE-26358] - Querying metadata tables does not work for Iceberg tables using HADOOP_TABLE<br/><br/>[HIVE-26366] - PTF Vectorization: BoundaryScanner for boolean<br/><br/>[HIVE-26371] - Constant propagation does not evaluate constraint expressions at merge when CBO is enabled<br/><br/>[HIVE-26372] - QTests depend on mysql docker image are fail<br/><br/>[HIVE-26373] - ClassCastException when reading timestamps from HBase table with Avro data<br/><br/>[HIVE-26374] - Query based compaction fails for tables with CDT and columns with Reserved Keywords<br/><br/>[HIVE-26375] - Invalid materialized view after rebuild if source table was compacted<br/><br/>[HIVE-26380] - Fix NPE when reading a struct field with null value from iceberg table<br/><br/>[HIVE-26388] - ClassCastException when there is non string type column in source table of CTAS query<br/><br/>[HIVE-26390] - TxnHandler.getTxnDbsUpdated() SQL syntax error on Postgres.<br/><br/>[HIVE-26396] - The trunc function has a problem with precision interception and the result has many 0<br/><br/>[HIVE-26403] - Iceberg CTAS fails if source table schema contains decimal column<br/><br/>[HIVE-26404] - HMS memory leak when compaction cleaner fails to remove obsolete files<br/><br/>[HIVE-26408] - Vectorization: Fix deallocation of scratch columns, don&amp;#39;t reuse a child ConstantVectorExpression as an output<br/><br/>[HIVE-26409] - Assign NO_TXN operation type for table in global locks for scheduled queries<br/><br/>[HIVE-26410] - Reading nested types within maps in Parquet Iceberg is not supported with vectorization<br/><br/>[HIVE-26421] - HmsClient atler_table_req() is called twice when running an alter operation on iceberg table <br/><br/>[HIVE-26423] - Make commons-pool2 an explicit dependency (and upgrade to 2.11.1)<br/><br/>[HIVE-26426] - Avoid StringIndexOutOfBoundsException in canCBOHandleAst() method.<br/><br/>[HIVE-26438] - Remove unnecessary optimization in canHandleQbForCbo() method<br/><br/>[HIVE-26440] - Duplicate hive-standalone-metastore-server dependency in QFile module<br/><br/>[HIVE-26446] - HiveProtoLoggingHook fails to populate TablesWritten field for partitioned tables.<br/><br/>[HIVE-26447] - Vectorization: wrong results when filter on repeating map key orc table<br/><br/>[HIVE-26466] - NullPointerException on HiveQueryLifeTimeHook:checkAndRollbackCTAS<br/><br/>[HIVE-26468] - Cleanup dependency to FlatBuffers<br/><br/>[HIVE-26476] - Iceberg: map &amp;quot;ORCFILE&amp;quot; to &amp;quot;ORC&amp;quot; while creating an iceberg table<br/><br/>[HIVE-26477] - Iceberg: `CREATE TABLE LIKE STORED BY ICEBERG` failing with NullPointerException<br/><br/>[HIVE-26481] - Cleaner fails with FileNotFoundException<br/><br/>[HIVE-26483] - Use DDL_NO_LOCK when running iceberg CTAS query<br/><br/>[HIVE-26495] - MSCK repair perf issue HMSChecker ThreadPool is blocked at fs.listStatus<br/><br/>[HIVE-26496] - FetchOperator scans delete_delta folders multiple times causing slowness<br/><br/>[HIVE-26504] - User is not able to drop table<br/><br/>[HIVE-26506] - HiveIcebergVectorizedRecordReader doesn&amp;#39;t set the selected array<br/><br/>[HIVE-26507] - Do not allow hive to iceberg migration if source table contains CHAR or VARCHAR columns<br/><br/>[HIVE-26510] - Minor compaction creates empty delta files when no prior delta file exists<br/><br/>[HIVE-26511] - Fix NoClassDefFoundError in HMS for HBaseConfiguration<br/><br/>[HIVE-26550] - Const struct equality operator throws error when CBO is off and vectorization is on<br/><br/>[HIVE-26556] - Iceberg: Properties set in HiveIcebergSerde are not propagated to jobconf<br/><br/>[HIVE-26568] - Upgrade Log4j2 to 2.18.0 due to CVEs<br/><br/>[HIVE-26573] - ClassCastException error on window function<br/><br/>[HIVE-26576] - Alter table calls on Iceberg tables can inadvertently change metadata_location<br/><br/>[HIVE-26583] - Ensure iceberg-catalog tests are executed in ptest<br/><br/>[HIVE-26584] - compressed_skip_header_footer_aggr.q is flaky<br/><br/>[HIVE-26608] - Iceberg: Allow parquet write properties to iceberg via session conf and Table Properties<br/><br/>[HIVE-26612] - INT64 Parquet timestamps cannot be read into BIGINT Hive type<br/><br/>[HIVE-26614] - Fix adding custom jars in Job Classpath<br/><br/>[HIVE-26629] - Misleading error message with hive.metastore.limit.partition.request <br/><br/>[HIVE-26633] - Make thrift max message size configurable<br/><br/>[HIVE-26639] - ConstantVectorExpression and ExplainTask shouldn&amp;#39;t rely on default charset<br/><br/>[HIVE-26643] - HiveUnionPullUpConstantsRule produces an invalid plan when pulling up constants for nullable fields<br/><br/>[HIVE-26652] - HiveSortPullUpConstantsRule produces an invalid plan when pulling up constants for nullable fields<br/><br/>[HIVE-26657] - [Iceberg] Filter out the metadata.json file when migrating <br/><br/>[HIVE-26723] - JDBC - Configurable canonical name checking for Kerberos<br/><br/><br/> <br/> New Feature<br/><br/><br/>[HIVE-25230] - add position and occurrence to instr()<br/><br/>[HIVE-25826] - Support table defaults at each database level<br/><br/>[HIVE-25886] - issue<br/><br/>[HIVE-26015] - CREATE HBase table fails when SERDEPROPERTIES contain special characters<br/><br/>[HIVE-26228] - Implement Iceberg table rollback feature<br/><br/>[HIVE-26251] - Disable vectorization when querying iceberg metadata tables<br/><br/>[HIVE-26395] - Support CREATE TABLE LIKE FILE for PARQUET<br/><br/>[HIVE-26425] - Skip SSL cert verification for downloading JWKS in HS2<br/><br/>[HIVE-26443] - Add priority queueing to compaction<br/><br/>[HIVE-26524] - Use Calcite to remove sections of a query plan known never produces rows<br/><br/>[HIVE-26551] - Support CREATE TABLE LIKE FILE for ORC<br/><br/><br/> <br/> Improvement<br/><br/><br/>[HIVE-13288] - Confusing exception message in DagUtils.localizeResource<br/><br/>[HIVE-13353] - SHOW COMPACTIONS should support filtering options<br/><br/>[HIVE-14514] - OrcRecordUpdater should clone writerOptions when creating delete event writers<br/><br/>[HIVE-18772] - Make Acid Cleaner use MIN_HISTORY_LEVEL<br/><br/>[HIVE-20473] - Optimization for materialized views<br/><br/>[HIVE-20800] - Use &amp;quot;posix&amp;quot; for property tarLongFileMode for maven-assembly-plugin<br/><br/>[HIVE-20890] - ACID: Allow whole table ReadLocks to skip all partition locks<br/><br/>[HIVE-21323] - LEFT OUTER JOIN does not generate transitive IS NOT NULL filter on right side<br/><br/>[HIVE-22193] - Graceful Shutdown HiveServer2<br/><br/>[HIVE-22316] - Avoid hostname resolution in LlapInputFormat<br/><br/>[HIVE-22692] - Use only fixDecimalDataTypePhysicalVariations when vectorizing TopNKey operator<br/><br/>[HIVE-23270] - Optimize isValidTxnListState to reduce the numbers of HMS calls<br/><br/>[HIVE-23391] - Non blocking ALTER TABLE add column<br/><br/>[HIVE-24483] - aarch64 Support: Bump protobuf version to 3.21.4<br/><br/>[HIVE-24484] - Upgrade Hadoop to 3.3.1 And Tez to 0.10.2 <br/><br/>[HIVE-24639] - Raises SemanticException other than ClassCastException when filter has non-boolean expressions<br/><br/>[HIVE-25055] - Improve the exception handling in HMSHandler<br/><br/>[HIVE-25444] - Make tables based on storage handlers authorization (HIVE-24705) configurable<br/><br/>[HIVE-25635] - Upgrade Thrift to 0.16.0<br/><br/>[HIVE-25733] - Add check-spelling CI action<br/><br/>[HIVE-25827] - Parquet file footer is read multiple times, when multiple splits are created in same file<br/><br/>[HIVE-25872] - Skip tracking of alterDatabase events for replication specific properties.<br/><br/>[HIVE-25980] - Reduce fs calls in HiveMetaStoreChecker.checkTable<br/><br/>[HIVE-26020] - Set dependency scope for json-path, commons-compiler and janino to runtime<br/><br/>[HIVE-26021] - Change integration tests under DBInstallBase to CheckIn tests<br/><br/>[HIVE-26026] - Use the new &amp;quot;REFUSED&amp;quot; compaction state where it makes sense<br/><br/>[HIVE-26058] - Choose meaningful names for the Metastore pool threads<br/><br/>[HIVE-26059] - Eventually clean compactions in &amp;quot;refused&amp;quot; state from compaction history<br/><br/>[HIVE-26107] - Worker shouldn&amp;#39;t inject duplicate entries in `ready for cleaning` state into the compaction queue<br/><br/>[HIVE-26109] - Upgrade groovy to 2.4.21 due to CVE<br/><br/>[HIVE-26119] - Remove unnecessary Exceptions from DDLPlanUtils<br/><br/>[HIVE-26122] - Factorize out common docker code between DatabaseRule and AbstractExternalDB<br/><br/>[HIVE-26133] - Insert overwrite on Iceberg tables can result in duplicate entries after partition evolution<br/><br/>[HIVE-26137] - Optimized transfer of Iceberg residual expressions from AM to execution<br/><br/>[HIVE-26146] - Handle missing hive.acid.key.index in the fixacidkeyindex utility<br/><br/>[HIVE-26157] - Change Iceberg storage handler authz URI to metadata location<br/><br/>[HIVE-26167] - QueryStateMap in SessionState is not maintained correctly<br/><br/>[HIVE-26169] - Set non-vectorized mode as default when accessing iceberg tables in avro fileformat<br/><br/>[HIVE-26170] - Code cleanup in jdbc dataconnector<br/><br/>[HIVE-26172] - Upgrade ant to 1.10.12<br/><br/>[HIVE-26173] - Upgrade derby to 10.14.2.0<br/><br/>[HIVE-26182] - Some improvements to make DPP more debuggable<br/><br/>[HIVE-26190] - Implement create iceberg table with metadata location<br/><br/>[HIVE-26196] - Integrate Sonar analysis for the master branch and PRs<br/><br/>[HIVE-26202] - Refactor Iceberg Writers<br/><br/>[HIVE-26203] - Implement alter iceberg table metadata location<br/><br/>[HIVE-26215] - Expose the MIN_HISTORY_LEVEL table through Hive sys database <br/><br/>[HIVE-26217] - Make CTAS use Direct Insert Semantics<br/><br/>[HIVE-26226] - Exclude jdk.tools dep from hive-metastore in upgrade-acid<br/><br/>[HIVE-26230] - Option to URL encode special chars in hbase.column.mapping that are valid HBase column family chars<br/><br/>[HIVE-26238] - Decouple sort filter predicates optimization from digest normalization in CBO<br/><br/>[HIVE-26242] - Compaction heartbeater improvements<br/><br/>[HIVE-26253] - upgrade postgresql to 42.4.1 due to security issues<br/><br/>[HIVE-26258] - Provide an option for enable locking of external tables<br/><br/>[HIVE-26260] - Use `Reader.getSchema` instead of deprecated `Reader.getTypes`<br/><br/>[HIVE-26261] - Fix some issues with Spark engine removal<br/><br/>[HIVE-26265] - REPL DUMP should filter out OpenXacts and unneeded CommitXact/Abort.<br/><br/>[HIVE-26272] - Inline util code that is used from log4j jar<br/><br/>[HIVE-26280] - Copy more data into COMPLETED_COMPACTIONS for better supportability<br/><br/>[HIVE-26282] - Improve iceberg CTAS error message for unsupported types<br/><br/>[HIVE-26294] - Allow substr to take bigint as parameters<br/><br/>[HIVE-26307] - Avoid FS init in FileIO::newInputFile in vectorized Iceberg reads<br/><br/>[HIVE-26321] - Upgrade commons-io to 2.11.0<br/><br/>[HIVE-26322] - Upgrade gson to 2.9.0<br/><br/>[HIVE-26334] - Remove misleading bucketing info from DESCRIBE FORMATTED output for Iceberg tables<br/><br/>[HIVE-26354] - Support expiring snapshots on iceberg table<br/><br/>[HIVE-26367] - Upgrade to tez 0.10.2<br/><br/>[HIVE-26378] - Improve error message for masking over complex data types<br/><br/>[HIVE-26381] - Fix link in Javadoc of MetaStoreUtils::getCurrentClassPaths<br/><br/>[HIVE-26385] - Iceberg integration: Implement merge into iceberg table<br/><br/>[HIVE-26397] - Honour Iceberg sort orders when writing a table<br/><br/>[HIVE-26402] - HiveSchemaTool does not honor metastore-site.xml<br/><br/>[HIVE-26414] - Aborted/Cancelled CTAS operations must initiate cleanup of uncommitted data<br/><br/>[HIVE-26417] - Iceberg integration: disable update and merge iceberg table when split update is off<br/><br/>[HIVE-26428] - Limit usage of LLAP BPWrapper to threads of IO threadpools<br/><br/>[HIVE-26429] - Set default value of hive.txn.xlock.ctas to true and update lineage info for CTAS queries.<br/><br/>[HIVE-26439] - Skip collecting Kafka delegation tokens if PLAINTEXT is set<br/><br/>[HIVE-26444] - Use tez.local.mode.without.network for unit tests<br/><br/>[HIVE-26450] - Use a more lightweight Oracle image<br/><br/>[HIVE-26460] - Upgrade Iceberg dependency to 0.14.0<br/><br/>[HIVE-26471] - New metric for Compaction pooling<br/><br/>[HIVE-26474] - Enable converting insert-only tables to full ACID tables<br/><br/>[HIVE-26478] - Explicitly set Content-Type in QueryProfileServlet<br/><br/>[HIVE-26479] - Add ability to set parameters for query-based compaction<br/><br/>[HIVE-26480] - Improve SYS.COMPACTIONS and SYS.TRANSACTIONS views<br/><br/>[HIVE-26500] - Improve TestHiveMetastore<br/><br/>[HIVE-26502] - Improve LDAP auth to support include generic user filters<br/><br/>[HIVE-26519] - Iceberg: Add support for CTLT queries<br/><br/>[HIVE-26521] - Iceberg: Raise exception when running delete/update statements on V1 tables<br/><br/>[HIVE-26529] - Iceberg: Fix VectorizedSupport support for DECIMAL_64 in HiveIcebergInputFormat.<br/><br/>[HIVE-26532] - Remove logger from critical path in VectorMapJoinInnerLongOperator::processBatch<br/><br/>[HIVE-26535] - Iceberg: Support adding parquet compression type via Table properties<br/><br/>[HIVE-26536] - Enable &amp;#39;hive.acid.truncate.usebase&amp;#39; by default<br/><br/>[HIVE-26539] - Kryo deserialization improvements<br/><br/>[HIVE-26543] - Improve TxnHandler, TxnUtils, CompactionTxnHandler logging<br/><br/>[HIVE-26554] - Upgrade Iceberg dependency to 0.14.1<br/><br/>[HIVE-26564] - Separate query live operation log and historical operation log<br/><br/>[HIVE-26567] - Hive Security - Upgrade Apache Log4j to 2.18.0 due to critical CVEs<br/><br/>[HIVE-26596] - Hive should enforce merge-on-read delete mode is set for Iceberg V2 tables<br/><br/>[HIVE-26603] - Initiator does not initiate minor compaction for insert-only tables<br/><br/>[HIVE-26613] - Upgrade jettison to 1.5.1 to fix CVE-2022-40149<br/><br/>[HIVE-26617] - Remove unused configurations<br/><br/>[HIVE-26620] - Remove unused imports for ThriftBinaryCLIService class<br/><br/>[HIVE-26623] - Maintain same columns in COMPACTIONS view present in SYS and INFORMATION_SCHEMA<br/><br/>[HIVE-26635] - Maintain update and merge mode on Iceberg V2 tables<br/><br/>[HIVE-26638] - Replace in-house CBO reduce expressions rules with Calcite&amp;#39;s built-in classes<br/><br/>[HIVE-26642] - Replace HiveFilterMergeRule with Calcite&amp;#39;s built-in implementation<br/><br/>[HIVE-26647] - Implement deserialization API for commit compaction event<br/><br/>[HIVE-26651] - MultiDelimitSerDe shouldn&amp;#39;t rely on default charset when returning the deserialized string<br/><br/>[HIVE-26670] - Track every single HTTP request between beeline and hs2<br/><br/><br/> <br/> Test<br/><br/><br/>[HIVE-19855] - TestStatsUpdaterThread.testQueueingWithThreads fails often<br/><br/>[HIVE-25423] - Add new test driver to automatically launch and load external database<br/><br/>[HIVE-26044] - Remove hardcoded version references from the tests<br/><br/>[HIVE-26200] - Add tests for Iceberg DELETE statements for every supported type<br/><br/>[HIVE-26461] - Add CI build check for macOS<br/><br/>[HIVE-26494] - Fix flaky test TestJdbcWithMiniHS2 testHttpRetryOnServerIdleTimeout<br/><br/>[HIVE-26619] - Sonar analysis is not run for the master branch<br/><br/><br/> <br/> Wish<br/><br/><br/>[HIVE-19624] - the method closeSession of SessionManager has a synchronized, is it able to be removed?<br/><br/><br/> <br/> Task<br/><br/><br/>[HIVE-19828] - Rename UDFCurrentDB to GenericUDFCurrentDatabase<br/><br/>[HIVE-21588] - Remove HBase dependency from hive-metastore<br/><br/>[HIVE-22030] - Bumping jackson version to 2.9.9 and 2.9.9.3 (jackson-databind)<br/><br/>[HIVE-23744] - Reduce query startup latency<br/><br/>[HIVE-26019] - Upgrade com.jayway.jsonpath from 2.4.0 to 2.7.0<br/><br/>[HIVE-26023] - Non blocking REPLACE, RENAME COLUMNS<br/><br/>[HIVE-26032] - Upgrade cron-utils to 9.1.6<br/><br/>[HIVE-26051] - Non blocking ALTER MATERIALIZED VIEW REWRITE<br/><br/>[HIVE-26052] - Non blocking DROP MATERIALIZED VIEW implementation<br/><br/>[HIVE-26053] - Non blocking DROP VIEW<br/><br/>[HIVE-26062] - Make sure that running 4.0.0-alpha-2 above 4.0.0-alpha-1 HMS DB reports the correct error<br/><br/>[HIVE-26064] - For Iceberg external table do not set external.table.purge=true by default<br/><br/>[HIVE-26067] - Remove core directory from src<br/><br/>[HIVE-26068] - Add README with build instructions to the src tarball <br/><br/>[HIVE-26069] - Remove unnecessary items from the .gitignore<br/><br/>[HIVE-26070] - Remove the generated files from the source tarball<br/><br/>[HIVE-26076] - Non blocking ADD PARTITION if not exists<br/><br/>[HIVE-26077] - Implement CTAS for Iceberg tables with partition spec<br/><br/>[HIVE-26078] - Upgrade gson to 2.8.9<br/><br/>[HIVE-26080] - Upgrade accumulo-core to 1.10.1<br/><br/>[HIVE-26081] - Upgrade ant to 1.10.9<br/><br/>[HIVE-26092] - Fix javadoc errors for the 4.0.0 release<br/><br/>[HIVE-26093] - Deduplicate org.apache.hadoop.hive.metastore.annotation package-info.java<br/><br/>[HIVE-26099] - Move patched-iceberg packages to org.apache.hive group<br/><br/>[HIVE-26100] - Preparing for 4.0.0-alpha-2 development<br/><br/>[HIVE-26101] - Port Iceberg Hive fix - Hive: Avoid recursive listing in HiveCatalog#renameTable<br/><br/>[HIVE-26103] - Port Iceberg fixes to the iceberg module<br/><br/>[HIVE-26106] - Non blocking ADD, DROP constraint<br/><br/>[HIVE-26121] - Hive transaction rollback should be thread-safe<br/><br/>[HIVE-26129] - Non blocking DROP CONNECTOR<br/><br/>[HIVE-26136] - Implement UPDATE statements for Iceberg tables<br/><br/>[HIVE-26149] - Non blocking DROP DATABASE implementation<br/><br/>[HIVE-26165] - Remove READ locks for ACID tables<br/><br/>[HIVE-26252] - Missing locks in case of MERGE with multiple branches<br/><br/>[HIVE-26289] - Remove useless try catch in DataWritableReadSupport#getWriterDateProleptic<br/><br/>[HIVE-26290] - Remove useless calls to DateTimeFormatter#withZone without assignment<br/><br/>[HIVE-26293] - Migrate remaining exclusive DDL operations to EXCL_WRITE lock &amp;amp; bug fixes<br/><br/>[HIVE-26309] - Remove Log4jConfig junit extension in favor LoggerContextSource<br/><br/>[HIVE-26310] - Remove unused junit runners from test-utils module<br/><br/>[HIVE-26324] - Add &amp;quot;one-row-table&amp;quot; constraints on NOTIFICATION_SEQUENCE table<br/><br/>[HIVE-26331] - Use maven-surefire-plugin version consistently in standalone-metastore modules<br/><br/>[HIVE-26412] - Create interface to fetch available slots during split calculation<br/><br/>[HIVE-26416] - AcidUtils$MetaDataFile.isRawFormatFile() throws InvalidProtocolBufferException for non-ORC file<br/><br/>[HIVE-26433] - StorageHandler authorization doesn&amp;#39;t work with &amp;quot;METASTORE&amp;quot; db type<br/><br/>[HIVE-26458] - Add explicit dependency to commons-dbcp2 in hive-exec module<br/><br/>[HIVE-26487] - Auto-compaction may hang or skip some of the eligible items <br/><br/>[HIVE-26566] - Upgrade H2 database version to 2.1.214<br/><br/>[HIVE-26579] - Prepare for Hadoop and Zookeeper switching to Reload4j<br/><br/>[HIVE-26594] - Upgrade netty to 4.1.77 due to CVE-2022-24823<br/><br/>[HIVE-26622] - upgrade aws-java-sdk to 1.12.132 version<br/><br/>[HIVE-26626] - Cut dependencies between HiveXxPullUpConstantsRule and HiveReduceExpressionsRule<br/><br/>[HIVE-26627] - Remove HiveRelBuilder.aggregateCall override and refactor callers to use existing public methods<br/><br/><br/>

Hive是基于hadoop的一个数据仓库工具,可以将结构化数据文件映射为一张数据库表,并提供类SQL查询功能.

<p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-40149">CVE-2022-40149</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2022-24823">CVE-2022-24823</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-44832">CVE-2021-44832</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-10172">CVE-2019-10172</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2020-36518">CVE-2020-36518</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-36373">CVE-2021-36373</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-10202">CVE-2019-10202</a></p><p><a target="_blank" href="https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2021-36374">CVE-2021-36374</a></p>

暂无

暂无

https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12351489&styleName=Html&projectId=12310843