Skip to content

Conversation

@nastra
Copy link
Contributor

@nastra nastra commented Jul 10, 2023

This backports #7931 to 1.3.x

@nastra nastra requested a review from szehon-ho July 10, 2023 06:58
@nastra nastra added this to the Iceberg 1.3.1 milestone Jul 10, 2023
@github-actions github-actions bot added the hive label Jul 10, 2023
@nastra nastra changed the title Hive: Set commit state as Unknown before throwing CommitStateUnknownException [1.3.x] Hive: Set commit state as Unknown before throwing CommitStateUnknownException Jul 10, 2023
@nastra nastra requested a review from Fokko July 10, 2023 10:23
@szehon-ho szehon-ho merged commit 831272e into apache:1.3.x Jul 10, 2023
@szehon-ho
Copy link
Member

Thanks @nastra !

@nastra nastra deleted the hive-unknown-commit-state branch July 11, 2023 06:08
laithalzyoud added a commit to revolut-engineering/iceberg that referenced this pull request Jan 30, 2024
* Hive: Set commit state as Unknown before throwing CommitStateUnknownException (apache#7931) (apache#8029)

* Spark 3.4: WAP branch not propagated when using DELETE without WHERE (apache#7900) (apache#8028)

* Core: Include all reachable snapshots with v1 format and REF snapshot mode (apache#7621) (apache#8027)

* Spark 3.3: Backport 'WAP branch not propagated when using DELETE without WHERE' (apache#8033) (apache#8036)

* Flink: remove the creation of default database in FlinkCatalog open method (apache#7795) (apache#8039)

* Core: Handle optional fields (apache#8050) (apache#8064)

* Core: Handle allow optional fields

We expect:

- current-snapshot-id
- properties
- snapshots

to be there, but they are actually optional.

* Use AssertJ

* Core: Abort file groups should be under same lock as committerService (apache#7933) (apache#8060)

* Spark 3.4: Fix rewrite_position_deletes for certain partition types (apache#8059)

* Spark 3.3: Fix rewrite_position_deletes for certain partition types (apache#8059) (apache#8069)

* Spark: Add actions for disater recovery.

* Fix the compile error.

* Fix merge conflicts and formatting

* All tests are working and code integrated with Spark 3.3

* Fix union error and snapshots test

* Fix Spark broadcast error

* Add RewritePositionDeleteFilesSparkAction

---------

Co-authored-by: Eduard Tudenhoefner <[email protected]>
Co-authored-by: Fokko Driesprong <[email protected]>
Co-authored-by: Xianyang Liu <[email protected]>
Co-authored-by: Szehon Ho <[email protected]>
Co-authored-by: Yufei Gu <[email protected]>
Co-authored-by: yufeigu <[email protected]>
Co-authored-by: Laith Alzyoud <[email protected]>
Co-authored-by: vaultah <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants