Skip to content

Conversation

@bk-mz
Copy link

@bk-mz bk-mz commented Mar 14, 2024

Fixes #6368
Fixes #6369
Fixes #9904

This PR adds test that shows 1k+ column table break on either delete or rewrite_position_delete_files

However the fix is not really clear as partition specs are stored in table metadata.

Modifying schema creation on the fly won't work in general sense b/c there are a lot of places scattered here and there that has to be modified as well.

Suggestions are welcome

@github-actions github-actions bot added the spark label Mar 14, 2024
@bk-mz bk-mz changed the title Fixing #9923 updating partitioned table with more than 1k columns fails [Draft] Fixing #9923 updating partitioned table with more than 1k columns fails Mar 16, 2024
@github-actions
Copy link

This pull request has been marked as stale due to 30 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@iceberg.apache.org list. Thank you for your contributions.

@github-actions github-actions bot added the stale label Oct 23, 2024
@github-actions
Copy link

This pull request has been closed due to lack of activity. This is not a judgement on the merit of the PR in any way. It is just a way of keeping the PR queue manageable. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.

@github-actions github-actions bot closed this Oct 30, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Delete/Update fails for tables with more than 1000 columns

1 participant