Skip to content

refactor: allow datafiles to contain columns without field id#5348

Merged
Xuanwo merged 3 commits intomainfrom
Xuanwo/remove-field-id-check
Nov 26, 2025
Merged

refactor: allow datafiles to contain columns without field id#5348
Xuanwo merged 3 commits intomainfrom
Xuanwo/remove-field-id-check

Conversation

@Xuanwo
Copy link
Copy Markdown
Collaborator

@Xuanwo Xuanwo commented Nov 26, 2025

This PR removes the check that requires all columns in data files to have a field ID. The check was only for safety and doesn’t enforce any real restriction in our logic. I’m removing it so we can keep building Blob V2.


This PR was primarily authored with Codex using GPT-5-Codex and then hand-reviewed by me. I AM responsible for every change made in this PR. I aimed to keep it aligned with our goals, though I may have missed minor issues. Please flag anything that feels off, I'll fix it quickly.

Signed-off-by: Xuanwo <github@xuanwo.io>
Comment thread rust/lance-table/src/format/fragment.rs
Comment thread rust/lance/src/dataset/fragment.rs Outdated
Xuanwo and others added 2 commits November 26, 2025 23:21
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Signed-off-by: Xuanwo <github@xuanwo.io>
@Xuanwo Xuanwo merged commit 556b3bc into main Nov 26, 2025
12 of 18 checks passed
@Xuanwo Xuanwo deleted the Xuanwo/remove-field-id-check branch November 26, 2025 15:23
jackye1995 pushed a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
…format#5348)

This PR removes the check that requires all columns in data files to
have a field ID. The check was only for safety and doesn’t enforce any
real restriction in our logic. I’m removing it so we can keep building
Blob V2.

---

**This PR was primarily authored with Codex using GPT-5-Codex and then
hand-reviewed by me. I AM responsible for every change made in this PR.
I aimed to keep it aligned with our goals, though I may have missed
minor issues. Please flag anything that feels off, I'll fix it
quickly.**

---------

Signed-off-by: Xuanwo <github@xuanwo.io>
Co-authored-by: Weston Pace <weston.pace@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants