Skip to content

fix: avx512 related symbol not found in mac x86#5379

Merged
jackye1995 merged 3 commits intolance-format:mainfrom
jackye1995:linalg-mac86
Dec 2, 2025
Merged

fix: avx512 related symbol not found in mac x86#5379
jackye1995 merged 3 commits intolance-format:mainfrom
jackye1995:linalg-mac86

Conversation

@jackye1995
Copy link
Copy Markdown
Contributor

@jackye1995 jackye1995 commented Dec 1, 2025

related failure in lancedb: https://github.com/lancedb/lancedb/actions/runs/19769925006/job/56653636802?pr=2826

There are two independent AVX-512 builds that both set the same cfg flag kernel_support="avx512":

  1. f16 kernels (line 45-56): Uses -march=sapphirerapids - a fixed cross-compilation target
  2. dist_table (line 58-64): Uses -march=native - uses the build machine's CPU features

Then in dist_table.rs:

  • Lines 38-48: The AVX-512 code path is compiled (because cfg is set)
  • Lines 164-171: The extern "C" declaration for sum_4bit_dist_table_32bytes_batch_avx512 is compiled
  • But the C code was never built, so the symbol doesn't exist

Separate cfg flags should be used for f16 and dist_table AVX-512 support

@chatgpt-codex-connector
Copy link
Copy Markdown

Codex usage limits have been reached for code reviews. Please check with the admins of this repo to increase the limits by adding credits.
Credits must be used to enable repository wide code reviews.

@github-actions github-actions Bot added the bug Something isn't working label Dec 1, 2025
@codecov
Copy link
Copy Markdown

codecov Bot commented Dec 1, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

Copy link
Copy Markdown
Member

@westonpace westonpace left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve the change but I'm not sure I understand the situation that caused the error so I'm not sure I understand if it would be feasible, practical, or useful to ask for some kind of test.

@jackye1995
Copy link
Copy Markdown
Contributor Author

Tried to verify in lancedb but can't do that without a pypi release. Will merge this first and see if it works.

@jackye1995 jackye1995 merged commit f00fc7d into lance-format:main Dec 2, 2025
25 of 26 checks passed
jackye1995 added a commit that referenced this pull request Dec 2, 2025
We have very low download stats for mac x86, and also latest github
runners for mac are all arm, so it makes sense at this point to
deprecate x86 support in general.

We also revert #5379 since it is no longer needed.
jackye1995 added a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
related failure in lancedb:
https://github.com/lancedb/lancedb/actions/runs/19769925006/job/56653636802?pr=2826

There are two independent AVX-512 builds that both set the same cfg flag
kernel_support="avx512":
1. f16 kernels (line 45-56): Uses -march=sapphirerapids - a fixed
cross-compilation target
2. dist_table (line 58-64): Uses -march=native - uses the build
machine's CPU features

Then in dist_table.rs:
  - Lines 38-48: The AVX-512 code path is compiled (because cfg is set)
- Lines 164-171: The extern "C" declaration for
sum_4bit_dist_table_32bytes_batch_avx512 is compiled
  - But the C code was never built, so the symbol doesn't exist

Separate cfg flags should be used for f16 and dist_table AVX-512 support
jackye1995 added a commit to jackye1995/lance that referenced this pull request Jan 21, 2026
We have very low download stats for mac x86, and also latest github
runners for mac are all arm, so it makes sense at this point to
deprecate x86 support in general.

We also revert lance-format#5379 since it is no longer needed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working python

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants