Skip to content

feat: add flash-attn to core dependencies#545

Closed
terrykong wants to merge 9 commits intomainfrom
flash-attn
Closed

feat: add flash-attn to core dependencies#545
terrykong wants to merge 9 commits intomainfrom
flash-attn

Conversation

@terrykong
Copy link
Copy Markdown
Collaborator

@terrykong terrykong commented Jun 24, 2025

Now that flash-attn has wheels for 2.7.0, users won't have to build flash-attn which require some manual steps like installing ninja to ensure the build is not slow.

Putting flash-attn in the base set of dependencies now means there's no initial step before the first "--no-build-isolation" call, so users have to now run uv run pip install setuptools to make flash-attn happy.

One other option is uv venv --seed, but it sometimes doesn't reliably install setuptools, so we'll go with the pip install for now.

Signed-off-by: Terry Kong <terryk@nvidia.com>

fix

Signed-off-by: Terry Kong <terryk@nvidia.com>

fix setuptools

Signed-off-by: Terry Kong <terryk@nvidia.com>

bug

Signed-off-by: Terry Kong <terryk@nvidia.com>

unset variables to speed it up

Signed-off-by: Terry Kong <terryk@nvidia.com>

deal with flash-attn

Signed-off-by: Terry Kong <terryk@nvidia.com>

2.8.0.post2 prebuilt wheels!

Signed-off-by: Terry Kong <terryk@nvidia.com>

Revert "2.8.0.post2 prebuilt wheels!"

This reverts commit f945c50.

Signed-off-by: Terry Kong <terryk@nvidia.com>

revert

Signed-off-by: Terry Kong <terryk@nvidia.com>

uv.lock

Signed-off-by: Terry Kong <terryk@nvidia.com>

try wheel

Signed-off-by: Terry Kong <terryk@nvidia.com>

try whl

Signed-off-by: Terry Kong <terryk@nvidia.com>

comment

Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
@terrykong terrykong marked this pull request as ready for review June 27, 2025 16:02
Comment thread README.md
Signed-off-by: Terry Kong <terryk@nvidia.com>
Signed-off-by: Terry Kong <terryk@nvidia.com>
parthchadha
parthchadha previously approved these changes Jun 27, 2025
@terrykong terrykong added this pull request to the merge queue Jun 27, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jun 28, 2025
@chtruong814 chtruong814 added this pull request to the merge queue Jun 28, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jun 28, 2025
@SahilJain314 SahilJain314 added CI:L1 Run doctests, unit tests, and functional tests and removed CI:L1 Run doctests, unit tests, and functional tests labels Jul 1, 2025
Signed-off-by: Sahil Jain <sahilj@nvidia.com>
@github-actions github-actions Bot added the CI Relating to CI label Jul 1, 2025
@SahilJain314 SahilJain314 added CI:L1 Run doctests, unit tests, and functional tests and removed CI:L1 Run doctests, unit tests, and functional tests labels Jul 1, 2025
Signed-off-by: Sahil Jain <sahilj@nvidia.com>
@SahilJain314 SahilJain314 added the CI:L1 Run doctests, unit tests, and functional tests label Jul 1, 2025
@SahilJain314 SahilJain314 enabled auto-merge July 1, 2025 08:28
SahilJain314
SahilJain314 previously approved these changes Jul 1, 2025
Copy link
Copy Markdown
Contributor

@SahilJain314 SahilJain314 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixed some ci test things (needed to add uv venv and the setuptools install). otherwise lgtm, merging

@SahilJain314 SahilJain314 added this pull request to the merge queue Jul 1, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Jul 1, 2025
Signed-off-by: Sahil Jain <sahilj@nvidia.com>
@SahilJain314 SahilJain314 added CI:L1 Run doctests, unit tests, and functional tests and removed CI:L1 Run doctests, unit tests, and functional tests labels Jul 1, 2025
@SahilJain314 SahilJain314 added CI:L1 Run doctests, unit tests, and functional tests and removed CI:L1 Run doctests, unit tests, and functional tests labels Jul 1, 2025
@terrykong terrykong added the CI:L0 Run doctests and unit tests label Jul 7, 2025
@terrykong
Copy link
Copy Markdown
Collaborator Author

closing this in favor of #622 since 2.8.0 is incompatible with xformers/TE

@terrykong terrykong closed this Jul 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI:L0 Run doctests and unit tests CI Relating to CI

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants