LlamaAttention forward function type hint is incorrect #38739

[ArkVex]

Hi, this PR fixes a small issue in the LlamaAttention class. The return type in the forward method currently shows three values, but the function actually returns only two. This seems to have been missed during the attention refactor (possibly in PR #35235).

I’ve updated the type hint to reflect the actual return values, just to avoid confusion for anyone reading or using the code. Let me know if any other changes are needed. Happy to help!

[Rocketknight1]

Hi @ArkVex can you run make fix-copies to propagate that change to other models that are copying from Llama? That should make the CI pass!

[ArkVex]

Hi @ArkVex can you run make fix-copies to propagate that change to other models that are copying from Llama? That should make the CI pass!

I didnt get that...could you plz explain?

[Rocketknight1]

Hi @ArkVex, if you look at the tests on this PR, "check_repository_consistency" is failing. The reason is that some other models copy from Llama, and those copies don't match after this PR. You should run make fix-copies in the transformers directory and then commit + push those changes, which should fix the problem.

[ArkVex]

Hi @ArkVex, if you look at the tests on this PR, "check_repository_consistency" is failing. The reason is that some other models copy from Llama, and those copies don't match after this PR. You should run make fix-copies in the transformers directory and then commit + push those changes, which should fix the problem.

Thanks for pointing it out...i will do the same

[ArkVex]

I did the test...plz check

[ArkVex]

@Rocketknight1 you there?

[ArkVex]

@vanpelt @dxoigmn @tmm1 anyone plz review

[Rocketknight1]

Seems like make fix-copies isn't working correctly, very odd! I can run it, one sec.

[Rocketknight1]

Hi @ArkVex, the reason it's failing is that the PR is on your fork's main branch. This breaks things! I recommend:

1. Close this PR
2. Make a new branch in your fork
3. Push the change there
4. Run make fix-copies
5. Open a PR from that branch and ping me

[ArkVex]

Hi @ArkVex, the reason it's failing is that the PR is on your fork's main branch. This breaks things! I recommend:

1. Close this PR
2. Make a new branch in your fork
3. Push the change there
4. Run make fix-copies
5. Open a PR from that branch and ping me

Okk oKk