Skip to content

Multi-query attention#4

Merged
jlamypoirier merged 35 commits intomainfrom
joel-mqa
Feb 8, 2023
Merged

Multi-query attention#4
jlamypoirier merged 35 commits intomainfrom
joel-mqa

Conversation

@jlamypoirier
Copy link
Collaborator

No description provided.

bigximik and others added 12 commits August 31, 2022 04:41
* Added onnx config whisper

* added whisper support onnx

* add audio input data

* added whisper support onnx

* fixed the seqlength value

* Updated the whisper onnx ocnfig

* restore files to old version

* removed attention mask from inputs

* Updated get_dummy_input_onnxruntime docstring

* Updated relative imports and token generation

* update docstring
* Add ESMFold code sample

* sorry sylvain

* make fixup

* sorry sylvain again
bigximik

This comment was marked as duplicate.

@bigximik bigximik marked this pull request as ready for review January 23, 2023 19:21
@bigximik
Copy link
Collaborator

@jlamypoirier, I can merge this PR in the morning with anything you will add today and also to merge @lvwerra branch from Hugging Face repo and to move all to gpt2mqa model from here? Will it be OK?

@jlamypoirier
Copy link
Collaborator Author

jlamypoirier commented Jan 23, 2023

@jlamypoirier, I can merge this PR in the morning with anything you will add today and also to merge @lvwerra branch from Hugging Face repo and to move all to gpt2mqa model from here? Will it be OK?

I think we should wait a bit, there seems to be some bugs still.
[Edit: bugs are gone, ready to review/merge]

@jlamypoirier jlamypoirier requested a review from bigximik January 27, 2023 02:20
@jlamypoirier jlamypoirier changed the base branch from main to gpt2_bigcode February 7, 2023 20:11
Base automatically changed from gpt2_bigcode to main February 8, 2023 19:14
@jlamypoirier jlamypoirier merged commit 9ab47d9 into main Feb 8, 2023
@jlamypoirier jlamypoirier deleted the joel-mqa branch February 8, 2023 19:16
@jlamypoirier
Copy link
Collaborator Author

Merged to speed things up, it doesn't affect the rest of transformers anyway

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants