Skip to content

[WIP] EncoderDecoder model that works#3740

Closed
sshleifer wants to merge 5 commits intohuggingface:masterfrom
sshleifer:bert-encoder-decoder
Closed

[WIP] EncoderDecoder model that works#3740
sshleifer wants to merge 5 commits intohuggingface:masterfrom
sshleifer:bert-encoder-decoder

Conversation

@sshleifer
Copy link
Copy Markdown
Contributor

@sshleifer sshleifer commented Apr 10, 2020

Continuing #3383 from @patrickvonplaten to facilitate MarianMT project.

Targeted API:

model = EncoderDecoderModel.from_model_names('bert-base-uncased', 'bert-based-uncased')
model.save_pretrained('bert2bert')
model.from_pretrained('bert2bert') # way 2

TODO

  • support test_common
  • test forward, generate
  • raise useful errors for incompatible encoder/decoder combinations

@sshleifer sshleifer changed the title [WIP} Bert encoder decoder [WIP] Make PretrainedEncoderDecoder work Apr 10, 2020
@sshleifer sshleifer changed the title [WIP] Make PretrainedEncoderDecoder work [WIP] EncoderDecoder model that works Apr 10, 2020
@sshleifer sshleifer closed this Apr 13, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants