-
Notifications
You must be signed in to change notification settings - Fork 14
Open
Description
Hello @XiangLi1999 and @ari-holtzman,
I'm trying to follow the implementation of the typical decoding baselines in the code base.
Here a typical argument is passed, but the generate method does not accept any such argument but only an optional argument typical_p. At the same time I am unable to find any call to model_kwargs['"typical"] anywhere so it seems no warping of the logits to do typical sampling is ever performed.
Am I missing something trivial?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels