Add beam search#631

Closed

mattpulver wants to merge 2 commits intoabetlen:mainfrom

heavyai:add_beam_search

Commits on Sep 19, 2023

Add beam search. Invoke by adding "beam_search": 2 (for example) to /v1/completions POST.
mattpulver
committed
Change default setting for logits_all from True to False.
mattpulver
committed