Skip to content

add /v1/completions endpoint#5914

Merged
ggerganov merged 2 commits intoggml-org:masterfrom
mscheong01:add-`/v1/completions`-endpoint
Mar 7, 2024
Merged

add /v1/completions endpoint#5914
ggerganov merged 2 commits intoggml-org:masterfrom
mscheong01:add-`/v1/completions`-endpoint

Conversation

@mscheong01
Copy link
Copy Markdown
Collaborator

resolves #4497

additional proposal:
add /completions endpoint to match the naming and mark /completion as legacy, then remove in future releases
image

@ggerganov
Copy link
Copy Markdown
Member

Let's rebase and merge

@mscheong01 mscheong01 force-pushed the add-`/v1/completions`-endpoint branch from 3bc4615 to 1d23285 Compare March 7, 2024 10:25
@ggerganov ggerganov merged commit 55a2a90 into ggml-org:master Mar 7, 2024
hazelnutcloud pushed a commit to hazelnutcloud/llama.cpp that referenced this pull request Mar 10, 2024
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
NeoZhangJianyu pushed a commit to NeoZhangJianyu/llama.cpp that referenced this pull request Mar 12, 2024
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
jordankanter pushed a commit to jordankanter/llama.cpp that referenced this pull request Mar 13, 2024
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
phuongncn pushed a commit to phuongncn/llama.cpp-gx10-dgx-sparks-deepseekv4 that referenced this pull request Apr 28, 2026
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

server: make completions endpoint follow openai api just like chatcompletion

2 participants