Skip to content

Conversation

@mscheong01
Copy link
Collaborator

resolves #4497

additional proposal:
add /completions endpoint to match the naming and mark /completion as legacy, then remove in future releases
image

@ggerganov
Copy link
Member

Let's rebase and merge

@mscheong01 mscheong01 force-pushed the add-`/v1/completions`-endpoint branch from 3bc4615 to 1d23285 Compare March 7, 2024 10:25
@ggerganov ggerganov merged commit 55a2a90 into ggml-org:master Mar 7, 2024
hazelnutcloud pushed a commit to hazelnutcloud/llama.cpp that referenced this pull request Mar 10, 2024
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
NeoZhangJianyu pushed a commit to NeoZhangJianyu/llama.cpp that referenced this pull request Mar 12, 2024
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
jordankanter pushed a commit to jordankanter/llama.cpp that referenced this pull request Mar 13, 2024
* add-`/v1/completions`-endpoint

* add legacy comment to `/completion` endpoint
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

server: make completions endpoint follow openai api just like chatcompletion

2 participants