Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

adding deepseek and lang specific mixtral for completions ab experiment#63283

Merged
sagtanih merged 1 commit intomainfrom
hitesh/completions-experiment-deepseek
Jun 17, 2024
Merged

adding deepseek and lang specific mixtral for completions ab experiment#63283
sagtanih merged 1 commit intomainfrom
hitesh/completions-experiment-deepseek

Conversation

@sagtanih
Copy link
Contributor

Context

  1. Adds support for deepseek-coder model and updated Mixtral finetuned-FIM models identifiers hosted on Fireworks.
  2. Client side pull request: https://github.com/sourcegraph/cody/pull/4577

Test plan

curl -vS -X POST http://localhost:9992/v1/completions/fireworks -H 'Authorization: bearer <SGD_TOKEN>' -d '{"stream":false,"max_tokens":50, "model": "accounts/sourcegraph/models/deepseek-coder-7b-base", "stop_sequences": ["\n\n"], "prompt": "const value = ", "stream":false}' -H 'X-sourcegraph-feature: code_completions'
curl -vS -X POST http://localhost:9992/v1/completions/fireworks -H 'Authorization: bearer <SGD_TOKEN>' -d '{"stream":false,"max_tokens":50, "model": "accounts/sourcegraph/models/custom-deepseek-1p3b-base-hf-version", "stop_sequences": ["\n\n"], "prompt": "const value = ", "stream":false}' -H 'X-sourcegraph-feature: code_completions'
curl -vS -X POST http://localhost:9992/v1/completions/fireworks -H 'Authorization: bearer <SGD_TOKEN>' -d '{"stream":false,"max_tokens":50, "model": "fim-lang-specific-model-mixtral", "stop_sequences": ["\n\n"], "prompt": "const value = ", "stream":false}' -H 'X-sourcegraph-feature: code_completions'

@sagtanih sagtanih merged commit d01358f into main Jun 17, 2024
@sagtanih sagtanih deleted the hitesh/completions-experiment-deepseek branch June 17, 2024 10:58
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants