mirror of
https://github.com/mudler/LocalAI.git
synced 2024-12-27 00:01:07 +00:00
44a7045732
This PR bundles together two unrelated features: 1. Model Gallery improvements - specifically, the ability to follow ".ref" gallery links (which I made up for this specific application) to an actual gallery yaml file (in order to have stable URLs) and the ability to load self-contained configurations, rather than always using a base.yaml + overrides. This is groundwork for my python-based huggingface scraper. 2. A while ago I introduced some Insomnia request templates for people to use. Unfortunately, Insomnia has decided to tank their product... So I've personally switched to using [bruno](https://github.com/usebruno/bruno/). Corresponding equivalent files that I use for my testing have been added. Just open the folder from bruno and everything will work. No import process required. --------- Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
26 lines
469 B
Plaintext
26 lines
469 B
Plaintext
meta {
|
|
name: chat-completions -stream-
|
|
type: http
|
|
seq: 6
|
|
}
|
|
|
|
post {
|
|
url: {{PROTOCOL}}{{HOST}}:{{PORT}}/chat/completions
|
|
body: json
|
|
auth: none
|
|
}
|
|
|
|
headers {
|
|
Content-Type: application/json
|
|
}
|
|
|
|
body:json {
|
|
{
|
|
"model": "{{DEFAULT_MODEL}}",
|
|
"messages": [{"role": "user", "content": "Explain how I can set sail on the ocean using only power generated by seagulls?"}],
|
|
"max_tokens": 256,
|
|
"temperature": 0.9,
|
|
"stream": true
|
|
}
|
|
}
|