LocalAI/embedded/models/codellama-7b.yaml

name: codellama-7b
backend: transformers
type: AutoModelForCausalLM
parameters:
  model: codellama/CodeLlama-7b-hf
  temperature: 0.2
  top_k: 40
  top_p: 0.95

usage: |
      curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{
          "model": "codellama-7b",
          "prompt": "import socket\n\ndef ping_exponential_backoff(host: str):"
      }'
transformers: correctly load automodels (#1643) * backends(transformers): use AutoModel with LLM types * examples: animagine-xl * Add codellama examples 2024-01-25 23:13:21 +00:00			`name: codellama-7b`
			`backend: transformers`
Update codellama-7b.yaml Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> 2024-01-30 10:36:20 +00:00			`type: AutoModelForCausalLM`
transformers: correctly load automodels (#1643) * backends(transformers): use AutoModel with LLM types * examples: animagine-xl * Add codellama examples 2024-01-25 23:13:21 +00:00			`parameters:`
			`model: codellama/CodeLlama-7b-hf`
			`temperature: 0.2`
			`top_k: 40`
			`top_p: 0.95`

			`usage: \|`
			`curl http://localhost:8080/v1/completions -H "Content-Type: application/json" -d '{`
			`"model": "codellama-7b",`
			`"prompt": "import socket\n\ndef ping_exponential_backoff(host: str):"`
Update codellama-7b.yaml Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com> 2024-01-26 17:35:33 +00:00			`}'`