From be498c5dd9b673f1480fffd593741d04c3efdae4 Mon Sep 17 00:00:00 2001 From: Ettore Di Giacinto Date: Wed, 28 Feb 2024 15:58:31 +0100 Subject: [PATCH] Update openai-functions.md Signed-off-by: Ettore Di Giacinto --- .../content/docs/features/openai-functions.md | 20 +++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/docs/content/docs/features/openai-functions.md b/docs/content/docs/features/openai-functions.md index bd7c5a7d..843524f4 100644 --- a/docs/content/docs/features/openai-functions.md +++ b/docs/content/docs/features/openai-functions.md @@ -80,6 +80,26 @@ When running the python script, be sure to: ## Advanced +### Parallel tools calls + +This feature is experimental and has to be configured in the YAML of the model by enabling `function.parallel_calls`: + +```yaml +name: gpt-3.5-turbo +parameters: + # Model file name + model: ggml-openllama.bin + top_p: 80 + top_k: 0.9 + temperature: 0.1 + +function: + # set to true to allow the model to call multiple functions in parallel + parallel_calls: true +``` + +### Use functions with grammar + It is possible to also specify the full function signature (for debugging, or to use with other clients). The chat endpoint accepts the `grammar_json_functions` additional parameter which takes a JSON schema object.