ChatOllamaFunction

​

Node Details

• Name: ChatOllamaFunction

• Type: ChatOllamaFunction

• Version: 1.0

• Category: Chat Models

​

Parameters

​

Inputs

​

Inputs

1. Cache (optional)

   • Type: BaseCache

   • Description: Caching mechanism for the model

2. Base URL

   • Type: string

   • Default: “http://localhost:11434”

   • Description: The base URL for the Ollama API

3. Model Name

   • Type: string

   • Description: Name of the compatible function-calling model (e.g., “mistral”)

4. Temperature

   • Type: number

   • Default: 0.9

   • Range: 0 to 1

   • Description: Controls the randomness of the model’s output

5. Tool System Prompt Template (optional)

   • Type: string

   • Description: Custom system prompt template for tool usage

6. Top P (optional)

   • Type: number

   • Description: Nucleus sampling parameter

7. Top K (optional)

   • Type: number

   • Description: Top-K sampling parameter

8. Mirostat (optional)

   • Type: number

   • Description: Mirostat sampling mode

9. Mirostat ETA (optional)

   • Type: number

   • Description: Mirostat learning rate

10. Mirostat TAU (optional)

    • Type: number

    • Description: Mirostat target entropy

11. Context Window Size (optional)

    • Type: number

    • Description: Size of the context window

12. Number of GQA groups (optional)

    • Type: number

    • Description: Number of GQA groups in the transformer layer

13. Number of GPU (optional)

    • Type: number

    • Description: Number of layers to send to GPU(s)

14. Number of Thread (optional)

    • Type: number

    • Description: Number of threads for computation

15. Repeat Last N (optional)

    • Type: number

    • Description: Look-back window to prevent repetition

16. Repeat Penalty (optional)

    • Type: number

    • Description: Penalty for repeated tokens

17. Stop Sequence (optional)

    • Type: string

    • Description: Sequences to stop generation

18. Tail Free Sampling (optional)

    • Type: number

    • Description: Parameter for Tail Free Sampling

​

Inputs/Outputs

• Input: Receives messages and optional function definitions

• Output: Generates responses, potentially including function calls

​

Usage

This node is used in workflows where function-calling capabilities of language models are needed. It’s particularly useful for tasks that require the model to choose and use specific tools or functions based on the input.

​

Special Features

• Supports various Ollama-specific parameters for fine-tuning model behavior

• Can handle both regular chat interactions and function-calling scenarios

• Includes a default