​
Node Details

  • Name: ChatOllamaFunction

  • Type: ChatOllamaFunction

  • Version: 1.0

  • Category: Chat Models

​
Parameters

​
Inputs

​
Inputs

  1. Cache (optional)

    • Type: BaseCache

    • Description: Caching mechanism for the model

  2. Base URL

  3. Model Name

    • Type: string

    • Description: Name of the compatible function-calling model (e.g., “mistral”)

  4. Temperature

    • Type: number

    • Default: 0.9

    • Range: 0 to 1

    • Description: Controls the randomness of the model’s output

  5. Tool System Prompt Template (optional)

    • Type: string

    • Description: Custom system prompt template for tool usage

  6. Top P (optional)

    • Type: number

    • Description: Nucleus sampling parameter

  7. Top K (optional)

    • Type: number

    • Description: Top-K sampling parameter

  8. Mirostat (optional)

    • Type: number

    • Description: Mirostat sampling mode

  9. Mirostat ETA (optional)

    • Type: number

    • Description: Mirostat learning rate

  10. Mirostat TAU (optional)

    • Type: number

    • Description: Mirostat target entropy

  11. Context Window Size (optional)

    • Type: number

    • Description: Size of the context window

  12. Number of GQA groups (optional)

    • Type: number

    • Description: Number of GQA groups in the transformer layer

  13. Number of GPU (optional)

    • Type: number

    • Description: Number of layers to send to GPU(s)

  14. Number of Thread (optional)

    • Type: number

    • Description: Number of threads for computation

  15. Repeat Last N (optional)

    • Type: number

    • Description: Look-back window to prevent repetition

  16. Repeat Penalty (optional)

    • Type: number

    • Description: Penalty for repeated tokens

  17. Stop Sequence (optional)

    • Type: string

    • Description: Sequences to stop generation

  18. Tail Free Sampling (optional)

    • Type: number

    • Description: Parameter for Tail Free Sampling

​
Inputs/Outputs

  • Input: Receives messages and optional function definitions

  • Output: Generates responses, potentially including function calls

​
Usage

This node is used in workflows where function-calling capabilities of language models are needed. It’s particularly useful for tasks that require the model to choose and use specific tools or functions based on the input.

​
Special Features

  • Supports various Ollama-specific parameters for fine-tuning model behavior

  • Can handle both regular chat interactions and function-calling scenarios

  • Includes a default