ChatTogetherAI

​
Node Details

  • Name: chatTogetherAI
  • Type: ChatTogetherAI
  • Version: 1.0
  • Category: Chat Models

​
Description

This node serves as a wrapper for TogetherAI large language models, allowing users to integrate and utilize TogetherAI’s chat capabilities within their solutions.

​
Base Classes

  • ChatTogetherAI
  • Additional base classes from the ChatTogetherAI implementation

​
Parameters

​
Credential

  • Label: Connect Credential
  • Name: credential
  • Type: credential
  • Credential Names: togetherAIApi

​
Inputs

  1. Cache (optional)
    • Type: BaseCache
    • Description: Caching mechanism for the chat model
  2. Model Name
    • Type: string
    • Placeholder: mixtral-8x7b-32768
    • Description: The name of the TogetherAI model to use. Users can refer to the models page for available options
    • Description: The name of the TogetherAI model to use. Users can refer to the models page for available options
  3. Temperature (optional)
    • Type: number
    • Default: 0.9
    • Step: 0.1
    • Description: Controls the randomness of the model’s output. Higher values make the output more random, while lower values make it more deterministic
    • Description: Controls the randomness of the model’s output. Higher values make the output more random, while lower values make it more deterministic

​
Initialization

The node initializes a ChatTogetherAI instance with the following configuration:
  • Model name (required)
  • Cache (optional)
  • Temperature (optional, defaults to 0.9 if not provided)
  • Streaming (defaults to true)
  • TogetherAI API Key (retrieved from credentials)

​
Usage

This node is used when you want to incorporate TogetherAI’s chat models into your solutions. It’s particularly useful for tasks that require advanced language understanding and generation, such as:
  • Conversational AI applications
  • Text completion and generation
  • Question answering systems
  • Language translation
  • Text summarization
By adjusting the model name and temperature, users can fine-tune the behavior of the chat model to suit their specific use case.

​
Note

Users must have valid TogetherAI API credentials to use this node. The API key is securely managed through the credential system.