ChatTogetherAI

​

Node Details

• Name: chatTogetherAI
• Type: ChatTogetherAI
• Version: 1.0
• Category: Chat Models

​

Description

This node serves as a wrapper for TogetherAI large language models, allowing users to integrate and utilize TogetherAI’s chat capabilities within their solutions.

​

Base Classes

• ChatTogetherAI
• Additional base classes from the ChatTogetherAI implementation

​

Parameters

​

Credential

• Label: Connect Credential
• Name: credential
• Type: credential
• Credential Names: togetherAIApi

​

Inputs

1. Cache (optional)

   • Type: BaseCache
   • Description: Caching mechanism for the chat model

2. Model Name

   • Type: string
   • Placeholder: mixtral-8x7b-32768
   • Description: The name of the TogetherAI model to use. Users can refer to the models page for available options
   • Description: The name of the TogetherAI model to use. Users can refer to the models page for available options

3. Temperature (optional)

   • Type: number
   • Default: 0.9
   • Step: 0.1
   • Description: Controls the randomness of the model’s output. Higher values make the output more random, while lower values make it more deterministic
   • Description: Controls the randomness of the model’s output. Higher values make the output more random, while lower values make it more deterministic

​

Initialization

The node initializes a ChatTogetherAI instance with the following configuration:

• Model name (required)
• Cache (optional)
• Temperature (optional, defaults to 0.9 if not provided)
• Streaming (defaults to true)
• TogetherAI API Key (retrieved from credentials)

​

Usage

This node is used when you want to incorporate TogetherAI’s chat models into your solutions. It’s particularly useful for tasks that require advanced language understanding and generation, such as:

• Conversational AI applications
• Text completion and generation
• Question answering systems
• Language translation
• Text summarization

By adjusting the model name and temperature, users can fine-tune the behavior of the chat model to suit their specific use case.

​

Note

Users must have valid TogetherAI API credentials to use this node. The API key is securely managed through the credential system.