​
Available Components

Character Text Splitter

Splits text based on a specified character separator for versatile general text splitting needs

Code Text Splitter

Splits code documents based on language-specific syntax, ideal for processing code files

HtmlToMarkdown Text Splitter

Converts HTML to Markdown and splits based on headers for processing HTML content

Markdown Text Splitter

Splits Markdown content based on headers while maintaining document structure

RecursiveCharacter Text Splitter

Splits documents recursively using multiple separators for customizable text splitting

Token Text Splitter

Splits text based on token count using TikToken library for language model preparation

​
Use Cases

Text Splitters are beneficial in various scenarios, including:

  1. Preparing large documents for processing by language models with input size limitations
  2. Breaking down text for more granular analysis or summarization tasks
  3. Splitting content for parallel processing or distributed computing
  4. Enhancing information retrieval and question-answering systems by creating