Projects in Awesome Lists tagged with semantic-chunking
A curated list of projects in awesome lists tagged with semantic-chunking .
https://github.com/mirth/chonky
Fully neural approach for text chunking
ai chunking llms ml rag semantic-chunking text-splitter
Last synced: 14 Jan 2026
https://github.com/isaacus-dev/semchunk
A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
chunking isaacus nlp python semantic-chunking splitting text text-chunking text-splitting
Last synced: 15 May 2025
https://github.com/jparkerweb/semantic-chunking
🍱 semantic-chunking ⇢ semantically create chunks from large document for passing to LLM workflows
chunking embeddings llm semantic-chunking text-chunking text-splitter text-splitting vector
Last synced: 01 May 2025
https://github.com/jparkerweb/llm-distillery
🍶 llm-distillery ⇢ use LLMs to run map-reduce summarization tasks on large documents until a target token size is met.
ai-text-reduction large-language-model llm openai-api semantic-chunking text-compression text-distillation text-processing text-summarization token-management tokenization
Last synced: 01 May 2025
https://github.com/bazilicum/axonode-chunker
Advanced semantic text chunking with custom structural markers, whole-text coherence preservation, and flexible token management. Features async processing, LangChain integration, and dynamic drift detection. Ideal for RAG systems, augmented text processing, and domain-specific document analysis.
lang langchain rag semantic-chunking test-split text-spl
Last synced: 15 Apr 2026
https://github.com/zircote/rlm-rs
Rust CLI implementing the Recursive Language Model (RLM) pattern for Claude Code. Process documents 100x larger than context windows through intelligent chunking, SQLite persistence, and recursive sub-LLM orchestration.
ai-tools chunking claude claude-code cli command-line context-window devtools document-processing llm mit-license mmap rayon recursive-language-model rlm rust rust-2024 semantic-chunking sqlite text-processing
Last synced: 08 Feb 2026
