ai
Chunking
Document Chunking
Definition
Chunking is the process of splitting documents into smaller segments before embedding them for retrieval-augmented generation. Chunk size, overlap, and splitting strategy (by sentence, paragraph, or fixed token count) significantly affect retrieval quality.
Good chunking preserves semantic coherence so that retrieved chunks contain enough context for the language model to generate accurate answers.
Ship secure code faster
Crash Override integrates security into the developer workflow. No context switching, no waiting on reviews.