field notes · ai, explained

how ai actually chunks your page, and why a bullet list beats a beautiful paragraph.

elisabeth hitz · july 26, 2026 · 5 min read

"write clear, answer-first sections" is advice you've probably already heard. what almost nobody explains is why it actually works. it's not a style preference. it's because of a specific step in how AI systems process your page before they ever "read" it the way a person does: chunking.

Content chunking is defined as the process of splitting a document into smaller passages before they are indexed for retrieval. Because retrieval searches chunks rather than whole pages, a self-contained passage can be extracted and cited cleanly while an argument spread across several paragraphs can lose the context that made it correct.

what chunking actually is

A retrieval system doesn't search your whole page as one block. It breaks the page into smaller pieces first, called chunks, converts each chunk into a numerical representation, and stores those so it can quickly find the ones relevant to a given question. When someone asks a question, the system searches across chunks, not across whole pages.

That means your gorgeously written, slow-building, payoff-at-the-end paragraph gets sliced into pieces before anything reads it holistically. If the answer to a specific question is scattered across four sentences that only make sense together, in context, chunking can separate them, and the piece that gets retrieved might be missing the context that made it correct.

the three ways pages actually get chunked

  • Fixed-length chunking. The simplest method: cut the text into pieces of roughly the same size, often with a little overlap between them so context doesn't get lost at the seams. Fast, cheap, and common, but it doesn't care where your sentences or ideas actually end.
  • Syntax-based chunking. Breaks a document up by sentence, using language-processing tools that understand where one sentence ends and the next begins. More respectful of meaning than fixed-length chunking, still not aware of which sentences belong together as one complete idea.
  • Format-based chunking. Respects the natural structure already in the file, treating a table, a list, or a whole code function as one unit instead of chopping it in half. This is the one that rewards structure you can actually control.

Here's the one line worth remembering: a fixed-length or syntax-based chunker will still find and split your bullet list at some point, but a well-formed list survives that split with its meaning intact far more often than a paragraph does.

why this explains the advice you've already heard

Every piece of "answer-first" advice in this series comes down to this mechanism. A self-contained answer in its own short section can be lifted as one chunk and still make complete sense. A claim that depends on three sentences of setup before it, scattered across a chunk boundary, can lose the context that made it true.

Practically, that means:

  • Open each major section with a complete, standalone answer to the question that section's heading asks. Don't make the reader, or the retriever, wait for the payoff at the end. This is the core of writing for the assistant, not the browser.
  • Keep one idea per paragraph or bullet. If a claim needs the previous sentence to make sense, a chunker might separate them anyway.
  • Use real lists and tables where the content is naturally list-shaped. A numbered list of steps is a format a chunker is more likely to keep intact than the same steps buried in a narrative paragraph.
  • Avoid answers that depend on scrolling back up. "As mentioned above" is a phrase that only works for a reader holding the whole page in their head. A chunk holding only that sentence has nothing to point back to.

the honest limitation

None of this guarantees a clean retrieval. Chunking strategies vary by platform and aren't something you can see or control directly, you're structuring for a process you can't fully observe. What you can control is giving every chunking method the best possible chance: short, complete, self-contained pieces of meaning, wherever your content is naturally shaped that way.

want to see how a retrieval system reads your pages?

not a guess, the actual read. the free 60-second ai visibility scan runs against your site, results on the page, no email needed.

run the free scan

browse all free tools →

frequently asked questions

What is chunking in AI retrieval?
Chunking is the process of splitting a document into smaller passages before indexing, so a retrieval system can find a specific relevant piece rather than a whole page. Retrieval searches across chunks, which is why self-contained passages perform better than long-building arguments.

How is content usually chunked?
Three common approaches: fixed-length chunks of roughly equal size, often with overlap; syntax-based chunking that splits on sentence boundaries; and format-based chunking that keeps structures such as tables, lists, and code blocks intact.

Why do short paragraphs get cited more often?
Because a two to four sentence paragraph usually makes one complete point, so it survives being separated from its neighbors. A ten-sentence paragraph containing three ideas cannot be extracted cleanly without dragging in unrelated context.

Do tables and lists help with AI citation?
Where the content is genuinely comparative or sequential, yes. Format-based chunking tends to keep a table or list intact as one unit, so its meaning survives a split that would break a narrative paragraph.

Can I control how my content is chunked?
Not directly. Chunking strategies vary by platform and are not visible to you. What you control is giving every method the best chance, by writing short, complete, self-contained passages.

written by elisabeth hitz, certified in anthropic's ai fluency program (framework & foundations, and ai capabilities & limitations), plus claude 101 and claude cowork. source: wikipedia's entry on retrieval-augmented generation, chunking strategies section, citing spacy, nltk, langchain, and unstructured as common chunking tools. drafted 25 july 2026.