Insights

In AI content, the quality gate is the product

· 2 min read · Caleb Kellah

Any model can write an article. What separates useful AI content from noise is what happens between the draft and the publish button. In my pipelines that step is the quality gate, and it is where most of my engineering time has gone.

What the gate checks

Every draft is checked before it can go live:

  • Structure. Headings, introduction, internal links and a clear call to action.
  • Length for its type. A short guide and a long itinerary should not be judged by the same word count, so each type of article has its own range.
  • Search basics. Titles and meta descriptions within the limits that search engines display.
  • Freshness. No year written as if it were current when it is not.
  • Banned phrases. The stock wording that makes AI text easy to spot.

A draft that fails is either fixed automatically or held for another attempt. Nothing that fails is published.

The checker can break things too

The most useful lesson came from a bug in the gate itself. Some drafts kept getting held for having a meta description that was too short, yet the drafts were fine when written.

When I traced one held article step by step, the cause was the checker. The quality model was allowed to fix small problems inline. While fixing an unrelated heading, it rewrote the whole document and, as a side effect, shortened a perfectly good meta description from 126 characters to 63. The final check then held the article for a problem the checking step had created.

The fix was simple once it was visible: tell the model the exact limits it must respect when it rewrites anything, and re-check its output against the same rules as the original draft.

Years are a quiet risk

Articles that call a past year "this year" age badly and look careless. My first version only checked titles for years. That missed the same mistake in body text, meta descriptions and tags, so the check now covers all of them. I also built a way to fix titles on articles that were already published.

Held is not the same as finished

A gate that holds drafts creates a new problem: a growing pile of held work that nobody looks at. Each pipeline now sends held drafts back for another attempt automatically, with a limit on retries, and alerts me when something stays stuck. The goal is that a person only steps in when the system genuinely cannot resolve something.

What this means if you are buying AI content

Ask any provider what happens between the draft and publishing. If the answer is "the AI checks it", ask what it checks, what happens when a check fails, and how they know the checker itself is right. That answer tells you more about the quality you will get than the name of the model they use.

You can see how the sites behind these pipelines perform in Google on my results page.

← All insights Talk to me about your project →