Proofmark · field note · knowledge-base rot & AI

Your knowledge base is lying to someone right now, and AI gave it a megaphone.

Every wiki, every Confluence space, every Notion becomes a graveyard eventually. The pages are rarely deleted; they go write-only and quietly stop being true. Retrieval still finds them. And now an assistant reads the stalest page in the graveyard and answers a customer with fluent, unearned confidence. This is a field note on knowledge-base rot: in the words of the people living it, and the data measuring what breaks when AI answers from it.

published 2026-07 · 8 min read
graveyard where documentation goes to die wiki rot tribal knowledge which doc is current confidently wrong write-only

The words practitioners actually type

Nobody calls it "knowledge decay." They say the wiki is a graveyard, that they cannot tell which doc is current, that the docs are write-only, that the real answer lives as tribal knowledge in one person's head. Below are verbatim public comments, unedited, collected July 2026. If you have run a knowledge base, you have said at least one of these.

"Confluence is where documentation goes to die. And then rot"
EdwardDiego
verbatim public comment · Hacker News · collected Jul 2026
"Out-of-date documentation can be worse than no documentation at all when it is actively wrong."
freedomben
Hacker News · verbatim · collected Jul 2026
"no documentation is better than wrong documentation"
Juan_Golt
r/sysadmin · verbatim · collected Jul 2026
"Either the information is outdated or in 5 different locations... with different information"
Keinichn
r/sysadmin · verbatim · collected Jul 2026
"What is everyone's responsibility is no one's responsibility."
toast0
Hacker News · verbatim · collected Jul 2026
"If the knowledge base is outdated so is the bot. For me this is so obvious and simple to fix."
obstschale90
r/LLMDevs · verbatim · collected Jul 2026
"you can never guarantee the output of an LLM from a given input"
chasd00
Hacker News · verbatim · collected Jul 2026

What the data says happens next

When an organization points AI at a knowledge base it never fully trusted, the outcome is measured, not anecdotal. The pattern is consistent: the model is fluent, the source is stale, and the answer is confidently wrong. Every figure below names its source inline, reported as the source stated it: no rounding up, no "AI proved."

95%

of enterprise GenAI pilots delivered no measurable P&L return.

an MIT-affiliated study found · Project NANDA · 2025
42%up from 17%

of companies are abandoning most of their AI initiatives, up from 17% a year earlier. The average organization now scraps 46% of its AI proofs-of-concept before production.

S&P Global Market Intelligence · Voice of the Enterprise · 2025
17-33%

of queries make even purpose-built legal AI research tools hallucinate. General-purpose chatbots: 58-82% on legal queries.

Stanford RegLab / HAI · 2024
66%

of AI users rely on the output without evaluating its accuracy. 56% of workers report making mistakes at work because of AI.

KPMG global study · 48,000+ people, 47 countries · 2025
91%

of customer-service leaders report pressure to implement AI in 2026, while the prior year's production deployment was still in the single digits. The mandate is arriving years ahead of the trust.

Gartner customer-service surveys (2026 pressure; 2024 deployment)
Proofmark · the failure mode, dated

When the bot answered from the rot

FEB 2024

Air Canada

A civil tribunal held Air Canada liable for its support chatbot's wrong bereavement-fare answer. The argument that the chatbot was a separate entity responsible for itself did not hold. The tribunal ordered the airline to pay.

British Columbia Civil Resolution Tribunal
APR 2025

Cursor

Cursor's AI support bot invented a customer policy that did not exist. Users hit the phantom rule, believed it, and cancelled their subscriptions over a restriction the company never had.

Public reporting · Apr 2025
OCT 2025

Deloitte

Deloitte refunded part of a ~A$440k government contract after a delivered report was found to contain AI-fabricated citations: sources that were never real.

Public reporting · Oct 2025

Three answers, confidently wrong, each traced back to a source no human was standing behind. In none of these cases did retrieval fail. The document was found. The answer was fluent. What was missing was a name and a date on the thing being quoted.

The gap was never retrieval

Every tool in this story can find the document. Search finds it. RAG finds it. The model finds it and quotes it back, fluently. What none of them can tell you is the one thing that decides whether the answer is safe to act on: which answer a person still stands behind.

Proofmark puts three things on the answer itself: a named owner, an attested version, and a review date. Here "verified" means exactly one thing, and never more: a named human attested this specific version, on a date. No owner, no badge. Let the freshness window lapse and the badge drops on its own: routine, not failure. When an agent quotes the answer over MCP, the citation travels with it: who signed it, which version, and when. The reader gets the receipt, not just the sentence.

VERIFIED Refund policy (enterprise tier) Dana K. · attested 2026-07-01 · v7 · 9f2c…e1 · source ↗
STALE Escalation matrix (EMEA) M. Osei · window lapsed 4d ago · v3 · in owner queue

Illustration of the credential line a Proofmark citation carries: the same row whether a human reads it in-app or an agent returns it over MCP. Green renders only for an attested version; stale is amber and routine, never styled as an error.

Honest scope. Proofmark is pre-launch and pre-revenue, built by a solo founder, and not SOC 2 certified yet. This page holds itself to the same rule the product does: every claim here is meant to survive you reading the repository. Where a capability is built but not yet proven in a live round-trip, it is described that way, not in the present tense.

Proofmark puts a named owner, an attested version, and a review date on the answer itself.

Request access → Open the app →

Sources