← All Case Studies
AI Product Design · Mid-Sized Company · Anonymized Client Work

Turning Fragmented Company Knowledge Into Trustworthy AI Answers

As a Principal Product Designer consulting on the project, I shaped the product strategy and designed a governed knowledge layer that gave approved AI workflows consistent, source-grounded access to company knowledge.

Client identity and system names are anonymized; unapproved metrics and production screenshots are omitted.

  • Role

    Principal Product Designer (Consultant)

  • Product

    Governed knowledge layer with reusable MCP access

  • Release status

    Validated through a limited pilot

  • Verified outcome

    One governed layer supported multiple approved AI workflows

The Company Had Data. It Did Not Yet Have AI-Ready Context.

Years of policies, research, project decisions, operating procedures, training material, and domain expertise were spread across disconnected systems.

Employees often knew the information existed, but finding the reliable version depended on knowing the right person, tool, folder, or search term.

A typical request moved through a fragmented journey: search several tools, ask a colleague, compare versions, reconstruct context, and finally decide what to trust.

Early AI experiments made this problem less visible rather than solving it. A model could summarize whatever it retrieved, but a fluent answer could still combine stale, incomplete, or contradictory information.

The reframe

Connected did not mean trusted.

The company needed a product layer responsible for structure, provenance, permissions, freshness, and recovery before AI-generated output could be dependable.

Before, employees searched several systems, asked colleagues, compared versions, and reconstructed context themselves, with permissions, freshness, and ownership held in personal memory. After, one governed workflow retrieved permitted sources, compared freshness and authority, prepared a grounded answer, kept the final action with a person, and turned corrections into improvements to the knowledge layer.
The transformation moved integration work from individual memory into a governed, inspectable product loop.

Three Decisions Turned a Chatbot Request Into a Testable Product

Discovery showed that a conversational interface alone would reproduce the company’s fragmented knowledge behind a more fluent surface. I reframed the work around the evidence people needed, the actions AI could safely prepare, and the governance required for reuse.

The core need was not “give me a summary.” It was “help me reach a trustworthy answer and let me inspect the evidence.”

Role and responsibility

Designed: Product framing, research approach, information architecture, AI interaction and state models, and usability validation.

Advised on: Knowledge architecture, AI evaluation criteria, pilot scope, and governance decisions.

Partnered with: The product sponsor, engineering, data and AI specialists, security and governance partners, domain experts, and knowledge owners.

  1. One governed layer instead of separate integrations for every assistant

    Evidence: Source ownership, permissions, terminology, and freshness already varied across systems. Reconnecting each assistant independently would reproduce those inconsistencies.

    Decision and trade-off: Invest in a shared information model and MCP access contract. It required more upfront governance and metadata work, but made permissions, provenance, and retrieval behavior reusable across approved AI workflows.

  2. An evidence contract instead of an answer plus a confidence score

    Evidence: People needed to distinguish retrieval from synthesis, inspect the primary record, and recognize weak or conflicting evidence before acting.

    Decision and trade-off: Define a response contract that carried capability state, sources, ownership, freshness, permissions, and recovery. Testing added explicit unable-to-answer and conflict states, accepting more disclosure in exchange for verifiability.

  3. Human-controlled consequential actions instead of end-to-end autonomy

    Evidence: Restricted information, source conflicts, and policy changes required accountable judgment that the system could not own.

    Decision and trade-off: Let AI retrieve, compare, and prepare while people approved changes and external action. This was slower than full automation, but preserved correction, auditability, and a legitimate recovery path.

Nine stages run left to right, grouped by the kind of evidence each produces: stakeholder alignment gives business evidence, user research gives user evidence, synthesis, information architecture, and prototyping shape the product hypothesis, moderated usability testing gives experience validation, AI evaluation and red teaming give model and system validation, and pilot, analytics, and iteration give adoption evidence. Three feedback loops run beneath the path, and knowledge gaps route separately to accountable source owners.
User testing evaluated whether people could use and trust the experience. Separate AI evaluations tested whether retrieval and response behavior worked as designed.

A Response Contract Made Every Answer Inspectable

Employees needed speed without losing evidence. The experience began with a direct answer, then kept capability state, sources, excerpts, ownership, freshness, permissions, the primary record, and recovery one step away.

Representative test scenario

An operations lead asks which policy applies to an older contract. Retrieval finds current and superseded records with different dates and owners. Instead of combining them into a confident summary, the product labels the conflict, shows the relevant excerpts, identifies the accountable owners, and offers a resolution path.

This illustrative test case is derived from the validated conflict, freshness, and recovery requirements; it is not presented as a production screenshot or client quotation.

Four layers every response had to provide

  • 1. Answer state

    A concise answer or an explicit unable-to-answer state, never fluent output without supporting evidence.

  • 2. Capability and confidence

    A clear label for retrieved, synthesized, inferred, or unavailable output, including weak-evidence and conflict states.

  • 3. Evidence and access

    Source count, title, owner, supporting excerpt, freshness or lifecycle state, and permission boundary.

  • 4. Inspection and recovery

    Open the full record, refine or constrain sources, request access, or log a knowledge gap.

Six ascending steps. Step one is the answer, or an explicit statement that the question cannot be answered. Step two is a capability label of retrieved, synthesized, inferred, or unavailable. Step three lists sources with titles, owners, dates, and permission state. Step four shows supporting excerpts, conflicts between sources, and freshness. Step five opens the original company record under its own access rules. Step six offers recovery: refine the question, constrain sources, request access, or log a knowledge gap.
The response stayed concise while rationale, evidence, the primary record, and recovery remained one step apart.

One Governed Knowledge Layer for Many AI Products

Instead of letting every assistant create its own connection to company data, the product introduced one shared layer between approved sources and AI experiences.

MCP was not the whole product. It was the reusable access contract for search, permissions, source inspection, controlled updates, and the boundary where consequential action stopped for human review.

Approved company sources pass through ingestion and normalization into a governed knowledge layer holding a shared information model, entity graph, version and freshness state, source ownership, permission model, and quality signals. An MCP access service exposes consistent search, retrieval, source inspection, evidence comparison, controlled update, and verification capabilities to multiple AI products. A governance rail of permissions, provenance, freshness, audit, and recovery spans ingestion through AI products, and a human approval boundary separates AI products from people and any consequential external action.
One governed layer supported multiple approved AI experiences without rebuilding the knowledge foundation for each one.

Why MCP mattered

The shared contract applied permissions before information reached a model, standardized retrieval and inspection, reduced vendor coupling, and let specialized assistants reuse the same governed capabilities.

Six-stage knowledge lifecycle

A closed six-stage loop around a center labeled governed company context. Gather collects approved sources with owners, dates, and permissions. Organize normalizes metadata and shared terminology. Connect links decisions, evidence, teams, products, and policies. Retrieve returns an answer with sources, excerpts, and the full record. Apply puts the context to work in specialized workflows and human action. Improve turns corrections, stale content, and missing knowledge back into the layer.
Gather, Organize, Connect, Retrieve, Apply, and Improve formed one continuous product and knowledge-quality loop.
  • Gather

    Connect approved sources with owners, dates, permissions, and lifecycle state.

  • Organize

    Normalize metadata and shared terminology.

  • Connect

    Link decisions, evidence, owners, policies, products, and later changes.

  • Retrieve

    Return answers with sources, excerpts, freshness, and the full record.

  • Apply

    Use governed knowledge inside specialized workflows with human action boundaries.

  • Improve

    Turn corrections, stale content, and missing answers into quality signals.

Making System and Human Responsibilities Visible

The strongest trust pattern was not a confidence score. It was making responsibility legible.

The system could retrieve, compare, and prepare. People defined intent, resolved ambiguity, approved consequential changes, interpreted sensitive evidence, and owned external action.

Human approval was designed as an inspectable lifecycle rather than a final modal. Users could preview, edit, reject, constrain, retry, and recover without losing useful work.

A request is received, permissions are checked, and evidence is evaluated. The product then resolves into one of five named states, each with its own icon, label, and explanation: supported, weak evidence, conflicting evidence, restricted, and no source found. Each state has a specific recovery action, and the paths end either in a resolved answer or a logged knowledge gap.
A trustworthy AI product could explain why it could not proceed, preserve progress, and offer a legitimate next step.
How the product handled uncertainty without taking responsibility away from people.
Condition What the system did Human owner or next step
Weak or missing evidence Avoided confident synthesis and showed what was checked Refine the question or log a knowledge gap
Conflicting sources Presented both sources, owners, and dates Accountable knowledge owner resolved the conflict
Stale information Labeled lifecycle state and opened the current record Source owner reviewed or updated it
Restricted information Explained the permission boundary Existing access-request process handled the decision
Consequential action Stopped before execution and showed a preview Authorized person approved, changed, or rejected it

Validation framework

I evaluated the concept and pilot against my Eight Heuristics for Generative and Agentic AI Products: capability and confidence, provenance, bounded autonomy, recovery, accessibility under change, inspectability, safety boundaries, and process visibility. This was a structured design walkthrough; live accessibility testing, production telemetry, and formally sampled evaluation remained separate activities.

Outcome: Validated Through a Limited Pilot

One governed knowledge layer supported multiple approved AI workflows in a limited pilot. The product made source evidence, permissions, freshness, and human review reusable instead of rebuilding those behaviors for every assistant.

The most important shift was from isolated data connections to reusable company knowledge that people could verify.

A seven-stage closed loop around a center labeled shared AI adoption foundation. An employee asks a real question, MCP retrieves governed context, the AI prepares a grounded response, the employee uses, corrects, or rejects it, the product captures a quality or knowledge-gap signal, an accountable owner improves the source or metadata, and future responses improve. Six workflows built on the same foundation are listed below: onboarding, research, policy guidance, product context, drafting, and leadership briefings.
Usage, corrections, stale sources, and missing answers improved the same knowledge foundation used by future responses.

The same governed capabilities could support research and decision retrieval, onboarding, policy guidance, product context, drafting, knowledge-gap detection, pattern discovery, and leadership briefings.

Before

  • Knowledge was fragmented across tools and owners.
  • Verification depended on personal memory.
  • AI experiments used inconsistent data connections.
  • Every new assistant required new integration work.

After

  • Approved knowledge was available through one governed layer.
  • Responses exposed evidence, ownership, freshness, and access.
  • MCP made the same behavior reusable across AI workflows.
  • Corrections and gaps became operational improvement signals.

What the evidence shows — and what it does not

Capability evidence and measured outcomes remain separate.
Evidence What it demonstrates Boundary
Connected-source inventory Real integration scope Does not prove adoption
Retrieval test set Source correctness on tested questions Does not cover every question
Permission tests Access rules applied as designed Does not replace governance review
Usage by approved workflows Pilot adoption Does not prove productivity
Resolved knowledge gaps The improvement loop operated Does not quantify business value

Remaining risks

  • Permissions require ongoing review as teams and responsibilities change.
  • Retrieval quality still depends on accountable owners and a repeatable evaluation set.
  • Adoption requires workflow design, training, and leadership support—not only infrastructure.

What I learned

  1. AI adoption is a data-product problem before it is a chatbot problem.
  2. A company does not need more answers if employees cannot inspect the evidence.
  3. Permissions, provenance, recovery, and human responsibility are product behaviors, not infrastructure details.

My contribution

I did not begin with a model or interface. I began with the company’s information flows, employee needs, risks, and adoption constraints.

I translated that evidence into the product strategy, information architecture, response contract, AI state and recovery model, reusable MCP requirements, evaluation criteria, and pilot plan—in partnership with the teams responsible for implementation, security, governance, and source ownership.