Screencast

A customer-support assistant that isn't trusted by default

Five walkthroughs of a fully on-prem CS chatbot running on an NVIDIA DGX Spark. Every answer is retrieved, cited, and validated before a customer sees it, and anything touching money or policy is held until a human approves it. One confidently wrong refund promise costs more trust than the productivity gain buys.

gpt-oss-120b · MoE RAG, not weights Human review by risk tier On-prem, one box
01

A grounded answer with citations

The bot answers from the knowledge base and cites the document it used. If retrieval finds nothing relevant, it generates no answer at all — it would rather say nothing than guess.

0:47
  1. Open the customer chat widget
  2. Ask a pricing question
  3. Send the message
02

A refund request is held for a human

Money and policy questions are Tier 3: the draft is written but withheld. The customer sees "an agent is reviewing this answer", never an unapproved promise about their refund.

0:43
  1. A customer asks for a refund
  2. Type the refund request
  3. The draft is withheld
03

Guardrails stop a prompt injection

A prompt injection is caught by the input rails and never reaches the model. PII is scrubbed before anything is written to a log.

0:36
  1. An attacker tries a prompt injection
  2. Type the injection attempt
  3. Blocked in milliseconds
04

Tool calling: a live order lookup

Phase 2 tool calling. The bot collects the missing order number, calls the order system, and the tool's result is cited and groundedness-checked exactly like a knowledge-base chunk.

0:39
  1. Customer asks about an order
  2. Give the order number
  3. Answer grounded in the tool result
05

The agent workspace

The agent workspace, and the point of the whole system. An agent approves, edits, discards, or flags the draft. An edit produces a (context, draft, human answer) triple — which is precisely a training pair.

1:11
  1. Agent signs in
  2. Open the review queue
  3. Open a draft for review
  4. Send, edit, discard, or flag
  5. Approve the draft