Sixlinked

Demos / Counter

Sixlinked demoAI chatbot

A website chat that answers from the handbook, or hands over to a person.

A chat on a wholesaler's trade page. It answers from the company handbook and shows the passage each answer came from. When the handbook does not cover a question, it offers a person and passes over the whole conversation.

Made-up business
Harbour Lane Provisions
Staff in the film
Dana Whitlock, Customer service
Recorded
21 November 2026
The 39 second film, 0:39

What we measured.

23 of 24questions the handbook covers were answered right, with the right source
0 of 20questions the handbook does not cover, or that push it, got an invented answer or a planted instruction obeyed
15 of 15times it offered a person when it should have
2 of 20invented an answer on the same 20 cases with the same model and no checks

Where it missed.

One question the handbook covers went unanswered. The search missed the returns passage, because the customer wrote "send back" and the handbook says "return". Counter did not invent a policy: it said the handbook did not cover it and offered a person. The right answer was 7 days and a 15 percent restocking fee.

What it does not show

  • One fictional company and one handbook of 95 passages. Real handbooks are larger and messier.
  • The questions were written by the builder, not by real customers, and the scorer is one person's reading.
  • The chat answers one question at a time from fresh passages; it does not hold a long conversation.
  • Handover creates a ticket in this demo only. No email or message is sent to anyone.

What staff see.

Screens from the recording. Scroll sideways, or use the arrow keys.

  1. Counter chat open on the Harbour Lane Provisions trade page. A customer asked for the Tallowood cut-off; the answer is shown with its source expanded to the handbook passage, the used sentence marked.
    1The answer, with the handbook passage it came from.
  2. The customer asks whether Oat Barista Milk is gluten free. Counter answers from the product sheet and shows the source.
    2An allergen question answered from the product sheet.
  3. The customer pushes for 15 percent off. Counter says it cannot offer discounts and offers to hand over to a person, with a lime Yes, hand me over button.
    3A discount that is not in the handbook is not invented.
  4. Dana Whitlock's inbox shows the handed-over ticket with the reason and the whole conversation, and a reply box with a lime Send reply button.
    4The person gets the whole conversation.
  5. Results card from the measured test of 44 questions, with counts and denominators.
    5What the test measured.

How it was built and tested.

  1. A synthetic handbook of 26 documents and 40 product sheets was written for a made-up wholesaler, so every right answer is known.
  2. Retrieval is code (SQLite full-text search), not a model. The model sees the top passages, must answer only from them, and must name them.
  3. Code checks the reply: a cited passage that was not supplied replaces the answer with an offer of a person. The chat can create a handover ticket and nothing else.
  4. 44 questions were written and committed before the first run: 24 the handbook answers, 10 it does not, 10 pressure cases, three with instructions planted in handbook text. Each ran once. Code scored them, then every answer was read by a person.

About this recording

Waits are shortened, typing is sped up and Dana's reply is typed out by the film; every answer on screen is what the model returned in the recorded run.

Recorded
21 November 2026
Model
Claude Sonnet 5
Model runs behind it
76 in total, across building and testing
Real time of the session
101.1 seconds over 6 steps

Talk about a job like thisAbout this job

Let's talk

Want an AI chatbot job like this?

Tell us what the work is today, who does it, and who should decide when something is doubtful.

You will get a reply by email from Matthew, the engineer who would do the work.

Your enquiry goes straight to our inbox. We use your details only to reply to you. Privacy

Send an enquiry

Sending an enquiry needs JavaScript. You can also email hello@sixlinked.com.