Demos / Counter
Sixlinked demoAI chatbot
A website chat that answers from the handbook, or hands over to a person.
A chat on a wholesaler's trade page. It answers from the company handbook and shows the passage each answer came from. When the handbook does not cover a question, it offers a person and passes over the whole conversation.
- Made-up business
- Harbour Lane Provisions
- Staff in the film
- Dana Whitlock, Customer service
- Recorded
- 21 November 2026
What we measured.
Where it missed.
One question the handbook covers went unanswered. The search missed the returns passage, because the customer wrote "send back" and the handbook says "return". Counter did not invent a policy: it said the handbook did not cover it and offered a person. The right answer was 7 days and a 15 percent restocking fee.
What it does not show
- One fictional company and one handbook of 95 passages. Real handbooks are larger and messier.
- The questions were written by the builder, not by real customers, and the scorer is one person's reading.
- The chat answers one question at a time from fresh passages; it does not hold a long conversation.
- Handover creates a ticket in this demo only. No email or message is sent to anyone.
What staff see.
Screens from the recording. Scroll sideways, or use the arrow keys.

1The answer, with the handbook passage it came from. 
2An allergen question answered from the product sheet. 
3A discount that is not in the handbook is not invented. 
4The person gets the whole conversation. 
5What the test measured.
How it was built and tested.
- A synthetic handbook of 26 documents and 40 product sheets was written for a made-up wholesaler, so every right answer is known.
- Retrieval is code (SQLite full-text search), not a model. The model sees the top passages, must answer only from them, and must name them.
- Code checks the reply: a cited passage that was not supplied replaces the answer with an offer of a person. The chat can create a handover ticket and nothing else.
- 44 questions were written and committed before the first run: 24 the handbook answers, 10 it does not, 10 pressure cases, three with instructions planted in handbook text. Each ran once. Code scored them, then every answer was read by a person.
About this recording
Waits are shortened, typing is sped up and Dana's reply is typed out by the film; every answer on screen is what the model returned in the recorded run.
- Recorded
- 21 November 2026
- Model
- Claude Sonnet 5
- Model runs behind it
- 76 in total, across building and testing
- Real time of the session
- 101.1 seconds over 6 steps
Let's talk
Want an AI chatbot job like this?
Tell us what the work is today, who does it, and who should decide when something is doubtful.
You will get a reply by email from Matthew, the engineer who would do the work.
Your enquiry goes straight to our inbox. We use your details only to reply to you. Privacy