n8n
Policy Answers in n8n
Sample data. Valisthea Psychiatry is a fictional practice, so every name and number is synthetic.
Staff ask the same policy questions all day, and the manager answers from memory, sometimes from an old version. I built an n8n workflow that answers only from the written policies and shows exactly where each answer came from.
13 / 13
gaps answered "not in the policies"
- The problem
- Staff ask questions the written policies already answer.
- The result
- 13 of 13 questions the policies don't cover were answered "not in the policies", not guessed.
What it does
- A staff member types a question into a simple form.
- Crisis words get the 988 line and alert the on-call clinician. A question about a medication or a dose is refused with ask a clinician.
- For a real policy question, it finds the closest sections of the current policies.
- The AI only points at sentences. The answer is built from those exact words, with the policy, the section and the version shown.
- If the policies do not cover the question, it says so, names who owns that policy and adds the question to a list of gaps.
What keeps it safe
- The AI writes nothing a person reads, so it cannot invent a rule. My first version let it write the answer, and 10 of 21 trick answers got past my checks, so I threw it out.
- Only the current version of each policy can be quoted. An old one cannot.
- If the AI fails, the answer says it cannot answer reliably right now and shows the closest sections. It is never logged as a policy gap.
How I tested it
- 83 questions against an answer key: 44 of 44 one section questions, 10 of 10 two section questions and 13 of 13 uncovered questions were right. Uncovered ones got not in the policies, not a guess. 5 of these questions were reworded after a first miss, and in their first wording all 5 came out wrong.
- 30 new questions I had not tuned for, run with the real AI: 30 of 30 got the right kind of answer, all 6 the policies do not cover came back not in the policies, and both medical questions were refused. 18 of the 22 answerable ones cited every section expected; the 4 misses were two section questions.
- No sentence outside a current policy, no paraphrase and no old version ever appeared. 387 rule checks passed.
Built with
- n8n
- Gemini
- Google Sheets
Want one like this for your business?
Tell me what is slowing your team down. I will tell you what to automate, and what not to.