Skip to content
Nodeyra.
HealthcareAI chatbots & agentsRetrieval

Retrieval over clinical documents that clinicians could verify.

A question-answering layer over unstructured clinical documentation, built so that every answer cites the source passage a reviewer can open.

Concept preview, sample data: an assistant answering a question from internal documents with citations to the exact source passages
CLIENT
Clinical operations platform, UK
INDUSTRY
Healthcare
WHAT WE DELIVERED
Discovery + Build
TECHNOLOGIES
Python · PostgreSQL · pgvector · OpenSearch · Airflow
DURATION
16 weeks
  • 100%Of answers cite a source passage
  • 91%Retrieval accuracy on the clinician-graded set
  • 1.8 sMedian response time
  • 0Patient records sent to an external provider

The challenge

Clinical staff were searching across scanned referrals, discharge summaries and structured records held in three different systems. A first attempt at a chatbot produced fluent answers that staff could not check, so it went unused.

The requirement was not better prose but traceability. Patient data could not leave the customer's cloud tenancy, source documents were a mix of clean text and uneven OCR output, and the team had no ML engineers to maintain a bespoke pipeline.

Our approach

  1. STEP 1 · DISCOVERY

    Made citation a property of the pipeline

    Rebuilt ingestion so every chunk retained a stable pointer back to its document, page and character range, rather than asking the model to cite.

  2. STEP 2 · RETRIEVAL

    Chose hybrid retrieval on the customer's own documents

    Clinical codes and drug names were matched far more reliably by keyword search than by embeddings alone. Re-ranking was added only where evaluation showed it changed the top result.

  3. STEP 3 · EVALUATION

    Wired a graded question set into CI

    Three hundred real questions supplied and graded by clinical staff, scored on every pull request, so prompt and retrieval changes were measured rather than argued about.

  4. STEP 4 · HANDOVER

    Constrained generation to fail closed

    A schema that required at least one citation, returning 'not found in the record' rather than an unsourced answer. The in-house team now owns the evaluation set and the deployment.

Before and after

BEFORESearching three systems by handA chatbot whose answers could not be checkedOCR output of uneven qualityNo way to measure whether a change helped
AFTEREvery answer links to the passage it came fromHybrid search with conditional re-rankingRegression scores on every pull requestRuns entirely inside the customer's cloud account

The outcome

Clinicians use the assistant daily because they can check it in one click. The hard problem was never the model; it was making the provenance of an answer a structural guarantee of the pipeline instead of an instruction in a prompt. Once citation could not be skipped, trust followed.

Clinicians use it because every answer links to the exact passage it came from. That one decision made the difference between a demo and a tool.
James WhitfieldBoston, USA
Concept preview, sample data: a tenancy and billing admin listing tenants and plans, with an invoice reproduced from the event logNext story · B2B SaaS platform, Australia · SaaSRebuilding tenancy and billing without a migration weekend.Read next →
Facing something similar?

Tell us about your system and we’ll give you an honest read on where to start.

Book an introductory call