PHSDAI TRANSFORMATION
AI ASSURANCE / EVIDENCE REVIEW

How confident are you in the AI you already run?

WHAT WE DO

When an AI application is in use, the important questions become practical. How is its quality tested? What can it access? How are mistakes detected? Can the team explain what changed and why?

Our Evidence Review examines the system as it exists and identifies gaps between the controls you need and those you can demonstrate.

[ 04 -1 ]

[ + ]WHAT WE EXAMINE

( 01 / 05 )
  1. /01

    The system's purpose, users and operational risks.

  2. /02

    Current quality tests, benchmarks and test data.

  3. /03

    Access controls, human approval and logging, as relevant.

  4. /04

    Monitoring, incident handling and change management.

  5. /05

    Applicable assurance requirements identified with the client's legal and compliance teams.

[ 04 -2 ]

[ + ]WHAT YOU RECEIVE

( GAP LIST_ )

A prioritised findings report with practical recommendations, dependencies, suggested remediation work and questions requiring business or legal decisions.

SPEC_ / AI ASSURANCE / EVIDENCE REVIEW
FOR
ORGANISATIONS ALREADY BUILDING OR RUNNING AI.
WE EXAMINE
PURPOSE AND RISKS, QUALITY TESTS, ACCESS AND LOGGING, MONITORING AND CHANGE MANAGEMENT.
YOU RECEIVE
A PRIORITISED FINDINGS REPORT WITH PRACTICAL RECOMMENDATIONS AND SUGGESTED REMEDIATION.
SCOPE AND FEE
AGREED WITH YOU BEFORE THE WORK STARTS.
( GAP LIST_ )ILLUSTRATIVE
GAPEXPOSUREFINDINGCLOSING IT
01HIGHAccuracy is not measured in production. The only evidence is the launch test, run once.Eval suite in CI plus live sampling.
02HIGHLogs record the answer but not the retrieved sources, so no decision can be reconstructed.Add retrieval logging.
03MEDHuman oversight exists on paper. The override is used by nobody and tested by nobody.Define and test an override path.
04MEDNo record of the data the model was evaluated on.Build a versioned test set.
05LOWTechnical documentation is current, but has no owner.Name an owner. One meeting.

An excerpt from a findings report. Invented system, invented findings. Not a legal assessment.

[ 04 -3 ]

[ + ]WHO SHOULD USE IT

This is for organisations already building or running AI and seeking a more defensible way to evaluate it. If you haven't chosen a use case yet, our discovery service is a better starting point.

CONTACT
US
[ + ]  EVIDENCE REVIEW

How confident are you in the AI you already run?

Tell us about the system, who uses it and what it can access. We will tell you whether a review is the right next step.