Accept demonstrated operating capability

AI Governance Setup Checklist

Use an evidence-based governance setup checklist covering ownership, decisions, policies, changes, incidents and handover, with a practical source-change exercise.

An AI governance setup checklist should test whether the organisation can make and maintain an authorised decision about a real AI use. It should ask for evidence, an accountable role and a consequence for an unresolved item. A list of policy titles with tick boxes cannot establish that a request, change or incident will reach the right person.

The checklist below is an original acceptance aid for Saudi organisations commissioning governance setup. Use it to agree scope before delivery, rehearse the resulting process and record what is ready for handover. It is not a regulatory certificate or a substitute for determining the obligations applicable to the organisation and its activities.

The NIST AI RMF Playbook provides voluntary suggested actions. This checklist translates selected operating questions into a practical acceptance exercise without representing itself as the official NIST instrument. Adapt its coverage to the work commissioned and preserve the evidence supporting each answer.

Set the boundary and completion states first

Name the entities, use categories, systems, languages and operating roles in scope. State whether the engagement includes design, software configuration, rehearsal, live operation or a combination. The checklist should not mark an implementation step complete if configuration was excluded from the work and has not been performed by anyone else.

Use explicit states: demonstrated, documented but not demonstrated, unresolved, or not applicable with a reason. Record the evidence reference and reviewer. “Not applicable” needs a scope explanation; it should not become the easiest way to clear a difficult item. A document can be accepted as a design deliverable while its operational demonstration remains pending.

Agree which unresolved conditions prevent the intended handover. Some missing details may be manageable actions after delivery; others prevent a valid approval route from operating. Make that judgement before scoring the exercise so the project does not redefine success when a difficult gap appears.

Keep a separate field for the next action, owner and decision point. The purpose is to make incomplete work actionable. A checklist that ends with several amber cells and no assigned response has described uncertainty without helping the organisation resolve it.

Check scope, inventory and ownership

Foundation checks for the agreed operating scope
CheckEvidence to inspectFailure implication
Each included use describes a business activityPurpose, users, sources, output and possible actionsA product name alone cannot define the permission
Purchased and embedded features are consideredRelevant subscriptions, enabled features and local use ownersThe inventory may omit activities already affecting work
An accountable operating owner is availableNamed role, responsibilities and absence coverConditions may have no person able to maintain them
Shared dependencies are identifiableLinks to platform, supplier, source and configuration recordsA change cannot be traced to affected uses
Lifecycle states have a usable meaningProposed, trial, active, paused and retired definitionsReporting may confuse planned permission with live operation

Test these checks on actual included uses, not only an empty register. The inventory guide provides the record design. Select cases that reveal different ownership and action boundaries; an ordinary drafting use alone may not test how the inventory handles an embedded feature or a shared component.

Where discovery is incomplete, retain a known coverage limit. Acceptance of the commissioned inventory should state what was examined and what remains outside it. Avoid converting a completed discovery workshop into a claim that every use across the company has been found.

Check intake, classification and decision rights

Decision-route checks
CheckEvidence to inspectFailure implication
A sponsor can submit a usable requestCompleted intake with questions understandable to the intended roleThe route may depend on specialist knowledge the sponsor lacks
Classification changes the review routeRecorded reasoning and resulting reviewers or conditionsA risk label may have no operating effect
The decision maker has relevant authorityDelegation and limits for the specific decisionAdvice or coordination may be mistaken for approval
Missing evidence leads to a defined outcomeRequest for clarification, narrowed scope, hold or refusal recordIncomplete requests can become approved through silence
Disagreement and absence have a routeAlternate or escalation exercised with a representative caseThe process may fail when its preferred participant is unavailable

Use intake design, classification and approval routes together. A classification worksheet is useful only if someone acts on it. The review should show how internal categories interact with the organisation's specialist applicability assessment without pretending that an internal label establishes a legal classification.

Observe what happens when the proposal changes during review. The team should identify the version being decided and which evidence must be reconsidered. If different reviewers assess different versions, an apparently complete set of approvals can fail to authorise any single coherent activity.

Check policies, evidence and operating conditions

Checks connecting approved rules to daily operation
CheckEvidence to inspectFailure implication
Staff can find the current applicable instructionAccess using an ordinary user's account or permitted equivalent demonstrationPublishing a document may not make it usable
Evidence supports the actual claimSource, date, scope, configuration and verification statusA general supplier statement may be overextended
Approval conditions have owners and closure criteriaCondition record linked to the operating decisionA conditional approval may be treated as unconditional permission
Human review occurs before the relevant consequenceDemonstrated workflow, source access and reviewer authorityA nominal reviewer may only see an action after it occurs
The fallback is available and understoodExercise of the permitted manual or alternative routeUsers may improvise an unapproved substitute when AI fails

A checklist should distinguish written rules from their enforcement. If the policy prohibits automatic sending, inspect whether the configured application can still send through another path. If a manual review is required, ask the reviewer to explain what evidence they inspect and what they do when it is missing.

Keep the evidence collection proportionate. An authorised demonstration can establish access without distributing sensitive records to the whole project. When actual operating evidence is required, define its handling and preserve the limit of what the sample can show.

Check changes, exceptions and incidents

Checks for events after initial approval
CheckEvidence to inspectFailure implication
A material change reaches the correct reviewersChanged source, user or action scenario and resulting routeApproval can remain attached to an obsolete boundary
A temporary exception expires meaningfullyExpiry owner, continuation decision and operating consequenceTemporary permission can become indefinite by neglect
An uncertain incident report is acceptedReporter exercise and receiving-team responseStaff may wait for proof while exposure continues
Pause and recovery authority are distinct and usableContainment and resumption exercises with relevant ownersA technical restart may bypass the required decision
Retirement removes continuing dependenciesAccess, scheduled actions, retained records and owner handoverA retired label may leave active connections or obligations

For detailed operating design, use the change-trigger guide and incident plan. In the acceptance exercise, the aim is to demonstrate the route and responsibilities included in the scope. Do not claim that a tabletop has tested every production control or every possible incident.

Choose events that challenge the actual arrangement. A supplier update, an unavailable owner and an expired exception can expose different weaknesses. Keep the exercise controlled and use synthetic or appropriately prepared material where real content is unnecessary.

Worked example: an attendee-enquiry assistant changes its source

Consider a fictional event organiser establishing governance for an assistant that drafts answers to ticket enquiries. The permitted task uses the current published ticket conditions and does not issue refunds or alter bookings. An employee reviews the draft and uses the existing customer-response process.

During the checklist exercise, the team introduces a revised cancellation rule with a different effective date. The original source remains in the collection. The question is whether the change is identified, the authoritative version established and the relevant permission and evaluation evidence reviewed before staff rely on the new answers.

The intake and source owner work correctly, but the employee cannot access the current instruction referenced in the approval record. The team therefore marks that item documented but not demonstrated and assigns an access repair. It does not mark the whole process complete because the policy exists in the project folder.

A second exercise removes the usual decision maker. The alternate can approve the source-version correction within the defined delegation, but cannot enable automatic refunds. This shows why absence cover must preserve authority limits. Successful handling of the source change should not be recorded as permission for a different action capability.

After the access repair, the employee repeats the relevant task and can locate the current instruction, identify the applicable conditions and escalate an ambiguous booking. The acceptance record cites that demonstration and preserves the still-excluded refund capability. It does not claim that every future customer enquiry will be answered correctly.

Turn the checklist into an acceptance record

For each item, retain the state, evidence reference, test date, participant or reviewer, finding and next action. Link the record to the agreed scope version. If a check is removed because the scope changes, preserve the decision and rationale rather than deleting the inconvenient row.

Record a capability-level conclusion: ready for the defined handover, ready with specified conditions, or not ready for the intended operating step. Explain the unresolved items and their consequences. Avoid a simple percentage that allows many easy checks to offset one missing authority or unavailable stop control.

Distinguish delivery acceptance from permission to launch a particular AI system. The governance process can be accepted while the system still needs technical evaluation or other specialist conditions. Conversely, a working application does not prove the organisation has a sustainable review and change process.

The client and delivery team should agree who accepts the setup and who owns continuing actions. An adviser can prepare and demonstrate the arrangement, but the organisation must adopt the relevant roles and decisions through its own authority. A signature from the project manager cannot stand in for every reserved approval.

Run a challenge set before signing the acceptance record

A checklist becomes more useful when the sponsor chooses a small challenge set that crosses several checks. For the attendee-enquiry assistant, use a normal source correction, an unavailable approver and a request to expand the assistant's action. Record the expected route before running the exercise, so the team cannot redefine success after observing a convenient result.

In the normal correction case, supply a revised cancellation rule with an effective date. The source owner should identify the authoritative version, the reviewer should understand when it applies and the employee should reach the current instruction. This tests several connected responsibilities while preserving the distinction between the source being approved and the user being able to apply it.

For the unavailable-approver case, ask the alternate to decide the permitted source correction using the evidence available through their actual access. The alternate's name in a responsibility map is insufficient if they cannot view the relevant rule or their delegation excludes the requested decision. Record the exact failed step and the condition it affects.

For the expansion case, request automatic refund execution. The original assistant only drafts reviewed replies, and the alternate's source-correction authority does not cover refund execution. A successful route recognises the new action, identifies the necessary assessment and reaches the appropriate decision authority. It does not need to approve the expansion to pass the exercise.

Acceptance observations for the illustrative challenge set
ScenarioUseful observationAcceptance consequence
Cancellation-rule correctionUsers can find and apply the version effective for the enquiryEvidence for the defined source-update route
Usual approver unavailableThe alternate can access evidence and act within their delegationEvidence for absence handling, or a precise gap to repair
Automatic refund requestedThe team recognises the action exceeds the existing permissionEvidence for escalation without granting an unsupported expansion

Use the observation record to separate an execution problem from a design problem. An incorrect access setting may be repaired without changing the delegation. A delegation that never included the required decision needs an authority decision. The corrective owner and acceptance evidence will differ, even though both problems initially appear as a failed exercise.

Retest the affected route after correction and identify any related checks that may have changed. Repairing the alternate's access should not grant broader access to unrelated attendee information. Inspect the relevant boundary as part of the correction, and retain the original result alongside the retest rather than overwriting the failure.

Also test the handover location. Ask the receiving owner to retrieve the current checklist, the evidence references and the unresolved-action list without using the designer's personal folders. If the only complete record is held by the external team, the client has not yet received the capability to maintain the result independently.

The sponsor can then make a precise acceptance statement: which routes were demonstrated, which deliverables were received, which limits remain and who owns the next evidence step. A launch decision for a specific AI use may still require its own conditions. Keeping that distinction in the signed record prevents a general project acceptance from becoming unintended permission for every use mentioned during the engagement.

Maintain the checklist after the engagement

Use completed operating cases to check whether the demonstrated route survives ordinary work. Revisit the relevant items after organisational changes, material supplier updates, new action authority or evidence of bypass. The checklist should evolve through versioned decisions, not through casual edits that erase what earlier acceptance meant.

Keep it focused. Add a check when it addresses a real gap, applicable requirement or changed scope. Remove duplication through a recorded decision when another control supplies the same evidence more clearly. A growing checklist is not automatically improving governance if it becomes too difficult for the responsible roles to use.

Discuss a governance setup acceptance exercise for your organisation with Open for AI. Bring the proposed scope, the decision roles and a case likely to challenge the process. The result should show what your team can actually operate, what remains unproven and what action will resolve the remaining conditions.

FAQ

Your questions, answered.

What should an AI governance setup checklist prove?

It should show whether the commissioned operating capabilities can be used by the intended roles: registering a use, routing review, reaching authorised decisions, maintaining conditions and responding to change or incidents. Each conclusion needs evidence and a stated scope. The checklist is an acceptance aid, not a universal compliance certificate or proof that every AI system is technically ready for production.

How should documented but untested governance controls be marked?

Keep a distinct state such as documented but not demonstrated. Identify the evidence needed, the owner and the decision affected. A design document can be accepted as a design deliverable while operational demonstration remains pending. Do not mark the control fully demonstrated because a policy exists or because a project participant says it will work after implementation.

When is not applicable an acceptable checklist answer?

Use it when the agreed scope and activity justify exclusion, with a recorded reason and reviewer. It should not be used simply because evidence is difficult to obtain or a control failed. If the scope changes, preserve the decision and reassess affected items. A later addition of users, sources or actions may make a previously excluded check relevant again.

Can a high checklist completion percentage offset missing approval authority?

No meaningful conclusion follows from averaging away a necessary decision condition. Agree which gaps prevent the intended handover and explain their operating consequences. Many completed administrative items cannot supply authority that has not been delegated. Use a capability-level conclusion with explicit conditions rather than a score that makes unlike requirements interchangeable or labels the whole organisation safe.

Why test access to instructions using the intended employee role?

A policy available to the project team may be inaccessible to the person who must apply it. In the event-organiser example, the current instruction exists but the employee cannot open it, so the operating claim remains unproved. Test the relevant access and comprehension through an authorised method, repair the gap and repeat that part of the exercise before accepting the capability as demonstrated.

Does passing the cancellation-source exercise authorise automated refunds?

No. The exercise demonstrates the tested source-change route and its authority boundary. The assistant’s permission remains limited to reviewed reply drafts in the example. Automatic refund execution is a different capability with additional consequences and approval needs. The acceptance record should preserve that exclusion rather than allowing success in one scenario to become a general approval of the product.

Who should accept the completed governance setup?

Identify the client role with authority over the commissioned operating arrangement, alongside any separate reserved approvals and continuing owners. The delivery team can prepare evidence and demonstrate the process, but the organisation adopts its roles and decisions. A project-management signature should not be treated as a substitute for every specialist or governance approval. Record unresolved actions and their effect on handover.

When should the checklist be revisited after handover?

Revisit affected items after material organisational, supplier, source, user or action changes, and when operating cases reveal a gap or bypass. Preserve versions and the meaning of earlier acceptance. Add checks for real requirements or observed weaknesses and remove duplication through a recorded decision. Continued usefulness depends on the checklist reflecting the current operating arrangement, not simply becoming longer over time.

LET’S WORK TOGETHER

Ready to build what’s next?

Tell us about your project or the platform you want to explore, and we’ll come back to confirm a suitable time.