Internal Audits

Purpose

This procedure sets Rygen Technologies’ internal audit program for the AI Management System (AIMS), as ISO/IEC 42001:2023 Clause 9.2 requires. Internal audits show whether the AIMS conforms to Rygen’s own requirements and to the standard, and whether it is effectively implemented and maintained.

Scope

This procedure applies to every internal audit of the AIMS. Audits cover all processes, activities and areas within the AIMS scope, including:

  • AI systems (X1 Platform, Corsair, internal AI tools)
  • AIMS processes and procedures, including AI governance and risk management
  • All organizational units involved in AI activities

Audit Program Framework

Audit Frequency

An AIMS internal audit is conducted annually. Appendix A.1 sets the clauses each year’s audit covers. The Annex A control effectiveness audit is also annual (see Control Effectiveness Verification).

Audit Method

Audits use:

  • Document review of AIMS documentation and records
  • Observation of AI activities and processes
  • Interviews with personnel involved in AI activities
  • Representative sampling of AI systems and processes
  • Verification of implementation through objective evidence

Responsibilities

  • Principal AI Engineer: audit program owner; plans and schedules audits and approves audit reports. The lead auditor for each audit is named in the annual audit schedule.
  • CTO: approves the audit program, allocates resources, and manages audit results.
  • AI Governance Committee: receives audit reports. The Principal AI Engineer approves corrective action plans (AI-014).
  • Team Leads: support audits, give access to personnel and records, and implement corrective actions.
  • Auditees: cooperate with audits, provide requested information, and take part in interviews.

Audit Planning and Scheduling

The Principal AI Engineer shall develop the annual audit plan for the following year by December 31st. The plan takes into account the importance of each process, the results of previous audits, risk assessment outcomes, new AI systems or processes, auditor availability and workload, and business priorities.

Audit Process

Audit Preparation

Each audit defines its objectives, criteria and scope.

  • Objectives: verify conformity to requirements, assess effectiveness and identify improvements, with focus areas drawn from risk assessment and previous audit results.
  • Criteria: internal requirements (AIMS policies and procedures, AI governance frameworks, risk management processes, and performance objectives and targets) and external requirements (ISO/IEC 42001:2023, applicable legal and regulatory requirements, and client contractual requirements).
  • Scope: the processes, organizational units, time period and locations covered, and any exclusions with the reason for each.

Auditor Selection and Competence

The lead auditor needs ISO 42001 knowledge and certification, AIMS implementation experience, auditing skills and experience, and objectivity and impartiality.

Additional auditors, when needed, are selected for technical expertise, process knowledge, availability, and objectivity, meaning no responsibility for the area being audited.

To ensure objectivity and impartiality:

  • Auditors shall not audit their own work.
  • There is no direct reporting relationship between auditor and auditee.
  • External auditors may be used where internal objectivity is compromised.
  • Audit assignments are rotated when practical.

Audit Execution

An opening meeting confirms the audit objectives, criteria, scope, plan and timeline, and how the auditor and auditees will communicate.

The auditor gathers information by the methods above:

  • Document review: AIMS policies and procedures, process documentation, records, previous audit reports, and corrective action records
  • Process observation: AI development, AI system operation, risk management, and training and competence activities
  • Personnel interviews: structured interviews on roles and responsibilities, knowledge of procedures, and training and competence

The auditor collects objective evidence, judges conformity and the effectiveness of implementation, identifies areas for improvement, and records each finding with its supporting evidence.

A closing meeting presents preliminary findings, discusses observations, clears up misunderstandings, and sets next steps and a timeline.

Audit Findings and Reporting

Finding Classification

Major Nonconformity

The absence of, or failure to implement, a requirement; a situation that would seriously affect the AIMS’s capability; or a pattern of minor nonconformities in the same area.

Minor Nonconformity

An isolated failure to meet a requirement that is unlikely to seriously affect AIMS capability, including documentation issues that do not affect implementation.

Observation

An area for potential improvement, good practice worth noting, or a trend that could become an issue.

Audit Report Content

Each audit report shall include:

  • Executive summary: key findings and overall assessment
  • Audit details: objectives, criteria, scope, dates and participants
  • Findings, with evidence and references
  • Conclusions on overall conformity and effectiveness
  • Recommendations for improvement
  • Appendices with supporting documentation and evidence

Report Distribution

Audit reports shall be distributed to:

  • The CTO, within 5 business days
  • AI Governance Committee members
  • Auditees and their managers
  • The audit record in the aims-governance repository

Follow-up and Corrective Action

Corrective Action Requirements

  • Major nonconformities require an immediate corrective action plan.
  • Minor nonconformities require corrective action under AI-014 by the target date set in the CAR.
  • Observations are considered for improvement planning.

Corrective Action Process

Corrective action follows AI-014: root cause analysis, action planning, implementation, verification of effectiveness, and closure once the action is verified effective.

Follow-up Audits

Corrective action effectiveness is verified under AI-014. A follow-up audit is conducted when management requests more verification.

Control Effectiveness Verification

Annual Control Effectiveness Audit

Annex A control effectiveness shall be audited every year in a dedicated audit, separate from the annual internal audit. The dedicated audit shall assess every Annex A control against three criteria:

  • Existence: does objective evidence exist, and is it current?
  • Implementation: is the control operating as described in the AIMS documentation?
  • Outcome: is the control producing the intended result?

The annual internal audit shall sample a subset of controls for effectiveness rather than re-auditing all of them.

The annual audit schedule sets the timing of the dedicated audit. Its plan and checklist templates are kept in the aims-governance repository.

Audit Records and Documentation

Required Records

  • Annual audit plans
  • Individual audit plans
  • Audit checklists and working papers
  • Audit reports
  • Corrective action plans and evidence
  • Follow-up audit reports
  • Auditor competence records

Record Management

  • Storage: content/audits/ in the aims-governance repository, one directory per audit
  • Retention: at least 3 years
  • Backup: included in organizational backup procedures
  • Access: controlled by role and responsibility

Program Evaluation and Improvement

Program Effectiveness Monitoring

Audit program effectiveness is judged from audit completion against the schedule, trends in findings, and the status of corrective actions, as reported at each management review.

Program Review and Improvement

  • Continuous: updates for changes in AIMS scope or processes, new requirements or standards, lessons learned from audits, stakeholder feedback, and external audit recommendations

Integration with Management Review

Audit program results are an input to management review: audit activities and findings, trends in nonconformities and observations, corrective action effectiveness, recommended AIMS improvements, and audit completion against the schedule. Appendix A.4 sets the frequency and source of each input.

Templates and Forms

Each year’s audit schedule is kept as content/audits/AUD-schedule-YYYY.md. The following templates support this procedure:

  • Internal audit checklist: internal-audit-checklist-template.md
  • Control effectiveness audit plan and checklist: control-effectiveness-audit-plan-template.md and control-effectiveness-audit-checklist-template.md
  • Corrective action report: corrective-action-report-template.md

Templates are in content/templates/ in the aims-governance repository. Each audit’s plan and report follow the contents this procedure sets.

Revision History

VersionDateAuthorSummary of Change
1.02025-06-05Field BradleyInitial draft.
1.12025-09-02Field BradleyMigrated to markdown and gitlab
1.22025-01-13Field BradleyAdded Audit Program Appendix (A.1-A.6)
1.32026-03-09Hank GalbraithAdded annual control effectiveness verification requirement
1.42026-07-14Field BradleyAudit-results reporting to management review aligned to the every-four-months review cadence (AI-1759)
1.52026-09-15Field BradleyCorrected the audit-record storage and distribution locations from Confluence to the aims-governance repository, which is where the records are held (AI-1976)
2.02026-11-09Field BradleyShortened every section, corrected approvals, cross-references and dates, and removed the mandatory audit triggers, keeping the annual internal audit and escalation re-audits (AI-2173, AI-2131). The committee receives audit reports; minor nonconformities follow the CAR target date; effectiveness is verified under AI-014; program effectiveness is judged from what management review reports.
2.12026-11-10Field BradleyThe Principal AI Engineer may be named lead auditor. Auditors still do not audit their own work (AI-1976).

Appendix: Audit Program

A.1 Three-Year Audit Cycle Schedule

Every ISO/IEC 42001:2023 clause is audited at least once in a three-year cycle. High-risk areas are audited every year, and lower-risk foundational elements rotate.

Audit Coverage by Year

SectionTitleY1Y2Y3Frequency
Clause 4: Context of the Organization
4.1Understanding the Organization and Its ContextXTriennial
4.2Understanding Needs and Expectations of Interested PartiesXTriennial
4.3Determining the Scope of the AIMSXTriennial
4.4AI Management SystemXTriennial
Clause 5: Leadership
5.1Leadership and CommitmentXTriennial
5.2AI PolicyXXXAnnual
5.3Roles, Responsibilities and AuthoritiesXTriennial
Clause 6: Planning
6.1.1Actions to Address Risks and Opportunities - GeneralXXXAnnual
6.1.2AI Risk AssessmentXXXAnnual
6.1.3AI Risk TreatmentXXXAnnual
6.1.4AI System Impact AssessmentXXXAnnual
6.2AI Objectives and Planning to Achieve ThemXTriennial
6.3Planning of ChangesXXBiennial
Clause 7: Support
7.1ResourcesXTriennial
7.2CompetenceXXBiennial
7.3AwarenessXTriennial
7.4CommunicationXTriennial
7.5.1Documented Information - GeneralXXBiennial
7.5.2Creating and UpdatingXXBiennial
7.5.3Control of Documented InformationXXBiennial
Clause 8: Operation
8.1Operational Planning and ControlXXXAnnual
8.2AI Risk Assessment (Operational)XXXAnnual
8.3AI Risk Treatment (Operational)XXXAnnual
8.4AI System Impact Assessment (Operational)XXXAnnual
Clause 9: Performance Evaluation
9.1Monitoring, Measurement, Analysis and EvaluationXXXAnnual
9.2.1Internal Audit - GeneralXTriennial
9.2.2Internal Audit ProgramXTriennial
9.3Management ReviewXXXAnnual
Clause 10: Improvement
10.1Continual ImprovementXXXAnnual
10.2Nonconformity and Corrective ActionXXXAnnual

Annual Focus Summary

Year 1 focuses on context (4.1 to 4.4), risk and impact (6.1.x), operations (8.x) and policy (5.2). Year 2 focuses on leadership (5.1, 5.3), objectives (6.2), resources (7.1) and the internal audit program (9.2.x). Year 3 focuses on awareness (7.3) and communication (7.4). Annual items are covered every year, and biennial items (6.3, 7.2, 7.5.x) in Years 1 and 3.

A.2 Audit Frequency Definitions

The Frequency column in A.1 assigns each clause to one of these frequencies.

FrequencyRationale
Annual (every year)High-risk areas with direct impact on AI system safety, effectiveness and compliance
Biennial (every two years)Medium-risk supporting processes that change moderately often
Triennial (every three years)Lower-risk foundational elements that change rarely

A.3 Escalation Criteria and Re-Audit Requirements

Nonconformities found in an audit are escalated and re-audited as follows.

Escalation Matrix

Finding TypeImmediate ActionsRe-Audit RequiredRe-Audit Timeline
Major NonconformityNotify CTO and AI Governance Committee within 24 hours; immediate corrective action plan requiredYes, full clause re-auditWithin 60 days of corrective action implementation
Multiple Minor Nonconformities (3 or more in the same clause)Escalate to CTO; root cause analysis requiredYes, targeted re-audit of the affected areaWithin 60 days of corrective action completion
Single Minor NonconformityStandard corrective action per AI-014Verification only, not a full re-auditAt next scheduled audit
Repeat Nonconformity (same finding as previous audit)Escalate to CTO; effectiveness review of previous corrective actionYes, expanded scope re-auditWithin 60 days of corrective action completion
Pattern of Observations (3 or more related observations)Review at next management reviewOptional, at auditor discretionAt next scheduled audit

Scope Expansion Criteria

A re-audit’s scope may be expanded as follows:

Original Finding ScopeExpansion CriteriaExpanded Scope
Single processRoot cause affects multiple processesRelated processes in same clause
Single AI systemSystemic issue identifiedAll AI systems using same process or component
Documentation issueControl effectiveness concernFull clause including implementation
Implementation gapTraining or competence concernAdd Clause 7.2 (Competence) to scope

A.4 Integration with Management Review

Audit program results are reported to the management review (AI-012) as follows:

InputFrequencySource
Audit completion status against scheduleEvery four monthsAudit program records
Summary of findings by clauseEvery four monthsAudit reports
Corrective action status and effectivenessEvery four monthsJira and corrective action records
Trend analysis of nonconformitiesEvery four monthsHistorical audit data
Re-audit results and outstanding itemsEvery four monthsRe-audit reports
Recommended schedule adjustmentsAnnualAudit program review

A.5 AIMS Document to ISO Clause Cross-Reference

This table maps AIMS handbook documents to the ISO/IEC 42001:2023 clauses they address, for audit planning and evidence collection:

AIMS DocumentIDPrimary ISO Clause(s)
AI PolicyAI-0015.2
AIMS ObjectivesAI-0026.2
AIMS ScopeAI-0034.1, 4.2, 4.3
AIMS CharterAI-0044.4, 5.1
Roles and ResponsibilitiesAI-0055.3, 7.1
Document ControlAI-0066.3, 7.5.1, 7.5.2, 7.5.3
Communication PolicyAI-0077.4
Risk Management FrameworkAI-0086.1.1, 6.1.2, 6.1.3, 8.2, 8.3
Impact Assessment ProcessAI-0096.1.4, 8.4
Security PolicyAI-0108.1
Data ManagementAI-0118.1
Management ReviewAI-0126.3, 9.3
System Development LifecycleAI-0138.1
Nonconformity and Corrective ActionAI-01410.1, 10.2
Internal AuditAI-0159.2.1, 9.2.2
Acceptable Use PolicyAI-0168.1
Performance MonitoringAI-0179.1
Competency MatrixAI-0187.2
Governance Committee RolesAI-0195.3
Approved ToolsAI-0208.1
Training and CompetenceAI-0217.2, 7.3
Statement of ApplicabilityAI-0226.1.3
Incident ResponseAI-0238.1
Problem-Definition MethodAI-0248.1