Insights · AI Governance · 9 min read

Your board is asking about AI risk. Your enterprise clients require SOC 2.

A practical generative AI governance framework for mid-market companies

Generative AI governance is the set of rules, responsibilities, and records that controls how a company uses tools that generate text, images, code, or other content. It establishes which tools are permitted, what data they can receive, and who checks their output.

Your board wants to know who owns AI risk. An enterprise client wants a SOC 2 report before completing its security review. If you lead operations, legal, IT, or compliance, both requests may land on your desk while employees use ChatGPT, Copilot, and other GenAI tools.

For companies using tools they did not build, the six-part framework below connects AI oversight to the controls and evidence behind a broader trust program. Start with shared work, then address the additional risks and evidence each request involves.

What generative AI governance means when you did not build the model

The provider manages how its model is developed. Your company manages how employees use the resulting service. Vendor safeguards support your program, but they cannot decide whether a particular client document belongs in a prompt.

For generative artificial intelligence based on large language models, or LLMs, ask the provider about training data, datasets, and any fine-tuning of foundation models relevant to your use. Ask whether your inputs become training data, what information the vendor discloses about its datasets, and what contractual protections cover your account.

Then answer four operational questions: Which tools are in use? What data goes in? Which decisions rely on the output? Who checks it?

Your responsibilities continue across the AI lifecycle as accounts, settings, connected data, and use cases change. These decisions put responsible AI into practice and sit within a broader AI governance framework.

The risks generative AI adds

NIST AI 600-1 identifies 12 risks unique to or exacerbated by generative AI. It calls hallucination, meaning confidently presented false content, confabulation. The examples below translate selected risks into workplace situations and practical responses.

RiskWhat it looks like at a mid-market companyThe control that answers it
Confidential data exposureAn employee submits client records to an unapproved chatbotData classification rules, approved tools, and access controls
Shadow AIA department adopts GenAI without reviewA tool inventory and a fast intake path
HallucinationAn invented fact enters a client deliverableHuman-in-the-loop verification against reliable sources
Intellectual propertyUnclear rights in AI-generated content or vendor reuse of inputsVendor terms review and content-use rules
Bias and discriminationAI helps screen candidates without fairness checksRestricted uses, assessment, and qualified review
Overly broad permissionsA copilot makes excessively shared files easier to discoverPermissions cleanup before rollout and access reviews
Security vulnerabilitiesA compromised integration or manipulated prompt exposes informationVendor diligence, testing, and an AI incident plan

A data security review should consider the complete workflow, including integrations. Microsoft 365 Copilot respects existing user access; it can surface overshared information that a user already has permission to view. That distinction matters when diagnosing exposure or suspected data breaches.

Environmental impacts also appear on NIST's list. Consider the energy and carbon footprint of AI use alongside privacy, fairness, and other ethical concerns.

How generative AI governance supports SOC 2 readiness

Connect the work through vendor due diligence, access reviews, employee training, change management, and incident response. Include AI providers, connected information, and AI-related incidents in the relevant processes. The records can support both programs where their scopes overlap. A SOC 2 report examines controls within a defined system and scope; it does not automatically establish comprehensive AI governance.

Prepare evidence around the request you receive. A customer may ask about sensitive information in GenAI tools; a board may ask who accepts risk; an insurer may ask about controls; an auditor will examine evidence within the agreed scope.

Grant Thornton's 2026 survey of 950 senior business leaders found that 78 percent lacked strong confidence they could pass an independent AI governance audit within 90 days. This measures respondents' confidence, not observed audit results.

A useful response package includes your policy, dated inventory, approval records, training records, and unresolved exceptions. It should explain accountability and give reviewers transparency into how decisions are made.

See what enterprise buyers are asking suppliers for. For law firms and professional services firms, confidential client work makes tool approval particularly consequential. Greenplaces' guide to AI governance for law firms explores that sector's client-diligence context.

A six-part generative AI governance framework

PartWhat you produceEvidence a customer can see
1. InventoryA register of tools and use cases, owners, vendors, and data touchedThe dated register
2. Risk classificationA tier for each use case, such as prohibited, restricted, or approvedAssessments and approval conditions for higher-risk uses
3. Data rulesPermitted data classes, permissions, and retention settings for each toolThe handling policy and relevant settings
4. Acceptable use and tool intakeA short policy and a request path for new toolsPolicy acknowledgments and an intake decision log
5. Training and human reviewRole-based instruction and named reviewersTraining records and review sign-offs
6. Review and monitoringA cadence for checking tools, incidents, and changesReview minutes, incident records, and corrective actions

1. Inventory the generative AI already in use

Start with a staff survey, sign-on records, and expense records. Include GenAI features inside software you already buy. Record metadata for each use case: owner, vendor, purpose, information handled, integrations, and approval status. Shadow AI means use outside your approved processes; give employees a straightforward way to disclose it. Date the register and assign someone to maintain it.

2. Classify each use case by risk

Tier use cases by data sensitivity and the consequences of a wrong result. Risk assessments should record approval conditions and residual risks. Block a proposed use involving confidential inputs if vendor terms permit their use for training without acceptable protections. Also pause uses lacking necessary enterprise controls or meaningful review of consequential decisions. An approved tool can still have prohibited uses.

3. Set the data rules

Specify which data classes each tool may receive and configure access and retention accordingly. Privacy laws such as GDPR and CCPA remain relevant when personal information enters a prompt. Data lineage and traceability mean being able to explain what information went in and where the output went. Collect records proportionately so the GenAI evidence log does not become another repository of sensitive information.

4. Write the acceptable-use policy and open a tool intake path

Keep the generative AI policy short enough to follow, with examples of permitted and restricted work. Include guardrails for client information, intellectual property, and published output. Establish an intake route with a target response measured in days. Record decisions and reasons so staff can find approved alternatives rather than repeatedly requesting the same tools.

5. Train people and keep a human in the loop

Use role-based exercises drawn from employees' work. Teach reviewers to verify sources, recognize limitations, and assess fairness where outputs affect people. Name a reviewer wherever a hallucination could reach a customer, and give that person authority to reject the output. As regulatory context, the EU AI Act's AI literacy provisions became applicable on February 2, 2025.

6. Review on a schedule

Set a regular cadence and review significant changes between meetings. Continuous monitoring should track incidents, new integrations, settings changes, and overdue corrective actions. Define oversight mechanisms and the explanations higher-risk uses need; explainability is not established by asking a model to justify itself. Agentic AI can take actions, raising the stakes: limit its authority and require approval for consequential actions.

Decision rights for generative AI governance

Name one accountable owner, supported by a small group representing IT or security, legal or compliance, and the business. Roles may overlap, but authority should be explicit.

Define three decision rights: who approves a tool, who grants an exception, and who signs customer questionnaire answers. Route sensitive-data decisions to the appropriate security or legal reviewer. Have the executive sponsor resolve disagreements and accept material residual risks.

Set expiry dates on exceptions and retain the decision record. Accountability becomes practical when employees know where to ask, reviewers know what they can approve, and leadership can see unresolved issues.

How the framework maps to NIST AI RMF, the EU AI Act and ISO 42001

The NIST AI Risk Management Framework and the other references below serve different purposes.

ReferenceWhat it isStatusWhere it can enter a buyer conversation
NIST AI RMF 1.0Voluntary framework with Govern, Map, Measure, and Manage functionsReleased January 26, 2023; NIST reports a revision in progressVocabulary for describing the program
NIST AI 600-1Voluntary Generative AI Profile with 12 risks and suggested actionsPublished July 26, 2024A reference for checking risk coverage
EU AI Act, Regulation (EU) 2024/1689 as amended by Regulation (EU) 2026/1744Risk-based law with prohibitions and transparency provisionsIn force August 1, 2024; generally applicable August 2, 2026, with exceptions. Annex III high-risk rules: December 2, 2027; regulated-product high-risk rules: August 2, 2028Questions involving EU operations or customers
ISO/IEC 42001:2023AI management system standard organizations can be certified againstPublished December 2023Requests for independent management system certification

As a practical crosswalk, ownership, policy, and training support Govern; inventory and risk classification support Map; testing and review support Measure; and corrective actions support Manage. This is an organizational mapping, not a finding of regulatory compliance.

General-purpose model obligations began August 2, 2025; transparency provisions began August 2, 2026. US state AI laws add another layer to check by jurisdiction. Framework alignment does not establish which laws apply to a company or replace an assessment of compliance.

This is general information, not legal advice.

Where generative AI governance stalls

Watch for five gaps that can undermine GenAI controls:

  • A policy with no inventory behind it: nobody knows which tools the rules cover.
  • A blanket ban without approved alternatives: employees may work around it.
  • A one-time document: settings and uses change while the rules stay fixed.
  • No named owner: intake decisions and incidents wait for someone to act.
  • Forgotten embedded features: oversight misses GenAI inside existing software.

To mitigate risks, connect each rule to an owner, a workflow, and a record. Responsible innovation needs a usable approval path as well as restrictions. Check whether staff understand the guardrails before adding another policy document.

Where to start with generative AI governance in the first 90 days

  1. Name an accountable owner and an executive sponsor. Agree on how unresolved decisions will be escalated.
  2. Run the inventory across departments, including embedded features and experiments. Record what remains unknown.
  3. Issue an interim acceptable-use policy while vendor reviews continue. Make approved options easy to find.
  4. Tier your ten most common use cases and address the highest-priority gaps first. Complete deeper assessments where warranted.
  5. Set the first review date and draft a standard customer questionnaire answer supported by current records.

Treat 90 days as a planning window, not a promise of completed compliance. The work should leave your team with decisions it can explain and evidence it can keep current.

Running the program without hiring for it

If your team lacks capacity to run the work, Greenplaces offers a managed program covering use-case inventory, risk classification, data governance, tool intake, acceptable-use policy, and training. Its AI governance framework support connects those activities with relevant references.

Greenplaces combines Big 4-credentialed expert support with its platform and offers an Annual AI Trust Review. Relevant controls and evidence can also support SOC 2 readiness, subject to the examination's scope; they do not make AI governance and SOC 2 interchangeable. Establish which tasks Greenplaces will handle and which approvals and responsibilities remain with your company.

Turn the next AI question into a clear plan

A customer questionnaire has an AI section, or a board member wants to know who owns the answer. Start with that request and the tools employees already use.

Bring the questionnaire, existing policies, and known AI tools to Greenplaces. Map the controls and evidence you already have, the gaps behind each request, and who will own the work.

Book a strategy call.

Last updated November 20, 2026

Frequently asked questions

What is generative AI governance?

It is the rules, responsibilities, and records governing how a company uses GenAI tools. It covers tool approval, information sharing, output review, and ongoing oversight, including when the company uses third-party services.

What are the goals of an AI governance framework?

The goals are to make AI use accountable, protect information, manage foreseeable harms, and support appropriate business use. A framework also helps teams explain their decisions and produce evidence for customer and leadership reviews.

Can you give an example of AI governance?

A firm approves an enterprise assistant for drafting proposals, prohibits unapproved client information, and assigns an account owner to verify claims before release. The inventory, approval conditions, training records, and sign-offs show how the controls operate.

When should a company block a generative AI tool?

Block or pause a proposed use when its risks exceed your acceptance criteria. Examples include inadequate protections for confidential inputs, missing access controls, or consequential output with no qualified review; an approved tool need not be approved for every task.

How does generative AI governance affect data privacy and security?

It defines what information a tool may receive, who can access it, and how long records are retained. Vendor review, configured safeguards, and an incident process help the company manage exposure across the workflow.

Who should own generative AI governance?

Name one accountable operational owner with executive backing. IT or security, legal or compliance, and business leaders should contribute defined expertise, with clear authority for approvals, exceptions, and customer responses.

Carbon Copy

Get the next issue in your inbox.

One email a month on what changed in sustainability, trust and AI governance, and what it means for your company. See what's inside

See your full compliance picture.