Should we build or buy — and who controls our AI providers?
Baseline: 4Enhanced: 5Advanced: 110 controls
Who it applies to
Enter for every AI system. Some of its controls apply only where you use the system as delivered (B1). Go as deep as your system letter, and implement in your mode.
Why it exists
Most organisations that adopt AI do not build it; they buy it. Let that fact decide where you concentrate your effort. When you buy an AI solution instead of building it, you are not only outsourcing the work — you are handing another company control over the parts of the system that matter most: the model itself, the data it learned from, how often it changes, and the ways it can go wrong. You will not see inside any of them. Treat the choice of whether to buy at all, and of which supplier, as governance decisions in their own right, not as a procurement formality to be settled by whoever moves first.
Decide whether you will build or buy before you speak to any supplier, because that decision does more than choose a vendor: it fixes what you are responsible for. If you buy a finished AI service and use it as delivered, you are a consumer, and your obligations are mainly about choosing and overseeing the provider. If you take someone else’s model and integrate, configure, or connect it into your own systems, you are a deployer, and you become responsible for how it behaves in your context. If you train a model, or adapt one substantially to your own data — the activity usually called fine-tuning — you are a developer, and you carry the full weight of building AI, including responsibility for the training data and for the model’s behaviour. Write down which of the three you are. Teams slide from buying into fine-tuning without noticing they have become developers, and at that moment every safeguard that assumed they were only a buyer quietly stops applying.
Your existing supplier checks were written for ordinary software and will not protect you here. They ask whether the vendor is financially stable, holds security certifications, and will sign an acceptable contract. None of that tells you whether the provider is quietly using your data to improve its model, where your data is actually processed at the moment the model answers, or whether the provider can replace the model overnight and change how it behaves. Those are the questions that decide your real exposure. Ask them before you sign, not after an incident forces you to.
Weigh six things before you decide to build or buy
No single factor settles the decision; the balance among these six does, and they often pull against each other. Work through all six and record where they land.
Count the total cost of ownership, not the headline price. The comparison is not a licence fee against a salary. Buying carries recurring running costs, the cost of the safety checks and monitoring you must place around a system whose inside you cannot see, and the eventual cost of leaving. Building carries the far larger and less visible costs of gathering and cleaning data, hiring scarce specialists, running the infrastructure, and — the part most build decisions forget — keeping the model working long after launch, because a model must be retrained as the world it was built for changes. A plan to build that looks cheap per use usually stops looking cheap once these are counted.
Be honest about whether you have the data, the skills, and the time to build. Building is only a real option if you already hold data of good enough quality and quantity, employ the specialists who can turn it into a model, and can wait for that investment to pay back. Most organisations overestimate all three. An honest answer often removes building from the table — which is a good outcome, because it stops an organisation without the means from taking on the heavy obligations of a model builder it cannot meet.
Compare the regulatory exposure of each path, because it is not the same. Buying can inherit the provider’s compliance position: reassuring if the provider is well run, dangerous if its data practices or the sources it trained on are unclear or disputed. Building makes you directly answerable for the lawfulness of your training data, the defensibility of your model’s decisions, and the completeness of your own evidence to a regulator. The easier path to engineer is frequently the harder path to defend. Weigh both, not just the one you find easier.
Check that the choice fits how your organisation actually runs. A model you build but have no team to operate, or a service you buy but cannot connect to your existing controls and identity systems, is the wrong choice whatever it costs. Judge the decision against how your organisation works today, not against an ideal future state you may never reach.
Compare the privacy exposure of each path. Buying usually means sending data — including, unless you prevent it, personal and confidential data — to an outside party whose retention and reuse of that data you must limit by contract and by technical means. Building keeps the data inside, but gathers a large and sensitive store in one place and creates its own duties around lawful use, keeping only what you need, and deleting on request. ‘Internal is safer’ is not the answer; assess both exposures on their merits.
Price the vendor lock-in and the cost of leaving. Building your operation around a single AI provider is cheap to start and expensive to escape: your prompts, your adaptations, your testing, and your staff’s know-how all gather around one provider’s model until moving away becomes impractical. Some organisations are already required to plan for this. Financial firms subject to the European Union’s digital operational-resilience regime (DORA), for instance, must keep a documented exit strategy and an exit clause for their critical technology providers, precisely so that the failure or withdrawal of one supplier cannot strand them. Even where no law compels you, adopt the same discipline whenever an AI capability comes from a single provider: agree, before you commit, how you would move away and what that would cost. A lock-in accepted without pricing the exit is a liability the board owns, not the team that signed the contract.
Know what your chosen path obliges you to do
Once the decision is made, the path you chose imposes a fixed set of guarantees. These are not preferences to weigh; they are the minimum you must secure.
If you buy, secure these before go-live. Confirm the provider will not use your data to improve its model unless you explicitly allow it. Establish, and accept, where your data is processed when the model runs. Obtain a contractual right to be warned before the model changes. Establish how you would get your data and settings back out, and what leaving would cost. Confirm who owns whatever the service produces for you and on what terms you may use it. And put the provider under ongoing oversight for as long as you depend on the service.
If you build or substantially adapt a model, your own team must secure these. Confirm the data you train on is lawful to use and its origin is documented. Ensure you can explain and defend the decisions the model makes. Confirm you have the people and the budget to run and maintain the model after launch, not merely to build it — the cost that is most often underestimated. And accept, in full, the security and testing duties that fall on anyone who builds AI (set out in the Technical Security domain).
Assess the provider before you buy — put the questions in writing
Do not rely on the provider’s sales material or on a generic security form. Assess the governance, security, and data handling of the product you are about to acquire, and do it by putting specific questions to the provider in writing and recording the answers. Ask, at a minimum, whether they train on your data, where your data is processed, whether and how they will warn you of a model change, how they test the model against attack, and how you would leave. The example below shows the shape such a questionnaire can take; treat an evasive or missing answer as a finding in its own right, not as a box left blank.
An example AI supplier due-diligence questionnaire. Issue it to any provider of an AI product, model, or service before onboarding, and keep the responses on file.
Put the model-change warning in the contract, and do not let it be dropped
A provider can replace the model behind the same connection without telling you, changing how it answers while nothing in your own systems has changed — reopening a weakness you had closed, or breaking a check you had validated. Require, in writing, that the provider warn you in advance of any replacement or material change to the underlying model, so that the change becomes an event you can prepare for and re-check, rather than a surprise your users discover for you.
Bring free models and marketplace agents inside the same checks
A model you download at no cost, or an autonomous ‘agent’ you obtain from an online marketplace, is still a supplier — with an origin, a licence, and an integrity you cannot take for granted — even though no salesperson was ever involved. Before you use one, establish where it came from, what its licence permits you to do, and that it has not been tampered with. Do not let the absence of a contract place it outside your supplier governance.
If you use AI exactly as delivered, own its settings. A service you did not build still has settings that decide what happens to your data and when the model underneath it changes. Set them deliberately, and keep watching the provider’s notices: for a consumer, that is where most of the control actually lies.
Controls
Baseline4 controls
Control 38
Configure the provider’s data settings for every AI service you use as delivered.
BaselinePreventiveconsumerper system
What it is
Switch off training on your data where the provider allows it, set the shortest retention that serves the use, and record the settings chosen.
How to implement it · Minimum rules
Training on your data: off wherever the plan allows; if it cannot be switched off, restrict what goes in
Retention: the shortest period the use needs; disable conversation history where it serves no purpose
Provider human review and sharing of your content: opt out where offered
Apply settings at organisation or administrator level where possible, so they cover every user
Record per service: setting, value chosen, date, who set it
How to start
Open the privacy settings of your most-used AI service, switch off training, set retention, and write down what you chose.
Evidence
A record per service of the settings chosen, with date, author and a screenshot.
Mode: light / standard / full
light
The person who manages the subscription sets them and records them in a shared spreadsheet with screenshots.
standard
IT applies the settings centrally and records them in the AI inventory entry for each service.
full
The platform team enforces them centrally and checks for drift at each inventory review.
Control 39
Follow the provider’s notices of model and terms changes, and record them.
BaselineDetectiveconsumerper system
What it is
A named person reads the provider’s change notices; a change of model or of data terms is recorded in the inventory and triggers the re-checks your uses require.
How to implement it · Steps
Name one person per service to read the provider's release notes, terms updates and administration messages
Subscribe a shared mailbox to each provider's change channels
Check the provider's change pages at least monthly for anything the email missed
Log each relevant notice: date, service, what changes (model, data terms, location), action needed
On a change of model or data terms: update the inventory entry and re-run the checks your uses rely on
How to start
This week, name the person and subscribe a shared mailbox to the change notices of every AI service you use.
Evidence
The change-notice log, with the inventory updates and re-checks each change triggered.
Mode: light / standard / full
light
The owner-manager or a named employee reads the notices and keeps the log in a spreadsheet.
standard
IT keeps the log in the ticketing system with a re-check task per change.
full
Vendor management collects notices and routes each change to the system owner with a deadline.
Control 40
Record the build-versus-buy decision, and the role it puts you in, before approaching any supplier.
BaselinePreventiveall rolesper system
What it is
This is the decision that activates the correct set of obligations for the rest of the framework, so it must be made deliberately and kept on file.
How to implement it · Minimum structure
Use case and the system it concerns
Path chosen and the role it creates: use as delivered (consumer), integrate or configure another's model (deployer), train or adapt one (developer)
Six factors, one line each: total cost including exit; data, skills and time; regulatory exposure; operational fit; privacy exposure; lock-in
Obligations the role activates, e.g. provider oversight for a consumer, training-data duties for a developer
Decision-maker, date, and the rule that any move into fine-tuning reopens the record
How to start
Before the first supplier call, fill in a one-page decision record for the use case and have the system owner sign it.
Evidence
The signed decision record stating the role, filed with the system's inventory entry.
Mode: light / standard / full
light
The owner-manager completes a one-page template and keeps it with the inventory spreadsheet.
standard
The system owner prepares it with IT and the AI committee approves it.
full
Architecture, procurement and risk contribute; the committee approves it before supplier contact.
Control 41
Issue an AI due-diligence questionnaire to every AI supplier and retain the answers.
BaselinePreventiveall rolesper system
What it is
Cover data use, location of processing, model change, security testing, and exit; an unanswered question is an open risk, not a closed item.
How to implement it · Minimum structure
Data use: do you train on or reuse our data; can it be switched off; how long is it kept
Processing location: where data is processed and stored, including subcontractors
Underlying models: which models the service uses, who provides them, where they run
Model change: will you warn us in advance, and how
Security testing: how and how often the model is tested against attack
Exit: how we get our data and settings back, at what cost
Handling: log every evasive or missing answer as an open risk with an owner
How to start
Prepare a one-page questionnaire with these questions and send it to the AI supplier you depend on most.
Evidence
The completed questionnaire per supplier, with unanswered points logged as risks.
Mode: light / standard / full
light
A named person sends it; if the provider will not answer, fill it in from its published terms, citing the page.
standard
Procurement issues it at onboarding; IT reviews answers.
full
Vendor management scores the answers and feeds gaps into the provider risk assessment.
Enhanced5 controls
Control 42
Require in the contract that the provider not train on your data without your permission, and that the place of processing be disclosed.
EnhancedPreventiveall rolesper system
What it is
These are the two exposures a standard procurement contract leaves silent.
How to implement it · Minimum structure
No-training clause: inputs, outputs and derived data are not used to train or improve any model without your prior written permission
Scope: binds the provider, its subcontractors and any underlying-model provider
Place of processing: countries or regions where data is processed and stored, including when the model answers
Change of location: advance notice and a right to object or terminate
Breach of either commitment treated as a material breach
How to start
Check each current AI contract against these two points and request an amendment or data-processing addendum for every gap before renewal.
Evidence
The signed contract or data-processing terms with both clauses identified.
Mode: light / standard / full
light
Accept the provider's standard business terms only if they already contain both commitments, and keep a copy of those pages.
standard
Procurement and legal insert a standard clause in every AI contract.
full
Legal maintains a clause library with these as non-negotiable minimums; any deviation needs risk approval.
Control 43
Require a model-change warning clause in every AI supply contract.
EnhancedPreventiveall rolesper system
What it is
Without it, you have no trigger to re-check the system before a silent change reaches your users.
How to implement it · Minimum structure
Material change: new or replaced underlying model, or changes to safety filters or behaviour-affecting configuration
Notice period: e.g. at least 30 days before a material change; immediate notice for emergency security changes
Notice content: what changes, when, expected effect
Testing window: access to the new version before it replaces the current one
Remedy where negotiable: stay on the previous version for a period, or terminate without penalty
Named recipient on your side for the notices
How to start
List which current AI contracts lack a model-change warning; add the clause to every new contract now and to the others at renewal.
Evidence
The contracts containing the clause, and a list of those still lacking it with renewal dates.
Mode: light / standard / full
light
Look for an advance-notice commitment in the provider's standard terms; where absent, ask for it in writing.
standard
Procurement adds a standard clause and the system owner is named as recipient.
full
Legal holds it as a mandatory minimum and notices feed the re-testing process.
Control 44
Fix, in the contract, who owns the outputs and how you exit — and know the exit cost before you commit.
EnhancedPreventiveall rolesper system
What it is
An exit accepted without a price is a lock-in the organisation cannot see until it is trapped.
How to implement it · Minimum structure
Output ownership: who owns code, text, designs and improvements produced for you, and your rights to use, modify and redistribute them
Data return: prompts, configurations, adaptations and logs returned in a usable format within a fixed period after termination
Deletion after exit, with written confirmation
Notice and transition support if the provider ends or withdraws the service
Exit-cost estimate before signing: migration, re-testing, retraining staff, parallel running, lost adaptations — approved by whoever signs
How to start
For the next AI contract, write a one-page exit-cost estimate and negotiate the ownership and exit clauses before signature.
Evidence
The contract clauses and the signed exit-cost estimate.
Mode: light / standard / full
light
The owner-manager checks the provider's terms on ownership and data export and notes a rough exit cost before subscribing.
standard
Procurement and legal negotiate the clauses; IT estimates the exit cost.
full
Legal, architecture and finance prepare a documented exit plan and cost for each critical provider, approved before commitment.
Control 45
Assess and document each provider’s risk in proportion to how critical the systems relying on it are.
EnhancedPreventiveall rolesper system
What it is
Refresh the assessment whenever the provider or the dependency materially changes.
How to implement it · Steps
Rate the criticality of the systems relying on the provider: what breaks, for whom, how fast, if it fails or leaves
Set depth by criticality: low means questionnaire review; high adds supporting evidence, contract review and exit analysis
Assess data handling, security, model-change practice and operational resilience
Record risks, rating, treatment and owner
Refresh on material change: new owner, model or terms, a provider incident, or a new critical use
How to start
List your AI providers, mark those supporting critical processes, and assess the most critical one first.
Evidence
A risk assessment per provider showing criticality, depth applied and the date and trigger of the last refresh.
Mode: light / standard / full
light
A named person keeps a short assessment per provider in a spreadsheet, deeper for the critical ones.
standard
IT and procurement assess with a standard template and the committee reviews high-criticality providers.
full
The third-party risk function runs tiered assessments and links results to the risk register.
Control 46
Apply the same origin, licence, and integrity checks to free models and marketplace agents.
EnhancedPreventiveall rolesper system
What it is
The absence of a contract does not place a dependency outside your governance.
How to implement it · Minimum rules
Origin: obtain only from the publisher's official page or a source the organisation has approved; record publisher and version
Licence: record what it permits (commercial use, modification, redistribution, restrictions); do not use a model with an unclear licence
Integrity: verify the published checksum or signature; prefer file formats that cannot run code when loaded
Agents: review requested permissions, tools and connections; grant only what the use needs
Register it in the inventory with an owner; no use until the checks pass
How to start
Find the downloaded models and installed agents already in use and run the checks on each.
Evidence
Inventory entries recording origin, licence and integrity check for each free model or agent.
Mode: light / standard / full
light
One named person runs the checks before anything is installed and notes them in the inventory spreadsheet.
standard
IT keeps an approved-sources list and checks each new model or agent at intake.
full
The platform team serves models and agents only from an internal approved repository, with automated checks.
Advanced1 controls
Control 47
Monitor suppliers across the life of the service, not once at onboarding.
AdvancedDetectiveall rolesper system
What it is
A provider’s data practices, model, and security posture all change while you depend on them.
How to implement it · Minimum rules
Calendar: reassess critical providers at least annually and others at a longer fixed interval, plus on any material change
Ongoing signals: change notices, terms updates, security incidents, outage history, ownership changes, disputes over training data
Contract performance: notice obligations met, data commitments honoured, service levels
Re-issue the due-diligence questionnaire after a material change
Findings logged as risks with owner and deadline; overdue reviews reported as an indicator
How to start
Give each provider a monitoring owner and a next review date, starting with the critical ones.
Evidence
The supplier monitoring calendar, the review records and the findings they raised.
Mode: light / standard / full
light
A named person keeps a dated review list and a news alert per provider, and reviews the critical ones yearly.
standard
Procurement runs the calendar and IT supplies incident and service data.
full
A third-party risk function monitors continuously with external feeds and reports to the risk committee.
Evidence
The recorded data settings per service and the log of provider change notices; Build-versus-buy decision records showing the chosen role; completed due-diligence questionnaires; contracts and data-processing terms including the model-change and exit clauses; provider risk assessments; supplier-monitoring records.