How the assessment works
Here you can see what we look at in the assessment and which modules it consists of. Every team is different: we always agree the process and focus with you individually. The basic structure stays the same.
Maturity model: 9 dimensions
We assess your setup along nine dimensions, from strategy and governance to the team. Dimension 9 measures whether your setup keeps up with the weekly pace of innovation.
| No. | Dimension | Key question | Evidence | KPI / tracking |
|---|---|---|---|---|
| 1 | Strategy and governance | Are there goals, owners and an AI usage policy? | Policies, roles, budgets | Existence, definition and maturity |
| 2 | Agent setup and harness | Do agents work with rules, context and guardrails, or only with prompts? | Rule files, hooks, skills, orchestration, model routing | Orchestration, routing |
| 3 | Specification | How good are requirements before an agent starts? | Tickets, specs, definition of ready, acceptance criteria | Definition of ready, quality of acceptance criteria |
| 4 | Quality and review | How is agent output checked before it is merged? | Review process, reviewer ≠ author, coverage, mutation score | Maker/checker principle, mutation score |
| 5 | Security and supply chain | How are secrets, dependencies and risky actions controlled? | Approvals, credential isolation, egress, dependency monitoring, SBOM | Egress control, credential isolation |
| 6 | Compliance and evidence | Can you show what an agent did and when? | Audit trail, GDPR, EU AI Act, CRA, BSI C5 | Quality markers for compliance |
| 7 | Delivery and cost | Does AI make delivery faster, and what does it cost? | Lead time, deployment frequency, token cost per task | Cost per task |
| 8 | Team and roles | Have developers moved from coder to orchestrator (TAPO)? | Skills, enablement, role profiles | TAPO concept |
| 9 | Evolvability of the harness | Who maintains the setup, how quickly do new practices arrive, is it tested? | Owner, versioning, update cadence, regression tests of the rules, drift between teams | Does the setup keep up with the weekly pace of innovation? |
Scale and evidence status
| Level | Meaning |
|---|---|
| 1 Ad hoc | Individual prompts, everyone works differently |
| 2 Repeatable | Rule files per repo, not team-wide |
| 3 Defined | Team-wide rules, gates manual |
| 4 Enforced | Hooks and gates automatic, versioned |
| 5 Measured and learning | Metrics, rules regression-tested, ongoing maintenance with an owner |
Every checkpoint gets an evidence status: evidenced (artefact seen), open (statement in the interview only) or not checked. A dimension only counts as reliably assessed if at least two thirds of its checkpoints are evidenced. Otherwise the score is marked “preliminary”.
Package and process
The assessment consists of nine modules. Part A is vendor-neutral and the same for every team. Part B is optional and only follows if you want it. Together, the modules correspond to around 7.5 person-days.
| No. | Module | What happens | Person-days (estimated) |
|---|---|---|---|
| 1 | Scoping and pre-assessment | A short questionnaire in advance on all nine dimensions and the key facts of your setup | 0.5 |
| 2 | Remote pre-analysis | Read-only analysis on your machines with the BeeKeep3r Harness: test coverage, code quality, dependencies and the quality of 3–5 real tickets | 1.0 |
| 3 | On-site day | One day with your team, including a block on the lifecycle of your harness: who maintains it, and how quickly do new practices arrive? | 2.0 |
| 4 | Evaluation part A | Your report: a vendor-neutral evaluation of all nine dimensions, compact at around 10 pages | 2.0 |
| 5 | Part B: comparison with BeeKeep3r + make-or-buy | Optional: principles heatmap, make-or-buy calculation with your figures and a plan for a trial | 0.5 |
| 6 | Executive debrief | 60 minutes of results from part A, then an optional 30 minutes on part B | 0.5 |
| 7 | Anthropic question channel | We pass your questions on to Anthropic. An answer is not guaranteed. Shared only anonymised and with your written approval | 0.25 |
| 8 | Cohort benchmark and roundtable | Anonymised comparison with the other participating teams, in ranges only, and a joint roundtable | 0.25 |
| 9 | Follow-up after 6–8 weeks | Together we look at what has been implemented and, if you like, discuss a trial | 0.5 |
| Total | 7.5 |
Sounds like a fit? Apply now.
First award: 16 Nov 2026 · Application deadline: 30 Nov 2026 · Duration: 3 minutes