Case study · Competitive intelligence

The competitor sheet that set the build agenda

40+ products, four capability categories, refreshed quarterly. It stopped being a document and became the thing teams consulted before prioritising — and four roadmap items came out of it, one of which now generates revenue.

My role
Owner — research, structure, quarterly refresh
Coverage
40+ products · 4 categories
Cadence
Refreshed quarterly
Outcome
4 roadmap items · 1 revenue add-on
The problem

Everyone had an opinion about the competition; nobody had a source of truth

Cadmus doesn't have one competitor, it has four different kinds.

Before

Every conversation about “what the market does” was really a conversation about whichever product the speaker had seen most recently.

Assessment delivery

Platforms that run the assessment itself — authoring, sitting, submitting.

Specialist assessment tools, exam platforms

Administration

The LMS layer that owns the course, the cohort and the gradebook.

Canvas, Moodle, Blackboard

Student writing support

Tools that help students produce the work — drafting, referencing, feedback.

Writing assistants, referencing tools

Academic integrity

Similarity detection, AI detection, proctoring and process assurance.

Turnitin, Inspera, ProctorU
False alarm

Worrying about a “competitor” operating in a different category entirely.

Missed gap

Missing a real gap because the product holding it wasn't the one anyone was thinking about.

Both

Prioritisation errors caused by a missing artefact, not by bad judgement.

Method

How you actually find out what a product does

Marketing pages describe intent; feature lists describe ambition. Neither tells you if a capability is usable.

1
Booked sales calls with competitors

The most direct route to a real demo. A vendor's pitch shows what they lead with and what they avoid — neither is on the website.

2
Product demos and recorded walkthroughs

Published demos and user-recorded walkthroughs, which often reveal the awkward parts of a workflow that an official demo skips past.

3
Full documentation sweeps

Support docs and help centres are the honest version of a feature list — they describe limitations because they have to answer real user questions.

4
Hands-on where possible

Where a product could be accessed directly, I used it as an academic would — the approach that produced the Smart Comments differentiator.

Structure

Any team could filter to their slice — group assessment only, integrity only — instead of reading 40 products to answer one question. A reference nobody can navigate gets rebuilt from scratch every time.

Why quarterly

The refresh is what makes it an instrument rather than a document. A stale comparison is worse than none — it produces confident wrong answers.

What it produced

From spreadsheet rows to a revenue line

The test of competitive research isn't whether it's thorough — it's whether anything is different because it exists. Here's the chain.

40+
products mapped

Full landscape across four categories, refreshed quarterly and structured so any team could filter to their own question.

4
roadmap items originated

Group assessments, vivas, Smart Comments and multimedia submissions — four capability gaps the sheet exposed that became real roadmap commitments.

2
I owned end to end

I took Smart Comments and multimedia submissions from gap to shipped feature myself.

1
became revenue

Work Playback — the sheet showed Turnitin Clarity leading on submission replay. Sales asked for it, I pitched and delivered it, and it now sells as a paid add-on.

Scoping reference

Engineering was pointed here for group assessment prioritisation, filtered to the competitors that mattered.

Partner benchmark

Checking whether a proctoring provider already had an invigilator-key equivalent before we scoped ours.

Read the Work Playback case study →  ·  Read the Smart Comments case study →

Strategic use

Where to reach parity, and where not to bother

The most valuable thing a comparison gives you isn't a list of gaps to close — it's the confidence to leave some open.

Chase parity

Capabilities that decide evaluations

Where a missing tick loses a deal regardless of how good the rest of the product is. These are table stakes: you don't win on them, you only lose without them.

Secure / locked-down exams Submission replay Multimedia submissions
Double down

Capabilities where Cadmus is one of few

Categories where the sheet showed Cadmus holding a genuine, defensible position — worth investing in precisely because competitors can't easily follow.

Assessment design templates Educative in-flow nudges Integrity assurance indicators
Why it matters

A parity gap is a cost of doing business — close it cheaply. A differentiation gap is a bet worth over-investing in. Treating both the same way is how roadmaps become feature-matching exercises.

Reflection

What I'd change

Standing reference across Product, Engineering & Sales 4 roadmap items originated 1 revenue-generating add-on Quarterly refresh maintained

What I'd do differently

I never instrumented the artefact — I know it was used, but not how often, or which categories drove decisions. That would have told me where to spend refresh effort. I'd also have written the parity-versus-differentiation call into the sheet rather than carrying it in my head.

What I'd repeat

Booking the sales calls. Slightly absurd, and the single highest-yield method I used — you learn what a company thinks its own strengths are, which isn't in any documentation. It led directly to the Smart Comments insight, so the return was concrete.