Fractional CMO Interview Scorecard (Copy and Score)

Interviews for senior part-time roles fail in a predictable way: every candidate sounds strategic for 45 minutes, and the decision gets made on charisma. The fix is boring and, in my experience, works: a scorecard with weighted dimensions, written anchors and red lines, agreed before the first call. Below is the one I would use to hire a fractional CMO, including against myself.

I’m Andrii Byzov, an AI-native fractional CMO for B2B tech; this scorecard pairs with my interview questions and the job description template.

Key takeaways

• Decide dimensions and weights before interviewing. A scorecard built after meeting candidates usually just rationalizes the favorite.
• Six dimensions cover the job; motion experience and diagnostic ability carry the most weight.
• Anchors beat adjectives: write down what a 1, 3 and 5 sound like, or scores drift to whoever interviewed last.
• Red lines override totals. Some answers end the process at any score.
• The paid working session provides half the evidence in my process; weight it accordingly.

The scorecard

Score each dimension 1-5 against the anchors, multiply by weight, sum. Run it identically for every candidate.

Adjust the weights to your situation (a team with no execution capacity might raise systems thinking; an AI-forward company might raise dimension 5 to 20%), but adjust them before the first interview.

Anchors per dimension

1. Motion experience.

• 5: Names two or more companies at your stage and motion, with numbers they owned and what worked and failed. References confirm.
• 3: Adjacent motion or stage; honest about the deltas and how they would close them.
• 1: Generic B2B record; cannot say how your motion differs from their last job.

2. Diagnostic ability. (Score this mostly from the paid working session.)

• 5: Asks for your funnel numbers before proposing anything; finds a constraint you had not articulated; sizes it.
• 3: Sensible questions, reasonable hypotheses, stops short of committing to a ranked diagnosis.
• 1: Arrives with a deck of tactics; the word “depends” never gets a follow-up question from them.

3. Systems thinking.

• 5: Shows an artifact a past client still uses: a playbook, dashboard, briefing system. Talks in cadences, not campaigns.
• 3: Describes systems credibly but cannot show one (NDAs are a fair reason; references can confirm instead).
• 1: Talks output (“we shipped 40 posts”) with no machinery behind it.

4. Leadership communication.

• 5: Gives a concrete story of disagreeing with a CEO, how it resolved, and a quarter where they reported bad numbers early.
• 3: Communicates clearly; conflict stories stay abstract.
• 1: Has never disagreed with a client, or every failure story blames someone else.

5. AI-native methods.

• 5: Demonstrates their actual working system (research, content production, reporting on LLM tooling) and can show before/after economics. (What this looks like.)
• 3: Uses AI tools regularly but as assistants, not as a system; honest about it.
• 1: “The team uses ChatGPT” or AI-as-slideware.

6. Engagement fit.

• 5: Days, scope, price (market context) and start date fit; contract terms are standard; no calendar gymnastics.
• 3: Workable with compromises you can name.
• 1: You would be their seventh client on one day a week.

Red lines (end the process at any total)

• Cannot name a single number they owned end to end.
• Proposes a channel plan before asking a single question about your funnel.
• Badmouths a past client by name.
• No reference available from a comparable engagement.
• Declines any form of paid working session while asking you to commit to a quarter.

How to run the process

1. Screen (30 min) against dimensions 1 and 6 only; do not score the rest yet.
2. Deep interview (60 min) using the question set; score dimensions 1-4 provisionally.
3. Paid working session (60-90 min) on your real funnel with real numbers; re-score dimension 2 and score 5 from what you observe, not what they claim.
4. References (2 minimum), at least one from a comparable stage and motion; verify dimension 3 artifacts and dimension 4 stories.
5. Score independently (everyone who met the candidate fills the card before discussing), then compare. Disagreement of 2+ points on a dimension is a signal to dig, not to average.

A candidate at 4.0+ with no red lines is worth moving fast on; senior operators with open capacity rarely stay available long. Between a 4.2 charmer and a 4.4 diagnostician, take the diagnostician; you are buying judgement, not company.

If you want this scorecard as a starting point and a second opinion on your weights, message me on LinkedIn.

FAQ

How do I score fractional CMO candidates objectively?

Use a weighted scorecard with fixed dimensions and written anchors for what a 1, 3 and 5 look like, and score every candidate against the same evidence: their answers, their audit of your funnel, and references. Deciding the dimensions and weights before the first interview is what makes it objective.

What dimensions matter most when interviewing a fractional CMO?

Six cover the job: relevant motion experience, diagnostic ability, systems thinking, communication with leadership, AI-native working methods, and engagement fit on scope, time and price. Motion experience and diagnostic ability carry the most weight in my scorecard.

What is a red line in a fractional CMO interview?

Answers that end the process regardless of total score: cannot name a number they owned, proposes tactics before asking about your funnel, badmouths past clients, cannot produce a reference from a comparable engagement, or refuses any form of paid working session.

Should I do a paid working session before hiring a fractional CMO?

Yes. A paid 60-90 minute session on your real funnel is the highest-signal step I know of: you see actual diagnostic behavior instead of polished narrative. Expect to pay their normal rate and treat it as the cheapest insurance in the process.