Hiring fractional leadership is unusually hard to evaluate. There's no reference class you know well, the engagement is short enough that a bad fit costs a quarter, and most candidates interview well because interviewing is adjacent to the job.
These twelve questions surface the difference. For each one, what a strong answer sounds like.
Scope and fit
1. Based on what I've told you, what would you do in the first two weeks?
Strong: diagnosis before prescription — sitting in existing forums, looking at where engineering time goes, talking to customers. Weak: a plan that could have been written before the call.
2. What would make you tell me I don't need a fractional CPO?
Strong: a real, specific list — you need execution capacity not leadership, you're pre-product-market-fit, you need a full-time person. Anyone who can't describe a scenario where they'd decline is selling, not diagnosing.
3. Which parts of this are you not going to cover?
Strong: explicit boundaries — not managing a large org, not always-on escalation, not replacing PM capacity. Vagueness here becomes a disagreement in month two.
Track record
4. Tell me about a company where your engagement didn't work.
Strong: a concrete account with their own contribution to it named. Everyone has one. "None come to mind" means either inexperience or a lack of candor, and both are expensive.
5. What did you own, specifically, at the last two companies?
Listen for scope precision and first-person detail. Operators say what they decided; advisors say what the team did.
6. What's still in place at a company you left a year ago?
This tests for durability. Changes that survive the leader's departure are the ones that were built into how the company operates rather than sustained by the leader's presence.
Operating approach
7. How do you handle it when the founder and the data disagree?
Strong: a real method — clarifying what would change either view, running a small test, or escalating explicitly. Both "I defer to the founder" and "I follow the data" are answers from someone who hasn't done this often.
8. What's your prioritization framework, and when do you abandon it?
The second half is the question. Anyone can name a framework. Knowing when a framework's assumptions don't hold is the actual skill.
9. How will my existing PMs be different in three months?
A fractional leader who doesn't mention developing the team is planning to become a dependency.
The best signal in these conversations is specificity. Real operators reach for particular companies, particular constraints, and particular decisions without being pushed to.
Logistics
10. How many other clients do you have, and what's your response time?
Multiple clients are normal and fine. Evasiveness about capacity is not. You want a number and a stated availability window.
11. What does the exit look like?
Strong: a defined transition — documented operating norms, a recommendation on what to hire next, a wind-down rather than a cliff. Engagements with no exit plan tend to drift into indefinite retainers.
12. What do you need from me for this to work?
The best answers are demanding: decision authority, access to customers and data, a named internal counterpart. Someone who needs nothing from you has planned to operate at the edge of the company, where nothing changes.
Red flags
- Guaranteed outcomes on a timeline. Product doesn't work that way and experienced people know it.
- No questions for you about constraints, budget, or team composition.
- Frameworks and methodology in place of specific operating stories.
- Unwillingness to name what's out of scope.
- Pressure to sign before you've had a working session together.
One more thing worth doing
Before the conversation, get clear on what you're actually buying. The cost calculator compares fractional against a full-time hire on your numbers, and the diagnostic gives you a structured read on which parts of your product function are weakest — which makes question one considerably easier to evaluate.