Choosing an ODD Provider: What actually matters
ODD providers can look remarkably similar in a proposal.
Experienced professionals, comprehensive coverage, established methodologies and detailed reporting are all easy to demonstrate and all worth having. They are much less useful in showing what the relationship will feel like when a difficult review produces evidence that does not fit neatly together.
That is where provider selection becomes more interesting.
An institutional investor is not simply appointing someone to collect manager information. It is deciding how much reliance it will eventually place on another organisation's professional judgement about managers to which it allocates capital and delegates investment decisions.
The selection process should test for that.
Look beyond coverage to what the provider does with it
A methodology document can cover governance, compliance, operations, technology, valuation, cybersecurity, business continuity and service providers. A sufficiently long DDQ can ask about almost anything.
Coverage matters because an issue cannot be identified if nobody looks for it. But breadth alone says little about what happens after the answers arrive.
In live ODD, the more difficult situations often begin with evidence that is untidy rather than obviously bad. A policy allocates responsibility clearly, while two senior people describe the arrangement differently. A control looks well designed, but there is limited evidence that it has operated as intended. Several observations appear minor individually but begin to suggest the same organisational dependency.
The provider needs a way of deciding what deserves more attention and what does not.
That is a more revealing subject for a procurement conversation than DDQ length. Ask how contradictory evidence is handled, what makes a reviewer deepen an enquiry, and how something moves from an interesting observation to a material conclusion.
A provider whose usual answer is simply “ask for more information” may be thorough. It does not yet tell you how the information becomes judgement.
A good delivery model does not depend on one senior person doing everything. It makes sure that experience is available precisely where the review stops being routine.
Find out where experience actually enters the review
Claims about senior involvement deserve some scrutiny.
ODD contains plenty of work that does not require the most experienced professional in the team. Documentation has to be reviewed, information organised and follow-ups managed. A model in which senior people perform every task would be expensive and difficult to scale.
The important issue is whether experience is close enough when interpretation becomes difficult.
Those moments are not always predictable. An interview changes the significance of something that looked routine. A senior departure turns an existing dependency into a more important one. Evidence requested for reassurance instead raises a different question.
A buyer should therefore understand who conducts the important interviews, who decides when a line of enquiry has become material, who resolves competing interpretations and who ultimately owns the conclusion.
The distinction is between senior oversight of a process and experienced judgement inside the process.
A good delivery model does not depend on one senior person doing everything. It makes sure that experience is available precisely where the review stops being routine.
See whether the provider can change its mind
Easy cases are not particularly useful for testing an ODD methodology.
The more revealing question is how the provider behaves when its initial interpretation proves incomplete.
An apparently concerning arrangement may turn out to be well controlled once operating evidence is understood. A reassuring policy may look less convincing after interviews reveal that responsibility works differently in practice. Good diligence has to allow both outcomes.
If every interview confirms the DDQ and every additional document reinforces the initial narrative, the process can become confirmatory rather than investigative.
Evidence should be capable of moving the ODD provider’s judgement. That principle is central to a more mature evidence-led ODD model, particularly because complete observation of an organisation is structurally impossible.
This also applies to uncertainty. A provider should be able to distinguish an elevated operational risk from a conclusion that is simply supported less securely than it would like.
Not every remaining uncertainty needs to become a finding, and not every reassuring conclusion deserves the same confidence. Being explicit about what is known, what is supported and what remains uncertain makes judgement more transparent rather than weaker.
A buyer should be more comfortable with a provider that can explain the limits of its conclusion than one for whom uncertainty always seems to disappear before the report is issued.
The aim is to make professional judgement more transferable without trying to standardise it away.
Look for consistency in the reasoning
Provider selection also needs a longer-term perspective.
The institution is unlikely to buy one isolated ODD review. Over time it will accumulate conclusions across managers, strategies and reviewers. Those conclusions need to remain reasonably coherent.
That does not mean different managers should receive identical treatment. Nor should every reviewer reach the same conclusion.
But broadly similar evidence should be subjected to broadly similar reasoning and thresholds for escalation. If two reviewers treat comparable dependencies very differently, there should be an understandable reason rooted in the operating context rather than simply personal preference.
The aim is to make professional judgement more transferable without trying to standardise it away. Lestrade's underlying positioning describes comparable judgement in exactly these terms: distinguish meaningful differences through a consistent framework without forcing different organisations into identical conclusions.
This matters more as the relationship grows. A provider that produces excellent work through the instincts of one exceptional individual can still leave the client with a fragile model.
The methodology should make experienced judgement more reliable, not make the entire service dependent on one person's judgement.
Treat the working relationship as part of ODD quality
Analytical quality should dominate the selection decision, but it is not the only thing the investor will experience.
Reviews need co-ordination. Managers need engagement. Information has to move between organisations. Questions need resolving and conclusions need to enter the investor's governance process.
A theoretically excellent provider that requires heavy internal project management can release much less capacity than expected. Similarly, a sophisticated report that has to be translated by the internal ODD team before an investment committee understands what matters has not quite completed the job.
Manager interaction deserves attention for the same reason.
ODD must contain challenge. Difficult questions should not be avoided for the sake of a comfortable relationship. But rigour and unnecessary adversarialism are different things. Managers are an important source of evidence about how their organisations actually operate, and professional engagement can produce better explanation and therefore better evidence than a process designed primarily to demonstrate toughness.
This is why low-friction execution should not be treated merely as customer service. The intended institutional experience is rigorous without being adversarial, structured without being bureaucratic and independent without being disruptive.
Select for reliance, not presentation
The strongest provider may not have the longest questionnaire, the largest team or the most elaborate methodology deck.
What matters more is whether the institution can understand and challenge its conclusions; whether experienced judgement enters the review when ambiguity matters; whether evidence can genuinely change the assessment; whether similar situations receive reasonably coherent treatment; and whether the relationship fits into the investor's operating model without creating another layer of work. These are also the core selection principles contained in the original provider material.
Those characteristics are harder to establish during procurement than headcount or scope.
They are also much closer to what the investor will eventually depend on.
Choosing an ODD provider is therefore ultimately a decision about whose professional judgement the institution is prepared to rely on — while still being able to understand and challenge it.
Reviewing your ODD model or external providers? Talk to Lestrade.
