How to align training with strategy and evaluate its real impact

Executive overview

Training that isn't tied to organisational strategy wastes time and budget. Aligning learning initiatives to long-term goals — then measuring whether they changed behaviour — is what separates effective training from box-ticking.

The episode covers two connected topics: how to conduct a needs analysis to select the right training, and how to use Kirkpatrick's four levels of evaluation to determine whether it worked.

The core insight: training solves the problem only if you've correctly identified the problem first — and then measured whether behaviour actually changed, not just whether people enjoyed the session.

Linking training to strategy

• Strategy = long-term planning; training must serve long-term objectives, not just react to complaints.
• A common failure: training is scheduled because "we haven't done it in a while," not because it addresses a strategic gap.
• Zappos example: customer service training works because their entire business model is built around service excellence — not because they got complaints.
• Ask before commissioning any training: how does this activity tie to the organisation's overall strategy?
• Michael Porter's five forces framework is a useful starting point for understanding competitive strategy.

Conducting a needs analysis

Three steps:

1. Determine the problem — identify the key business lever that would make a significant impact if fixed. Focus on pain, not nice-to-haves. People act faster to relieve pain than to pursue improvement.
2. Affirm that it really is the problem — interview stakeholders individually (group settings can suppress honesty, especially with senior leaders). Talk to frontline employees, not just executives. Use mind mapping to surface the central issue and its downstream effects. Quantify where possible: what does high turnover cost per hire? What revenue is lost from reduced customer retention?
3. Develop and present solutions — training is not always the answer. If the underlying issue is attitudinal or cultural, training won't fix it. Knowing how to do something doesn't mean someone will choose to do it.

Two types of evaluation

Formative evaluation

• Conducted during or immediately after training.
• Measures satisfaction: did participants like the trainer, the content, the format?
• Inexpensive and common — the end-of-session survey.
• Good at detecting when something went wrong; poor at predicting long-term behaviour change.

Summative evaluation

• Measures real, lasting change after training.
• More expensive and harder to conduct; requires time to pass.
• Includes return on investment (ROI) analysis: what did we spend, and what did we get back?
• Jack Phillips is a leading expert on training ROI.

Kirkpatrick's four levels of evaluation

Donald Kirkpatrick is considered the father of training evaluation. His four levels move from surface reaction to business impact:

1. Reaction — did participants like the training? Covers trainer personality, logistics, format. Important but insufficient.
2. Learning — what knowledge was gained? Pre- and post-tests measure this. Common in compliance training (e.g. sexual harassment training with a pre/post quiz).
3. Behaviour — did participants change what they do? Common knowledge doesn't mean common practice. Observing how people run meetings before and after training is a level-three evaluation.
4. Results — did the training produce real, lasting organisational outcomes? Example: measuring salespeople's revenue for six months after training. This is the hardest level to measure but the most meaningful.

Applying the framework

• Measure the business metric before training starts, so there is a baseline to compare against.
• Stakeholder buy-in during the needs analysis phase means they are invested in the outcome and will help course-correct if results fall short.
• If training doesn't produce results, it may be that follow-up one-on-one coaching is needed to reinforce the learning.
• Fear of failure is normal; leaders who publicly commit to measurable outcomes earn more respect, not less, even when results are mixed.
• A failed training initiative that is honestly evaluated is more valuable than an untested one that gets repeated year after year.