
The Corporate Learning Factbook® 2008: The U.S. Corporate Training MarketOverview This industry report provides detailed benchmarking data on the U.S. corporate training marketplace.
| |

The Corporate Learning Factbook® 2008: The U.S. Corporate Training MarketDate Published: 1/23/2008 Author: Karen O’ Leonard (more research by Karen O’ Leonard) Industry Study Member 77
Overview This industry report provides detailed benchmarking data on the U.S. corporate training marketplace.
| |

Building Healthy Leaders July 2008
It may be a surprise to learn that the “Be, Know, Do” (BKD) model of leader development which has gained some degree of popularity in both formal and non-formal Christian leader development did not originate in the church, but in the U.S. Army.
In view of its endorsement and extensive use by such a large-scale and diverse organization whose mission wholly relies on the ongoing building of new leaders, the BKD model clearly has some degree of credibility.
There are questions, however, about the appropriateness and, most importantly, the sufficiency of this model for specifically Christian leader development. This Letter will begin to examine the BKD model as an overarching framework for understanding the goal and process of Christian leader development.
The Need for an Appropriate Goal
The very first step of designing an effective leader development strategy must be to clearly define the goal. Into what, exactly, are we trying to build the emerging leader? If our leader development efforts are successful, what they will produce? What will the leader “look like” at the end of an effective leader development process?
Thus, we must first define the “ideal” Christian leader - or, in our language, the “healthy” Christian leader. This definition of the healthy Christian leader then becomes the goal of all leader development activities. The “process” - or all the various activities that we implement to build the leader - must directly correspond to the goal and help the emerging leader move toward the goal in his development.
This highlights the extreme importance of having the right goal. If the goal is not appropriate or adequate, then the process (which proceeds from the goal) will be insufficient and the leader development work itself will not be successful.
The BKD Model as a Holistic Goal for Leader Development
The BKD model is a framework for understanding the goal of leader development. According to the Army, leaders lead others by their character, by their competence, and by their actions; therefore, effective leader development must focus on the leader’s character and values (”Be”), his competencies (”Know”), and his decisions and actions (”Do”).
Versions of the BKD model have influenced U.S. Army leadership doctrine for more than half a century, and the Army’s long-term, continuing reliance on this model is significant evidence of its robustness.
Clearly, this model provides a holistic goal, and leader development toward this goal becomes synonymous with the building of the whole person.
While the three components of the BKD model are necessarily interrelated and integrated, for the sake of clarity we will discuss each of them separately.
“Be” - Character First!
The Army sees itself as a values-based organization; therefore, the BKD model emphasizes “character-based” leadership. In addition to personal character development (in the seven main areas of loyalty, duty, respect, selfless service, honor, integrity and personal courage), the “Be” component stresses adherence to organizationally-shared values that bind together all members of the Army. This component also addresses mental, physical and emotional wellbeing.
“Know” - Know What and Know How!
The second component focuses on competencies: what a leader needs to know (in the sense of both “know what” and “know how”), in four main areas:
“Do” - Acting Well!
The last component of the BKD model focuses on the actions of a leader:
Three Levels of Leadership
In an extremely useful demarcation, the Army’s BKD model distinguishes between three levels of leadership, with each level requiring distinct capacities and skills:
Strengths
As we begin to reflect on the strengths and limitations of the BKD model, our purpose is not to critique the Army’s use of this model, but rather its use in distinctly Christian leader development.
The model has numerous strengths:
But, is it all positive?
In our next Letter, we will examine a number of significant limitations of the BKD model as a basis for the design of Christian leader development.
Source: http://www.leadershipletters.com/category/building-healthy-leaders/
We will come in and train your leaders for you, using our curriculum, our teachers, our funds and we will give you our degrees upon completion.
We will come and show you how to train. We will train you and then you will use the same materials and the same procedures and you will train others, who will then do the same with others, etc.
We will come and explore with you the basic, biblical principles of how leaders are built, and, on the basis of those principles, we will then work with you as you develop the strategies, methods and tools that you will use as you build your own leaders.
Published July 2008
To cultivate exceptional leaders, CLOs must seek changes in the delivery of executive education and collaborate with academic institutions to develop custom course content that is beneficial to both parties.
According to conventional wisdom, 70 percent of employee development happens on the job, 20 percent through formal and informal relationships with bosses and mentors and 10 percent in the classroom.
However, we are seeing a new dynamic emerge, one that suggests that 50 percent of employee development takes place through challenging job assignments, 30 percent in the classroom and 20 percent through community involvement. This theory suggests that powerful learning experiences are available everywhere and that experiential classroom instruction can be tied more closely to the job than ever before.
As a result, CLOs can no longer assume that what is in the business school brochures is all that’s available for meaningful management education. Businesses and executive education providers must work together to design and develop course content and delivery formats.
Many CEOs and CLOs remain skeptical of business schools’ ability to change and deliver programming in executive education that promotes high performance in industries, organizations and teams. They seem to believe schools are restricted to the ABC method of instruction that has been used since teaching began:
A. An educational institution offers courses according to curricula that convey subject matter knowledge in the amount and timing needed for the school to bestow various credentials.
B. An instructor has a predeveloped syllabus for the presentation of course content for each individual course.
C. Each course is presented according to that outline.
Naturally, instructors feel comfortable in that structure because it’s theirs. But if businesses are going to receive the relevant education they need to compete and succeed in the face of demographic challenges, global competition and the accelerating pace of change, it’s going to be the responsibility of CLOs to seek out changes in the delivery of the educational product and the responsibility of educational institutions to listen, question, challenge and advocate. In other words, it’s up to academic institutions and businesses to collaborate in developing and delivering content in a way that will have an immediate and lasting impact.
At first blush, this sounds like a revolutionary concept. But all it really means is that we have to communicate with each other. CLOs need to be clear about their needs, scope and parameters, and educational providers need to understand CLOs’ needs and buying criteria. They have to establish honest, business-like relationships based on two-way communication.
Once this is achieved, businesses can access a university’s research-based content and a learning environment that provides a safe place to think and act differently. More importantly, they can access instructors who facilitate participants’ learning using their own experiences, as well as external perspectives — instructors who challenge participants to think broadly and innovatively, enable them to reconnect with fundamentals and a wider set of purposes and promote reflection and reassessment.
All this fosters courage and openness to change, which after all is what businesses are looking for to survive. But schools also need this interaction. When CLOs and university providers can communicate well, business schools serve the business community in immediate as well as long-term ways, and this contributes to the schools’ relationships, reputations and revenues. I have seen this put into practice where the school and its business client become reinvigorated by the possibilities.
Learner-Driven Teaching Methods
One executive education provider offers a number of leadership courses designed to teach future managers in corporations how to be successful. A pharmaceutical company that sent many of its employees through these leadership courses came to its partnering university and asked for something “a little different.” This company wanted a two-day program that would change the way its managers thought. This is the essence of education, and it’s very different from the training in specific tasks or specialized knowledge that most companies think to provide for their employees through a school or college.
The educational institution accepted the challenge even though its leaders knew it was a departure from what they had done in the past. This approach had to do with promoting new ways of thinking within a specific organizational culture, not how to think within a specific intellectual discipline. To make this program successful, the institution had to ask the instructors to be facilitators more than teachers.
They would have to pose open-ended questions to students without having any idea what the answers might be and then respond extemporaneously to the questions posed. This made the professors participating in the program understandably nervous, but this approach was necessary to explore the thought patterns of the employees.
Through this relatively unstructured program, the strangest thing happened: Between the first and second sessions, the professors digested and analyzed the answers they received during the first open-ended discussion, developed relevant teaching points around that analysis and on the second day offered insight and expertise that spurred additional discussions.
A day after the program ended, the two professors said they couldn’t remember the last time they were so intellectually stimulated and sought out opportunities to teach similar classes. This approach turned out to be beneficial for both the business and educational provider.
Flexible Delivery Schedules: “Spatial Learning”
Time is another reason CLOs must partner with academic institutions to develop the delivery of their learning programs. Although many companies have high-potential employees who would benefit from customized educational programs, these companies also realize they are limited in the amount of time these employees can spend away from the job in learning activities. The company’s bottom line depends on their on-the-job performance.
An executive education department at a private university’s business school faced just such a dilemma with a high-profile, high-pressure financial institution. This organization desired a leadership development program for its up-and-coming managers. The university’s representatives outlined the many programs the school offered in this area, everything from an advanced leadership program that met regularly over a nine-month period to short one- and two-day programs.
“But you don’t understand,” the company’s learning officer said. “We can’t spare two days, let alone nine months.”
“OK,” the university representative replied. “How much time can you spare?”
“Two hours. Max.”
Undaunted, the executive education department devised a concept called “spatial learning” in which curricula were developed that could be delivered in the two-hour periods the company had allocated. Then the school formed “sunrise breakfast sessions,” during which smaller groups from the company gathered to talk about the practical applications of the theories that had been presented during the general class session. These breakfast sessions helped the university supply the company with a complete course in a time frame that suited the needs and demands of that company.
Critical Mass and Global Reach
There is a high demand for leadership programs these days because companies are looking to develop a critical mass of talent ready to assume leadership responsibilities at enterprise, business-unit and top functional levels. Not only that, they also are looking for these groups of officers, executives and high-level managers to be in alignment with the organization’s overall mission and strategy and to mobilize their respective departments around the world in this endeavor.
This is another area in which CLOs and executive education providers can profitably collaborate — if they will communicate well. Here is how one firm collaborated with a business school provider to achieve the necessary critical mass, alignment and global reach:
Two years ago, a worldwide retailer of travel products and a provider of distribution and technology solutions for the travel industry enrolled seven high potentials into a yearlong advanced leadership course offered by the executive education department at a nearby university. Based on their positive experience in the public program, the company seized the opportunity. It formed a partnership with the university, in which the executive education department developed a leadership program specifically designed for one of the firm’s major operating units and the company’s corporate culture.
The university sent faculty members to the company’s headquarters so they could learn firsthand how that culture operated within the overall organizational framework. Then the faculty members designed a program that dealt exclusively with developing leaders within that organizational culture and taught it at the company’s headquarters, not the university’s campus.
Was it a success? Apparently so, because the company has since asked the university to formulate a similar program for all its units for delivery at locations in South America and Eastern Europe, each with its own specific cultural anomalies.
Specifically Tailored Course Content
The human resources department of a large company recently asked an executive education department to design a course for its personnel that had nothing to do with HR skills. It wanted a program to teach department personnel the languages of finance, accounting and marketing. Why? Because only then, the HR department head reasoned, could his personnel understand their places, their roles and their effects on the corporation’s balance sheet.
He wanted them to know where they could find the costs of such things as recruiting, hiring, training and turnover on the balance sheet and how investments in these areas would pay off. Then they would be able to determine how the changes they proposed would affect the firm’s overall success.
But why marketing? The HR director said that nine times out of 10, when the human resources department wants to initiate a new program or change an existing one, it is met with resistance. The marketing aspect of the executive education custom course was designed specifically to teach the HR professionals within that organization how to brand their offerings and effectively communicate the HR value proposition to internal customers.
Immediate Application
Whether we are talking about learner-driven teaching methods, flexible delivery formats, critical mass and global reach or developing skill in the language of business, the ultimate test of collaboration between a CLO and a business school partner is the application of new learning for the benefit of the company and the participant.
Many custom executive education programs do this by embedding projects into the program structure. The CLO needs to be clear about the firm’s overall business situation, the management development implications of its business challenges and the resulting learning agenda for the company. The business school provider must listen, question and challenge to identify and structure tangible business issues into effective learning vehicles.
When this communication occurs, a company can achieve immediate benefits from the application of learning to specific projects, as well as long-term benefits as the participants continue to apply their learning to new situations.
For example, a regional beverage distribution company wished to develop general manager skills among its sales and operations managers. The participants were divided into teams, and each was assigned a company challenge in areas such as overtime, route optimization and implementation of new information systems.
The teams had one month to research the topics and return with formal recommendations. Program instructors and the company’s top management accepted and implemented the teams’ recommendations, saving thousands of dollars and reallocating resources to new initiatives.
Using business projects as part of a customized learning experience makes it easier to assess the effectiveness of a program and the company’s return on investment. For example, it is easy to identify the number of program projects that “go live,” retain executive sponsorship and achieve their business metrics.
Getting Tomorrow’s Leaders Today
What are the leadership traits corporations need to be looking for as they enter the second decade of the 21st century? There is no one correct answer to this question. Each corporation has the right to define the characteristics of its leadership team and then turn to its educational partner and say, “Make this dream a reality.”
This is how the CEO of a Houston-based energy company defined it. She asked her executive education partner to develop a program unique to her company that would help in “developing the skills and talents required of tomorrow’s leaders.” She was very specific in what she wanted and outlined her requirements in a letter to her educational partner.
“Our culture looks to create an environment where leaders must be willing to be questioned, demonstrate vulnerability and not take things personally. In other words, good leaders need to be able to embrace change and overcome failures,” she wrote.
“Our leaders also must be able to demonstrate passion, energy, and be ruthlessly disciplined. While discipline, execution and safety are key ingredients to our success, this must be balanced with a thirst for creative ideas and a willingness to challenge the status quo.”
An off-the-shelf, straight-from-the-catalog business school course open to all will not meet the needs of this CEO or others who want to establish their next leadership generation. It is incumbent on corporations and business schools to collaborate and develop and deliver custom executive education programs that develop leaders who will assure the ongoing success of their firms.
This means CLOs must clearly articulate need, scope and outcomes, and providers must clearly express their capability, compatibility and commitment. When such open, two-way communication happens, companies can access the rigor of the academy, and business schools can access the relevance of the workplace. Together, they can develop and deliver customized educational experiences for executives that impact immediate business success and long-term business survival.
Published August 2008
Since ancient Greek times, organized competition has been an engaging way to develop skills and knowledge. With the 2008 Summer Olympic Games kicking off in Beijing this month, learning leaders can take a cue from those athletic competitions to engage learners and deliver results that last.
When you ask people what the Olympic Games mean to them, you’ll hear things such as friendly competition, breaking records, being the best, striving for perfection, winning and being honored just to compete. But the Olympic spirit goes beyond just competition and record setting. It engages the body and mind in a quest to set a lofty example and elevate the human spirit.
According to the Olympic Charter, “Olympism is a philosophy of life, exalting and combining in a balanced whole the qualities of body, will and mind. Blending sport with culture and education, Olympism seeks to create a way of life based on the joy found in effort, the educational value of good example and respect for universal fundamental ethical principles.”
As learning architects look to build effective learning models and methods that deliver results and create learning that lasts, they can take a cue from the Olympic games by creating their own learning olympics. The learning olympics model of training brings with it all the good attributes associated with the real Olympics and gives people a structured forum to learn, build teams, compete, feel challenged, have fun and experience a sense of accomplishment in one training package.
Growing up, many of us enjoyed games, everything from hide-and-seek to cards to monopoly to sophisticated video and online games. Then there are sports. The focus was on enjoyment, the experience, bonding with others and, of course, winning. If important competition was involved and prizes awarded, memories of those games often are indelibly etched in our hearts and minds. Competition is deeply embedded in our way of life. Whether you call them games, activities or events, companies are benefiting by adding more of them to their mix of training methodologies.
Learning architects can incorporate the Olympic spirit into a learning olympics that, when implemented effectively, can enhance training results and lead to significant behavioral and organizational change.
Sitting in a traditional, static classroom setting observing a trainer who is using text-saturated PowerPoint slides cannot compare to the kinetic experience of a live, team-oriented challenge in which competitive, fast-paced action and learning gets the blood rushing and the neurons firing in new ways.
Even well-designed and delivered Web-based instruction cannot generate the excitement of a set of engaging, team-based activities. Learning olympics, however, is not designed to replace valuable traditional instructional methods, but to supplement them.
Learning olympics is a training platform that appeals across generations and personality styles. The Learning olympics building blocks can be applied to just about any work discipline, including sales and marketing, customer support, engineering, manufacturing, administration, leadership, quality improvement, productivity and research and development.
Design Elements of a Learning Olympics
Making events challenging and competitive is the core of any learning olympics-type event, but so is creating an engaging learning experience. Here are other guidelines and ideas on designing learning olympics:
Events and duration: The real Olympics have numerous events in which individuals and teams compete in a variety of sports activities. In an Innovation Olympics learning event, for example, six team events each lasted two hours. This was an ideal maximum time frame to experience learning and skills and keep excitement and attention at a peak.
Depending upon goals and the activity, organizers might choose to allocate 15-30 minutes or less for each event and allow teams the choice to participate in several or all events. In the Innovation Olympics, each event built on the previous event’s learning or skills development objectives, yet was flexible and independent enough to allow people to pick and choose which events to compete in.
Setting performance and learning goals: Each event should have at least one core performance goal and one core learning goal, along with subordinate ones. For example, in one part of the Innovation Olympics, teams were given a package of wooden sticks, paper clips, string and two hot-glue guns. Their performance goal was to construct the tallest free-standing structure with the materials. The core learning goal was to develop effective teamwork focused on solving a problem. Subordinate learning goals included how to generate creative ideas, have open discussions, plan quickly and take calculated risks to achieve superior results.
Team focus: The learning olympics model lends itself to team building and teamwork. While individual activities should not be excluded, many people like to collaborate in a focused group, and many organizations want to build teams that work together effectively on multidisciplinary projects.
Scoring: Like the real Olympics, every event has criteria to score the top three winners (gold, silver and bronze). The Innovation Olympics used a point system in each of the events. For example, in the Creative Change Course (see the “In Practice” on page 36), judges used a detailed scoring sheet that involved more than 15 performance-criteria measurements based upon the goals of the event.
Rewards: Television sports journalist Jim McKay popularized the phrase “the thrill of victory and the agony of defeat” to describe the range of feelings that come from the end of a competition. In learning olympics, hype the thrill of victory, but eliminate the agony of defeat for teams that tried but missed by giving out a variety of awards.
Awards can recognize top-scoring teams, as well as the best risk-taking team, the most creative team or offbeat rewards, such as awards for the group that overanalyzed or overplanned but under-implemented or the group that had the most fun working together. There are no losers in a learning olympics.
Rewards might consist of, for example, $100 to each winning team member, gift cards to restaurants or retail stores, engraved trophies or plaques and even silly but meaningful awards such as stuffed animals that symbolize a specific desired work trait.
Recording and reliving the event: Photograph and videotape the team events and then edit the photos into creative slide shows and video clips that portray a fun and interesting story. Use customized graphics, cartoons or illustrations to deliver key messages that reinforce what participants learned.
Burn the slides and video to DVDs to give to each team member. Reliving the experience is a strong reinforcement tool. People often take pride in showing the DVD contents to co-workers, family and friends.
Fast paced and exciting: Excitement is created when participants have a deadline to meet and are challenged with constant action. Whenever possible, design some physical activity into the event, whereby participants are actively doing something, rather than passively listening or observing.
To elevate the level of excitement for participants, consider streaming the events live over the Web for others in the organization or develop a video podcast afterward. Think of other ways to raise the adrenaline level of the participants.
Side games: If you have several learning olympics events and a large group that is shuttling between activities (and have extra scheduled time in between to ensure continuity), set up small arcades of fun games to keep people involved before they enter the next event.
For example, you could have several mini-basketball games, in which people try to pitch a softball-size basketball inside the net to illustrate targeting goals.
For a sales olympics, you could give people dart guns to shoot the “competitor,” in which participants score a hit when they strike the target. The larger the group, the greater the potential and need for fun side games and prizes to keep excitement flowing.
Presentation and handouts: While a learning olympics event by itself should create intrinsic learning and skills development, consider amplifying the results by having a brief 15-minute to three-hour concentrated training presentation before starting the event to give people the context to make the activity meaningful to their development. In addition, give out a reference booklet, checklists or other valuable handouts and materials that give helpful information to support the goals of the event.
Scalability: Depending upon the design of a specific learning olympics event, make it scalable for groups of all sizes. For example, three Innovation Olympics events can accommodate thousands of people, while the other three require abundant resources to facilitate groups exceeding 100 participants. It’s not always feasible because of resource constraints, such as facilitators needed, rooms, materials, time or budget. Look for ways to stretch resources to make the events as scalable as possible.
Fun and creative: The core of any learning olympics is the enjoyment and entertainment it brings. When people play and have fun within structured learning, the results, including comprehension and retention, can be superior to traditional training methods. From the beginning, tell people to let loose and have fun, but also engineer the fun factor into learning by using creative ways to get people relaxed, uninhibited and playful.
For Innovation Olympic events, we used lively background music to keep energy high, played comedy-oriented audio and projected video clips such as those in “America’s Funniest Home Videos” at appropriate times to get people laughing. Consider embedding magicians, comedians and other performers as event co-facilitators, so they can use their skills to reinforce key learning points while adding the critical entertainment factor.
Using a series of ongoing learning olympics in your organization can be an excellent way to train, motivate and energize employees. But first, target the groups that would most enjoy and benefit from this type of training, then start small with one event. Let the games begin!
As long as learning has played a prominent role in organizations, metrics have played a prominent role in learning. If CLOs want to be among the heavy hitters at their organizations, they’ll have to make reliable and meaningful measurement a priority.
Metrics: Some CLOs swear by them, others at them. Chief Learning Officer magazine columnist Mike Echols sounded the clarion call this February for CLOs to rededicate themselves to measurement, whereas former Goldman Sachs learning executive Steve Kerr called measurements like ROI “silly.” Love them or hate them, though, metrics likely will play a key role in resolving a serious challenge for CLOs. Few CEOs and CFOs are satisfied with the impact of their organizations’ learning programs. There is a need for discussion on the value of metrics and which metrics are valuable.
We’re All in This Boat Together
First, there needs to be reconciliation between the two camps: those who believe metrics are our salvation and those who believe they’re a waste of time and energy and a feeble attempt to justify the value of learning. Secretly believe what you want, but the heads of your organization — you know, the ones who dictate the budget for learning — are dissatisfied and want evidence of success. Two years ago, when Accenture asked executives about their learning programs, only 10 percent were very satisfied. So after innumerable conferences, classes and advances in technology, CLOs still have a long way to go.
ROI Is Dead
Most organizations don’t bother to measure the financial benefits of learning. To a large degree, this is because measuring the ROI of learning is perceived as difficult, time-consuming and labor intensive.
More than half of the organizations surveyed by Bersin & Associates cited the need to improve alignment with the business as one of the top learning and development challenges for 2008. Why would we consider using the same ROI method that has a two-decade-plus track record of indistinction?
Simply put, it’s because the method being used for ROI is too complicated. Some, for example, attempt to isolate the effect of training and separate it from other interventions (e.g., technology, marketing, process improvements) as if conducting a laboratory experiment. A lot of hard work and effort gets applied to scrub financial data and tease out the contribution of the learning function. This is but one small example of how we make Level 4 evaluation needlessly difficult on ourselves.
This apparent overcomplication drives many learning leaders to abandon ROI. But they still must do something to report on the training function. Many reach for readily tracked data, such as course-completion rates and training hours — none of which do much to establish the value of learning at the C-level.
Offering up these metrics in some ways demonstrates a fundamental disconnect with the business. Course-completion statistics show nothing in the way of alignment with the goals of the business. There is no inherent value solely in the completion of courses.
Long Live Impact of Learning
For those who want to demonstrate the value of employee development programs to the business, meet Impact of Learning (IOL). IOL is simple enough to be practiced in 100 percent of organizations, not just those elite few that have the time and resources to engage in ROI.
There are three basic steps to IOL as a way of demonstrating the value of learning:
1. Insight: Create a map of the linkage from business goals to training initiatives and identify success metrics.
2. Individual: Gather overall data on success metrics, in addition to personal success stories.
3. Impact: Develop an impact report rich with compelling stories of individual and overall success so executives clearly see the impact on organizational issues about which they truly care.
Start With Insight
The road to business alignment needs to be mapped early on. For each major initiative involving training, it is vital to gain insight and identify the business drivers up-front and in writing. Robert O. Brinkerhoff describes a delightfully simple one-page format to represent business alignment in his book, The Success Case Method. IOL insight involves understanding the business case during the initial phase of work, when the training staff first starts to understand how they can support an initiative.
Insight essentially means metrics — specifically, effectiveness metrics that business leaders are committed to achieving. But it’s important to point out that insight metrics rarely are as broad as overall sales or revenues. For example, for the leader of sales at a manufacturing company, sales from new customers were a key focus. That nuance was critical both in planning the learning curriculum and any future assessment of impact. In this case, substantial resources needed to go toward training to sell into new markets.
Or in another example, sales metrics can be targeted specifically to a channel such as independent dealers vs. big-box retailers. Whatever the insight gained from front-end planning, learning leaders must establish from the start that they have clear intent to deliver results.
Mapping this makes our intentions even more visible and lays the groundwork for assessing impact. Typical maps of the linkage to success can be four to six columns of information. Sample column headings may include:
• Who will be trained (audience, job role or title)?
• What will they need (knowledge and skills, competencies or expected behaviors)?
• What they should do (key actions)?
• What should individual results be (outcomes or job results)?
• What are the company’s goals (business objectives or strategic results)?
The value of the insight map is that it documents the shared understanding of what needs to happen and how and when success will be measured. Armed with that, a CLO can enhance the curriculum accordingly — adding where needed, pruning courses that no longer fit and planning learning strategies that make the most sense for key audiences.
Individuals Make It Happen
The CLO with insight sets the stage, but it is the individual learner who makes it happen. The key to the second part of the IOL process involves a celebration of how people create results. Instead of poring over tedious stacks of data or creating cumbersome financial models to calculate training’s ROI, we prefer to listen to the anecdotes of the individuals we have trained. Are they creating the important outcomes we mapped earlier? If so, are they doing so by virtue of the concepts and skills we provided?
The CFO of a major health care system articulated how she used what she had learned to create a balanced set of outcomes, including margins that were within financial targets. This was achieved without sacrificing the core mission of serving those who could not afford health care. The powerful story she told clearly demonstrated success in the context of the organization’s goals and fully acknowledged the value of what had been learned.
This is the most compelling type of data describing the impact of learning. The individual perspective demonstrates the alignment of employee development with the goals of the business. If you can’t find those individual examples in the organization, then you need to take a hard look at what you are teaching. Perhaps the curriculum failed to keep up with what really matters in the current environment.
Business goals change and so should your training content. That’s important data, as well. Individuals also can tell you if you are not teaching them things that achieve results. They are a great source when it comes to showing the need to make important improvements in training delivery. This side of the equation is not supplied when learning functions rely on an ROI approach.
I have never seen an ROI study fail to return an answer of less than an 80 percent gain. (Given that, it’s amazing that CFOs don’t clamor to double the training department budget each year.) Yet, overall, individual performance stories are far more credible to executives than the fantastic results often reported in ROI studies. No doubt, it’s still worth looking at whether the sales group is meeting its sales targets and if the finance department is managing the business within margin targets. At a high level, this context is important to see if the business is making progress toward its larger goals. But assessments at the individual level should not be overlooked.
Say It With Impact
Learning leaders can’t forget to do the most important part at the end of the IOL process. They need to let their internal customers in the organization know they care about the results. The best way to do this is with a written report: an impact statement. If you just spent $500,000 to improve customer service, your internal customers need to hear something more important than the fact that employees sat through 3,000 hours of training.
For example, a large health insurance company is in the process of teaching more than 200 customer service representatives how to more quickly and consistently answer questions about coverage. The organization is geared up to analyze expected improvements in their first-call resolution one month after implementation. It’s critical to get that message out in a timely fashion. Few would care if the learning department reported the number of course completions. Not many would listen if it decided to take the next two months analyzing data and then touted some complex rationale around 120 percent return on investment.
But when it tells the story of the 15-year veteran customer service representative who applied what she learned and immediately increased her ability to provide full and complete answers to callers, now they are really saying something of value. Her story, combined with overall results of call accuracy and decreases in escalated calls, is a solid statement of impact.
An impact statement should include at least two or three cases, but it ought to have as many as are needed to lend credibility and clarity to the situation. It also should include the original map constructed in the insight phase. And most importantly, it needs to be produced as soon as outcomes can be seen in the organization. Business leaders need to get the facts quickly before their attention moves on to the next great challenge facing them.
Summary
Every couple of decades or so, thought leaders unveil a model that transforms learning’s approach to evaluation. In the late 1950s and early 1960s, it was Donald Kirkpatrick’s four levels of training evaluation. In the 1980s, the new idea was to prove the return on investment of training. Comparing the cost of a learning intervention to the performance gain it produces seems like a worthy endeavor. ROI might seem viable to a small number of companies willing to put forward the time and money for such an analysis. But even if properly executed, it may overlook whether the learning intervention was organizationally aligned to begin with.
And that’s the challenge facing our industry right now: proving our contribution to business goals. IOL is a method that ensures linkage to business goals while yielding faster and more compelling evaluation results. It’s time for another sea change in learning measurement.