Monday, March 24, 2014

The Logical Fallacy of Training



A classic scene from The West Wing provides a pithy definition of post hoc ergo propter hoc, a Latin phrase which defines a logical fallacy translated as "after this, therefore because of this." The fallacious argument is that if X occurs after Y, then Y must have be caused by X.

We see this argument often when consulting with clients and business leaders, and we even see it slip into the thinking of Learning people. I recently read an otherwise very intelligent article that provided a perfect example: employees are not following a procedure, and the assumption is that a lack of knowledge is causing the employees’ failure to follow the procedure. Leaping off from there, an elaborate business case follows: if we could just improve retention of learning, improved performance ensues.

Correlating a performance failure (“the employee who fails to follow proper customer-service principles and ends up driving a loyal customer away”) with poor learning transfer is fallacious, since the root cause of that fail is much more likely to be related to non-training factors. How many times do we see training promised as a panacea for performance problems? Excellent training is provided to employees, and Kirkpatrick-esque multi-level evaluation is used to establish the efficacy of the training. Then, after the performance indicators don’t move, the failure is attributed to the training, instead of the business executive, who is ultimately accountable for the result. Now we face a lose-lose situation, where not only did the performance not improve, but the training department is the scapegoat.

In Shakespeare’s Julius Caesar, the nobleman Cassius says to Brutus, “The fault, dear Brutus, is not in our stars, / But in ourselves.” We could adapt that notion for an executive to say: “the fault, dear comrades, is not in our supporting staff functions, but in ourselves” Fans of Thomas Gilbert, the “father of human performance technology,” recall that the point of his Performance Engineering Model is that the root cause of employee performance problems is far more likely to be non-training factors, such as flaws in process design, incentives, expectations-setting and other work environment issues. “Before we throw training at a problem,” the enlightened business leader continues, “let’s make sure that we understand the root cause of the performance issue.”

Learning professionals, take heed and seek the root causes of the performance issues before moving towards a (very expensive, very time-consuming) training solution. Business people don’t automatically think this way, so we, as advisers, need to teach them. When training is actually implemented, a useful metric beyond knowledge transfer would be to see a correlation between the effectiveness of knowledge transfer (Kirkpatrick Level III, if you will) and performance. Don’t make an assumption about root cause. Otherwise, you fall into the trap of post hoc ergo propter hoc.

This type of thinking can change the game. The game for most learning professionals has traditionally been to drive usage of training, creating the illusion of Learning as an indispensable function. The new game will be to create as much business value with as little training as possible.

Thursday, March 13, 2014

Schools of Thought About "Training"

Do you ’ Training, or do you do everything possible to avoid it?

Recently, I was searching for a simple example to delineate the differences between what I think of as two schools of thought about training: (1) the conventional view of training (in my company, we talk in terms of “order-taking”) and (2) the (presumably more enlightened) view that adds emphasis to front-end analysis and a focus on outcomes. The former I will refer to as the “I ‘’ Training” school, and the latter, the “I do everything I can to avoid instruction" school.



The “I ‘’ Training” School

At its annual convention, the American Society for Training & Development (ASTD), the largest association for our profession, often distributes keepsakes (buttons, keychains and the like) that proclaim “I ‘♥’ Training.” This swag represents the most common view of training, among education professionals and the clients they serve. This school of thought reinforces mantras like, ”training is fun!” and “all curious and inquisitive people ‘♥’ training!”“I ‘♥’ Training” is an understandable, and even healthy, point of view for classroom facilitators and, to some degree, instructional designers. It is also common among executives (training and otherwise) who measure the success of training by volume of content produced, course evaluation feedback, and participation. In terms of the Kirkpatrick model, I refer to these metrics as 'Level 0' evaluation, that is, usage.

Even a cursory look at the accomplishments of Chief Learning Officers profiled in CLO magazine shows that many of the most successful practitioners in our field quantify their accomplishments in terms of spending and usage (Level 0 metrics), such as number of people trained, amount of money spent building training infrastructure, or number of courses put in place as part of a curriculum.


The “I do everything I can to avoid instruction" School

When HPT pioneer Joe Harless passed away a couple of years ago, I was reminded of the other school of thought. In an article in the Performance Improvement journal, author William Coscarelli recalls Harless opening a 1977 talk with "I do everything I can to avoid instruction." He continued to explain how front-end analysis directs clients to the root causes of their issues, and those root causes are only occasionally matters of “training.”

This "avoid instruction" attitude carries with it a whole other set of assumptions. Instead of training for the sake of training, with a goal of butts in seats, the measure of training success is business impact. Instead of more training being better, adherents to this school recognize that training is expensive to produce and deploy. Instead of trumpeting 4.5 mean responses on smile sheets, the Harlessians (yes, I made that up) know that training has limited utility- it can only be relied on to help build skills.

So What?

Carrying the Harliessian torch is much easier said than done. Even with the best of intentions and rigorous discipline, one cannot reasonably expect to demonstrate measurable business impact on even half of training projects. Alas, sometimes training is just training.

But we have to fight the fight.  I'll always fight the good fight in seeking demonstrable performance improvement over the development of useless training. And I'll always seek true partnership with clients to help them see how training can support their goals. If we can never demonstrate value and a focus on outcomes, our function will cease to exist. 

Sunday, March 2, 2014

Comically Poor Customer Service



Last week I had a comically poor customer service experience with a major car rental company at Logan Airport. I won’t identify them by name, but let's just call them the Difficult Car Rental Company. It got me to thinking about how service or employee performance problems are so often erroneously tied to “training.”


In my career in the restaurant and corporate education businesses, I've heard the refrains all too often, from customers and managers: “The service sucks because they aren't trained.” “This person doesn't know what they’re doing. Send them to training.” “My team is not on-board with the new program. They need more training.”


In my experience with Difficult, I have a series of encounters with employees, all pointing to major service quality problems. On the surface, most seem like ‘training’ problems, but even cursory speculation reveals them to point to other issues in the workplace. (N.B. – I experienced what is described below as a customer starring in a 23-minute horror show. This blog would not take the place of the analysis that should happen with this place.)


The Situation: Swapping the rental car
I rent a car for my business trip. The windshield wiper fluid squirter isn't working, and the wiper blades are worn out. This won't work for a drive through New England in February, so I arrange to swap this car for another car.

Touchpoint #1: Checking in the car
Francesca checks in the car and seemingly does everything correctly, checking mileage and so forth. I explained that I needed to exchange this car for another. She asks, “Are you a Gold Club Rewards Member?” “No.” “Go up to counter the second floor.” Including the people I dealt with in renting the car originally, this makes about four consecutive employees who have asked me if I was a Gold Club Rewards Member. I'm already weary of typing the name - let's just call it Gold Member for short.
  • Problem: Everyone asks me if I’m a Gold Member,
    but no one invites me to become one. Being reminded over and over again that I’m not a Gold Member plants a mental seed that I’m not getting the best or most efficient service.
  •  Possible Root Cause: Process issue. The Training works: Everyone apparently has it drilled into their head to greet everyone warmly, and before providing any service whatsoever, to ask if they are a Gold Member.
  • Possible Solution: The service process could be redesigned in such a way as to not ostracize non-Gold Members. They should also examine why they ask this question and what affect it has on customers. If they want more people to become Gold Members, then the process should include an
    invitation to become one.
Touchpoint #2: In line at the rental counter
I get to the counter, and there is one agent behind the counter, Janet, serving another customer. I am first in line. A young man, Ted, warmly greets me at the front of the line and asks how he can help me. I explain. “Are you a Gold Member?” “No.” “Well, even though you're not a Gold Member, you can probably go to the Gold desk in the garage." In my head: "Oh, you mean that place the place right next where I dropped off the old car?” Out loud: “Well, there’s only one person ahead of me, so I might as well just wait for him to be done.” “OK.”
  • Problem: If I had known that I could get a new car via the desk in the garage, I would not have had to walk about 150 yards each way to the main rental counter.
  • Possible Root Cause: Policy and Communications. Two employees have two different conceptions of the policy for exchanging a car. Francesca sent me upstairs because I’m not a Gold Member, but apparently, based on Ted’s actions, there are exceptions. 
  • Possible Solution: The company needs to set proper expectations with employees about the policy. It needs to be clear, and everyone needs to know the policy. If there is leeway for exceptions, for
    example if it’s not busy, employees should know that. 
Touch point #3: Still at the rental counter
Five minutes pass. Janet is still with the same customer. Finally Ted says, “I’ll help you. Let me just sign into the terminal here.” He goes around the desk, and after trying two stations, finally gets logged into a terminal. As he is trying to log in, Janet comes over and asks Ted why there isn’t anyone else working the counter
besides her. “Because there isn’t,” Ted replies sharply. It makes me wonder if Ted is a Supervisor or in another role just trying to pitch in and help out. 
  • Problem: Even though there are only two customers present, me and the guy that Janet is helping, service is dreadfully slow, and the employees are stressed out.  
  • Possible Root Cause: Supervision (staffing and scheduling) and system performance. Based on the amount of time that Janet has spent with one customer, either she doesn’t know what she is doing or the system terminals are not performing. Based on his performance, I don’t think that Ted knows how to sign in and perform this transaction. Janet is overwhelmed, and Ted is trying to help. 
  • Possible Solution: If Ted is supposed to perform
    transactions, he needs to be trained to do so. The company also needs to look at the systems. Both Ted and Janet are struggling to get customers processed.
Touchpoint #4: Supervisor to the rescue
As I wait for Ted to sign in, Suzy approaches and warmly greets me. I explain my situation, and her first question is, of course: “Are you a Gold Member?” “No.” She assures me, very nicely, that Ted can help. Minutes pass. Ted gets logged in, and starts the transaction. “Did you put the old car into the spot where you
found it?” “No, I brought it to Returns, like the person on the phone told me to.”

As Ted is trying to assign me a new car in the system, he gets stuck. He calls over Suzy to help. Suzy nudges him out of the way and completes the transaction. Apparently Ted pressed an incorrect button along the way. As Suzy helps me, Ted steps out from behind the counter and begins answering questions for other customers now waiting in line. Suzy completes the transaction.“Thank you for your patience today, Mr. Winter!” It feels like she delivers this line often!
  • Problem: Suzy thinks that Ted knows what he is doing, but apparently he doesn't.
  • Possible root cause: Supervision. Suzy needs to schedule and assign employees based on their capabilities. It wasn't busy at the rental counter, but the employees were still overwhelmed. 
  • Possible Solution: Suzy needs to get a handle on her employees' capabilities and not put them in situations where they look incompetent. Also, as a side note, if Suzy does want to help Ted learn how to do a transaction, she should help him to do the transaction, rather than hip-checking him out of the way in order to do it herself.
Touchpoint #5: Leaving the parking lot
I get to the new car, and I check the wipers. All set. Leaving the parking lot, I need to speak with Tasha, who looks over my paperwork. After warmly greeting me, she asks, “Full tank of gas?” “Yes.” “Have
a great trip!” As with the other employees, she could not have been nicer. I leave the parking lot and immediately head towards the nearby Ted Williams tunnel. Oh no! This car has no EZ Pass transponder, and I have no cash! 15 seconds later I brazenly drive through the EZ Pass lane with no EZ Pass, cursing Difficult to high heaven. Ironically, when I checked out the original car, the employee checking me out of the parking lot asked me if I had my EZ Pass transponder, which I did, but she did not ask me if the gas tank was full, which it was not.
  • Problem: Inconsistency. If the primary purpose of them stopping me on the way out (other than ensuring that I am taking the correct car) is to make sure that I'll all set, then the questions that the employees ask of the customers should be consistent. 
  • Possible root causes: Process design and supervision. Based on the two times I went through this process, different employees check on different things. Apparently, the people who prepare the cars to be rented make a variety of small mistakes, at least one per car! 
  • Possible solution. These interactions should be designed to focus on common problem areas as well as creating peace of mind with the customer. Systems should be put in place to minimize these annoying problems, as well as create a consistent customer experience.
What to make of this?
There you have it: Five touchpoints, five annoying interactions. Let's tally the possible root causes of the problems:
  • Supervision - 3
  • Process - 2
  • System - 1
  • Policy - 1
  • Communications - 1
They have a myriad of problems with their customer service, but training is not the primary root cause of any of them. Training could be part of the solution (e.g., teaching Ted how to use the system for transactions), but training alone will not fix any of Difficult's issues.

Epilogue: Manny
Four days later, I return the car. Jessie, who checks in the car, doesn't greet me warmly, doesn't smile, and doesn't ask me if I'm a Gold Member. Through our interaction he says 4 words: "Hello...yeah...all set." Now I've lost it: This guys needs some damn training!


As I start the lonely walk across the cold parking lot at the end of a week-long business trip, wondering at 10 p.m. if I can find a cab anywhere nearby, a man yells at me from the next aisle over. 


"Hey! Hey!!! You all set?!?!?!" 

I wonder what is going on. Why is this guy yelling at me? Oh, he's wearing a Difficult uniform. "Yeah," I reply, waving my receipt. "The other guy took care of me."

He walks closer. "Where you going? You catching a flight?"

"No. I'm going home."

"You need a ride to the taxi stand?"

"Actually, yes."


Thus begins a very pleasant 5-minute experience with Manny, as he drives me, in the rental car I just returned, to the taxi stand at Terminal A. Manny doesn't follow a script. Manny doesn't ask me if I'm a Gold Member. Manny doesn't even really smile, but he is affable and helpful. We converse easily about the weather, the construction at the airport, and the consequences of driving through a toll booth without an EZ-Pass. I don't think about whether Manny is following a procedure, what his role is, or even if he needs more training. He's just Manny, a guy who makes sure that I'm all taken care of.