Seeing The Signals In Your Measuers: 3 Approaches To Traffic Lights
- Date: 2007-04-18 - Word Count: 627
Share This!
Traffic lights - the decoration de rigueur for performance dashboards and reports. Have you gotten more carried away with the decoration, than with the rigueur? Take a look at these four common approaches to traffic lights, and see if you've got some room for improvement.
approach 1: % difference from month to month
When this month is 10% worse than last month, the traffic light turns red. When it's 5% worse than last month, the traffic light turns amber. When it's 10% better than last month, the traffic light turns green. Obviously, this approach works for time periods other than a month, and for cut-offs other than 10% and 5%.
Such traffic lights encourage us, usually, to ask questions like "what caused such a big difference?" In turn, such questions encourage us, usually, to find some way to explain the difference. If we're clever, we'll already have added a comment to the performance measure explaining that the difference is due to something outside our control. If we're not so clever, we'll be putting up different explanations every month, and have a list as long as Santa Claus' of improvement projects.
There's no advantage I can see to this approach to traffic lighting. It tends to encourage us to knee-jerk react to data, tamper with business processes or blaming something we don't have to do anything about. Time gets wasted chasing problems that aren't there and we miss problems that are.
approach 2: up and down, good and bad
When some performance measure values increase, it's a good thing (like revenue, satisfaction and on-time performance). There are others whose values decrease and it's a good thing (like rework, cycle time and pollution). Combine this with whether there's an upward change or downward change in actual performance values and you get a complex range of traffic light signals to deal with: upward change that is good, upward change that is bad, downward change that is good, downward change that is bad. This "solution" probably resulted from a confusion that erupted when upward and downward arrows were chosen as the traffic light symbols.
When we sort out the confusion, these multi-faceted traffic lights encourage us to ask questions like "what's behind the trend?" and the trend is concluded from maybe 3 consecutive points of data. Marginally better than approach # 1, and only just.
Any system of traffic lighting that moves us away from point to point comparisons (the essence of approach # 1) is a step in a good direction. But we still risk drawing the wrong conclusions from trend analysis that is based on not nearly enough data to be valid. And does upward and downward really matter nearly as much as good and bad?
approach 3: statistically valid signals
Statistical process control is an analysis method that discerns variation that is typical from variation that signifies change has occurred. It's like filtering the signals from the noise, something the other two approaches don't do (they assume that any arbitrary difference is a signal, irrespective of the typical size of differences over time). The signals are defined from a set of rules that test the probability that a difference is due to just normal variability (no change) versus atypical variability (change). Signals include sudden shifts in performance, gradual shifts in performance and instability in performance.
When our attention is moved from point to point variations to patterns in variation over time, we ask questions like "what caused that shift in performance to occur at that time?" and "why is performance so chaotic and unstable?" and "what do we have to focus on improving to improve the overall average level of performance?".
These questions seek root causes, not symptomatic causes. They lead us to find the solutions that don't just fix next month's performance, but fundamentally improve the baseline performance level further into the future.
approach 1: % difference from month to month
When this month is 10% worse than last month, the traffic light turns red. When it's 5% worse than last month, the traffic light turns amber. When it's 10% better than last month, the traffic light turns green. Obviously, this approach works for time periods other than a month, and for cut-offs other than 10% and 5%.
Such traffic lights encourage us, usually, to ask questions like "what caused such a big difference?" In turn, such questions encourage us, usually, to find some way to explain the difference. If we're clever, we'll already have added a comment to the performance measure explaining that the difference is due to something outside our control. If we're not so clever, we'll be putting up different explanations every month, and have a list as long as Santa Claus' of improvement projects.
There's no advantage I can see to this approach to traffic lighting. It tends to encourage us to knee-jerk react to data, tamper with business processes or blaming something we don't have to do anything about. Time gets wasted chasing problems that aren't there and we miss problems that are.
approach 2: up and down, good and bad
When some performance measure values increase, it's a good thing (like revenue, satisfaction and on-time performance). There are others whose values decrease and it's a good thing (like rework, cycle time and pollution). Combine this with whether there's an upward change or downward change in actual performance values and you get a complex range of traffic light signals to deal with: upward change that is good, upward change that is bad, downward change that is good, downward change that is bad. This "solution" probably resulted from a confusion that erupted when upward and downward arrows were chosen as the traffic light symbols.
When we sort out the confusion, these multi-faceted traffic lights encourage us to ask questions like "what's behind the trend?" and the trend is concluded from maybe 3 consecutive points of data. Marginally better than approach # 1, and only just.
Any system of traffic lighting that moves us away from point to point comparisons (the essence of approach # 1) is a step in a good direction. But we still risk drawing the wrong conclusions from trend analysis that is based on not nearly enough data to be valid. And does upward and downward really matter nearly as much as good and bad?
approach 3: statistically valid signals
Statistical process control is an analysis method that discerns variation that is typical from variation that signifies change has occurred. It's like filtering the signals from the noise, something the other two approaches don't do (they assume that any arbitrary difference is a signal, irrespective of the typical size of differences over time). The signals are defined from a set of rules that test the probability that a difference is due to just normal variability (no change) versus atypical variability (change). Signals include sudden shifts in performance, gradual shifts in performance and instability in performance.
When our attention is moved from point to point variations to patterns in variation over time, we ask questions like "what caused that shift in performance to occur at that time?" and "why is performance so chaotic and unstable?" and "what do we have to focus on improving to improve the overall average level of performance?".
These questions seek root causes, not symptomatic causes. They lead us to find the solutions that don't just fix next month's performance, but fundamentally improve the baseline performance level further into the future.
Related Tags: metric, business goals, kpi, balanced scorecard, performance measure, key performance indicator
Stacey Barr is the Performance Measure Specialist, helping people to measure their business strategy, goals and objectives so they actually achieve them.Sign up for Stacey's free mezhermnt™ Handy Hints ezine at www.staceybarr.com to receive your complimentary copy of her e-book "202 Tips for Performance Measurement", and make your business goals more achievable. Your Article Search Directory : Find in Articles
Recent articles in this category:
- 5 Reasons That a Restaurant Should Use a Restaurant Recruiter
Have you ever noticed how many restaurants pop-up over time but then disappear just as quickly? Runn - Does Money Motivate?
Some say money can't buy happiness, but data shows that for those who can barely pay the monthly bil - Because Workforce Friendly Policies Payoff
Employer-sponsored wellness programs are becoming more popular as companies strive to maintain a hea - EAP Value
Life would be simpler if we could set aside our personal issues and emotional baggage when the workd - Hiring an Expert SEO Company to Improve Your Online Business
Search Engine Optimization or SEO Services are used to make your website or online business popular - Why Safety Training at Workplace is Important
Safety training at workplace should be one of the top priorities of your business. An effective safe - Team Building: Brain and Sweat to Attain Company's Central Goal
Are you one of those employees branded ineffective and unproductive? Reasons might be the sense of d - Security Alarm System
It is a must that houses and offices install a security alarm when we speak about safety reasons. Se - Workplace Safety Tips
When we speak of safety based on books, its importance is next to food. It is essential to all indiv - The Benefits Of Lease-to-own Properties
One of the hit real estate investments today is to buy properties that will later be put up as "leas
Most viewed articles in this category:
- A Map Mural for Your Business
Yay! That retail store you've been planning has finally opened its doors and you are officially in b - Attracting Customers Through An Improved Shopping Experience
So many new shopping malls and supermarkets are put up every year. Many more are already in business - "To Oz!": Leading a Resilient-High Achievement Organization
One of my favorite movies is "The Wizard of Oz" based on the book by Frank Baum. The story is about - 5 Critical Items Never to be Included in Cost Benefit Analysis
When dealing with decisions using Cost Benefit Analysis techniques it is very important to follow th - Collaboration and Change
I’m an expert on change and leadership, but my most popular speaking topic this past year, and - Workplace Gap
In your workplace, are you a manager with a smart group of people and they aren't responsive to your - Leadership - The Proper Relationship with Subordinates
In the army, "the men" are kept separated from those known as "the officers." This comes from the id - The 10 Most Asked Questions of Cost Benefit Analysis
When dealing with decisions using Cost Benefit techniques it is very important to follow the proven - Cubicle Space Planning
Space planning is an essential element of any project and efficient planning serves the dual purpose - Why Passenger Surveys are a Transport Operators Best Friend
Public transport operators who already use passenger surveys may not fully appreciate the multiple b