How To Design Great Measures
- Date: 2007-04-17 - Word Count: 701
Share This!
Are you guilty of using the following methods as your approach to measure selection:
*
brainstorming with your team in a one-hour session during your two-day planning workshop?
*
trawling the internet or other places to find out what others like you measure?
* asking your IT guy or gal what data you have and creating measures from that?
* hoping someone will tell you (maybe a consultant or a stakeholder)?
These aren't approaches to measure selection. They are just ways to gather ideas for what to measure. None of these methods include any kind of overt and deliberate evaluation of which measures are the best measures. And you're probably wondering why your organisation has so many meaningless measures! Plus, on the flip side, these methods may have left you high and dry without any viable options for measuring some of those less tangible results like culture or sustainability or engagement or confidence.
If this is your burden - having no logical, practical way of choosing or designing the measures that can truly convince you that you're making the differences you need to in the world - then here are three tips that might make your life a little easier:
1. measure the result, not the action
2. what you can observe and describe, you can measure
3. don't measure it just because it's easy
measure the result, not the action
"Ensure that people with a disability do not experience discrimination and have their particular needs for services and support acknowledged and met." Such an inspirational and noble goal is so easily cheapened by a measure like "Establishment of an effective Advisory Council on Disability". Such measures track the activity associated with the initiatives hypothesised to produce the results implied by such wonderful goals. They can't let us know how much or how frequently people with a disability experience discrimination.
No doubt you're going to want to monitor activities in your organisation, but what meaning does that have unless you are first monitoring the results those activities exist to produce or influence?
what you can observe and describe, you can measure
Why is it so hard to measure results like "achieving equi-marginal efficiency for trade-exposed industries on a least-cost trajectory within a general equilibrium model"? The answer is not because no-one has thought of the right measure yet! If we go back to basics, measuring is about observing and collecting specific information about something. If you don't know how to recognise when that something is happening, you can't know where and when and how to collect information about it, can you?
So before you can measure "achieving equi-marginal efficiency for trade-exposed industries on a least-cost trajectory within a general equilibrium model", you need to know what equi-marginal efficiency and least-cost trajectories look and feel and sound like when they're happening. Even more, you need to be able to describe it in words that are evocative, words that conjure rich and detailed and shared pictures in the minds of people before they select or design measures.
don't measure it just because it's easy
It's easier to select more viable candidates for measuring a result when you describe it richly and without weasel words. In fact, you can end up with so many candidate measures that you might be tempted to pick those that are the easiest to bring to life. You already have the data, it would be a waste not to use it, no-one's got the time to collect more data. But you'd be falling into one of the deepest traps of organisational performance management: not making sure that your organisation has the data it really needs.
You'll need to think about more than just the feasibility of each potential measure in deciding on the best ones. Measures are meaningful when they have strong relevance to the result you want them to evidence.
use your brain when you design your measures
Three basic steps to better measures: focus on the result and not the activities, articulate clearly what that result looks like, and shortlist your potential measures by balancing feasibility with strength of relevance. Yes it will take a little more time that you have probably been giving to measure selection, but it will save you loads more time than you have probably been wasting managing with the wrong measures.
*
brainstorming with your team in a one-hour session during your two-day planning workshop?
*
trawling the internet or other places to find out what others like you measure?
* asking your IT guy or gal what data you have and creating measures from that?
* hoping someone will tell you (maybe a consultant or a stakeholder)?
These aren't approaches to measure selection. They are just ways to gather ideas for what to measure. None of these methods include any kind of overt and deliberate evaluation of which measures are the best measures. And you're probably wondering why your organisation has so many meaningless measures! Plus, on the flip side, these methods may have left you high and dry without any viable options for measuring some of those less tangible results like culture or sustainability or engagement or confidence.
If this is your burden - having no logical, practical way of choosing or designing the measures that can truly convince you that you're making the differences you need to in the world - then here are three tips that might make your life a little easier:
1. measure the result, not the action
2. what you can observe and describe, you can measure
3. don't measure it just because it's easy
measure the result, not the action
"Ensure that people with a disability do not experience discrimination and have their particular needs for services and support acknowledged and met." Such an inspirational and noble goal is so easily cheapened by a measure like "Establishment of an effective Advisory Council on Disability". Such measures track the activity associated with the initiatives hypothesised to produce the results implied by such wonderful goals. They can't let us know how much or how frequently people with a disability experience discrimination.
No doubt you're going to want to monitor activities in your organisation, but what meaning does that have unless you are first monitoring the results those activities exist to produce or influence?
what you can observe and describe, you can measure
Why is it so hard to measure results like "achieving equi-marginal efficiency for trade-exposed industries on a least-cost trajectory within a general equilibrium model"? The answer is not because no-one has thought of the right measure yet! If we go back to basics, measuring is about observing and collecting specific information about something. If you don't know how to recognise when that something is happening, you can't know where and when and how to collect information about it, can you?
So before you can measure "achieving equi-marginal efficiency for trade-exposed industries on a least-cost trajectory within a general equilibrium model", you need to know what equi-marginal efficiency and least-cost trajectories look and feel and sound like when they're happening. Even more, you need to be able to describe it in words that are evocative, words that conjure rich and detailed and shared pictures in the minds of people before they select or design measures.
don't measure it just because it's easy
It's easier to select more viable candidates for measuring a result when you describe it richly and without weasel words. In fact, you can end up with so many candidate measures that you might be tempted to pick those that are the easiest to bring to life. You already have the data, it would be a waste not to use it, no-one's got the time to collect more data. But you'd be falling into one of the deepest traps of organisational performance management: not making sure that your organisation has the data it really needs.
You'll need to think about more than just the feasibility of each potential measure in deciding on the best ones. Measures are meaningful when they have strong relevance to the result you want them to evidence.
use your brain when you design your measures
Three basic steps to better measures: focus on the result and not the activities, articulate clearly what that result looks like, and shortlist your potential measures by balancing feasibility with strength of relevance. Yes it will take a little more time that you have probably been giving to measure selection, but it will save you loads more time than you have probably been wasting managing with the wrong measures.
Related Tags: metric, business goals, kpi, balanced scorecard, performance measure, key performance indicator
Stacey Barr is the Performance Measure Specialist, helping people to measure their business strategy, goals and objectives so they actually achieve them.Sign up for Stacey's free mezhermnt™ Handy Hints ezine at www.staceybarr.com to receive your complimentary copy of her e-book "202 Tips for Performance Measurement", and make your business goals more achievable. Your Article Search Directory : Find in Articles
Recent articles in this category:
- 5 Reasons That a Restaurant Should Use a Restaurant Recruiter
Have you ever noticed how many restaurants pop-up over time but then disappear just as quickly? Runn - Does Money Motivate?
Some say money can't buy happiness, but data shows that for those who can barely pay the monthly bil - Because Workforce Friendly Policies Payoff
Employer-sponsored wellness programs are becoming more popular as companies strive to maintain a hea - EAP Value
Life would be simpler if we could set aside our personal issues and emotional baggage when the workd - Hiring an Expert SEO Company to Improve Your Online Business
Search Engine Optimization or SEO Services are used to make your website or online business popular - Why Safety Training at Workplace is Important
Safety training at workplace should be one of the top priorities of your business. An effective safe - Team Building: Brain and Sweat to Attain Company's Central Goal
Are you one of those employees branded ineffective and unproductive? Reasons might be the sense of d - Security Alarm System
It is a must that houses and offices install a security alarm when we speak about safety reasons. Se - Workplace Safety Tips
When we speak of safety based on books, its importance is next to food. It is essential to all indiv - The Benefits Of Lease-to-own Properties
One of the hit real estate investments today is to buy properties that will later be put up as "leas
Most viewed articles in this category:
- A Map Mural for Your Business
Yay! That retail store you've been planning has finally opened its doors and you are officially in b - Attracting Customers Through An Improved Shopping Experience
So many new shopping malls and supermarkets are put up every year. Many more are already in business - "To Oz!": Leading a Resilient-High Achievement Organization
One of my favorite movies is "The Wizard of Oz" based on the book by Frank Baum. The story is about - 5 Critical Items Never to be Included in Cost Benefit Analysis
When dealing with decisions using Cost Benefit Analysis techniques it is very important to follow th - Collaboration and Change
I’m an expert on change and leadership, but my most popular speaking topic this past year, and - Workplace Gap
In your workplace, are you a manager with a smart group of people and they aren't responsive to your - Leadership - The Proper Relationship with Subordinates
In the army, "the men" are kept separated from those known as "the officers." This comes from the id - The 10 Most Asked Questions of Cost Benefit Analysis
When dealing with decisions using Cost Benefit techniques it is very important to follow the proven - Cubicle Space Planning
Space planning is an essential element of any project and efficient planning serves the dual purpose - Why Passenger Surveys are a Transport Operators Best Friend
Public transport operators who already use passenger surveys may not fully appreciate the multiple b