Archive for the ‘Measurement’ Category

Getting attention with internal communication

Monday, January 16th, 2012

It’s become a cliche, you know. Overworked employees who can’t keep up with all the information they need to consume to be effective, despite (or because of) e-mail, voicemail, Facebook, Twitter, Yammer, Sharepoint…  But why blame the tools? It’s the strategy that needs work.

I recall 17 years ago when “we want employees to manage their own information” became a watchcry.

The idea was to create a repository of news and information and get people to seek it out.  This change from “push” to “pull” was supposed to take the heat off of communicators and bring about a knowledge revolution. Instead, employees voted with their feet, ignoring most all the news we pushed out, especially the stuff that supposedly was “important” — the company strategy, leadership messages and  human resources materials.  We were repurposing news releases in those days, not really originating stories from the employee perspective. We were passive, and we waited for our internal clients to come up with stuff.

Well, that’s not altogether true. We called them and asked, “Got any news?” What we should have done is treated employees as our clients and looked for reasons to do a piece, not expect our leaders and managers to come up with stuff on their own.

All through the years, our best-read materials at Key, Goodyear, National City and other places were stories, not news. They had people and drama and conflict and tension, or at least a compelling new angle on our business, told through example and demonstration, not mere recitation of fact.

At Goodyear, we had our interns do a ton of writing for our intranet, GO.  During their yearlong assignment, they’d cover plenty of news, such as events, quarterly earnings, significant announcements and industry doings, of course. But they also had to originate stories, particularly in the last couple of months of the assignment.

They wrote country profiles, talking with leaders and others about the business situation. They did stories on different parts of the business and people. And they did a multipart series focusing on one regional business, or on the fastest-growing geographies in the company.

These stories got read because they helped employees make sense of the information instead of merely leaving everything up to them.

We began to attract news from all the major business units, increasing our annual story count into the range of 1,200 – 1,500 stories per year.  Over a two-year period, we tripled our monthly GO traffic (visits and pages viewed) and saw a 10% increase in understanding of our company strategy.

How do you get attention, cut through the clutter? Write (produce) stories that matter to your employees, balancing the need for leadership to transmit information with the need for employees to have relevant content available to them.  Do research among employees and leaders to discover what those stories should be, and do it often.

All you’ve got to lose is your irrelevancy.

Share

WSJ: Buzz May Not Matter

Thursday, November 17th, 2011

Many of us in the measurement community strive to get people to connect communication activity to business results — outcomes, not outputs.  The reason for this fanaticism got ink in the Wall Street Journal today with a story about how TV shows that got great social media buzz wound up flopping once people actually saw the shows.

This should be no surprise.  Mainstream hype often produces a big opening weekend, but if the film is crappy, the grosses deflate pretty fast.  It makes sense to be the same in SocMed.  Still, I know there are some SocMed consultants in Hollywood right now trying to convince the studios that all that Twitter and Facebook traffic built on the back of a hot trailer will lead to bigger receipts at the box office.

For the right films, that’s probably got some truth. But for everyone?

That’s why we cannot ascribe attaining squishy communication targets as ROI. They aren’t.  If success is Twitter mentions, Facebook fans and other hype, all that stuff had better lead to business results of some description. Outcomes, baby, not outputs.

By the way, how’d you like Green Lantern? Charlie’s Angels (the reboot?) The Playboy Club (on NBC?) They all got terrific buzz…

Share

PR as sales support: EZ 2 Measure, but…

Thursday, September 22nd, 2011

Our ongoing conundrum in public relations measurement is how best to move our practice from simple output measures to more substantive matters. Mostly, we struggle to connect our outputs to business outcomes – results. This puzzle has led to thinking of ourselves as extensions of marketing, looking to conduct activities that have a more direct impact on sales. Certainly a fair number of people are having a fair amount of success in that respect.

There are a few things that worry me about this type of focus. Among them, Whither internal communications?  Subject matter that targets employee engagement often has little direct effect on revenue. Even attempts to get employees to “think like owners” and “spend each dollar like it was your own” have to have only the most tangential effect on savings. Does that mean we shouldn’t attempt to help employees identify with the company? Avoid communicating the benefits of working there? Forget about generating employee ambassadors?  I hope not.

What about corporate social responsibility? Helping to create the environment where the organization can thrive is critical, but doesn’t turn up consistently on a balance sheet. There’s research that says people want to do business with companies that match their own ethical priorities, but that’s not the same direct connection as conducting a product PR campaign focused on sales.

Investor relations and government relations have different impact than direct sales – it’s part of the public affairs world that, like CSR, has a roundabout relationship to sales. Do we stop doing that? (BTW, I’m aware that these are usually separate departments, but stick with me, please.)

As apocryphal as these cases might sound, there’s a real danger in thinking of PR only in the direct-sales case. Our profession is wider than that.  When we seek to measure only in ROI terms (a financial term with a financial result), we unnecessarily limit ourselves and start to think that if one sees everything as a nail, every tool looks like a hammer.

Reputation and issues management should be critical to strategy development. Third-party endorsement and the two-step flow to influencers are still relevant.  Sales-related PR isn’t wrong or bad — it’s just not the only relevant game in town.  We have other tools in the toolbox that serve different purposes…All marketing is communication, but not all communication is marketing.

 

Share

Engagement as an ‘Objective’

Tuesday, June 14th, 2011

Gotta hit the bullseye (creative commons)

True or False: The point of social media for business is to engage with people.

That statement is being used as a club to pummel the reluctant into the social media world. Remember the glory days of the dawn of the World Wide Web?  Businesses needed Web sites because customers who weren’t on the Web now would be soon… Because people would look up your business on Yahoo! or Alta Vista or AOL to try and learn about you…Because it was so cool to be on the Web!

It took a while to get there, but now the idea that a business could be viable without a website is ludicrous. It may well turn out that way for social media too.  But back to the first sentence — there’s a defensible body of wisdom that says social media for businesses isn’t about direct selling (Southwest Airlines excluded, as well as other online businesses), it’s about engagement.

So how do we know if our audience/stakeholders is/are engaged?

It could be blog comments, Twitter @ replies and RTs, Facebook “likes” or any number of seemingly independent activities. But do those activities really constitute engagement in a meaningful way?

I surmise that there needs to be more independent research to answer that question. As well, I wonder whether engagement really matters to the business, which is the pregnant elephant in the living room in measurement circles. I’m most concerned with what happens as a result of engagement than of engagement itself.

But I am comfortable with the notion of engagement as a goal, a weigh station on the way to a business objective. To use the academic vernacular, it’s likely an outtake — a measurable step on the way to business results — rather than a business result of its own.  Though some folks have averred that those who engage with a brand are more likely to spend and spend more than those who do not, the research is self-serving — it’s coming from firms who have a vested interest.  Open up the methodology in that black box and let’s have the math types run it through a wringer!

In the meantime, go ahead with your plans to engage publics — just be sure that engagement is in service to something that matters to business results.

Share

When You Don’t Need to #MeasurePR

Thursday, May 26th, 2011

No Measurement!

Being a measurement evangelist feels like really hard work sometimes. On the one hand, I haven’t been at it long enough to complain — witness the indefatigable Katie Paine and Angela Jeffrey, who’ve been toiling in the trenches for, well, a long time.

But there surely are situations where measurement is unnecessary, right?

For example, you’re, I don’t know, Walmart. Your stock is suffering, there are employee lawsuits, and one of your stores has been destroyed by a tornado. How much measurement do you need to do to know you’re media coverage is, well, tortuous?  It’s likely that no amount of proactive management is going to turn your story around — at least not meaningfully.

Or, you’re a big money center bank — yep, the titans of capitalism currently getting the lion’s share of blame for the financial crisis (some of which is just wrong.) Can’t you make an educated guess about your coverage?

Aside from my personal financial stake in getting Walmart or a big bank to hire me to help them with measurement, I’ll give you three reasons why you should not measure – and three reasons why you should.

Forget Measurement When:

  1. You cannot make a difference. Sometimes business will hand you a dirt sandwich, and you have no choice but to eat it. There’s no need to weigh the sandwich, examine the types of dirt , evaluate the sandwich-maker, etc. Just eat it and move on.
  2. You’re unwilling to do what it takes to make things better.  Often, the worst media situations are when you’re “making tough choices.”  Layoffs, facility closures, moves from one city to another, hiring more executives. The path to turning the story around leads through the organization revisiting its management decisions — deciding not to outsource, keeping the plant open and operating, renovating existing headquarters rather than pitting your incumbent city against somewhere else.  See #1, above.
  3. It’s more expensive to measure than the program your measuring.  Advanced statistics are miraculous. We absolutely can measure the specific impact of public relations/communication activity on the bottom line. We just need a lot of data to isolate our impact from everything else that influences the bottom line.  That costs money (not as much as you might think, but still,) so let’s spend wisely.

Do Measurement When:

  1. You care about whether what you’re doing is working or not. You have objectives, and hopefully, they’re specific, measurable, achievable, realistic and time-bound (S.M.A.R.T.) They have a benchmark, target and timeframe. So, if you don’t measure, how do you know whether you’re making progress?
  2. You know you need to change.  Make data-driven decisions! Your intuition is flawless, of course, but as I’ve said many times, the days of PR/Communications being able to wave a hand and say, “trust me” to the c-suite are over.  A former boss told me, “facts and data win the day,” and that’s good advice.
  3. You need numbers to share with the numbers people.  Qualitative, quantitative, no matter. There are times when the people you need demand numbers. Measure to give them what they need.  Share of voice/discussion, peer comparison of tone of mention, trends in coverage overall, message presence/absence, correlation of coverage to Web traffic. Do measurement when you need to do it!

There is one other reason to do measurement — though more accurately, it’s research we want to do, not only measurement.  It’s the right thing to do. It puts us on a firmer foundation. It informs our opinions and enhances our credibility.

What’s your view?

Share

Two Twitter Chats: #MeasurePR Tues., #ICChat 21 April

Monday, April 11th, 2011

This Tuesday, 12 April, I pinch hit moderating the #MeasurePR Twitter discussion at 12 Noon Eastern, batting for the estimable @Shonali Burke. We’re going to talk B.A.D. measurement — BS, AllWet and Dumb.  It’s a continuation of  a theme for me — there’s so much crap measurement and stupid metrics that we need to squash, it’s worth chatting about. Who knows, maybe we’ll get some folks who disagree!  #MeasurePR is at 12 Noon, Tuesday, 12 April.  Secondly, a week from Thursday, 21 April, is the return of #ICChat on internal communications.  Frankly, the participation’s been a little light — maybe not enough internal commsters are on Twitter, or maybe it’s not a creative enough topic from me. Or, I haven’t marketed it enough. Whatever. If you want to talk Internal Comms, join us at 10 a.m. Eastern Time on 21 April.

Share

AVEs: The Zombie Metric

Monday, April 4th, 2011

Courtesy Josh Jensen, Toronto, Canada (Creative Commons)

It was a gray, windy, stormy day. And that’s just the reaction to Ragan’s PR Daily piece from Jessica Epperly declaring that Advertising Value Equivalents are the cat’s pajamas for PR Measurement.  AVE is the walking dead of PR metrics.

Andrew Bruce Smith (@andismit) commented on the post: “…200 delegates representing 33 countries and five global PR and measurement organizations (AMEC, IPR, PRSA, ICCO, The Global Alliance) voted last summer to declare that Advertising Value Equivalents (AVEs) do not measure the value of PR and do not inform future activity. In the UK, the CIPR (Chartered Institute of Public Relations) has effectively outlawed the use of AVE as a measurement metric. PR Week has also banned the use of AVEs as a success criteria in Awards Entries.”

What th…?

The only explanation is supernatural.  AVEs are the walking dead.  We can’t kill them, ever. Not as long as the Jessica Epperlys of the world continue to say they’re safe and friendly!

Share

Lies, Damn Lies, & Stinking Loads of …

Thursday, March 10th, 2011

Courtesy CBS Interactive & Star Trek

Remember that Star Trek episode where Captain Kirk is stuck on some barren planet with a 9-foot Godzilla-like lizard, and the two of them are supposed to fight rather than their respective armies? The big lizard hisses, “I grow weary of the chase. Wait for me — I will make it quick, and painless(sssss). That’s how I’m feeling about measuring social media right now.

It would be so easy to just give in.

I’ve been pondering how to measure influence, in particular, after a spirited discussion on both Justin Goldsborough’s and Shonali Burke’s blogs. That led to a bunch of posts on how we might use the structure of measuring relationships (Hon/Grunig).   This is heady stuff for peanut-brains like me.  The high-forehead types who make their living in the academe are used to thinking in these terms, but all of this stuff is pretty new for me. I’m just some guy, trying to puzzle out how to make sense of the concepts of influence in the social age, and apply the both new and hoary theories in the process. If I have to explain this stuff, I better have some ideas.

But there’s a lot more traction in just inventing a method and telling people it’s the standard, never revealing the contents of the magic box.  From Altimeter to Syncapse, to Vitrue to Klout, we learn that more-social companies have higher revenue than less-social (correlation is NOT causation); Facebook fans of a brand buy more stuff than non-fans (but which drives which?); Facebook fans are worth $3.60 (no, $136, no…), and that the “standard for influence” has something to do with Facebook and Twitter, but we’re not sure what because the formulas are secret.

H-E-double hockey sticks! I want to fight them all!

But, jeepers, why not just join them?  I came up with an idea last year to evaluate political material — know at a glance whether an article is left-or-right wing, moderate, or a combination of both.  I cooked up how it would work (programmed like automated sentiment), selected someone to write the code and even chose a name.

But it would have been a stinking load of … crap! I wasn’t basing it on any kind of research, just my own desire to make money, preferably by selling the company quickly to someone with deeper pockets, poor analytical skills and a short attention span.  Why go to all the trouble of vetting it, ensuring it actually does what it intends? That hasn’t stopped the flow of snake oil!

The class I teach at Kent State meets Wednesday nights, and on 9 March, the estimable Chuck Hemann, SVP for Ogilvy, joined us by Skype to talk to the class. He’s SUCH a smart dude (and he’s humble, claiming that I taught HIM stuff…) What my takeaway was: There are no easy answers to the social media measurement questions, and the snake oil is still gushing in the space. It takes some primary research, some actual analytical work, to figure this out. No shortcuts, no one-size-fits-all formula.

Here, I thought I’d missed the boat and should be hawking the Oil of Genius.  It’d be a lot easier than fighting the good fight, for sure. But I’m glad I’m still on the ramparts, exalting the troops to victory.

Even if I do, occasionally, “weary of the chase.”

Share

Metrics on Relationships May Apply to Influence

Thursday, March 3rd, 2011

Creative Commons

Influence has been on my mind for a while, and on Feb. 24, I posted a thought about using the methods recommended in a paper on measuring relationships by James Grunig and Linda Hon to apply to measuring influence.  The post of Feb. 28 looked at the first three of the six components of that relationship measurement strategy.  This one finishes off the list, but I’ll have more to write on this topic later on as this all percolates.

Continuing:

Commitment – The extent to which each party believes and feels that the relationship is worth spending energy to maintain and promote. Two dimensions of commitment are continuance commitment, which refers to a certain line of action, and affective commitment, which is an emotional orientation.

With no criticism intended, these last two terms are a little tough for me, so a bit of explanation. Affective commitment is the sense that the organization wants to have a relationship with me, there’s a bond between us, and I value this organization over others, so it’s my emotional perspective about that relationship. Continuance commitment if the sense that I see the organization’s actions in support of our relationship… I think.

This may fit with Twitter followers or Facebook friends. If my Twitter posse is retweeting and engaging me in discussion, I can conclude they’re interested in a relationship with me.  Their actions are the continuance commitment and my own feelings about them are the affective commitment.  This type of measurement seems like a good proxy for influence, as I can conclude that the absence of such commitment would stop influence in its tracks.

Exchange Relationship — In an exchange relationship, one party gives benefits to the other only because the other has provided benefits in the past or is expected to do so in the future.

Exchange relationships are the heart of commercial propositions. We pay someone for something and get it.  But, we could say that blog consortia could be evidence of exchange relationships – we agree to promote each other’s posts and comment on each other’s blogs in exchange with one another.  I am not sure whether the extent of that relationship is evidence of influence or commerce. {and not in a bad way, mind…}

Communal Relationship — In a communal relationship, both parties provide benefits to the other because they are concerned for the welfare of the other — even when they get nothing in return. For most public relations activities, developing communal relationships with key constituencies is much more important to achieve than would be developing exchange relationships.

This one’s the stretch, in my mind – organizations have an increasingly hard time convincing stakeholders that they’re really interested in stakeholder well-being. The management-employee communal relationship comes to mind. But on an individual basis, we could say that the maturity of social media depends on creating communal relationships online.  Actual friendship.  It seems like we’d need to see a low quotient of exchange relationship if the communal quotient is high for there to be solid evidence.

I want to explore this further – and I’d like you’re help… How do your own influencers (those who influence you) align with these elements (or not?) Does this make any sense at all to you?

 

Share

Measuring Influence ‘Might’ Use Relationship Metrics

Monday, February 28th, 2011

 

Creative Commons, by Brian Hillegas

I’ve been thinking again. Last time, I tossed out the idea that measuring influence might be gleaned from Grunig and Hon’s work on measuring relationships.  Usually, you need to get people to fill out a questionnaire to determine the quality of the relationship, but maybe looking at the public evidence is enough.  Here are three of the six elements, with comment following about the potential for adapting to qualitative influence measurement:

Control Mutuality — The degree to which parties agree on who has the rightful power to influence one another. Although some imbalance is natural, stable relationships require that organizations and publics each have some control over the other.

Think about that in context of online influence – being “Facebook friends” might imply a mutual influence, but being friends with an organization if one’s not a customer or other stakeholder wouldn’t seem to greet the same implication.

Still, the idea that an organization would change its behavior as a consequence of interaction with its stakeholders is the essence of Grunig’s Excellence Theory (two-way, symmetrical communication.) Retweeting on Twitter, and a content analysis of the @reply sequence (actual conversations) might lead to an index by topic – it could demonstrate the extent of control mutuality as a surrogate for mutual influence. The question is whether there’s enough in the stream to properly analyze.

Trust – One party’s level of confidence in and willingness to open oneself to the other party. There are three dimensions to trust: integrity: the belief that an organization is fair and just … dependability: the belief that an organization will do what it says it will do … and, competence: the belief that an organization has the ability to do what it says it will do.

This, too, could be accomplished by content analysis, substituting individual for organization. Establishing the extent of trust could also indicate the opportunity for influential behavior, which could be apparent from the stream. We’d need to define the language trusted people use, but that doesn’t seem much different from a normal content analysis.

Satisfaction — The extent to which each party feels favorably toward the other because positive expectations about the relationship are reinforced. A satisfying relationship is one in which the benefits outweigh the costs.

This one’s tough – the nature of the relationship plays in to the analysis of satisfaction. Celebrities may make general comment about loving their fans, but is that a sincere platform for mutual satisfaction? Also, if the expectations are very low (as in celebrity culture, where the connection is, um, tenuous in reality but provides a simulation of a close relationship), does that negate the influence string?  My putative 14 year-old son may get his hair in a Beiber, demand I buy Beiber music and Beiber-esq purple garments, but is that influence or a phase? Or merely effective marketing?

Next post: the remaining three elements.

Share