Posts Tagged ‘ROI’

Measurement Crucial to PR’s Business Value

Tuesday, May 18th, 2010

My learned Australian colleague Geoff Barbaro waxes rant in a post from 17 May (US time), where he inveighs against measurement.  Perhaps not the concept, as much as the practice. He asks:

Do you measure how you look after your family? Do you count the meals, the trips to school, the time spent with children to evaluate effectiveness? When you buy that great new dress or suit that you love, did you then sit down and work through complex metrics to measure what you did?

So why do you think it’s different in business? I’ll tell you why, it’s because you don’t trust people to do the job you employed them to do. You don’t believe they are motivated and care about their work, so you can only make sure they are working by measuring what they do, and then argue that this is the motivational tool. Measuring because “we do what we measure” is a failure of leadership, a failure of motivation, a failure of selection, a failure to define values, a failure of engagement and a failure of communication.

Sorry, Geoff, but this is fuzzy-headed thinking about a vital enhancement to the profession of Public Relations.

I started a comment on Geoff’s blog (a fine and interesting read, btw), but found that it was all too likely that I’d hijack it. And that’s not right. So, here is my reply to Geoff’s shot across the bow. Man the torpedos!

========================

Oh, my. Nothing like an existential rant to get one’s blood up, eh Geoff?

Let’s start by differentiating terms. Measurement isn’t gotcha. It’s not “check-up-on-the-poor-employees.” Neither is it merely about outputs or activities, at least not when it’s strategic.

We in PR have long been the only department in a firm that can say to the C-suite, “trust me” and get away with it. The question on the CEO (and CFO, especially) mind these days, however, is, “What business value do I get for my investment in PR?”

We can take a SWAG (stupid, wild-assed guess) at the answer, but then we sound like witless weasels (um, we build reputation and protect…uh, no, uh, we get media coverage…no, uh, we help the organization communicate effectively, wait, ummmm.)

The fact is that most of us don’t have a clue what the quantifiable business value of PR is, and that’s why PRSA has commissioned a task force to work on that very question. It’s also one of the driving forces in modern PR. It’s created an industry specialty that people are finding value in, even though there is much sophistry and bad measurement out there.

In modern business, every department must contribute to the bottom line. So, direct sales and the support for sales is a winner, as is direct effort to improve efficiency, save money, etc. There’s also credible research about the effect on brand awareness, attitude and disposition of various PR activity. On the internal side, engagement metrics, and employee knowledge and behavioral metrics lend credence to a communicator’s value.

The trick is to a) Measure what matters; and b) Link communication outputs to business outcomes. This is, indeed, a hairy process, filled with risks — bad math the most prevalent, if you ask me.  Correlation is not causation, but frequently it’s a pretty good stand-in for it, if your math is good.  We mustn’t give up on the goal of establishing impact metrics and ROI just because it’s so much easier if we don’t!

I don’t know, Geoff, if I agree that “what gets measured gets done,” but I’m sure that if you can’t measure it you can’t manage it.

Cheers,

Sean

@commammo

Share

Theater of the Absurd in Social Media Metrics

Tuesday, May 11th, 2010

As we PR people feel our way along in social media, the marketers are declaring the End of Times for everything else. Anecdotal evidence shows that big companies are pulling big money out of traditional advertising and funneling it into social media, and that bears examination.  But as I’ve said, I’m not ready to write obits for mass marketing/advertising in favor of “marketing to a segment of one” right this very minute.

I first heard that phrase (Marketing to a segment of one) from the lips of Steve Cone, legendary marketer and then-CMO with KeyCorp. He was the architect of dropping the “Corp” and/or “Bank” from the company name in favor of the symbol you see at right.

That made Key one of just three companies in the US bearing an eponymous symbol for its name. Shell and Apple are the other two.

Key made a strategy of getting people to see the Key logo and associate it with “bank,” as in, “I need to stop by the Key on the way home.”  The idea, Cone claimed, was to stop thinking of mass marketing — with all of its efficiency and logical, numbers-driven strategy, and think of “marketing to segments, eventually to a segment of one.” So then came emerging affluents, wealth management, small business, middle market, large corporate — all of those categories based on grouping customers in some logical way, then changing strategy to target them.

This requires information about customers and prospects. When it comes to social media, that information is scattered to the four winds, unless you’re on Facebook.  Twitter’s foray into geo-location, Foursquare, and many other social media firms are trying to gather as much data about YOU as possible to facilitate what is a pretty old marketing model.

Just as at the onset of the Web Age you had hundreds of companies popping up to “help” companies enter the Internet realm, now at the onset of the Social Media age you have companies popping up to “help” companies enter this realm. The part that twists my noodle is when companies purport to know how to measure social media come up with yowlers — like the Vitrue Facebook fan value imbroglio, the Altimeter study on correlations between social media activity and stock appreciation, and now Vitrue’s assertion that frequency of mention in social media is somehow a reflection of its social media reputation.

Vitrue offers a chance to compare brands in a handy Flash gobo that produces a cool pie chart. Just for fun, I compared Ford (which Vitrue pronounces its winner) with a couple of random words — sure enough, pop “the” in there, and you find upteen thousands (OK, 134,000) ‘somethings’ and the aforementioned cool pie chart. Ooh, and there’s a bar chart too! So kewl.  W00t!

I could go on for 1,500 words, but won’t. It’s another cow pie pretending to be a metric.  Resist this assault on rational thinking.

Share

Survey: Internal Comm Effectiveness ‘Important Concern,’ But…

Thursday, April 1st, 2010

Researchers Dr. Juan Meng of the University of Dayton (Ohio) and Dr. Bruce K. Berger of the University of Alabama cut to the chase in their research presentation at the Institute for PR International PR Research Conference. Their first finding? “Though communication effectiveness has been an important concern for organizational leaders, the assessment of communication effectiveness has not been widely applied by using business outcome metrics in organizations.” Sigh.

Meng and Berger used both the results from the 2007-2008 IABC Research Foundation/Watson Wyatt international survey of senior communicators, and a series of in-depth interviews with 13 IABC Gold Quill winners to look for process links between internal communication effectiveness and organizational financial performance.

For me, this represents a sort of Holy Grail: we internal comms experts know that our work is impactful, but have lacked the hard evidence of causality that we perceive the C-suite respects and demands. I was disappointed, yet again, though that first finding is by no means the only one.  In brief, the other five are:

  • Measuring internal comm effectiveness should be standard operating practice.
  • There’s lots of measurement going on, evaluating awareness/understanding; engagement; job performance; employee behavior, and improvement in overall business performance.
  • Everyone has good reasons why measurement isn’t as robust as it should be, and they’re the usual culprits — lack of time/money/staff and the pain of finding actual cause-and-effect toward business results.
  • The measurement approaches used are employee surveys, employee participation in communication activities and manager surveys.
  • Four valuable purposes for internal communication: Explaining/Promoting programs and policies; educating about culture and values; providing information about performance and financial objectives, and helping employees understand the business.

At Goodyear, we made great progress toward true outcome measurement for internal communications, but didn’t quite get there. We did establish a strong link between employee knowledge/comprehension, intranet use and managerial behavior, but never got the chance to take everything to the organizational performance level.

At National City Corporation (the regional bank), our focus from the first day I arrived was on external measurement, for a variety of reasons. But the internal side wasn’t ignored — we were a Gallup Q12 company, and despite the wretched economic conditions and horrific, calamitous financial performance of the company, we still topped 94% participation in the Q12.  Right until the last moment, we were using Q12 results in our planning process, as well as beginning to use editorial content more strategically. But, again, we weren’t reaching the business outcomes level of measurement.

Here’s a quote from one of Meng & Berger’s in-depth interviews:

I think the biggest challenge in measurement continues to be convincing clients to spend, not so much the money, but to spend the time. As the industry develops, I don’t have a hard time in convincing them about the validity of measurement, but they are reluctant to actually take the time away from business to actually administer surveys or focus groups or some other measurement tools.

Looks like we have to continue making those tools easier to use and more valuable, even as we continue to scale the mountain tops for the Holy Grail.

Share

Communicators too often out the door in hard times

Monday, March 8th, 2010

I’ve been a regular reader of the New York Times’ Corner Office series, where they interview a senior executive, usually a CEO, about how they hire, how they lead and manage and what they do.  There is a central theme that runs through literally all of these interviews: communication excellence.

Every exec talks about how important communication is to their work — both by them and with them. Of course, there is a bit of the “usual” about that kind of statement. No one would ever say, “communication is not important at all in my work.”  But what I find striking about this observation is that ostensibly, we public relations people are the experts in communication, but get too easily dismissed from the leadership table.  We are welcome during times of crisis (the one time, it seems, that the mahogany row types understand our value) but aren’t regularly consulted about the communication dynamics of decisions.

Additionally, financial pressures often lead to cuts in the communication staff that could help the company deal with the financial issues, particularly internal communication.  It’s a fact that internal communication pros earn less than their media relations colleagues and tend to be lightly regarded. I’ve encountered this in my own career. I feel reasonably comfortable saying that generally, businesses don’t care about internal communication very much at all. They care about “getting the word out” internally, or “making sure we’re all rowing in the same direction.”  But honest improvement in the process of communication within the enterprise? Not so much.

Why?

Some of the issue emerges from a distinct lack of communication curriculum in colleges of business. Marketing, management theory, finance and operations, but no communication theory that could help leaders understand their workers (and customers) better.  More of the blame goes to convenient financial thinking. It’s easier to impose across-the-board cuts than dig into an income statement and excise the real waste, duplication and nonessentials.

One company had a largely decentralized communication structure that permitted significant duplication in communication infrastructure. Some such duplication is inevitable in a multi-national company, but why have 40-something different intranets, run on multifarious platforms? Why not unify newsletter design under a singular brand?  This company really has no idea what it spends on communication, because the units are autonomous — the financials are opaque.

Canada’s Bombardier (a few years ago) published a paper newsletter that permitted regions to wrap their own around the corporate version. All the design elements reinforced the brand. You knew it was a Bombardier newsletter whether you were in Montreal or Dublin, Ireland. That kind of consistency is economical.

How about automating manual processes on the intranet? Sounds like it should be an easy sell, but companies look at the up-front costs and decide to forget it.

I fault us.  As the putative experts, we should have a deep understanding of how moving communications levers will create value for the business.

But too many of us don’t have a clue, and that means, when the going gets tough, we’re the ones who get told to get going…out the door.

Share

The Measurement Debate Continues

Tuesday, February 2nd, 2010

The estimable Shonali Burke has started a fortnightly Twitter chat — #MeasurePR — that begun 2 February, with the equally estimable Katie Paine as first guest. I caught only the last half, which featured good discussion and the usual paroxysm over advertising value equivalency. AVE is bete noir for @KDPaine and @Shonali, who both are categorical in their condemnation of the practice. A couple of participants, however, say that there still is demand on the part of clients for AVE.

The Institute for PR Measurement Commission condemned AVE last fall, AMEC (the professional organization for media evaluation firms) has declared its intent to find a logical replacement, and a recent paper offered Weighted Media Cost as an element worthy of inclusion in measurement programming. Where does this leave us?

I have no stake in this game. My personal belief is that AVEs are bad science, but I’m also sensitive to the need to help clients. AVE is easy for a client to grasp — “if we paid for the space our story ran in, it would have cost us X.”  Katie points out that doctors won’t prescribe a medicine if it’s not right for the patient. AVE isn’t life and death — but what do we do after we’ve explained the drawbacks and negatives and the client still wants it?

I can’t help but put myself in that situation — young company, trying to latch on with a client. Do I tell the client “No. I won’t do AVE” and risk having him/her say, “Well then, I’ll go find someone who will!” ?

#MeasurePR had much more great content than this AVE nonsense, and I really do wish we could collectively move on. I’m done writing about the debate, at least for now.

Looking for a quick way to improve measurement?

Start setting objectives and measuring your attainment of them. Stop worrying about generating lots of eyeballs and do some audience research to reach the right ones. Start looking for correlations between your various communication outputs (and outtakes) and business metrics, such as revenue, cost savings, cost avoidance, time saved, help desk traffic, speed of benefits enrollment, travel system savings, expense systems savings, etc…

Share

Objectives most critical element in measurement

Tuesday, December 1st, 2009

One smart PR pro told me years ago that even the best road map is useless without a destination. Because so many communicators are struggling to understand the role of strategy in a world of fascinating tactics, it can seem like the universe is throwing map after map to us, shouting “you need this right now!”

When I step back from “being strategic” (quite a trick for someone once called, with some derision, “strategy boy”) it is no exaggeration to say, echoing the travel metaphor, that the best strategy is useless without an objective.

Strategic objectives need three things: 1) a benchmark. You need to look back to see where you’ve been. 2) A target. You need to look ahead and see where you’re going. 3) A time period. You need to articulate how long it’s going to take to get from where you were/are to where you want to be.  If you’re missing any of those things, chances are good that you don’t have a strategic objective.

The trick is, too often, we set objectives with no clear understanding of where we are, let alone where we were. That’s where research comes in. It’s right out of PR 101 — start with research before you launch a campaign — and we find lots of reason not to do the research. Sometimes it’s related to cost, sometimes to our own skillsets. We like to think of ourselves as creative geniuses, unencumbered by such trivialities. This attitude is especially prevalent in media relations, where our relationships and seat-of-the-pants skills can mean so much in a crisis; when things go right in our activities, that can reinforce the perception that PR is art, rather than science.

Of course, our “gut” is merely the application of our accumulation of experience, both in terms of time and in terms of education. We think we know what our employees, or our customers, for example, know/think/feel about our organization, when we could remove any uncertainty with some simple research.

But, I digress — the objective-setting process is even more important when considering social media.  Too many organizations are jumping in without a clear idea of what they want to accomplish.  More on this topic to follow.

What about your communication planning process? Does it start with objectives?

Share

Still stuck on AVEs

Monday, November 23rd, 2009

The continuing debate over advertising value equivalency reached the pages of the New York Times 22 Nov., with a “Soapbox” piece saying Hollywood studios are cutting ad budgets and using public relations as an alternative. One anecdote:

Disney recently went so far as to develop a computer program to help it determine how much monetary value was coming from such publicity efforts. It can quickly plug in data — “Access Hollywood” had a 30-second interview with a star of “The Middle,” a new ABC comedy — and the program spits out what that same 30 seconds would cost to buy.

AVEs are a sore spot in PR circles these days.  KD Paine, measurement maven extraordinaire, has campaigned against them for years as bogus figures that don’t quantify the value of media hits. The Institute for PR Measurement Commission (of which I am a member) officially condemned the practice in October, and PRSA has formed a blue-ribbon panel to address measurement generally — looking to a world without AVEs.

I believe there are certain circumstances where AVEs are useful — product publicity, for one, where features and benefits are the subject. But AVEs need to be net of cost, be based on actual charges, not simply “book rate,” and the publication has to be targeted to the specific business need. My example is Goodyear, the tire company. If they get a product review in Road and Track, it’s going to be relevant to their audience, include features and benefits, and in nearly all cases quite similar to an advertisement. What’s unaccounted for is the reader’s perception of value — AVEs are limited by an inability to include the weight of third party independence.

Look, notwithstanding this last paragraph, AVE is a bad metric 90 percent of the time, and there are other ways of evaluating media coverage that are better.

So, why does it appear that so many firms are stuck on this difficult metric? Well, AVEs are simple to understand. Here’s what it would have cost us to buy this time or this space — that’s a lot easier to grasp for a lot of people. There also is the pressure on PR agencies levered by their clients — “I understand you don’t like AVE, but I have to have a dollar figure to tell my CEO, so if you don’t give it to me, I’ll find someone who will.”

Still, I wish that more companies would stop using AVE. Oh, and that more people would understand that PR isn’t limited to publicity and press agentry. Perhaps the best reason not to use AVE is that it doesn’t measure the reputation work that represents most of what PR work is in business these days. For every stunt PR trick, there are months of quiet conversations with centers of influence, months of work on helping employees better understand their industries and organizations, and programs designed to help people grasp the significance of a company’s role in the community. There is more to our profession than being a low-cost replacement for marketing.

Share

Discussions you should read

Tuesday, November 17th, 2009

Several good ones:

Rich Becker — great discussion in the comments on social media concepts…

Brian Solis — Do we need to redefine “influencers?”

Chuck Hemann — What impact on social media use/adoption does organizational culture have ?

Paul Seaman — The Excellence theory says PR is about fostering relationships. Paul disagrees.

Share

Ethics in PR: The Social Media Question

Tuesday, November 10th, 2009

In the political firestorm that engulfs the United States, one side claims the other has no principles, whilst the other claims their opponents show a slavish devotion to ossified beliefs that make no sense in modern America.  Moral relativism, one side’s rhetoric goes, has brought our society to the brink of destruction. Outmoded thinking, the other side’s speaking points read, has made our country a cruel, Darwinist dystopia, where “survival of the fittest” is played out in policy.  For some reason, the ongoing debate of tea parties and new Fascism makes me think about public relations.

The collapse of centralization of news and the growth of social media is fueling a similar decamping in our profession.  On one side, those who believe that social media is an incarnation of evil, bent on destroying the concept of objectivity and authoritative sources, not to mention the homicide of the public relations industry. On another side (there are more than two), those who see social media as the democratization of information and the dissolution of concentrated media power, elevating ordinary people and adding to the diversity of voices in the media mix.

The ethical questions percolating for me these days relate to our role as PR people in participating in social media.  In the sense of the “Excellence Theory,” social media should represent the triumph of two-way, symmetrical communication; active engagement of organizations and their stakeholders, seeking mutual benefit.  But it seems to me that organizational participation in social media is still largely an asymmetrical game of persuasion, of message sending rather than dialogue. Marketers dominate the conversation online, devaluing PR objectives regarding reputation in favor of metrics focusing on revenue generation.  Organizations continue to struggle to find applications for social media inside the enterprise (speaking broadly here; fully aware there are exceptions), as despite efforts to embrace openness and multi-directional communication, command and control is difficult to release.

The dilemma for practitioners is especially acute for agencies and suppliers, and the ad value equivalency debate is an example. AVE has been discredited for years, but is still in common use because many clients demand it. They understand it, and AVE provides a shorthand description that they find useful.  The Institute for PR Measurement Commission recently condemned the practice, with one member writing that just because something is popular doesn’t mean it’s right.  When a client pays an agency and asks for AVE, we should say “no,” goes that argument. But the fear is that, “If I don’t give them AVE, they’ll go find someone who will.”

On the social media side, should all organizations use social media?  What is our ethical responsibility here? I’d be hard pressed to say that everyone should embrace social media.  I cannot make that claim, that is, if I care about giving good advice to my client. It’s not much different than telling a client reflexively that they need an intranet, or a newsletter, or a video. I need to understand the client’s objectives before I jump to tactics.

That doesn’t even address the more serious ethical challenges represented by social media.

Look at the Astroturfing issues, from fake blogs to agency staff commenting on client products.  Is the free market of ideas and caveat emptor sufficient to rein in those who have no compunction about engaging in such tactics?

I have always been an idealist with respect to media, seeing the years between Edward R. Murrow and Watergate as the pinnacle of journalism, heroic reporters, courageous editors and committed publishers digging for The Truth, all with peerless ethical grounding. The disappearance of even the pretext of objectivity in journalism (reaching its zenith — or nadir — with MSNBC/Fox News/The Washington Post/New York Times) has disgusted me, even as I admit that objectivity was a goal, not a reality according to my own journalism professors. We could aspire to objectivity and embrace fairness, something few media outlets now even attempt, at least by my crude measure.

Certainly the outright failure of the trust equation (media, government, business all suffer), should be laid bare here. One must evaluate the media’s biases and objectives, and caveat emptor reigns there, as well.

People determined to do wrong will find a way if their personal ethical compass permits. Maybe that’s the scariest part of all of this. We’re relying on individuals to manage their own ethics in a time when ethics are subjective, not objective, and right and wrong are relative concepts.

Share

Great discussion at [grow] on Social Media dissent

Monday, September 21st, 2009

Mark W. Schaefer writes a great blog, and today there is a terrific discussion there regarding the echo chamber surrounding social media’s expert class, the Chris Brogan, Brian Solis, Julien Smith, Beth Harte, Amber Naslund slate.  Namely, Mark observes that we are lacking strong dissenting voices.

Obviously, there are a few people out there who are refusing to drink the social media Kool-Aid — @amandachapel the most notable.  My own experience with social media as a user is putting me in the class of skeptics, not outright refuseniks, but I have been asking about the value of social media in PR and bemoaning the lack of objective, independent research to evaluate the often breathless claims of its moral superiority.

At the [grow] blog, commenter @tamadear offers this important proviso:

Nobody responds well to “You’re wrong; I’m right” dissent, to those who dwell on our weaknesses. It makes us defensive and unwilling to listen.

This is very true, and is why in virtually all of my consulting (both inside and outside organizations) I always assume that I may be wrong and use language accordingly.  There are far too many pronouncements, baseless and unresearched, in all of public relations, but especially in social media.  I have used the term “self-described experts” many times because I have no visibility into the qualifications of the speaker (or writer). Many of them could be literally anyone, and will even call out their lack of qualifications as a benefit of working with them. From Drudge’s refusal to be called a journalist, to Chris Brogan’s declaration that he is not in public relations, I’m often left wondering why I am supposed to regard these people as authorities.

With a tip of the cap to @amandachapel, it’s “caveat emptor” in the world of communication these days — there is big money to be made (a worthy effort that I share the desire to attain) and precious little objective information to help the consumer evaluate claims.  There are also few best practices that include true outcome measurement of the sort Olivier Blanchard describes in his excellent slide show, “The definitive social media ROI presentation.”  My only beef with the esteemed BrandBuilder is that such end-state ROI calculations performed without care lead to assuming that correlation equals causation.  We would love to see revenue increase and expenses go down concurrent with our social media campaign, but what percentage of the improvement is due to social media and how much due to other factors, including simple continuous improvement?

This is the point of the dissent discussion — for every Olivier and Mark there are five people claiming that the action of participating in social media IS the return on investment. That’s just not going to fly, and the more the experts try to convince people otherwise, the worse off we all are.  The “conversation” MAY be important — it always has been prior to all of this Web. 2.0 stuff — but aside from questionable research by the people poised to benefit the most from its findings, there simply isn’t much data at this point to declare the social media discussion closed.

What’s your view?

Share