Posts Tagged ‘Research’

Theater of the Absurd in Social Media Metrics

Tuesday, May 11th, 2010

As we PR people feel our way along in social media, the marketers are declaring the End of Times for everything else. Anecdotal evidence shows that big companies are pulling big money out of traditional advertising and funneling it into social media, and that bears examination.  But as I’ve said, I’m not ready to write obits for mass marketing/advertising in favor of “marketing to a segment of one” right this very minute.

I first heard that phrase (Marketing to a segment of one) from the lips of Steve Cone, legendary marketer and then-CMO with KeyCorp. He was the architect of dropping the “Corp” and/or “Bank” from the company name in favor of the symbol you see at right.

That made Key one of just three companies in the US bearing an eponymous symbol for its name. Shell and Apple are the other two.

Key made a strategy of getting people to see the Key logo and associate it with “bank,” as in, “I need to stop by the Key on the way home.”  The idea, Cone claimed, was to stop thinking of mass marketing — with all of its efficiency and logical, numbers-driven strategy, and think of “marketing to segments, eventually to a segment of one.” So then came emerging affluents, wealth management, small business, middle market, large corporate — all of those categories based on grouping customers in some logical way, then changing strategy to target them.

This requires information about customers and prospects. When it comes to social media, that information is scattered to the four winds, unless you’re on Facebook.  Twitter’s foray into geo-location, Foursquare, and many other social media firms are trying to gather as much data about YOU as possible to facilitate what is a pretty old marketing model.

Just as at the onset of the Web Age you had hundreds of companies popping up to “help” companies enter the Internet realm, now at the onset of the Social Media age you have companies popping up to “help” companies enter this realm. The part that twists my noodle is when companies purport to know how to measure social media come up with yowlers — like the Vitrue Facebook fan value imbroglio, the Altimeter study on correlations between social media activity and stock appreciation, and now Vitrue’s assertion that frequency of mention in social media is somehow a reflection of its social media reputation.

Vitrue offers a chance to compare brands in a handy Flash gobo that produces a cool pie chart. Just for fun, I compared Ford (which Vitrue pronounces its winner) with a couple of random words — sure enough, pop “the” in there, and you find upteen thousands (OK, 134,000) ‘somethings’ and the aforementioned cool pie chart. Ooh, and there’s a bar chart too! So kewl.  W00t!

I could go on for 1,500 words, but won’t. It’s another cow pie pretending to be a metric.  Resist this assault on rational thinking.

  • Share/Bookmark

Big Banks Get Whipped: 2008 News Coverage

Monday, April 26th, 2010

Think back two years. The financial crisis hit its gallop around this time in 2008, when the U.S. government sold Bear Stearns to JP Morgan Chase before its wrecked hull could breach and take the global economy down to Davy Jones’ Locker.  But that was just the beginning of a wicked huge bear market brought on by inflated real estate prices, preposterous mortgage loans, complicated and unregulated investment vehicles, and a collapse in confidence by everyone from global investors to your local school custodian.

Those of us who watched from a courtside seat (and wished we were in the bleachers, one bank CEO said) remember it all too well.

That’s why I thought twice about hearing University of North Carolina-Chapel Hill’s David Remund, a doctoral student, present his paper, “Crisis of Confidence: News Coverage of America’s Largest Banks During the 2008 Financial Crisis” at the 13th Annual International PR Research Conference.

Remund did a content analysis of news releases and national and local newspaper coverage of the 10 largest American banks for the second half of 2008, looking for some kind of systemic understanding about how these banks used crisis communication techniques to spray some pain-killer on the daily parade of negative information marching down Main Street.

Two crisis communication theories applied: Image Restoration Theory, which holds that if you’re at fault, you admit it and share the steps you’re taking to address the situation and prevent it from recurring. Situational Crisis Communications Theory says that you need to show concern for people who’ve been hurt by your crisis. Remund’s hypotheses offered that banks that acknowledged the financial crisis and showed concern for consumers in their media relations efforts would enjoy a higher proportion of confidence-building news coverage as a results.

Whoops. Remund’s findings were the exact opposite, with neither hypothesis supported.

Instead, the media pretty much held that banks’ actions contributed to the financial crisis, and the quietest banks got the greater proportion of positive coverage.  So, what happened?

As I wrote in my own research covering one company, the crisis had so many contributing factors, was so broad and so extensive that we got to the point where facts and data simply didn’t matter. It was a mob, running headlong down the street screaming, “Run! Run!” Everybody had to run, even as they asked what what happening. Secondly, Remund’s research drew from a rather small batch of news outlets and from only the largest banks.

Finally, by the third quarter of 2008, the news media wasn’t about to trust pretty much anything that banks had to say. Washington Mutual raised capital and swore up and down that it was solvent, even as its capital dwindled away toward federal seizure. Lehman Brothers didn’t think it had any problems in the summer and was dead by September. IndyMac, Countrywide, Wachovia, National City… all positioned themselves as in good shape — but what else could they say?

We PR people are always recommending the most transparent approach — the article of crisis communication faith seems to be , “Tell it first, tell it fast and tell it all.” Aside from a recent study, all the literature calls for that type of approach.  I believe it’s far more situational — once you’re in a systemic crisis that reaches past you and your world, your ability to affect its course gets a lot more difficult. Sometimes, you just have to wait it out.

The Remund study reveals more about the limits of crisis communication, than about bank public relations in a crisis.

  • Share/Bookmark

Two Important Reads

Saturday, April 17th, 2010

Will all that’s been going on lately (teaching class, presentations, conferences, client discussions) I’m a little behind on my reading. Good thing Google Reader keeps stuff around for me.  Two pieces from the Harvard Business Review website (AP Style says that’s OK now) bear a close read, one on the use of Twitter-type tools for internal communications, and the other summarizes several new perspectives on business strategy.

Tools such as Yammer have brought Twitter capabilities (microblogging) into the enterprise. Authors Jeanne C Meister and Karie Willyerd cover the cases of LG Electronics and Meredith Corporation in using Yammer and Socialtext to reduce the lengthy process of designing training programs and communicate speedily and across silos, respectively. Use Microblogging to Increase Productivity is worth your time.

In Strategy By Any Other Name, Walter Kiechel notes that speakers who usually discuss business strategy have been shoved aside by economists and journalists talking about the global financial crisis. He finds, however, that strategy has just gone a bit underground — it’s showing up “all over the place in contemporary management literature, albeit sometimes under different cover.”

Kiechel covers a lot of ground, with links to many resources. One that looks particularly interesting is The Power of Pull, by John Hagel and John Seely Brown.  Their core thinking is that the old economy “was based on ‘push,’ forecasting what would be needed or what would sell and then mustering resources to fulfill that demand.   The new world is one of ‘pull’ — find people and resources exactly when you need them, attract them to you even before you know they exist, and then pull the best from within them, and yourself, to achieve your potential.”

Certainly Hagel and Brown’s idea has history — we communicators have been trying to puzzle out the push vs. pull argument for a really long time (at least as long as I’ve been in this career, anyway.) I’m eager to add the book to my summer reading list.

In the meantime, check these two pieces out — and if you’re not reading HBR in some form, get on it.

  • Share/Bookmark

Why Vitrue’s Facebook Fan Value is Poppycock

Wednesday, April 14th, 2010

Vitrue, a social media marketing firm founded in 2006, snagged an AdWeek article this week when it announced that it had caculated the value of Facebook fans. It’s $3.60 per fan.  What’s behind the valuation? A rash of assumptions, according to a piece on the company’s Web site.

Why do I think this is wrong? Let me count the ways:

  1. Their data is proprietary. The company says it manages 45 million fans and drew the data from a sampling across industries, but they don’t specify the amount of the sample, the specific firms involved or any other information that might provide clarity as to the methodology. No one can cross-check the data.
  2. They make several assumptions: They say they looked at the ratio between wall posts and number of fans — asking how many fans have the potential to see a post. This is similar to using circulation in a print pub. Fine. But unlike circulation (audited) or even Nielsen Ratings, we’re assuming that all fans have an equal opportunity to see, and we’re assuming that a wall post is equivalent to an ad. Then, they say that multiple posts have equivalent impressions — two per day totals 60 million impressions on a one million fan page.
  3. They then say that these impressions are free, “similar to earned media.” But we know earned media is not free — someone had to do some work to make it happen. This is one of the insidious problems with ad value equivalency — there certainly are costs associated with generating earned media, and they must be accounted for.
  4. Next assumption, cost per thousand impressions. They settle on $5 CPM, based on nothing — wouldn’t this number depend on the specific outlet?  How about some science instead of conjecture? Multiply it out using their figures and it totals $300,000 in monthly value for the two post-a-day million fan page.  They show it like this:

1M impressions x 2 posts x 30 days = 60M impressions >>> 60M impressions / 1000 x $5 CPM = $300,000

But what I believe is most egregious is the idea that engagement on Facebook is really just a game of increasing advertising impressions. This is totally contrary to how social media is designed to work. It’s push-focused instead of relationship-focused. It’s shouting from the rooftops instead of talking to your neighbors.

Look, everyone has to make a living — advertisers are pretty comfortable in their “metrics every marketer is familiar with,” as Vitrue’s article says.  But marketers need to wake up — measure something meaningful!  I don’t know, but perhaps the fans are actually doing something that increases their intent to purchase? That improves their understanding of the product? That makes them have a more favorable attitude toward the company? That they bought something?

Surely any of those is a better metric than one based on made-up numbers, bad methodology, weak assumptions and false equivalencies.

Harrumph.

  • Share/Bookmark

Transparency: Always Best?

Monday, April 12th, 2010

It’s become almost a cliche. The conventional wisdom is that organizational communication requires “transparency through every aspect of corporate communications,” as Brigham Young University’s Dr. Brad Rawlins wrote in 2008. Openness, authenticity, successes and failures, ongoing discussion and abandoning the drive to maintain a perfect corporate image.  Dr. Brad’s colleagues at BYU, Dr. Rob Wakefield and Susan Walton looked into this assumption and found it wanting, according to their presentation at the 13th International Public Relations Research Conference in Miami in March.

Rob and Susan argue that there are two flaws in the practice of transparency that need to be clarified, as per the summary of their paper:

  1. Transparency often is interpreted as being completely open at all times — but there are times when it is in the best legal and moral interest of entities to not disclose, and in these times this is the most ethical stance for both organizations and their stakeholders; and
  2. Entities increasingly are self-proclaiming “transparent” communication, when investigation reveals that the claims are smokescreens to deflect actual lack of openness and honesty.

The authors conducted a series of interviews with seven senior level PR execs or consultants who work with PR leaders around the U.S., asking when, specifically, transparency is needed and good for organizations and society; when it’s better to not disclose information; and in what situations does transparency actually harm stakeholders?

I can’t do justice to Rob and Susan’s thinking in such a brief post, but in short, they learned enough to come up with an alternative to transparency — not a new theory, they hasten to say, but a different perspective: Translucency.

Something translucent lets in light, and one can see the rough outline of things, but those things aren’t entirely visible. Rob and Susan say there are four key considerations under which translucency can and should occur:

  1. Translucency is a commitment to communication to your stakeholders — not an advance commitment to what that communication will contain.
  2. Translucency occurs when credibility as already been established.
  3. Translucency might be most effective when there is reason to believe that an organization’s arguments and data are rock-solid, but not persuasive.
  4. Translucency is most effective when and organization already has put in place a process and structure for bringing greater light of information through the glass.

No one seems to want to admit that there really is a thing called “too much information.” Rob and Susan do a fine job offering a possible filter to address that problem.

  • Share/Bookmark

Survey: Internal Comm Effectiveness ‘Important Concern,’ But…

Thursday, April 1st, 2010

Researchers Dr. Juan Meng of the University of Dayton (Ohio) and Dr. Bruce K. Berger of the University of Alabama cut to the chase in their research presentation at the Institute for PR International PR Research Conference. Their first finding? “Though communication effectiveness has been an important concern for organizational leaders, the assessment of communication effectiveness has not been widely applied by using business outcome metrics in organizations.” Sigh.

Meng and Berger used both the results from the 2007-2008 IABC Research Foundation/Watson Wyatt international survey of senior communicators, and a series of in-depth interviews with 13 IABC Gold Quill winners to look for process links between internal communication effectiveness and organizational financial performance.

For me, this represents a sort of Holy Grail: we internal comms experts know that our work is impactful, but have lacked the hard evidence of causality that we perceive the C-suite respects and demands. I was disappointed, yet again, though that first finding is by no means the only one.  In brief, the other five are:

  • Measuring internal comm effectiveness should be standard operating practice.
  • There’s lots of measurement going on, evaluating awareness/understanding; engagement; job performance; employee behavior, and improvement in overall business performance.
  • Everyone has good reasons why measurement isn’t as robust as it should be, and they’re the usual culprits — lack of time/money/staff and the pain of finding actual cause-and-effect toward business results.
  • The measurement approaches used are employee surveys, employee participation in communication activities and manager surveys.
  • Four valuable purposes for internal communication: Explaining/Promoting programs and policies; educating about culture and values; providing information about performance and financial objectives, and helping employees understand the business.

At Goodyear, we made great progress toward true outcome measurement for internal communications, but didn’t quite get there. We did establish a strong link between employee knowledge/comprehension, intranet use and managerial behavior, but never got the chance to take everything to the organizational performance level.

At National City Corporation (the regional bank), our focus from the first day I arrived was on external measurement, for a variety of reasons. But the internal side wasn’t ignored — we were a Gallup Q12 company, and despite the wretched economic conditions and horrific, calamitous financial performance of the company, we still topped 94% participation in the Q12.  Right until the last moment, we were using Q12 results in our planning process, as well as beginning to use editorial content more strategically. But, again, we weren’t reaching the business outcomes level of measurement.

Here’s a quote from one of Meng & Berger’s in-depth interviews:

I think the biggest challenge in measurement continues to be convincing clients to spend, not so much the money, but to spend the time. As the industry develops, I don’t have a hard time in convincing them about the validity of measurement, but they are reluctant to actually take the time away from business to actually administer surveys or focus groups or some other measurement tools.

Looks like we have to continue making those tools easier to use and more valuable, even as we continue to scale the mountain tops for the Holy Grail.

  • Share/Bookmark

In praise of persistence

Tuesday, March 30th, 2010

Calvin Coolidge said it best:

Press on- nothing can take the place of persistence. Talent will not; nothing is more common than unsuccessful men with talent.

Genius will not; unrewarded genius is almost a proverb.

Education will not; the world is full of educated derelicts.

Perseverance and determination alone are omnipotent.

  • Share/Bookmark

Amazon’s Recovery from Kindle Content Deletion Crisis Evaluated

Wednesday, March 24th, 2010

In the middle of 2009, owners of e-reader Kindle got a nasty surprise when Amazon snatched back e-books that it turned out were supplied illegally. Amazon’s supplier didn’t have the rights to distribute the content, so Amazon accessed Kindles and deleted it.

Seems like no problem to me, but then, I don’t have a Kindle. Amazon got to enjoy seven days of flame and shouting for its trouble.

Drs. W. Timothy Coombs and Sherry J. Holladay of Eastern Illinois University (kind of a hotbed of pithy PR scholarship), presented a paper about Amazon’s week from hell at the 13th International PR Research Conference.  Dr. Coombs is a preeminent theorist on crisis communication, the author of several books and papers about it, and a good presenter who carries a quick wit with his slide rule.  He a smart dude.

Apparently, the “Kindle Community” was pretty angry about having “their” stuff unceremoniouslyyanked. Amazon’s notification statement lacked complete information, or ordinary human compassion, according to those who read it:

“The Kindle edition books Animal Farm by George Orwell, published by MobileReference (mobi) and 1984 by George Orwell, published by MobileReference (mobi) were removed from the Kindle store and are no longer available for purchase. When this occurred, your purchases were automatically refunded. you can still locate the books in the Kindle store, but each has a status of not yet available. Although are rarity, publishers can decide to pull their content from the Kindle store.”

Commenters went ballistic, and before you could blink, there were boycotts threatened. So Amazon CEO Jeff Bezos posted an abject apology, saying in part: “Our ‘solution’ to the problem was stupid, thoughtless, and painfully out of line with our principles.” He beat on his company pretty hard.

Coombs and Holladay found that the florid, nearly over-the-top apology worked very well. 71 percent accepted the apology, nearly 16 percent accepted it conditionally, and just 13 percent rejected it.  More important, more than 21 percent indicated they were more likely to buy from Amazon versus 10.5 percent said they were less likely to buy.

So what’s that mean? It means that Coombs’ main theories of crisis communication are holding steady in the online world — the process of admitting you’ve done wrong, taking steps to rectify the situation and ensure it won’t happen again, and beating yourself up a bit in the process result in restoring positive feelings among your stakeholders.

There surely are crises where this won’t happen — some things are just too bad — but this study gives additional support to the basis for advice during crisis times.

Watch for the complete paper in May when the IPRRC proceedings are released.

  • Share/Bookmark

Hooked on PR Research

Monday, March 22nd, 2010

One of the great professional pleasures of my life involves an academic conference filled to the brim with fascinating public relations research. It’s the International PR Research Conference put on by the Institute for Public Relations, and I’ve attended four of the past five years. That it’s held early in March in Miami, Fla., has NOTHING to do with it!

OK, well, it has a little bit to do with it.  The tropical breezes feel especially fine in the icy wake of February in Cleveland, and there is terrific food, shopping, pleasant walks and an excellent pool. But, other than that, it’s all business for three days.

I’ve had the good fortune to present at IPRRC twice; the first time, 2008, I presented a paper with my research pal Dr. Julie O’Neil of Texas Christian University that covered one large company’s internal communication program, focusing especially on the measurement of the work. It won an award, of which I am very proud indeed – the Jackson-Sharpe Award for research by an academic and a practitioner (I’m not the academic, or wasn’t…).

This year, I presented a work in progress, an exploratory study of corporate blogs and Twitter activities, with an eye on whether they’re demonstrating James Grunig’s Excellence Theory – are they conversations? – or other PR theories.

The idea is to see what actually IS in this space for 18 companies – the work is ongoing (frantically; the final paper is due May 1), and I was able to share a few key findings.

  1. There’s a lot of using social media as a broadcasting tool – no two-way, no evidence of symmetry (mutual change) – and persuasion, therefore, still rules.
  2. There are a couple of firms that are doing yeoman’s work and engaging in conversations – there are also seven or eight companies who’ve abandoned their blogs since December 2009.
  3. One industrial giant, interestingly, has subject matter experts blog and then engage engineers and customers in a discussion about improving the product – this is a rarity.
  4. Twitter as link-bait is quite in evidence.
  5. The Cluetrain may have left the station, but it’s creeping along a siding, not hurtling on a MagLev track.

This is hardly conclusive or particularly scientific – that’s why we call the paper exploratory. Dr. O’Neil and I have more work to do this coming month, but this paper is intended to be the first of three. Next step is a qualitative discussion with some of the people behind social media at our subject companies, followed (we hope) by a quantitative survey of users of corporate blogs and their associated Twitterverse (we’ll see; that’s going to take some cash…).

In the meanwhile, stay tuned over the next few days as I recount some of the work that impressed me the most at IPRRC this year.  Once our paper is done, we’ll share.

  • Share/Bookmark

The Measurement Debate Continues

Tuesday, February 2nd, 2010

The estimable Shonali Burke has started a fortnightly Twitter chat — #MeasurePR — that begun 2 February, with the equally estimable Katie Paine as first guest. I caught only the last half, which featured good discussion and the usual paroxysm over advertising value equivalency. AVE is bete noir for @KDPaine and @Shonali, who both are categorical in their condemnation of the practice. A couple of participants, however, say that there still is demand on the part of clients for AVE.

The Institute for PR Measurement Commission condemned AVE last fall, AMEC (the professional organization for media evaluation firms) has declared its intent to find a logical replacement, and a recent paper offered Weighted Media Cost as an element worthy of inclusion in measurement programming. Where does this leave us?

I have no stake in this game. My personal belief is that AVEs are bad science, but I’m also sensitive to the need to help clients. AVE is easy for a client to grasp — “if we paid for the space our story ran in, it would have cost us X.”  Katie points out that doctors won’t prescribe a medicine if it’s not right for the patient. AVE isn’t life and death — but what do we do after we’ve explained the drawbacks and negatives and the client still wants it?

I can’t help but put myself in that situation — young company, trying to latch on with a client. Do I tell the client “No. I won’t do AVE” and risk having him/her say, “Well then, I’ll go find someone who will!” ?

#MeasurePR had much more great content than this AVE nonsense, and I really do wish we could collectively move on. I’m done writing about the debate, at least for now.

Looking for a quick way to improve measurement?

Start setting objectives and measuring your attainment of them. Stop worrying about generating lots of eyeballs and do some audience research to reach the right ones. Start looking for correlations between your various communication outputs (and outtakes) and business metrics, such as revenue, cost savings, cost avoidance, time saved, help desk traffic, speed of benefits enrollment, travel system savings, expense systems savings, etc…

  • Share/Bookmark