Posts Tagged ‘PR measurement’

Useful Discussion on Measuring Social Media Influence

Tuesday, July 13th, 2010

Creative CommonsLynne d Johnson is working on a means of measuring social media influence, and is asking good questions about current tools and models. She rightly says that the core issue is a lack of a good definition of influence, and covers a couple of methods – Razorfish’s Social Influence Marketing Score and Altimeter’s Social Marketing Analytics — while calling for a deeper definition.

I always am wary about anything smacking of “calculators” in social media and PR, particularly those advanced by companies with an interest in selling social media as a revolution.  But Johnson’s role as SVP of the Advertising Research Foundation lends a serious imprint to the task. The ARF is working with the Word of Mouth Marketing Association (WOMMA) to create a set of social media measurement guidelines for the industry, she wrote.  My only concern is that the effort — being driven by marketers — will continue the marketing-centric, impression-oriented, reach-focused, quantity over quality mentality we’ve seen so far — or that it will be full of, well, BS metrics and methods.

Johnson writes of her similar concern, “I don’t think we’re talking about a wrong way of looking at influence, but we could be looking at only one side of the equation. In measuring social media, we have to listen, observe, and study to understand who the real influencers are. Perhaps an influencer’s influence isn’t driven online, but offline. Here’s where Razorfish’s SIM Score (or perhaps Altimeter’s Social Marketing Framework) can help us capture–along with the aid of engagement in a private community, an interview or survey–the offline component.”

Read the piece — it’s worth it.

  • Share/Bookmark

Internal Communications at its Best

Tuesday, July 6th, 2010

The UK’s Liam FitzPatrick wrote a post decrying the tendency of internal comms people complaining about manager communication incompetence.  FitzPatrick says: “I believe we get the internal clients we deserve.  If senior managers are used to a diet of crap communications support, that is all they’ll ever understand.”

He’s right, and he’s wrong.

The challenge always is whether to keep fighting or just give managers what they want.  FitzPatrick relates a story about a senior manager who wants “intelligence” about what employees are saying and thinking from her internal comms support.  There are a lot of things a skilled internal communicator can do to gather that intelligence, but much of the budgetary process is more output-focused than outcome-focused (echoing the same tendency elsewhere in corporate communications.)

The key for any of us is research (he said self-servingly — my practice includes research services, just sayin;.)

The research doesn’t even have to be quantitative, though tying qualitative assessment to intranet traffic, for example, can shed a lot of light on the effectiveness of our internal comms activities. We don’t have to do formal surveys, which can be very expensive and time consuming, if all we’re looking for is a snapshot to share for planning and strategy.

At Goodyear, we used an intranet poll to get just that sort of intelligence — it was a great window into what at least some employees were thinking, and it gave us a source of content, too.

But, there is no replacement for more formal measurement — even with qualification of our poll results, we still got management questions about the reach of opinion, which is a valid criticism. The old ROPE method (Research, Objective, Programming, Evaluation) still holds truth.

Meanwhile, read FitzPatrick’s piece. It’s worth reading (and commenting — no comments on his blog, so I wrote this post!)

  • Share/Bookmark

IT Conference Reveals Unexpected Connection with PR

Monday, June 28th, 2010

Ask most PR people whether they’d like to attend a conference filled with IT people. Go on, ask. Read the conference brochure and marvel at “2000 Years of IT Service Management,” “Achieving Technology and Business Superiority through IT Organizational Transformation,” and “IT Alignment: It Takes Two to Tango.”  It turned out to be one of the best conferences I’ve ever attended.

Everyone should take the time to assess their own objectives for attending a conference, seminar, luncheon or other event. Think through what you want to get out of it, what you’re willing to put into it. My objective, this summer, is to expand the network, among people who might want to engage my services.  I’ve been marketing myself through social media, and among communication organizations — the IABC Conference, my presentation to Lake Communicators, and this fall’s presentations at the PRSA International Conference and IABC’s Research and Measurement Conference.

While reviewing networking opportunities here in Cleveland on Pat Ropchock’s blog (she’s locked in big time), I noted “Integrate 2010: Uniting the World of IT” put on by the Greater Cleveland Local Interest Group of the ITSMFUSA – it’s a mouthful of an acronym that means, “IT people who want to be more relevant and strategic.”  They call the main discipline Service Management,” a process for aligning IT services with the needs of the enterprise.

The themes that emerged from most of the presentations I saw were fascinating.

  • IT feels like it’s not at the leadership table. Instead, they’re brought in after the business strategy’s in place and have to scramble to make things happen.
  • IT struggles to articulate its business value for all but a handful of services.
  • IT gets stuck on describing activities rather than defining its service portfolio in terms that the business leadership understands.
  • IT often can’t “sell” itself effectively, caught up in jargon and technical detail that isn’t relevant to leadership.

What happens if we replace “IT” with “PR” or “Corporate Communication?”

  • A consistent theme of IABC/PRSA material for years was “winning a seat at the table,” and then keeping it. We’ve been talking amongst ourselves for as long as I’ve been in the business about being business people first and communicators second. Yet, we’re still not there consistently.
  • Think about the debates over measurement methods — PR activity is difficult to isolate in the communication mix, and there are no standard answers for return on communication investment. Just last year, PRSA and the Institute for PR began working on a project to prove the business value of our profession. Internal communication is especially vulnerable to the question of ROI — and social media value outside of direct sales is still an unfinished book.
  • PR/Communications people frequently take as a given that their professional activities are impactful, regardless of the lack of data to support that claim. Our “service book” describes our activity from our perspective, not from that of our customers.
  • We (especially in internal communications) tend to resort to tactical explanations using our own lingo, rather than speaking about our work in terms readily understood by HR, Finance and leadership.

Sometimes it may seem like IT is on a different planet — more science than art, more Mars than Venus.  We, however, aren’t that different in our desires to be taken seriously by leadership as business people who employ specialized skills.

In addition to a few other things I discovered, this knowledge about IT was worth the price of admission.

More to follow on the conference shortly.

  • Share/Bookmark

Another IABC International Conference…

Wednesday, June 16th, 2010

I recognize that if I’m not a speaker at the big IABC soiree, I’m probably not the target audience for it. I’m not surprised, therefore, that my first blush reaction to the Toronto gathering wasn’t particularly positive.  My goal for attending this year was to meet some new people and make contact with some who I haven’t seen in a while. I hope to eventually get some business from it, but really just need to expand the network.

The programming and format are nearly identical to my first International, in 1995, also in Toronto. That one was a revelation — I was just 4 years or so into the profession, and everything was new.  Every session offered fascinating insights or enhanced skills.  I met scores of people and hung out with many, enjoying my first trip to Toronto and my first extended business trip in several years.

In 1997, L.A. was a different experience. Many of the speakers were the same as two years earlier, and in 2002 at Chicago, there were just a few sessions that really caught my eye. So I took a vacation from the big show until this year.

Things that impressed me:

Erin Dick from Pratt & Whitney — a social media case study that wasn’t from a Silicon Valley firm… Her use of blogs, Twitter, YouTube and Flickr to help support P&W’s client (the U.S.Government) on the selection of an engine for the Joint Strike Force fighter was off the charts — brilliant. And it had a fairly strong measurement component. I decided to Tweet the session instead of trying to take notes. The benefit was that I had a great summary, though my thumbs threatened to lock up from BlackBerry-itis…

William Amurgis from American Electric Power — Looking for use of social media in internal communications? Amurgis delivered. AEP’s blogs, discussion boards, employee-uploaded photos, etc., set a high standard of participation. The company’s intranet philosophy? Enhance employee productivity, reinforce corporate messages and provide a place to meet for all employees. Everything has to pass through that frame, or it doesn’t happen. And, rather than buy software solutions, AEP makes their own. Amurgis has a designer and a developer on his staff.

The UnConference — OK, it was a bit different than other UnConferences (usually low-or-no-cost, open to anyone; you had to buy the day (at least) for the IABC Conference to get in, and it wasn’t cheap) — but the method of operation was different and fun. There was no pre-set program, just a list of ideas posted on the TorontoTalks website (that a few people did discuss first), and three 5-minute “keynotes” — very informally delivered.  The three-hour session on Sunday afternoon was comprised of four 25-minute blocks of time with six possible topics (being held at six tables). We wrote on sticky notes our question or suggested topic, then stuck it on a flip chart in an empty time slot. The writer could lead the discussion, or someone else could.  I talked measurement (what a shock!) with seven other folks and it was fascinating. We didn’t solve the ROI question in full, nor did we get into other facets of communication, but it still was valuable and fun.

The thing is, the (nice) venue, formal structure and overwhelming size of the show made it hard to connect with people. Even the formal networking session (the big one held on the floor of the exhibit show) was just an hour long — not near enough time to connect. (I also didn’t attend Monday’s sessions — none particularly grabbed me. That might have inhibited my networking activities, so shame on me!)

The cost was pretty high for a new entrepreneur, not only in travel but in the conference fee. I’ll be considering very carefully before jumping on again soon. But, if I wind up as a speaker…

{FYI, I’m speaking in November at IABC’s Research and Measurement Conference in Seattle, as well as at the PRSA National conference in DC in October.  I’m also willing to come to chapter lunches, etc., and can make a deal for my PRSA/IABC fellow members!}

  • Share/Bookmark

Crisis Analysis, SocMed Use, Get Globe/Mail Attention

Friday, June 11th, 2010

Canada’s outstanding The Globe and Mail has two stories today worth noting.  Vancouver, B.C., retailer Lululemon is using Twitter to gather intel from its customers about what sizes and colors to stock; British Petroleum gets second-guessed in its crisis communication strategy under the headline, “Lessons in Leadership Spill from BP.”

BP’s feckless communication strategy, especially demonstrated by company CEO Tony Hayward’s frequent gaffes when speaking off the cuff, deserves to be pilloried. Hayward and company were obviously led by lawyers in this regard, minimizing the potential impact of the disastrous gusher, appearing too rarely in public and pointing blame to subcontractors. Hayward’s “I’d like my life back” rang especially tone-deaf in the wake of 11 deaths and the potential for catastrophic wildlife impact (not to mention the economic peril for the gulf fishing industry.) Several communication experts get quoted in Wallace Immen’s excellent piece, including Michael Stern (Michael Stern Associates), Prof. Julian Barling (Queen’s University School of Business), and Guy Beaudin, (RHR International).

Lululemon sells athletic ware, and by all accounts does a bang-up job of it. Some of the success, according to CEO Christine Day, is due to its use of social media — Twitter and Facebook.  Reporter Marina Strauss quotes Day: “We learn more about [which items are in demand] on Facebook and social media: what are the guests really screaming for, and so we use [the feedback] to get a little bit more indication.”

Keeping an eye on its 127,000 Facebook fans and 32,000 Twitter followers gets Day and company a faster view than its store performance metrics (and offers perspectives from people who are just thinking about going to the store, rather than having bought something there — that’s an interesting view on potential demand, the pipeline, some call it.)

The social media use has two purposes, according to the article — to gather information, and to drive traffic to the company website. When we’re looking for ways to measure the effectiveness of social media, website traffic is more often cited than the research value, which is a pity.  Going back to the ROPE method of communication planning (Research, Objectives, Programming, Evaluation), you don’t have anything without the research.

If social media served no other purpose than market intelligence, it’d still be worth the investment, no?

{P.s., my Canadian sojourn is nearly complete – back to a more regular schedule next week.)

  • Share/Bookmark

HBR: Research Shows Futility, Not Fear, Quashes Employee-Manager Dialogue

Wednesday, May 26th, 2010

A group of researchers looked into the state of employee-manager discussion and found that fear of retribution is not the leading cause of employee silence.  Instead, it’s futility, at least among the professional class, and among women, a Harvard Business Review story said today.

If this research can be extrapolated, the emphasis we communicator-types have placed on helping managers create a “safe” environment for people to speak up isn’t helping managers get the straight scoop that they need. It’s almost an HR article of faith that humanistic style, paying close attention, smiling and telling people you really want them to share is the path to effective leadership. Now this.

Does employee feedback matter? It does to employees, but we can’t get at the problem presented by this research without addressing the elephant in the living room… When they give feedback, does anything happen to fix the issues they share? It’s just like doing employee surveys — if you aren’t willing to change your organization as a consequence of the research, don’t do it.

The disappointment of truly thinking like a business owner and offering suggestions that go nowhere is soul-crushing. Why do it if it just doesn’t matter? Cue up Bill Murray and “Meatballs.”

On the other hand, what if organizations committed to changing where it makes sense and letting people know. Sounds kind of, well, motivational.

Nah.

  • Share/Bookmark

Measurement Crucial to PR’s Business Value

Tuesday, May 18th, 2010

My learned Australian colleague Geoff Barbaro waxes rant in a post from 17 May (US time), where he inveighs against measurement.  Perhaps not the concept, as much as the practice. He asks:

Do you measure how you look after your family? Do you count the meals, the trips to school, the time spent with children to evaluate effectiveness? When you buy that great new dress or suit that you love, did you then sit down and work through complex metrics to measure what you did?

So why do you think it’s different in business? I’ll tell you why, it’s because you don’t trust people to do the job you employed them to do. You don’t believe they are motivated and care about their work, so you can only make sure they are working by measuring what they do, and then argue that this is the motivational tool. Measuring because “we do what we measure” is a failure of leadership, a failure of motivation, a failure of selection, a failure to define values, a failure of engagement and a failure of communication.

Sorry, Geoff, but this is fuzzy-headed thinking about a vital enhancement to the profession of Public Relations.

I started a comment on Geoff’s blog (a fine and interesting read, btw), but found that it was all too likely that I’d hijack it. And that’s not right. So, here is my reply to Geoff’s shot across the bow. Man the torpedos!

========================

Oh, my. Nothing like an existential rant to get one’s blood up, eh Geoff?

Let’s start by differentiating terms. Measurement isn’t gotcha. It’s not “check-up-on-the-poor-employees.” Neither is it merely about outputs or activities, at least not when it’s strategic.

We in PR have long been the only department in a firm that can say to the C-suite, “trust me” and get away with it. The question on the CEO (and CFO, especially) mind these days, however, is, “What business value do I get for my investment in PR?”

We can take a SWAG (stupid, wild-assed guess) at the answer, but then we sound like witless weasels (um, we build reputation and protect…uh, no, uh, we get media coverage…no, uh, we help the organization communicate effectively, wait, ummmm.)

The fact is that most of us don’t have a clue what the quantifiable business value of PR is, and that’s why PRSA has commissioned a task force to work on that very question. It’s also one of the driving forces in modern PR. It’s created an industry specialty that people are finding value in, even though there is much sophistry and bad measurement out there.

In modern business, every department must contribute to the bottom line. So, direct sales and the support for sales is a winner, as is direct effort to improve efficiency, save money, etc. There’s also credible research about the effect on brand awareness, attitude and disposition of various PR activity. On the internal side, engagement metrics, and employee knowledge and behavioral metrics lend credence to a communicator’s value.

The trick is to a) Measure what matters; and b) Link communication outputs to business outcomes. This is, indeed, a hairy process, filled with risks — bad math the most prevalent, if you ask me.  Correlation is not causation, but frequently it’s a pretty good stand-in for it, if your math is good.  We mustn’t give up on the goal of establishing impact metrics and ROI just because it’s so much easier if we don’t!

I don’t know, Geoff, if I agree that “what gets measured gets done,” but I’m sure that if you can’t measure it you can’t manage it.

Cheers,

Sean

@commammo

  • Share/Bookmark

Big Banks Get Whipped: 2008 News Coverage

Monday, April 26th, 2010

Think back two years. The financial crisis hit its gallop around this time in 2008, when the U.S. government sold Bear Stearns to JP Morgan Chase before its wrecked hull could breach and take the global economy down to Davy Jones’ Locker.  But that was just the beginning of a wicked huge bear market brought on by inflated real estate prices, preposterous mortgage loans, complicated and unregulated investment vehicles, and a collapse in confidence by everyone from global investors to your local school custodian.

Those of us who watched from a courtside seat (and wished we were in the bleachers, one bank CEO said) remember it all too well.

That’s why I thought twice about hearing University of North Carolina-Chapel Hill’s David Remund, a doctoral student, present his paper, “Crisis of Confidence: News Coverage of America’s Largest Banks During the 2008 Financial Crisis” at the 13th Annual International PR Research Conference.

Remund did a content analysis of news releases and national and local newspaper coverage of the 10 largest American banks for the second half of 2008, looking for some kind of systemic understanding about how these banks used crisis communication techniques to spray some pain-killer on the daily parade of negative information marching down Main Street.

Two crisis communication theories applied: Image Restoration Theory, which holds that if you’re at fault, you admit it and share the steps you’re taking to address the situation and prevent it from recurring. Situational Crisis Communications Theory says that you need to show concern for people who’ve been hurt by your crisis. Remund’s hypotheses offered that banks that acknowledged the financial crisis and showed concern for consumers in their media relations efforts would enjoy a higher proportion of confidence-building news coverage as a results.

Whoops. Remund’s findings were the exact opposite, with neither hypothesis supported.

Instead, the media pretty much held that banks’ actions contributed to the financial crisis, and the quietest banks got the greater proportion of positive coverage.  So, what happened?

As I wrote in my own research covering one company, the crisis had so many contributing factors, was so broad and so extensive that we got to the point where facts and data simply didn’t matter. It was a mob, running headlong down the street screaming, “Run! Run!” Everybody had to run, even as they asked what what happening. Secondly, Remund’s research drew from a rather small batch of news outlets and from only the largest banks.

Finally, by the third quarter of 2008, the news media wasn’t about to trust pretty much anything that banks had to say. Washington Mutual raised capital and swore up and down that it was solvent, even as its capital dwindled away toward federal seizure. Lehman Brothers didn’t think it had any problems in the summer and was dead by September. IndyMac, Countrywide, Wachovia, National City… all positioned themselves as in good shape — but what else could they say?

We PR people are always recommending the most transparent approach — the article of crisis communication faith seems to be , “Tell it first, tell it fast and tell it all.” Aside from a recent study, all the literature calls for that type of approach.  I believe it’s far more situational — once you’re in a systemic crisis that reaches past you and your world, your ability to affect its course gets a lot more difficult. Sometimes, you just have to wait it out.

The Remund study reveals more about the limits of crisis communication, than about bank public relations in a crisis.

  • Share/Bookmark

Two Important Reads

Saturday, April 17th, 2010

Will all that’s been going on lately (teaching class, presentations, conferences, client discussions) I’m a little behind on my reading. Good thing Google Reader keeps stuff around for me.  Two pieces from the Harvard Business Review website (AP Style says that’s OK now) bear a close read, one on the use of Twitter-type tools for internal communications, and the other summarizes several new perspectives on business strategy.

Tools such as Yammer have brought Twitter capabilities (microblogging) into the enterprise. Authors Jeanne C Meister and Karie Willyerd cover the cases of LG Electronics and Meredith Corporation in using Yammer and Socialtext to reduce the lengthy process of designing training programs and communicate speedily and across silos, respectively. Use Microblogging to Increase Productivity is worth your time.

In Strategy By Any Other Name, Walter Kiechel notes that speakers who usually discuss business strategy have been shoved aside by economists and journalists talking about the global financial crisis. He finds, however, that strategy has just gone a bit underground — it’s showing up “all over the place in contemporary management literature, albeit sometimes under different cover.”

Kiechel covers a lot of ground, with links to many resources. One that looks particularly interesting is The Power of Pull, by John Hagel and John Seely Brown.  Their core thinking is that the old economy “was based on ‘push,’ forecasting what would be needed or what would sell and then mustering resources to fulfill that demand.   The new world is one of ‘pull’ — find people and resources exactly when you need them, attract them to you even before you know they exist, and then pull the best from within them, and yourself, to achieve your potential.”

Certainly Hagel and Brown’s idea has history — we communicators have been trying to puzzle out the push vs. pull argument for a really long time (at least as long as I’ve been in this career, anyway.) I’m eager to add the book to my summer reading list.

In the meantime, check these two pieces out — and if you’re not reading HBR in some form, get on it.

  • Share/Bookmark

Why Vitrue’s Facebook Fan Value is Poppycock

Wednesday, April 14th, 2010

Vitrue, a social media marketing firm founded in 2006, snagged an AdWeek article this week when it announced that it had caculated the value of Facebook fans. It’s $3.60 per fan.  What’s behind the valuation? A rash of assumptions, according to a piece on the company’s Web site.

Why do I think this is wrong? Let me count the ways:

  1. Their data is proprietary. The company says it manages 45 million fans and drew the data from a sampling across industries, but they don’t specify the amount of the sample, the specific firms involved or any other information that might provide clarity as to the methodology. No one can cross-check the data.
  2. They make several assumptions: They say they looked at the ratio between wall posts and number of fans — asking how many fans have the potential to see a post. This is similar to using circulation in a print pub. Fine. But unlike circulation (audited) or even Nielsen Ratings, we’re assuming that all fans have an equal opportunity to see, and we’re assuming that a wall post is equivalent to an ad. Then, they say that multiple posts have equivalent impressions — two per day totals 60 million impressions on a one million fan page.
  3. They then say that these impressions are free, “similar to earned media.” But we know earned media is not free — someone had to do some work to make it happen. This is one of the insidious problems with ad value equivalency — there certainly are costs associated with generating earned media, and they must be accounted for.
  4. Next assumption, cost per thousand impressions. They settle on $5 CPM, based on nothing — wouldn’t this number depend on the specific outlet?  How about some science instead of conjecture? Multiply it out using their figures and it totals $300,000 in monthly value for the two post-a-day million fan page.  They show it like this:

1M impressions x 2 posts x 30 days = 60M impressions >>> 60M impressions / 1000 x $5 CPM = $300,000

But what I believe is most egregious is the idea that engagement on Facebook is really just a game of increasing advertising impressions. This is totally contrary to how social media is designed to work. It’s push-focused instead of relationship-focused. It’s shouting from the rooftops instead of talking to your neighbors.

Look, everyone has to make a living — advertisers are pretty comfortable in their “metrics every marketer is familiar with,” as Vitrue’s article says.  But marketers need to wake up — measure something meaningful!  I don’t know, but perhaps the fans are actually doing something that increases their intent to purchase? That improves their understanding of the product? That makes them have a more favorable attitude toward the company? That they bought something?

Surely any of those is a better metric than one based on made-up numbers, bad methodology, weak assumptions and false equivalencies.

Harrumph.

  • Share/Bookmark