Posts Tagged ‘Research’

The Measurement Debate Continues

Tuesday, February 2nd, 2010

The estimable Shonali Burke has started a fortnightly Twitter chat — #MeasurePR — that begun 2 February, with the equally estimable Katie Paine as first guest. I caught only the last half, which featured good discussion and the usual paroxysm over advertising value equivalency. AVE is bete noir for @KDPaine and @Shonali, who both are categorical in their condemnation of the practice. A couple of participants, however, say that there still is demand on the part of clients for AVE.

The Institute for PR Measurement Commission condemned AVE last fall, AMEC (the professional organization for media evaluation firms) has declared its intent to find a logical replacement, and a recent paper offered Weighted Media Cost as an element worthy of inclusion in measurement programming. Where does this leave us?

I have no stake in this game. My personal belief is that AVEs are bad science, but I’m also sensitive to the need to help clients. AVE is easy for a client to grasp — “if we paid for the space our story ran in, it would have cost us X.”  Katie points out that doctors won’t prescribe a medicine if it’s not right for the patient. AVE isn’t life and death — but what do we do after we’ve explained the drawbacks and negatives and the client still wants it?

I can’t help but put myself in that situation — young company, trying to latch on with a client. Do I tell the client “No. I won’t do AVE” and risk having him/her say, “Well then, I’ll go find someone who will!” ?

#MeasurePR had much more great content than this AVE nonsense, and I really do wish we could collectively move on. I’m done writing about the debate, at least for now.

Looking for a quick way to improve measurement?

Start setting objectives and measuring your attainment of them. Stop worrying about generating lots of eyeballs and do some audience research to reach the right ones. Start looking for correlations between your various communication outputs (and outtakes) and business metrics, such as revenue, cost savings, cost avoidance, time saved, help desk traffic, speed of benefits enrollment, travel system savings, expense systems savings, etc…

Future of Employee Communication Depends on Us

Wednesday, January 13th, 2010

The newly launched CommScrum features a terrific multi-author piece on issues in internal communications that outlines several huge issues in the function.

  • Mike Klein wants to reclaim the term Employee Communication, owing to the multi-audience impact of employees.
  • Dan Gray says the boundaries between internal and external communication have fallen, with alignment no longer the sine qua non, and fusion the future.
  • Lindsay Uittenbogaard says that employee ambassadorship needs “20 cans of Red Bull and a red-hot poker” and continued emphasis on alignment.
  • Kevin Keohane outlines the disparate “belief systems” about employee communication that cloud the ability to see employee communication leadership as “connecting up the core factions to deliver value to the organization and its people.”

You’ll want to read the post, but here are my thoughts.  I believe internal communicators need to respect each of these constituencies.

Information provision is still important — a gatekeeper/distributor or merely a systemic means of access for employees is the change afoot here. People still need information that helps them do their jobs. Tactical support.

The human capitalists – HR wants there to be a predictive model, hence the focus on engagement and free will — they want to believe that persuasion isn’t needed, that pushing the right buttons will lead to further discretionary effort in support of business objectives.  Certainly, a few of the Gallup 12 questions will apply in the new order, but not the ones that focus on the purely social aspects of workplace. Systemic methods of finding collaborators and achieving objectives will be welcome, whilst ersatz sentimentality and misguided cheerleading will not. Look, everyone knows better now what companies are in business for – earning money for their owners. No more corporate Kum By Ya, if you please.

The experientialists – Branding agents want the internal constituency to be like customers – send your messages overtly, and subliminally through design, color, etc., at the worst; understand the customer’s motivation and make employees understand it too, at the best. Advertising and direct marketing don’t work on employees – it’s too one-way and too asymmetrical and employees can smell a sales job a mile away.  It’s the potential disconnect between brand ideation and reality that represents the second largest threat to success.

The influencers – Keohane writes: “A third camp is (and often the most seriously flawed) the PR and change camp, where internal/employee comms is all about defining “publics” and then influencing them using spin and external PR techniques.”  I’d argue that this has been on the decline for a while now.  After a brief flirtation with indentifying peer influencers and doing internal outreach, a la a traditional campaign, most of us have come to our senses.  Nevertheless, involving employees in a meaningful way (the “cultivating influencers” model) could have widespread positive impact.  But again, there can’t be a say-do disconnect – the walk must match the talk.

The changelings – “Communications is change.  Change comes from workstreams.”  Change isn’t an event. We are very close to realizing the Deming concept of continuous improvement, where so many aspects of the business are changing so often that there is no pause.  Here’s where the engagement concept fails so utterly – with no new normal, no one ever gets comfortable, or attains much mastery of the work environment.  The flexible, excellent communicators live in this change and adapt easily to help the organization manage through the issues that arise.

The executives – “It’s all about leadership communication.” A large proportion of it is about leadership (I suppose I’d type myself into this camp), but not in the sense of leaders making pronouncements from on high. Too much managerial communication focuses on managers sharing the strategy with the hoi polloi.  Managers need to be the primary communication agent in the organization, knowing how the strategy will affect their departments and teams and drawing the linkages for them to improve line of sight to the overall objectives.

The managerials – “It’s all about line managers.” Only insofar as the organization has line managers. Of course, in manufacturing, union stipulations, work rules and (European) Works Councils govern much of how the operations will function. The line manager may not be able to participate as fully as the managerials would prefer, though their role in any model can be as robust or lean as required. This is a tough one to generalize about.

The KM brigade – “It’s about intranets and managing knowledge.”  It’s only about intranets if you have enough employees using them. At Goodyear, about 32,000 employees use PCs, and about 43,000 operate complex machines. You don’t want a worker building a truck tire to be looking at a monitor, no matter how compelling the content, and the process of knowledge sharing is person-to-person, which we know is far superior to person-to-database.

The storytellers – “It’s all about big pictures and stories, since the dawn of time it always has been.” Well, stories are still important, dang it.  Organizations are made up of people doing things that help the organization succeed. There are good, compelling, interesting stories about these people. Stories still capture our imagination, perhaps now more than ever.  Do we watch American Idol in the states because it’s great art, or that the story lines are so interesting?  Good employee communication makes dry topics interesting with humanity.

We didn’t even get into the concepts of two-way communication – the process of fostering dialogue to build understanding and commitment, generate improvement feedback and otherwise create an organizational impulse to participation rather than passivity.

The future of employee communication does depend on communication leaders’ ability to tie these many perspectives together.

Amanda Chapel is Still Relevant, and Important

Monday, January 4th, 2010

Mark W. Schaefer’s {Grow} blog carries an interview with Web. 2.o critic Amanda Chapel this week that asks whether the acerbic commenter is still relevant.  I believe Amanda remains most relevant. The rivers of Kool-Aid flowing in social media need to be dammed (and damned) and few of us consistently do so.

I’m grateful that Amanda included me in her list of “critical thinkers” along with Kent State prof Bill Sledzik, Ike Pigott, Joel Postman and Mark; that’s high praise from an important voice.

Look, I’m a committed capitalist, so I don’t begrudge anyone from making money, in particular, people who are early adopters and make the personal investment needed to stay just ahead of the crest of a wave. A bunch of people have done so, and are making a terrific living at it.

Some of those people don’t have anything but an expertise at sales and a gift for jargon to qualify them, and that’s a big problem in social media. Consider that we don’t even have licensing for mainstream PR and marketing — and think about how much really bad advice organizations get from those professions.”

At least in PR and Marketing there are longstanding professional associations with codes of ethics, increasingly strong academic and theoretical foundations, and a body of research-based knowledge (Cutlip, Center, Broom, 10th ed., p 120) that qualify us as members of a profession. This is despite our many weaknesses, including the presence of our own charletons.

Social media isn’t even there yet, and it needs to get there soon in order to separate the wheat from the chaff. Despite worthy efforts from Institute for PR Measurement Commission colleagues Katie Paine, Don Bartholomew and a few others, we’re still working on how best to measure social media effectiveness beyond output metrics.

We need Amanda to continue to call out snake oil salespeople, foggy logic, asinine commentary and the real danger of a lost of authoritative, professional conduct in such a fast growing area of communication practice. That she does so with wit, style and occasional vulgarity keeps the stew from being too bland.

So, count on me not only to declare Amanda relevant, but for vote #3 for the return of Strumpette — 140 characters at a time isn’t enough space.

As for “her” anonymity — I have been of two minds about it, both “yea” and “nay,” especially following my rather “eventful” introduction to Amanda last year. But in the end, I don’t think it affects credibility at all and it offers the freedom to focus on the message rather than its sender.

Finally, skepticism is not negativity, as I asserted last June. We surely are not lemmings, powerless in the thrall of the “wisdom” of the crowds, are we?

Cautionary tales on Twitter ‘metrics’

Friday, December 4th, 2009

The ever-excellent Don Bartholomew, MetricsMan, provides an overview of some of the Twitter applications that purport to measure “influence.” He says:

Influence is contextual not absolute.  An individual may have the ability to influence certain people in specific subject areas.  Authority and trust are important constituent elements of influence.  Do they have the authority to speak within a particular area and are their words and deeds trusted?  The notion of coming up with an influence score without context is inherently flawed.  It might be interesting, but it is not actionable.

Read the post, especially if you use Twitter, but even if you don’t, much of the content can be easily extrapolated to other forms of social media.  A fair number of social media “experts” are bottling measurement snake oil these days, and the rigorous concepts Don discusses are the antidote for such chicanery.

Objectives most critical element in measurement

Tuesday, December 1st, 2009

One smart PR pro told me years ago that even the best road map is useless without a destination. Because so many communicators are struggling to understand the role of strategy in a world of fascinating tactics, it can seem like the universe is throwing map after map to us, shouting “you need this right now!”

When I step back from “being strategic” (quite a trick for someone once called, with some derision, “strategy boy”) it is no exaggeration to say, echoing the travel metaphor, that the best strategy is useless without an objective.

Strategic objectives need three things: 1) a benchmark. You need to look back to see where you’ve been. 2) A target. You need to look ahead and see where you’re going. 3) A time period. You need to articulate how long it’s going to take to get from where you were/are to where you want to be.  If you’re missing any of those things, chances are good that you don’t have a strategic objective.

The trick is, too often, we set objectives with no clear understanding of where we are, let alone where we were. That’s where research comes in. It’s right out of PR 101 — start with research before you launch a campaign — and we find lots of reason not to do the research. Sometimes it’s related to cost, sometimes to our own skillsets. We like to think of ourselves as creative geniuses, unencumbered by such trivialities. This attitude is especially prevalent in media relations, where our relationships and seat-of-the-pants skills can mean so much in a crisis; when things go right in our activities, that can reinforce the perception that PR is art, rather than science.

Of course, our “gut” is merely the application of our accumulation of experience, both in terms of time and in terms of education. We think we know what our employees, or our customers, for example, know/think/feel about our organization, when we could remove any uncertainty with some simple research.

But, I digress — the objective-setting process is even more important when considering social media.  Too many organizations are jumping in without a clear idea of what they want to accomplish.  More on this topic to follow.

What about your communication planning process? Does it start with objectives?

Returning to normalcy? Recovering from conference mania

Friday, October 23rd, 2009

Make a note. It takes practice to handle two conferences in five days’ time.  Of course, maybe my energy level would have been higher if I’d been speaking at them instead of attending one (live-Tweeting my way through a couple of days), and introducing speakers and serving as sponsorship chair at the other.  Anyone who knows me will aver that I’m a fairly well-smoked ham, so being at the center of attention is exciting for me, rather than exhausting.

But the stress of pressing the flesh, talking to new people, and simultaneously trying to stay engaged in a sudden spate of potential business opportunities turned out to be rather a bit tiring. I also wondered whether the evil humours surrounding new friend Richard Bagnall and his lovely friend Marian might have attempted to seize me, but as it turns out, a couple o’nights of good sleep returned me to fit-as-a-fiddle status. Just ask my students if I lacked energy 22 October in class… Hah!

But now, devoid of excuses, I’m faced again with the ever-growing list of things to do, with ideas for a paper roaming in my head along with the still-warm and previously mentioned business opportunities. Oh, and I do need still to write a final exam and figure out what I need to do when I teach “Face to Face Tactics” at Kent State in the next semester.  I also had slowed the pace of my blogging, owing to the madcap hilarity of the past couple of weeks, but accelerated the Twitter-ing at #iprms09. The social media experiment continues.

So it seems that indeed, I’m finding a bit of normalcy amid the falling leaves and gathering chill.  Providence willing, I’ll soon have a fall more complicated — this time by billable hours.

Whither Public Relations?

Friday, October 2nd, 2009

There is an existential discussion going on over at PRConversations. A post by the eminent Toni Muzi Falconi asks the question, “What comes next after Grunig?” — Jim Grunig being the legendary PR pro and educator whose landmark research in the 1980s led to the Excellence Theory of public relations.

PR has long had a love-hate relationship with theories. One hallmark of a true profession is that it has a strong theoretical basis in academic circles. So, the lack of a theory of its own (as near as I can figure) has led to gnashing of teeth and some amount of inferiority fantasy in the academic community.

Many of the most studied theories — Community Theory, Rhetorical Theory, Framing Theory, Systems Theory — borrow heavily from other disciplines, most notably from the general communication studies field.  Coupled with PR practitioner resistance to theory in general and the academy in part, scholars for a time were very quick to dismiss PR as a separate profession. They preferred to see it, instead, as a part of communication, journalism, or marketing, and thus not as serious as their intellectual fore-bearers.

Grunig, along with co-researchers David Dozier, William Ehling, Larissa Grunig, Fred Repper and Jon White, conducted a massive study funded by the IABC Foundation to answer the question of why public relations has value to an organization.

In itself, this research wasn’t geared to establish a theoretical foundation for the profession. Instead, it answered two main questions: “Why and to what extent [does] PR make an organization more effective, and how much is that contribution worth economically?” and, “What are the characteristics of a public relations function that are most likely to make an organization effective?”

It was the process of identifying the structural and behavioral aspects of PR departments that led to the idea that Excellence was a theory. In a nutshell, Excellence says that the PR team should be led by a manager who is in senior management, and its work should primarily rely on two-way, symmetrical communication.

It’s this contention that an increasing number of scholars are taking issue with. The foundation of our profession is persuasion (Bernays, Ivy Lee) and the use of language and discourse in service of that effort (Rhetorical Theory) — either one-way or two-way, but definitely asymmetrical.

I don’t pretend to be as schooled in these matters as some of the commenters at PR Conversations, but as an experienced practitioner who is now dabbling in the academe (adjunct prof at Kent State this fall), I’m intrigued by the intellectual exercise.  One person says that such navel-gazing (my words) isn’t important — likening the discussion to a college student trying to examine new majors.  But our profession can no longer get by with “trust me” as its operating theory.  There are solid reasons why we do what we do and recommend what we recommend.  The theoretical foundation for these efforts gives us credibility even if we never mention them to our employers or clients.

What is PR, and why is it important? That’s a question worth discussing.

Great discussion at [grow] on Social Media dissent

Monday, September 21st, 2009

Mark W. Schaefer writes a great blog, and today there is a terrific discussion there regarding the echo chamber surrounding social media’s expert class, the Chris Brogan, Brian Solis, Julien Smith, Beth Harte, Amber Naslund slate.  Namely, Mark observes that we are lacking strong dissenting voices.

Obviously, there are a few people out there who are refusing to drink the social media Kool-Aid — @amandachapel the most notable.  My own experience with social media as a user is putting me in the class of skeptics, not outright refuseniks, but I have been asking about the value of social media in PR and bemoaning the lack of objective, independent research to evaluate the often breathless claims of its moral superiority.

At the [grow] blog, commenter @tamadear offers this important proviso:

Nobody responds well to “You’re wrong; I’m right” dissent, to those who dwell on our weaknesses. It makes us defensive and unwilling to listen.

This is very true, and is why in virtually all of my consulting (both inside and outside organizations) I always assume that I may be wrong and use language accordingly.  There are far too many pronouncements, baseless and unresearched, in all of public relations, but especially in social media.  I have used the term “self-described experts” many times because I have no visibility into the qualifications of the speaker (or writer). Many of them could be literally anyone, and will even call out their lack of qualifications as a benefit of working with them. From Drudge’s refusal to be called a journalist, to Chris Brogan’s declaration that he is not in public relations, I’m often left wondering why I am supposed to regard these people as authorities.

With a tip of the cap to @amandachapel, it’s “caveat emptor” in the world of communication these days — there is big money to be made (a worthy effort that I share the desire to attain) and precious little objective information to help the consumer evaluate claims.  There are also few best practices that include true outcome measurement of the sort Olivier Blanchard describes in his excellent slide show, “The definitive social media ROI presentation.”  My only beef with the esteemed BrandBuilder is that such end-state ROI calculations performed without care lead to assuming that correlation equals causation.  We would love to see revenue increase and expenses go down concurrent with our social media campaign, but what percentage of the improvement is due to social media and how much due to other factors, including simple continuous improvement?

This is the point of the dissent discussion — for every Olivier and Mark there are five people claiming that the action of participating in social media IS the return on investment. That’s just not going to fly, and the more the experts try to convince people otherwise, the worse off we all are.  The “conversation” MAY be important — it always has been prior to all of this Web. 2.0 stuff — but aside from questionable research by the people poised to benefit the most from its findings, there simply isn’t much data at this point to declare the social media discussion closed.

What’s your view?

Handling ‘No-Win’ Media Stories

Monday, August 10th, 2009

The Taliban resurgent in Afghanistan.  The U.S. House wants to spend $550 million on new jets for themselves. Banks fork over billions in bonuses after receiving trillions in U.S. taxpayer funds.  How’d you like to be the PR folks who need to handle those issues?

When I was relatively young in public relations, our top-five execs were poised to gather up a prodigious pile of cash, stock and options — they hit their targets, and then some, for the year.  The main way they’d done so, however, was to cut headcount by 10 percent across the board.  Preparing the internal communications for that proxy release (which would include the compensation details) wasn’t an easy task.

There were good business reasons for the compensation strategy, not the least that there were contractual obligations — they were owed this compensation. The packages had all been vetted by the compensation committee of the board of directors, comprised only of “outside” directors — people who weren’t also employees of the company.  The goals for the year were bottom-line oriented, aligning the interests of the executives with those of the shareholders.  A substantial amount of the dollar value of the pay was long-term compensation — three years’ deferred. And, the largest portion of the package was in restricted stock and stock options, both of which were designed to keep high-performing executives at the company for several years.

After reading the proxy, I felt reasonably comfortable with the reasons for the high pay.  I wrote a paragraph not too different from this last one in a questions-and-answers document for managers, answering the question, “Why did these executives get such high compensation?”

The corporate treasurer called me, with a smile in his voice, and said, “This is an argument you can’t win. Let’s not try to explain the reasons for the packages. Just say that there may be questions as a consequence of news media coverage and refer interested parties to the Proxy.”

I was pretty disappointed.  I’m a fan of sharing the reasons behind decisions. Of course, the danger here was the snicker factor.

The snicker factor is the likelihood that that people will snicker when they read the explanation, that the intent of being transparent and honest will instead be seen as spin.

The reality is that executive pay is a tough story. The reality is that contracts tend to insulate execs from downside risk, that the independent directors are execs at other firms, their motives suspect… You can almost hear the conversation around the water cooler, visualize the Tweets… “Yeah, right! These guys all take care of their own, they’ll do anything to get their piece of the pie, what do they do around here, anyway?”

Do we only explain if there is a likelihood of winning the argument? That certainly would simplify the measurement of our efforts in these matters. By the way, I’m aware of at least one company that, as a matter of policy, separates proactive and positive PR from reactive and negative PR. They feel like they have a great track record and lots of positive reinforcement.  It’s not exactly what the Excellence Theory calls for (two-way, symmetrical), but it has its fans.

For another firm, staying out of any no-win story was the primary objective, and they did (and do) a fine job of it.

As long as we define our function as one of advocacy — and are above board about it — this makes perfect sense.  In those circumstances, we adopt the model that calls for non-participation if there is no objective benefit to our organization. We increase reputation risk by not participating, but perhaps that’s the main question: How risky is participating and explaining compared to staying away from such controversy?

It seems to me to be a question of certain risk versus uncertain risk — we know the snicker factor will kick in if we participate. We don’t know what will happen if we don’t.

Avoiding the devil you know can be a compelling strategy. What do you think?

Research Report Finds Little Impact of SocMed on Brand

Friday, July 24th, 2009

A study conducted by Cleveland-area research firm WorkPlace Media may be bad news for social media marketers.

“A whopping 96% of respondents said their opinion of a product brand did not change if that brand had no presence on a social networking site, only 11% of social networking users reported following any major brand through a social networking site, and just 12% of respondents
said their opinion of a brand changes if that brand maintains a social networking presence.”

The research echos a recent Harris poll that found just 4% of its respondents mentioned “private social networking sites, such as customer communities,” when asked about pre-purchase information gathering.

Well, then.

As with many announcements of this kind, my skept-o-meter kicks in. The news release offers the highlights (as it should), and the offer of more detail comes with a requirement to fill out a contact form.  What’s missing for geeky old me is some more of the math — I’d be interested in the actual correlations — what were the variables? Or, was the research just a preference exploration — a quick marketing tool?

The role of social media in forming perceptions needs more study.  That’s pretty hardcore research — there are so many factors that make up people’s perspectives on things, including on brands and marketing and companies.  I am not a stat guy, but I know the work on Marketing Mix Modeling is very promising. Structural Equation Modeling permits multiple dependent and independent variables, so you can see how different variables interact on one another, which is critical to determining which are the most important and effective.

The excellent work of Dr. Don Wright of Boston University and Michelle Hinson of the Institute for PR since 2006 have examined how social media is affecting PR.  It seems to me that this is what’s really needed in the social media space: The bridges to brand perception, disposition and purchase intent still need to be built.

I realize that this opinion may brand me as seeing social media as just another channel for messaging. But unless we have better understanding of the impact of social media on the people using it for business, we’ll fail to get the resources to study how the conversation itself affects people.

We see casual, superficial research on social media all the time, usually from consultants with a vested interest in pushing social media as revolution.  I don’t deny that this new suite of tools is important — I just want some facts on my side before I go declaring that the tide is permanently shifted.