Posts Tagged ‘evaluation’

« Older Entries

The Measurement Debate Continues

Tuesday, February 2nd, 2010

The estimable Shonali Burke has started a fortnightly Twitter chat — #MeasurePR — that begun 2 February, with the equally estimable Katie Paine as first guest. I caught only the last half, which featured good discussion and the usual paroxysm over advertising value equivalency. AVE is bete noir for @KDPaine and @Shonali, who both are categorical in their condemnation of the practice. A couple of participants, however, say that there still is demand on the part of clients for AVE.

The Institute for PR Measurement Commission condemned AVE last fall, AMEC (the professional organization for media evaluation firms) has declared its intent to find a logical replacement, and a recent paper offered Weighted Media Cost as an element worthy of inclusion in measurement programming. Where does this leave us?

I have no stake in this game. My personal belief is that AVEs are bad science, but I’m also sensitive to the need to help clients. AVE is easy for a client to grasp — “if we paid for the space our story ran in, it would have cost us X.”  Katie points out that doctors won’t prescribe a medicine if it’s not right for the patient. AVE isn’t life and death — but what do we do after we’ve explained the drawbacks and negatives and the client still wants it?

I can’t help but put myself in that situation — young company, trying to latch on with a client. Do I tell the client “No. I won’t do AVE” and risk having him/her say, “Well then, I’ll go find someone who will!” ?

#MeasurePR had much more great content than this AVE nonsense, and I really do wish we could collectively move on. I’m done writing about the debate, at least for now.

Looking for a quick way to improve measurement?

Start setting objectives and measuring your attainment of them. Stop worrying about generating lots of eyeballs and do some audience research to reach the right ones. Start looking for correlations between your various communication outputs (and outtakes) and business metrics, such as revenue, cost savings, cost avoidance, time saved, help desk traffic, speed of benefits enrollment, travel system savings, expense systems savings, etc…

Tags: , , , , , , , , , , , , , ,
Posted in Uncategorized | 8 Comments »

Amanda Chapel is Still Relevant, and Important

Monday, January 4th, 2010

Mark W. Schaefer’s {Grow} blog carries an interview with Web. 2.o critic Amanda Chapel this week that asks whether the acerbic commenter is still relevant.  I believe Amanda remains most relevant. The rivers of Kool-Aid flowing in social media need to be dammed (and damned) and few of us consistently do so.

I’m grateful that Amanda included me in her list of “critical thinkers” along with Kent State prof Bill Sledzik, Ike Pigott, Joel Postman and Mark; that’s high praise from an important voice.

Look, I’m a committed capitalist, so I don’t begrudge anyone from making money, in particular, people who are early adopters and make the personal investment needed to stay just ahead of the crest of a wave. A bunch of people have done so, and are making a terrific living at it.

Some of those people don’t have anything but an expertise at sales and a gift for jargon to qualify them, and that’s a big problem in social media. Consider that we don’t even have licensing for mainstream PR and marketing — and think about how much really bad advice organizations get from those professions.”

At least in PR and Marketing there are longstanding professional associations with codes of ethics, increasingly strong academic and theoretical foundations, and a body of research-based knowledge (Cutlip, Center, Broom, 10th ed., p 120) that qualify us as members of a profession. This is despite our many weaknesses, including the presence of our own charletons.

Social media isn’t even there yet, and it needs to get there soon in order to separate the wheat from the chaff. Despite worthy efforts from Institute for PR Measurement Commission colleagues Katie Paine, Don Bartholomew and a few others, we’re still working on how best to measure social media effectiveness beyond output metrics.

We need Amanda to continue to call out snake oil salespeople, foggy logic, asinine commentary and the real danger of a lost of authoritative, professional conduct in such a fast growing area of communication practice. That she does so with wit, style and occasional vulgarity keeps the stew from being too bland.

So, count on me not only to declare Amanda relevant, but for vote #3 for the return of Strumpette — 140 characters at a time isn’t enough space.

As for “her” anonymity — I have been of two minds about it, both “yea” and “nay,” especially following my rather “eventful” introduction to Amanda last year. But in the end, I don’t think it affects credibility at all and it offers the freedom to focus on the message rather than its sender.

Finally, skepticism is not negativity, as I asserted last June. We surely are not lemmings, powerless in the thrall of the “wisdom” of the crowds, are we?

Tags: , , , , , , , , ,
Posted in Uncategorized | 3 Comments »

A Manager Who Can’t Communicate Can’t Lead

Tuesday, December 15th, 2009

“As soon as you move one step up from the bottom, your effectiveness depends on your ability to reach others through the spoken and written word.” It’s been years since Peter Drucker offered that bon mot, but it certainly seems to be truth. The New York Times’ Corner Office feature, which runs Sundays on page two of the Business section, talks to business leaders of all stripe, and each of them has something to say about the importance of communication to their business style.

Dec. 6, Joseph J. Plumeri, Chairman and CEO of Willis Group Holdings (the insurance broker whose name now graces the former Sears Tower in Chicago), was Corner Office’s subject. He said:

I spend 25 percent to 30 percent of my time calling my associates — whether they had a family problem or pulled off a great deal and brought in a new client, or saved a client. Two-minute phone call, or handwritten note. I can’t begin to tell you how important that stuff is. E-mails are easy, but sometimes they get in the way of really feeling how somebody feels about your effort.

Is it time consuming? Yes. But that’s what you’ve got to do…

Plumeri goes on to say that helping people understand and believe in the choices the company makes is essential to realizing business vision.

On Dec. 13, Nancy McKinstry, CEO of Wolters Kluwer, a Netherlands-based information services company, says “Every culture is very different in how people make decisions” as she relates how her leadership style changed over time according to the communication styles of her team.

In the Netherlands, where our company is based, people really want to be heard early in the process. So if you just go to someone and say, “I want you to go take this product and enter this new market,” most likely the first response they’ll say is, “No, and let me tell you how that won’t work.” What they really want to say is, “I’m not going to commit yet to that objective until we have a chance to really sit down and explore how we’re going to do that, what your expectations are, and how we measure success.”

Then, when I work with my Italian colleagues and the Spaniard colleagues, what you find is they can’t always tell you how they’re going to get something accomplished, but they manage to get it done.

Shocking news, really, that one’s leadership team expects to have a clear strategy in place before acting, and wants the freedom to choose how to accomplish the goals they’re responsible for.

What concerns me is how few middle managers (or even executive managers) have undertaken the sort of self-examination that both McKinstry and Plumeri evidently have. In 20 years, I’ve met only a handful who embrace the power of participative communication. By the way, they’re the leaders who typically win in the marketplace.

Why don’t more organizations evaluate the communication strength of their leaders?  One reason is the perception that you can’t hold people accountable for “soft” skills. Yet, we know that there are very strong correlations between effective communication behavior and employee understanding and comprehension. So, if we want an informed, educated workforce which understands the business and their role in it, their managers will need to be the ones providing context and leadership.

Therefore, let’s evaluate communication skills among managers and come up with ways of helping those managers improve and thrive. It’s not too difficult a concept.

Tags: , , , , , , , , , , , , , , , , ,
Posted in Uncategorized | 8 Comments »

Objectives most critical element in measurement

Tuesday, December 1st, 2009

One smart PR pro told me years ago that even the best road map is useless without a destination. Because so many communicators are struggling to understand the role of strategy in a world of fascinating tactics, it can seem like the universe is throwing map after map to us, shouting “you need this right now!”

When I step back from “being strategic” (quite a trick for someone once called, with some derision, “strategy boy”) it is no exaggeration to say, echoing the travel metaphor, that the best strategy is useless without an objective.

Strategic objectives need three things: 1) a benchmark. You need to look back to see where you’ve been. 2) A target. You need to look ahead and see where you’re going. 3) A time period. You need to articulate how long it’s going to take to get from where you were/are to where you want to be.  If you’re missing any of those things, chances are good that you don’t have a strategic objective.

The trick is, too often, we set objectives with no clear understanding of where we are, let alone where we were. That’s where research comes in. It’s right out of PR 101 — start with research before you launch a campaign — and we find lots of reason not to do the research. Sometimes it’s related to cost, sometimes to our own skillsets. We like to think of ourselves as creative geniuses, unencumbered by such trivialities. This attitude is especially prevalent in media relations, where our relationships and seat-of-the-pants skills can mean so much in a crisis; when things go right in our activities, that can reinforce the perception that PR is art, rather than science.

Of course, our “gut” is merely the application of our accumulation of experience, both in terms of time and in terms of education. We think we know what our employees, or our customers, for example, know/think/feel about our organization, when we could remove any uncertainty with some simple research.

But, I digress — the objective-setting process is even more important when considering social media.  Too many organizations are jumping in without a clear idea of what they want to accomplish.  More on this topic to follow.

What about your communication planning process? Does it start with objectives?

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Uncategorized | 2 Comments »

Still stuck on AVEs

Monday, November 23rd, 2009

The continuing debate over advertising value equivalency reached the pages of the New York Times 22 Nov., with a “Soapbox” piece saying Hollywood studios are cutting ad budgets and using public relations as an alternative. One anecdote:

Disney recently went so far as to develop a computer program to help it determine how much monetary value was coming from such publicity efforts. It can quickly plug in data — “Access Hollywood” had a 30-second interview with a star of “The Middle,” a new ABC comedy — and the program spits out what that same 30 seconds would cost to buy.

AVEs are a sore spot in PR circles these days.  KD Paine, measurement maven extraordinaire, has campaigned against them for years as bogus figures that don’t quantify the value of media hits. The Institute for PR Measurement Commission (of which I am a member) officially condemned the practice in October, and PRSA has formed a blue-ribbon panel to address measurement generally — looking to a world without AVEs.

I believe there are certain circumstances where AVEs are useful — product publicity, for one, where features and benefits are the subject. But AVEs need to be net of cost, be based on actual charges, not simply “book rate,” and the publication has to be targeted to the specific business need. My example is Goodyear, the tire company. If they get a product review in Road and Track, it’s going to be relevant to their audience, include features and benefits, and in nearly all cases quite similar to an advertisement. What’s unaccounted for is the reader’s perception of value — AVEs are limited by an inability to include the weight of third party independence.

Look, notwithstanding this last paragraph, AVE is a bad metric 90 percent of the time, and there are other ways of evaluating media coverage that are better.

So, why does it appear that so many firms are stuck on this difficult metric? Well, AVEs are simple to understand. Here’s what it would have cost us to buy this time or this space — that’s a lot easier to grasp for a lot of people. There also is the pressure on PR agencies levered by their clients — “I understand you don’t like AVE, but I have to have a dollar figure to tell my CEO, so if you don’t give it to me, I’ll find someone who will.”

Still, I wish that more companies would stop using AVE. Oh, and that more people would understand that PR isn’t limited to publicity and press agentry. Perhaps the best reason not to use AVE is that it doesn’t measure the reputation work that represents most of what PR work is in business these days. For every stunt PR trick, there are months of quiet conversations with centers of influence, months of work on helping employees better understand their industries and organizations, and programs designed to help people grasp the significance of a company’s role in the community. There is more to our profession than being a low-cost replacement for marketing.

Tags: , , , , , , , , , , , , ,
Posted in Uncategorized | 2 Comments »

Discussions you should read

Tuesday, November 17th, 2009

Several good ones:

Rich Becker — great discussion in the comments on social media concepts…

Brian Solis — Do we need to redefine “influencers?”

Chuck Hemann — What impact on social media use/adoption does organizational culture have ?

Paul Seaman — The Excellence theory says PR is about fostering relationships. Paul disagrees.

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Uncategorized | 1 Comment »

As Ad Spending Declines, What of Media?

Thursday, October 29th, 2009

“The Wall Street Journal” closes its Boston bureau.  “Forbes” lays off a couple dozen this week, with rumors flying of more to come. “The New York Times” is looking for 100 buyout exits. Conde Nast shutters “Gourmet” magazine, and “Cookie,” “Elegant Bride” and “Modern Bride.” It’s a lousy time to be a journalist, eh?  But what about being the PR people who pitch these pubs?

With advertising spending falling (or at least reclassifying from print to broadcast and Web), “getting media attention” in the right segments continues to be a critical element of PR activity. But the burgeoning social media market is threatening to change that calculus, if you believe the doyennes of blogs, Twitter and similar platforms.  And why wouldn’t it? If we were pitching Modern Bride before, why can’t we pitch Classic Bride, Becoming Mrs. Jones, or The Broke-Ass Bride?

Does a company that makes bride dresses, or wedding catering, or domestic partnership photography have the time necessary to build relationships in social media? Or do they just need a quick ad with a special phone number that offers 20 percent off, a mention in a popular blog?

How many of us will the new behemoth integrated agencies need to help facilitate these processes? Who’s going to pay us to tell them to talk to a bride blogger in Madison, Wisc.?

This is only part of the puzzle — I have written before about the lack of independent and authoritative content in new media. Unless many of us suddenly become willing to pay a subscription fee for such content, it’s going to go away.  Perhaps crowds really are wise, and not mobs. Perhaps over time, Wikipedia is more accurate than the Encyclopedia Brittanica, notwithstanding being horrifically inaccurate at the moment we need factual information, or openly manipulated.

Any of us who care about this topic will need to develop our own ability to engage in social media, build our reputation for accuracy and probity, and somehow compete with the fakers, liars, and spammers. That’s not an easy task.

Tags: , , , , , , , , , , , , , ,
Posted in Uncategorized | 5 Comments »

Whither Public Relations?

Friday, October 2nd, 2009

There is an existential discussion going on over at PRConversations. A post by the eminent Toni Muzi Falconi asks the question, “What comes next after Grunig?” — Jim Grunig being the legendary PR pro and educator whose landmark research in the 1980s led to the Excellence Theory of public relations.

PR has long had a love-hate relationship with theories. One hallmark of a true profession is that it has a strong theoretical basis in academic circles. So, the lack of a theory of its own (as near as I can figure) has led to gnashing of teeth and some amount of inferiority fantasy in the academic community.

Many of the most studied theories — Community Theory, Rhetorical Theory, Framing Theory, Systems Theory — borrow heavily from other disciplines, most notably from the general communication studies field.  Coupled with PR practitioner resistance to theory in general and the academy in part, scholars for a time were very quick to dismiss PR as a separate profession. They preferred to see it, instead, as a part of communication, journalism, or marketing, and thus not as serious as their intellectual fore-bearers.

Grunig, along with co-researchers David Dozier, William Ehling, Larissa Grunig, Fred Repper and Jon White, conducted a massive study funded by the IABC Foundation to answer the question of why public relations has value to an organization.

In itself, this research wasn’t geared to establish a theoretical foundation for the profession. Instead, it answered two main questions: “Why and to what extent [does] PR make an organization more effective, and how much is that contribution worth economically?” and, “What are the characteristics of a public relations function that are most likely to make an organization effective?”

It was the process of identifying the structural and behavioral aspects of PR departments that led to the idea that Excellence was a theory. In a nutshell, Excellence says that the PR team should be led by a manager who is in senior management, and its work should primarily rely on two-way, symmetrical communication.

It’s this contention that an increasing number of scholars are taking issue with. The foundation of our profession is persuasion (Bernays, Ivy Lee) and the use of language and discourse in service of that effort (Rhetorical Theory) — either one-way or two-way, but definitely asymmetrical.

I don’t pretend to be as schooled in these matters as some of the commenters at PR Conversations, but as an experienced practitioner who is now dabbling in the academe (adjunct prof at Kent State this fall), I’m intrigued by the intellectual exercise.  One person says that such navel-gazing (my words) isn’t important — likening the discussion to a college student trying to examine new majors.  But our profession can no longer get by with “trust me” as its operating theory.  There are solid reasons why we do what we do and recommend what we recommend.  The theoretical foundation for these efforts gives us credibility even if we never mention them to our employers or clients.

What is PR, and why is it important? That’s a question worth discussing.

Tags: , , , , , , , , , , , , , , , , , , , , , , , ,
Posted in Uncategorized | 22 Comments »

Great discussion at [grow] on Social Media dissent

Monday, September 21st, 2009

Mark W. Schaefer writes a great blog, and today there is a terrific discussion there regarding the echo chamber surrounding social media’s expert class, the Chris Brogan, Brian Solis, Julien Smith, Beth Harte, Amber Naslund slate.  Namely, Mark observes that we are lacking strong dissenting voices.

Obviously, there are a few people out there who are refusing to drink the social media Kool-Aid — @amandachapel the most notable.  My own experience with social media as a user is putting me in the class of skeptics, not outright refuseniks, but I have been asking about the value of social media in PR and bemoaning the lack of objective, independent research to evaluate the often breathless claims of its moral superiority.

At the [grow] blog, commenter @tamadear offers this important proviso:

Nobody responds well to “You’re wrong; I’m right” dissent, to those who dwell on our weaknesses. It makes us defensive and unwilling to listen.

This is very true, and is why in virtually all of my consulting (both inside and outside organizations) I always assume that I may be wrong and use language accordingly.  There are far too many pronouncements, baseless and unresearched, in all of public relations, but especially in social media.  I have used the term “self-described experts” many times because I have no visibility into the qualifications of the speaker (or writer). Many of them could be literally anyone, and will even call out their lack of qualifications as a benefit of working with them. From Drudge’s refusal to be called a journalist, to Chris Brogan’s declaration that he is not in public relations, I’m often left wondering why I am supposed to regard these people as authorities.

With a tip of the cap to @amandachapel, it’s “caveat emptor” in the world of communication these days — there is big money to be made (a worthy effort that I share the desire to attain) and precious little objective information to help the consumer evaluate claims.  There are also few best practices that include true outcome measurement of the sort Olivier Blanchard describes in his excellent slide show, “The definitive social media ROI presentation.”  My only beef with the esteemed BrandBuilder is that such end-state ROI calculations performed without care lead to assuming that correlation equals causation.  We would love to see revenue increase and expenses go down concurrent with our social media campaign, but what percentage of the improvement is due to social media and how much due to other factors, including simple continuous improvement?

This is the point of the dissent discussion — for every Olivier and Mark there are five people claiming that the action of participating in social media IS the return on investment. That’s just not going to fly, and the more the experts try to convince people otherwise, the worse off we all are.  The “conversation” MAY be important — it always has been prior to all of this Web. 2.0 stuff — but aside from questionable research by the people poised to benefit the most from its findings, there simply isn’t much data at this point to declare the social media discussion closed.

What’s your view?

Tags: , , , , , , , , , , , , , , , , , , , , ,
Posted in Uncategorized | 2 Comments »

Just Thinkin’ …

Wednesday, September 16th, 2009

Barron’s this week says that “Digital media and subscription TV are likely to see sizable gains in ad spending as a recovery gains…” A graphic shows that adverts on mobile phones and handhelds are estimated to increase by 33% from 2008-2013, Internet ads will rise more than 10% and pay TV ads by more than 7% during the period. Of course, another chart shows a “U-Shaped” curve for that spending increase, flat through next year.  They don’t talk about any of the newest ad ideas though, showing that the social media revolution is still at the fringe of business consciousness regarding driving sales behavior.

Tuesday’s Wall Street Journal talked about the use of Twitter in crisis situations, sharing stories from wine guy Gary Vaynerchuk (@corkd), who got hacked by unsavory characters, and Scott Townsend from a Bartlesville, Okla.-based uniform company who tweeted after an ice storm, and a few others.  I can see the application for this type of activity clearly — and I know that my Web traffic increases when I Tweet — so sharing news is great, provided you’re followed. I’ve gotten the most benefit from Twitter to simply meet people and see what others say during Twitter meetings, such as #prstudchat and #icchat.  Whether this is building sufficient awareness to help me generate business, I have no clue! Heaven knows I spent enough time Twitter-ing today.

Tuesday at Kent State, the class I’m teaching got into the community theory of PR being advanced by Dr. Dean Kruckeberg of University of Northern Iowa.  Fascinating discussion ensued as we investigated the implications of the theory, which holds that organizations are part of society and therefore owe society as a member of its community. I’m too new to this academic stuff, but this challenges me — I tend to be a garden variety capitalist, believing that a company’s only logical responsibility is to its owners, its purpose to make money lawfully. I need to think about this a while…

Tags: , , , , , , , , , , , , , , , , , ,
Posted in Uncategorized | 4 Comments »

« Older Entries