Keywords

Featured Here

  • Alltop, confirmation that I kick ass

and There

  • Communities and Networks Connection

How Work Looks

  • www.flickr.com
Blog powered by TypePad
Member since 06/2004

Creative Commons

June 09, 2009

You're Invited to a Social Media / Beer Event at ZAAZ: Thursday June 18th

ZAAZ is hosting the latest in our social media events series next Thursday, June 18th, at ZAAZ hq in downtown Seattle. Join us from 6 - 9 for a panel discussion on agency / client relationships in social media. Panelists will include folks from the agency side who specialize in digital, brand, and PR; along with client-side web and community managers. Here's the announcement:

How do agencies help clients develop richer, more valuable online relationships with customers? Should agencies moderate communities on behalf of their clients? How will budgets adjust to accommodate ongoing, as opposed to project-based, work? What skillsets are best suited for in-house groups? Which agency type owns social media strategy? Should corporations create social media teams, or distribute the work across groups?

Confirmed panelists so far are:

Dave Ballantine, Director of User Experience, DNA

Ted Zahn, Creative Director, ZAAZ

Jordan Williams, Online Community Manager, REI

Marty Collins, Group Marketing Manager, Windows Social Media Team, Microsoft

Teri Citterman, President, Citterman Ink

Expect a very lively discussion around the future of agencies--I'll be moderating, so if you have thoughts about topics, please drop them in the comments below.

We'll have a Facebook event up soon, I'll update this post with the link when we do. UPDATE: Here is the link.

I hope to see you there--come say hello!

May 11, 2009

How Twitter Promotes Quantity to the Detriment of Quality, And Why Twitter Matters Nonetheless

My Twitter experiment was a “successful failure.”

I started an experiment a few weeks ago, basically using Twitter differently than I had previously. Until then, I'd only followed people I know personally--friends, family, colleagues, and professional acquaintances. But a couple weeks ago, I decided to try following everyone who follows me.

This is not a large number of people by Twitter standards (a couple hundred), but I was immediately annoyed with Twitter, and I stopped looking at it for a while. The people I was using Twitter to keep tabs on were simply drowned out by the deluge of incoming tweets, which I found almost entirely uninteresting and not at all useful.

I didn't give up. I created a group in TweetDeck for people I know personally, so I could follow them separately from my full collection of tweeters. That kind of worked on my computer, but it didn’t work on my phone--I never used poor, neglected Twidroid any more. I had to turn off the updates.

I started sort of hating Twitter. What I thought was interesting, though, was people sending me messages thanking me for following them. "You're... uh... welcome...?"

That was what raised the question:

Why do people on Twitter care how many people are following them?

The answer is, because Twitter wants it that way. The affordance for social capital on Twitter is all about quantity: How many following, how many followers, and how many updates posted. The measure of a person, in Twitter, is all about the total amounts accumulated:

to Ryan's Twitter Page

The display of these measures represents just a fraction of the text on a Twitter page, just a few pixels of space—but they’re critical, because they are the attributes attached to the representation of my identity. Effectively, they are me, and I am valued on the basis of their accumulation. Other people, at a glance, get a sense of who I am that’s based on the amount of stuff I have, and not what kind of stuff, and not on the value of that stuff.

This is a bad thing. As Twitter’s massive increase in number of users the last few months has started to illustrate, an increase in users also increases the breadth of topics, decreasing the signal to noise ratio. Six months ago, when Twitter was populated mainly by a relatively narrow group of social software and Web aficionados, there was a stronger sense of Twitter being a community. Today there’s much less topical focus, and Twitter’s limitations as a social tool have become much more readily apparent.

The fix: Build quality-based social capital.

What if, instead of showing, underneath my photo and name, the number of people I follow, the number of people following me, and the number of times I’ve posted, Twitter showed data that reflected the value of my activity? For example, what if my Twitter identity were associated with the percentage of my posts replied to, favorited, and re-tweeted by others?

identity

I’m going to go ahead and suggest that this tweak would substantially alter the way people use Twitter—for the better. Because the measure of a person would be their ability to consistently create value, people would be encouraged to be more interesting. But notice that the measures I’m suggesting don’t reflect the number of people finding any particular tweet valuable, only the percentage of tweets found interesting by someone. That’s an important difference, because it says you don’t need to play to the crowd—that one-to-one value counts the same as one-to-many value. So you don’t have to be interesting to lots and lots of people, only interesting to a single person.

And there’s more here yet: Because the social capital of the system would be tied to recognition by others, the system would encourage connections that were active, and based on mutual attention and interest. “Capital” here works in the sense of “currency.” We’d pass it back and forth—if I like your tweet, I reward you with a reply, a retweet, or a favorite. My doing so counts for you. You look for an opportunity to reciprocate.

Quality and value, when rewarded, are fundamentally self-reinforcing. So if Twitter supported quality and value, great ideas would be passed along more, reaching more people. Reputation and credibility would flow from meaningful contribution. Relationships grounded in mutual helpfulness would flourish.

Now, as Twitterers like the prolific Nancy White illustrate, quality and quantity are not mutually exclusive. And it’s certainly better to have more good stuff than it is to have only some good stuff. So a shortcoming of my suggestion is that it doesn’t reward the consistent creation of value over time, or put another way, the creation not only of consistent value but of a LOT of it, consistently.

Batting average only counts beyond a threshold of at-bats. Total home runs matters only relative to years played. If Ichiro goes 4-for-4 in the season opener, he’s batting a thousand, but that doesn’t yet qualify his season for any discussion of the all-time best. So the real answer, if we’re going to get serious about it, is for Twitter to create a quality algorithm and use that as the measure of an individual’s contribution.

Twanalyst is a gesture in the right direction. It’s a service that analyzes Twitter accounts across a number of quality-focused dimensions, resulting in a (sort of cheesy) personality test: I am very pleased to tell you I am a “chatty coherent guru.” Yes!

Kind of fun, but what I actually really like about Twanalyst is that it’s looking primarily at the nature of what you’re doing on Twitter, rather than the amount of it. That, I believe, is the future on an increasingly noisy web.

Speaking of the future, what about Twitter’s future?

At this point, it’s kind of common knowledge that Twitter has passed a… can I say… Twipping point. As Twitter gets huge, and as the purchase offers get bigger, which direction it takes—toward signal or noise—will help determine its fate as a social application.

Will Twitter end up yet another spammy channel, a trivialized feature of a larger social network, under pressure to monetize? Or will it add a valuable layer of ambient awareness to rich, multi-channel online relationships? I’m rooting for the latter, not just because I’m a fan of Twitter (I am), but because I want to live in a digital future where quality, meaning, order, and value trump unwanted noise.

 

But what I’ve said here is also kind of wrong. The story (like stories always are) is more complicated.

Despite all that—despite the shortcomings of a system that rewards meaningless connections, high volumes of worthless posts, and claiming to listen to more people than anyone possibly could—the truth is we can’t ignore Twitter.

And there’s a reason it’s hard to get comfortable with that truth. Twitter, in the midst of its deluge of valueless tweets, also produces a kind of magic: The collective value of all the noise has a tremendous potential to add up to something meaningful—something with a value beyond what any particular contributor can produce. As the Moldova uprising most recently illustrated, and as did the presidential election and Katrina did before it, Twitter, at its best, is a powerful venue for the expression of real-time collective intelligence. And that’s where businesses need to stand up and pay attention.

April 14, 2009

Straw Horse: An Enterprise Social Media Platform Feature List

We did an internal exercise recently that produced a list of the advanced features we think are crucial for a successful enterprise social media platform. The idea is that functionality for user participation across every owned venue should draw upon a central system, enabling a multifaceted approach to CRM, data analysis, reporting—and ultimately leveraging distributed corporate efforts to generate enterprise business intelligence.

I’ll share the results of that exercise here, with the caveat that this is undoubtedly a partial list only. Your comments and suggestions are welcome, of course!

I helped think through this some of this stuff, but the bulk of the credit (including for the writing) goes to my ZAAZ colleague Ariel van Spronsen. We also had input from another longtime friend and colleague of mine, Gary Carlson, an expert on enterprise metadata management. Enjoy:

 

Reputation (authority systems)

When properly implemented, reputation systems are excellent for creating trust and motivating users to participate at greater and greater levels of engagement. When implemented poorly, High volume of participation or seniority are rewarded—the key to getting reputation right is to focus on the quality of the contribution, not the amount of it.

In implementations where credibility matters, reputation is critical. See this great presentation from Bryce Glass of Yahoo for more detail.

User management

The platform provides the opportunity for centralized management of user data and permissions, including authentication, account management, personalization, segmentation, and behavioral targeting.

User data can provide the connective link among multiple social networking implementations (personal, business group). Content owned by a user can be shared among these via permissions or syndication.

Identity services

A unified data repository means an individual user can centrally manage her public-facing identity, and also create a more robust data picture for the business .

Interfaces from the platform access custom degrees of information contained in the central identity.

Quality algorithms

User-generated ratings have important utility, but translating them directly to measure “quality” is fallible. Ratings are opinion-driven and the ability to control input is minimal. However, combined with analytics data using weighted algorithms quality becomes a more stable and useful metric that both users and business can trust.

Recommendation engine

An important use for user-generated data and analytics is the ability to enrich experiences with recommendations, prompting discovery and deeper engagement. A centralized social networking platform is primed to leverage this functionality.

Taxonomy-driven folksonomy

Tags are a powerful way to augment search and increase information “find-ability”. They also give the business a powerful view into how people are thinking about the tagged content.

A purely user-generated tag set (a “folksonomy “) has issues such as misspellings, tense shifts, and count (singular vs.. plural). A taxonomy-driven folksonomy maps user tags to a controlled vocabulary authority to allow for specific schema analysis.

Video, audio, and photo streams

A significant part of the communication among social networks will be in multimedia forms. Easy uploading, tagging, and sharing features will create a robust social media environment, greater user satisfaction, and increased engagement.

Mobile

The demand for social media in the mobile space is undeniable. Application development for a new breed of smartphones is rapidly increasing as the ability to manage social networking functions becomes a key differentiator for users. The platform should provide for mobile implementation as well as web and API calls, and it should support both content consumption and content production via mobile.

Custom syndication

Custom syndication allows users to filter and process feeds in ways that are meaningful to their specific information needs. Yahoo! Pipes is an example of a custom syndication mechanism.

Custom syndication can augment other elements of a social networking system, especially for a user group that is highly specialized in goal and purpose.

Social bookmarking

Social bookmarking functions promote the development of shared information collections among networked groups.

Collaborative filtration

Collaborative filtration gives users the ability to vote submissions (bookmarks, feeds, entries, etc.) up or down. A popular feed-based example of this is Digg. In the marketing realm, Dell’s IdeaStorm lets users identify the best ideas for product development.

Private groups

Ad hoc, user-created groups for sharing or collaboration can support communities of practice and leverage user data management features.

Microblogging

Twitter is perhaps the most ubiquitous example of microblogging, which invites low-threshold, stream-of-thought information sharing and ambient connection among networked groups. Link sharing, whether to photos or other assets, is pervasive in microblogging, creating connections that can be used in many ways.

Marketplace

A social networking platform could provide functionality for connecting people to products or services, offered by the company or by one another. Examples are Craigslist, eBay, and Xbox Live Marketplace. Marketplace connections give a strong view into communities’ product needs, and they also support, to varying degrees, the purchase process itself.

Chat

Instant communication among community members creates a synchronous communication layer that can be particularly useful within a collaborative environment for communities of practice.

Moderation Tools

Property owners need tools to support management of their users and communities, along with the structures to support governance and workflow at distributed and global levels.

 

I’m sure there are other ideas out there. and for that matter lots of ways to slice and dice what constitutes a “feature.” For example, is blogging a feature, or is discussion? Or are those both higher-order uses supported by features like WYSIWYG publishing, commenting, etc?

I don’t really want to get into an argument about that stuff, but I am very interested in what kind of emerging capabilities corporations need to support in order to realize the full promise of engaging with their constituencies online.

Do share!

March 09, 2009

Death of Email: Not a Minute Too Soon

Email is dead!

OK, maybe not yet, but the latest news certainly suggests the end is inevitable: Social networking has now passed email in global use. Here are the highlights (from Nielsen via Mashable):

New stats from Nielsen Online show that by the end of 2008, social networking had overtaken email in terms of worldwide reach. According to the study, 66.8% of Internet users across the globe accessed “member communities” last year, compared to 65.1% for email.

Some other key findings from the report:

- Globally, Facebook reaches 29.9% of global Internet users, versus 22.4% for MySpace.

- MySpace remains the most profitable social network, generating an estimated $1 billion in revenue versus $300 million for Facebook in 2008.

- Facebook is the top social network in all countries except Germany, Brazil, and Japan (Nielsen still has MySpace as tops in US in the report, but as of January ’09, that had changed).

- On Twitter, CNN, The New York Times, and BBC have the greatest reach among mainstream media companies as of late February.

Details are here: http://mashable.com/2009/03/09/social-networking-more-popular-than-email/

It’s worth mentioning that “member communities” is a pretty broad definition of social networking. It encompasses more, obviously, than formal Facebook-style social networks—it essentially includes every kind of online space where people can interact with each other!

What this points to for me is less that social networks are better than email and more that email is an obsolete tool. Simply put, there isn’t a single thing you can do with email that you can’t do better with a different tool. (And feel free to challenge that point if you like!)

The reason email, like the occasional tape deck, is still around is that it’s been a dominant norm for business communications for long enough that people depend on it. It's a standard.

But rest assured, in the same way email for personal social use is fading, it will also fade in business. It’s just a matter of time, and obviously it won’t happen overnight. And no, email won't disappear off the face of the earth. It'll go the way of snail-mail instead: Relegation to use by Luddites, a few innovative specialized uses (a la Netflix with snail-mail), and saturation with junk.

The transition to a new set of web-based communication and collaboration tools is already well underway, and it’s happening partly invisibly: The new web-based tools, for now, integrate really well with email. You can post to a Typepad blog through email, edit a SocialText wiki through email, update a Basecamp discussion thread through email, and so on. Email users the world over are, at this very moment, authoring blogs and editing wikis, some without knowing it!

The first step in supplanting a standard is to build in compatibility with it, and that's what the newer tools are doing. Email lovers beware! Your demise is at hand!

Ok ok, clearly I have a personal vendetta against email. My point is, so should everyone.

What do you think?

February 26, 2009

Innies vs. Outies

A colleague sent this awesome email the other day, from the outer reaches of darkest Portland:

I had carrot sticks with <famous Internet guy> and Portland's IxDA group last night.  He was *going off* on how ineffective the agency model is for creating and sustaining great, long-term interfaces/software/websites.  He called us shortcuts and a guaranteed method for design failures and that the only way to get the quality of, let's say, Netflix is to go in house and never use an agency. And while I agreed with him on several fronts, I was most impressed by this entertaining and horrifying quote he spat out:


"Agencies are the liposuction of the design world."
-<famous Internet guy>, Feb. 17, 2009


You heard it here first. Are we just a pack of sexy, short-term solutions that leave our clients temporarily svelte if they have enough money to afford our, um, procedure? Do they go back to their bad bloated selves as soon as we leave? Are we preventing them from regular exercise and a healthy diet?

 

And another colleague sent this awesome response:

 

Well, I think <famous Internet guy> is right on at least one point – we are sexy.  

However, apart from that - although I can see where he’s coming from, I respectfully disagree.  The problem he’s describing is not unique to design/ux/creative/whatever.  Innie v Outie is a classic conflict.  Are we sustained organizational change?  Hell no.  Can we make something better, faster, and stronger than institutional Innies can make?  Hell to the yeah we can.  Will the elegant solutions we deliver be bastardized and Frankenstein-ed after we leave?  It all depends on the client. We are not a guaranteed method for failure, but nor are we for long-term success.  We are less like lipo and more like Jenny Craig, we can give you the tools to succeed, but whether you keep using them after the program is over is up to you.  

 

Personally, I'm in both camps, and I don't mean that as a cop-out. I see a symbiotic relationship between clients and agencies where the agency can provide leading-edge, broadly-informed, and swiftly-executed online strategy, and where clients can provide depth of expertise and long-term accountability.

But I think there's a huge gap today, which has to do with the way budgets are structured in the marketing world: Innies tend to have funding for a project, which they hire Outies to execute, and once the budget is gone the concept languishes.

The gap, in other words, is operational. Agencies can provide vision, but we can't, even on retainer, provide true follow-through. Nobody can get in between businesses and their relationships with their customers. (And that's just as it should be.)

Your thoughts?

January 10, 2009

Leadership in Three Easy Steps

I was on the road a lot in the early and late parts of 2008, which is fortunately not something I have to do a lot most of the time. I am not a fan of business travel. But there's a single note I took during all those road days that sticks with me still. I'd almost say it made it worthwhile. (But, let's get real. I missed my kids.) I'll share:

Martin Sorrell, CEO of WPP, the parent company of the company I work for, said something that was well worth the 18 hours of travel to get to a conference in Athens. Yes, Athens Greece, not Athens Georgia. Long flight(s).

Leadership, he said, is three things:

"Vision, alignment, and execution. That's it."

I take it as a given that we all lead, as well as follow. So this isn't about rank, seniority, or the org chart. It's about effective leadership, period. And it's clear that the best "anointed leaders" in effective organizations know how to "follow" their most junior colleagues at the right times.

Vision. Alignment. Execution.

I could expound for a while on each of those, and end up with a nice, meaty blog post, but I give you more credit. What a great, simple way to encapsulate such a difficult practice! Sorrell said it well.

January 08, 2009

Tweeting about the Weather Isn't Lame

I can't remember where I read this, but someone (with some time on their hands?) figured out that some higher-than-you'd-expect percentage of posts to Twitter are about the weather. Seriously, the weather!

I myself have done this. And the past month in Seattle, with the crazy snow and now rain we've had, my PNW-centric personal Twittersphere has been all abuzz about sledding, traffic, holiday travel hassles, snow, snow, snow, and now the road-salting controversy in the City Council. (Salting! What is this, Wisconsin? It snows like twice a year here.)

I have to say, the volume of weather-related tweets this holiday season has been marked. And this has made me wonder what's going on. Why would anyone go to the trouble to broadcast a stray water cooler comment out to the world?

On the one hand, this sudden flood (ahem) of banal weather tweets might seem to confirm once and for all the uselessness of Twitter. I see it a little differently, though. What I think is actually happening is that people are creating a layer of light conversation around a synchronous shared experience. It's the equivalent of a water-cooler chat, yes--but I've started to think there's something important about the shared aspect of that experience. If there's one thing we have in common, after all, it's the weather.

Though other smart folks (including, most vehemently, my psychotherapist / wife) disagree, I'm starting to think experiences don't have to be meaningful to be important, as long as they're shared, and especially when the sharing is synchronous with the experience.

So no, tweeting about the weather isn't lame at all. I'd rather think of it as a social gesture acknowledging commonality, strengthening bonds, and maintaining connectedness.

But do all our random followers on Twitter, or even our followers who (are lucky enough to) live in other climates care about this kind of stuff? In many cases, clearly not. For me, this points to Twitter's shortcoming as a social network. Twitter, I'd even say, is not an appropriate tool for relationship-building. It's not, in other words, a social network in its own right.

I see Twitter, instead, as a powerful feature of social networks. Standing alone, it's a feature of existing distributed social networks--and a great reminder that social networks are made of people, not web pages. Fed into Facebook, Twitter becomes a more-powerful status communicator, a feature of Facebook. And with Twitter's open API, endless possibilities exist for layering meaningful triviality into social network-driven web experiences.

January 06, 2009

A Simple Recipe for Great Mobile Application Design

As you can probably tell, I'm being a little tongue-in-cheek with the title of this post, just for the sake of provocation. But I actually do have a theory about how to design great mobile apps. I've been floating the idea with colleagues lately, and it's been producing great results: Strongly opinionated responses, for and against!

Here it is: There are two things about mobile that are fundamentally different from web designed for the desktop / laptop, two things that are really cool about mobile. They are location awareness and constant access to your relationships. Where those two factors intersect is the sweet spot of great mobile design.

Your mobile device knows where you are. As our creative director said to me in one of his wild rants (yes you, Tim), good mobile is all about "information about your surroundings." I agree, but I'd add that your mobile device also knows who you know. It knows how to contact the people you know, it knows what they're saying, and it gives them a way to contact you. It's a portal into all your relationship channels--good mobile is also all about portable access to your people.

Good mobile design, says me, taps into one of those two unique attributes of mobile. And great mobile design taps into them both.

I also say no manifesto worth its salt lacks a Venn diagram. Therefore:

 

                     

 

Some smart people have voiced objections to this idea, including that there are some really cool games out there for mobile that have nothing to do with location awareness or sociability. I've even been called on my recent defense of triviality in light of this argument. Fair enough. But I'm sticking to my guns.

I'm not saying everything for mobile has to fall into this framework to be worthwhile. I'm just saying great mobile design--game-changing, market-defining, indispensable design--takes full advantage of the unique benefits of mobile. Ms. Pac-Man might be pretty fun controlled by the iPhone's accelerometer, but just because it's kind of cool doesn't mean it's great design.

Here's an example that I think illustrates what I'm talking about.

Helio's "buddy beacon" feature takes advantage of both location awareness and access to the contacts list. (Disclosure: Helio is a client.) Buddy beacons represent people in your contact list, and it displays their locations on a map. You can see where your people are, and you can also see their status: Are they busy, available, on the phone, etc.

Helio has taken the instant messaging metaphors of presence and status, and extended them into a location context.

Pretty nice. There are some limitations, though: Only other Helio customers show up, and there's no seamless way to contact buddies directly through the map. In the era of open standards and touchscreen interfaces, this doesn't quite cut the mustard.

There are plenty of other easy examples. Finding nearby restaurants is cool, and seeing customers' ratings and reviews of those restaurants is even cooler. But cooler yet would be to show restaurants visited by people you know--a shared restaurant landscape of opinions, experiences, and preferences. It's not hard to imagine all kinds of extensions of relatively simple ideas: Just ask, how do we add geographic and social context to create value?

Poof! Mobile design made easy. What do you think?

November 26, 2008

Site Optimization: Lipstick on a Pig?, Or, Bacon and the Theory of Local Maximum

Jason Carmel is a colleague of mine I learn a ton from. His expertise is in web site optimization--running experiments where he tests versions of web pages against each other to see which performs best. (Not to be confused with search engine optimization, improving a site's visibillity in search engines.)

Jason is a fairly unflappable guy. Nonetheless I recently started making an effort to get his goat. He gives me just enough encouragement that I keep going. The gist of my teasing is that optimization is nothing but a mechanical exercise to determine whether a red button works better than a blue button. "Glad to hear that red button worked out better by 2.84 percent Jason. The sum of your creative energy has produced yet another quarter million in revenue. You must really love your life, man. Hey, have you thought of trying one of those animated GIFs instead of a regular button?"

Fortunately, Jason is twice as nice as me, as well as twice as smart. He takes my ribbing well--and responds thoughtfully to the serious question underlying my teasing: We know optimization can move big numbers in terms of revenue, but can it do more than simply tweak pages to bump up conversion? Can it vet creative concepts? Can it maximize the creation of mutual value between businesses and customers? Can it help create more engaging experiences?

A joke about the parts of a pig tasting either "good" or "real good."

(image credit, found via Lee)

 

The short answer here, according to Jason, is that it depends, partly on what you're trying to achieve. If all you're focused on is moving business value measures, you're probably putting lipstick on a pig. But testing against value creation has the potential to uncover game-changing opportunities.

Here's an email exchange between Jason and me, in which he explains in a little more detail:

 

RYAN:

That whole web site optimization thing—isn’t it really just putting lipstick on a pig?

 

JASON:

I think “I hate you so much” might be a succinct way of responding, but I'll provide a little more detail:

Web Site Optimization is exactly like putting lipstick on a pig, but only if you start out with a pig. And if you are starting out with a pig, your opportunities for improving things are limited, and you’d be using the wrong tool to fix the problem. We are talking here about the concept of a “local maximum” which is a fancy, math term applied to mean “the best something can be within a limited dynamic.” Consider the aforementioned pig’s ability to fly, which, metaphorically speaking, is not particularly developed. We could take a pig and genetically modify it to be more aerodynamic. We could investigate building pig hang-gliders and attempt to train the smartest pigs to use them. But even in the best case, with the most aerodynamic pig, benefiting from the best training, and using the best pig flying technology, it will never fly as well as a bird. The best case flying scenario for a pig (the pig’s local maximum as far as flight is concerned) is nowhere near as effective as a bird’s. In that scenario, you’d be better off exchanging the pig for a bird at the start, rather than waste any time or effort teaching a pig to fly better.

Applied to the web: if a site sucks so much- if the goals and purpose are unclear, if the information architecture looks like my desk (at the moment), if the navigation is counterintuitive and the messaging has absolutely no intersect with the audience, then no amount of optimization in the world will make it right. The local maximum of that crappy site is too low for any optimization to matter. Or (even worse) you’d need the infinite number of monkeys to stop typing Shakespeare and to start applying experiments to your site to get the right combination where testing would make a real difference. Neither is very efficient. If your site is the pixilated equivalent of a pig, you need much more elemental help from a user experience expert first (know any?). Until you fix the fatal flaw(s) in a site, anything else you do will be throwing good money after bad.

Site Side Optimization works well in circumstances where the local maximum is high, but for some reason, the site is not achieving it. This can be due to single points of failure on the site, like a specific conversion path or page underperforming, or because the audience needs to be targeted more specifically, or because the existing content is stale/irrelevant. In each of these cases, experimental testing can make a huge difference. Optimization also works exceptionally well (and this is far more interesting to me) when applied as a method of trying out a new (and potentially risky) idea that could radically change and significantly improve an experience.  In both of these examples, the basic site is healthy, and the optimization program serves as a tool to reach its fullest potential.

 

RYAN:

But what I keep looking for is the way to test birds against pigs, not in the sense of which flies better, because as a user experience expert I do have the capability to predict the winner of that contest—but when I don’t have a clear sense of the best conceptual solution. For example, maybe I just can’t decide between eggs and bacon. Can optimization help design a better breakfast, or only decide between pulp and no-pulp in the OJ?

 

JASON:

Optimization can test more conceptual ideas, but it will be really hard to unpack the WHY after we determine which one wins. Most sites aren’t deciding between bacon and eggs, but rather between the bacon, eggs and hashbrowns with coffee or the granola, fruit and yogurt with yerba matte. If the former wins in a test, I don’t know whether it’s because of the bacon (which will usually win over everything) or the coffee, or because the person deciding had granola for the past three days, and would have taken ANYTHING other than more granola.

The other trick about testing high concepts in a website format is that you would have to build each solution to test them, which is usually more expensive than testing out wireframes or front-end prototypes in front of a more controlled audience.

 

RYAN:

First, you seem to be suggesting that a test win for the bacon breakfast might not imply extensibility for bacon breakfasts in general: That because, lacking control, the results might be idiosyncratic, they might not therefore apply broadly. Next week you might get a different result. My question is, why does that matter? And why does “knowing why” the bacon breakfast worked matter, as long as you know it worked.

 

JASON:

It is definitely a question I get from clients a lot. Why do I care about the individual elements of a variant- if the variant as a whole makes us more money, let’s just launch it and move on. I can’t fault the sentiment, but knowing why the bacon worked could lead to better tests, more focused messaging and (even more) cash money. I want to know that it’s the bacon by itself that is the motivating factor outside of all the other influences. Let’s say that we ran a test breakfast against a bowl of Total cereal and we tested bacon with powdered eggs as the experimental variant. Now let’s assume that bacon and powdered eggs lost to the control by 1%. You could take the position that we would do better to serve Total because we want to avoid losing that 1%, and you would be right. But what if you knew that the bacon by itself actually improved the breakfast by 15%, but the powdered eggs were so crappy that they hurt the breakfast by 16%, so you netted the 1% loss? If I controlled for all the variables in my breakfast, that knowledge would a) help me make a better breakfast overall (just serve bacon), and b) will also prevent me from throwing away a positive variable simply because it was paired with a really negative one.

I imagine you run into that a lot with prototyping and wonder how you deal with it in the UX world.  If a subject totally fails at a task, are you ever afraid of overcorrecting a prototype to account for it? Do you ever throw the baby out with the bathwater? How do you control for that?

 

RYAN:

A great question. One of the answers is that in usability testing, you're looking for usability problems. So as long as your test participants are representative of your users as a whole, major failures are, practically speaking, never anomalous. If your user population is one million, and one of the eight people participating in your test has trouble understanding some aspect of the interface, what are the odds they're the only person who's going to have that problem?

The other thing I wonder about is what happens when what you’re trying to accomplish is harder to measure than conversion (e.g. brand lift) or if you want to measure it over time (e.g. engagement). Especially in social media, it’s quality that matters, not quantity. You want to know how valuable your user-generated videos are more than you want to know how many of them you have. Can web site optimization help you get to answers?

 

JASON:

Ah, you and your social media. When are you going to come to terms with the fact that this whole thing is a fad? The future is in email, Ryan, and lots of ‘em. Mark my words.

Absent a more qualitative tie-in with optimization (surveys, satisfaction scores, etc.) you will be hard-pressed to get good data about branding or the impact of social media. But I’m not saying you shouldn’t optimize for branding or social media. I’m saying you need to get that qualitative kicker. I’ve done a few branding tests, and I think they provide some interesting feedback. But I’ve never optimized where a KPI has to be judged on quality (e.g., good comments vs. troll comments) or off the site entirely (e.g., buzz in the blogosphere). Sounds fun.

November 11, 2008

Twitter: Trivial. Beautifully So.

I wrote a post a year and a half ago on Twitter in which I identified two types of use for it. This was at the height of the initial buzz about Twitter, and while some folks were really excited to finally see an HTML / SMS / IM social application, others worried aloud that Twitter, for the same reasons it offers such a low threshold of entry, would also tend to erode the quality of social relationships online. The thoughtful anti-Twitter point of view was that it encourages triviality, and the gist of my post was that while that may be true, there are times when trivialities are useful.

Since I wrote that post, I've become an avid Twitterer, and I have to say my perspective on Twitter, and indeed on triviality, has changed. I now see triviality as maybe the critical element of truly meaningful relationships, online and off, and Twitter has accordingly become one of the cornerstone services of my personal and professional social lives.

That sounds crazy, I know, and while it may be true that I am prone to crazy-sounding declaratives, I'm actually not kidding about this. I now use Twitter at work very frequently, mostly within my team, and it has improved our functioning and, dare I say it, made us closer, more personally connected.

Let me float an assertion: The deeper the relationship, the greater the proportion of it dedicated to triviality; and beyond, say, 90% triviality, the relationship isn't a relationship at all. And likewise with meaningful interactions--if everything is meaningful, it's not a relationship, it's therapy.

So here is my Bullseye Diagram of Love, illustrating the way I'm starting to envision online social systems supporting healthy relationships:

the bullseye of love

So I'm arguing for Twitter, or an analogous triviality service (ha!) as a supplement to existing relationships, not as a full-fledged social channel in and of itself. As a social network, I actually do think it's useless, or worse. And you can take that as a caveat.

But I am saying I think triviality in general and as supported by Twitter, in both personal and professional settings, is indispensable--that we can and should deliberately design it into social systems.

My Photo

Subscribe by Email

  • Enter your email address:

    Delivered by FeedBurner

Voices

links worth saving