Keith Hopper's blog

Moving this Site to keithhopper.com

Thu, 24 Apr 2008 15:21:56 -0400

This website and blog have moved to keithhopper.com.

Please move your links and feeds as appropriate.

All news, posts, and essays will appear there from now on.

Collective Intelligence Book Arrives

Fri, 18 Apr 2008 12:40:45 -0400

Today, the book Collective Intelligence: Creating a Prosperous World at Peace arrived on my doorstep. I am fortunate enough to be a contributing author. My chapter is entitled Empowering Individuals Towards Collective Online Production, and focuses on the paradoxical notion of the importance of individual motivation in effective online collaboration. Works from several of my personal heroes appear in this compendium, including Yochai Benkler, Doug Engelbart, Pierre Levy, Thomas Malone, Howard Rheingold, and David Weinberger. I simultaneously feel incredibly fortunate and remarkably unworthy of sharing a book jacket with the likes of these folks, but here it is.

Online Participation Headed Towards Democratic Utopia or Civic Demise?

Sat, 12 Apr 2008 14:59:06 -0400

On Thursday, the MIT Center for Future Civic Media as part of the MIT Communications Forum and Civic Media Series hosted a talk between Yochai Benkler and Cass Sunstein, moderated by Henry Jenkins and entitled "Our World Digitized: The Good, the Bad, the Ugly." The premise, of which I was skeptical, was to get Cass and Yochai to duke it out over whether internet participation was headed anywhere good. I was dubious of MIT staging a scholarly drama, but Benkler, Sunstein, and Jenkins have written three of the (arguably) most important recent works on the participatory internet, and for that fact alone, attendance was mandatory.

Many great arguments were articulated, all of which can be heard here. To nutshell it, Sunstein stayed true to his books stating that pervasive individual self-selection on the internet is leading to insulation and a lack of diversity. He paraded out the tired old The Daily Me argument and the so-called echo chamber effect. He suggests that democracy itself is at risk, as it requires diverse input, the exchange of unshared knowledge, and serendipitous encounters to function effectively.

Benkler refused to outright disagree with Sunstein, but instead focused on the positive effect of empowering individuals to participate online. He argued that individuals who perceive they can influence society's agenda become more engaged in civic discourse and behave more responsibly in this context. I took this to mean that individuals who feel they can make a difference are more likely to be engaged (vs. detached), develop meaningful arguments (vs. complain), and try to make a productive difference (vs. passivity).

While I agree with Sunstein's desire for diversity and serendipity and with Benkler's excitement over individual feelings of empowerment, I was disappointed that neither questioned the tired and quaint notion of the web being nothing more than a series of echo chambers. I wonder if either looks outside their inboxes to see what's really going on. Here is where Jenkins should have jumped in and schooled them on growing participation across diverse online communities, the wildly serendipitous (if not downright chaotic) information exchange found on Twitter, and individual interest (and subsequent sharing) expanding outward across every category of long tail media and knowledge. I would go farther to argue that emerging social norms in online interactions encourage diverse information dissemenation and punish the types of insular behavior that Sunstein and Benkler seem to accept as universal.

Undoubtedly, there are specific examples where echo chambers do exist, and link analysis shows narrow patterns of interaction in, for example, select political blogs, but I would argue that the internet is just a wee bit more than link spam littering the bottom of inflammatory blog posts.

I live-twittered the event. Here are some selected Tweets
(These are not direct quotes but rather real-time paraphrasing what I took each speaker to mean. Greatness is theirs. Mistakes are mine):

Benkler: What happens instead of a few elite that can set the agenda, we now have 3 million who believe they can affect their society
Yochai suggests that traditional mass media is more polarizing (fox news, radio talk shows) than the web's perceived echo chamber effect
Sunstein: How much serendipity we embrace depends on what we're regularly exposed to
Show of hands: 3/4 of the Bartos Theater audience have edited Wikipedia
We need a new model for understanding human behavior that builds in imperfection to allow for the possibility of true collaboration
Benkler: If you feel you have the ability to influence the cultural agenda, your concerns migrate from complaints to considered positional arguments
Sunstein, in response to what web tools should come to be: Stimulate curiosity. Once curiosity is triggered, it is very hard to resist
Triggering participatory activity requires, in part, for individuals to feel their efforts are needed and wanted
1st order diversity = range within our group (different people); 2nd order diversity = range across groups (different groups)
Sunstein: 4 probs in deliberation: amplify individual bias, polarization, early words initiate cascade, shared knowledge crowds out unshared

Arduino Homing Device Prototype

Tue, 25 Mar 2008 22:01:02 -0400

And now, for something highly dorky.

I have begun to play with DIY electronics. This is principally because it's tremendous fun. You should try it. Seriously. The possibilities are endless.

Here is a video of a range test for my prototype homing device built with an Arduino microcontroller module and an XBee radio transceiver. The portable, handheld device cost me about $60 to make, but theoretically could be a lot less if you designed a PCB and didn't rely on prototyping components.

Short-term, I hope to join fellow Boston Dorkbot members to build on this prototype and construct a location-based game. Stay tuned...

My longer-term goal is to develop a standardized radio/micontroller platform on which to load and share user-oriented software applications (like the homing software shown here) for proximity-based device communications.

The range for the "homing device" seems to well exceed the 300' that the XBee specs claim. Cool.

Please send me suggestions for improvements, other ideas, etc.

The Customer Wants a Divorce

Sat, 22 Mar 2008 16:32:45 -0400

"The Break Up" video has been around for about a year, but it's so relevant to what we've been working on with Project VRM, I couldn't resist posting it. Produced by Microsoft (of all people) along with ad agency openhere.be, the short video is a brilliant slam on how the traditional approach to customer outreach is woefully out of touch. It basically runs like an ad for The Cluetrain Manifesto.

The video is by Geert Desager and originally posted at bringtheloveback.com.

Big Week for Shoutouts

Fri, 21 Mar 2008 17:45:58 -0400

Seeing as I get "the mention" about once a year, and usually by accident, I figured I’d strut out the fact that I got two (2) unsolicited plugs this week on not totally obscure media outlets.

The first was from none other than the Cluetrain man himself, Doc Searls. During a Newsgang podcast from Steve Gillmore with Steven Hill, and the Interim CEO of NPR, Dennis Haarsager, Doc mentioned our work together on Project VRM at the Berkman Center. The future of public broadcasting discussion that ensues is an interesting insider view and a worthwhile listen.

The next one was great fun and truly a historic moment in our little sphere of nerds-who-work-in-public-broadcasting. Thursday’s Up to Date call-in show on KCUR (Kansas City) was sagely dedicated to the future of Public Broadcasting and its interesting and evolving relationship with the web and social technology.

Rob Patterson, Andy Carvin, and Todd Mundt then spent the next hour trying their damnest to not talk constantly about Twitter (and pretty much failed). In a particularly self-referential moment, Andy mentioned that I was livetwittering a bunch of twittering broadcasters as they broadcast twitter's impact on broadcasting. I’m not sure that last sentence was grammatically correct or even remotely what Andy said, but whatever. Listen to it yourself.

Idea Engines

Thu, 20 Mar 2008 15:07:03 -0400

In a long anticipated move, idea submit & rate engines are finally catching some meme-like popularity. They're certainly easy to build. In a follow-up post, I will tear them to bits for the flaws they introduce and the assumptions we make around their utility.

They do poke at some interesting aspects of Collective Problem Solving. Here are three:

* IdeaStorm

* My Starbucks Idea

* Ubuntu Brainstorm

Making Experts: The Future of Audience Engagement

Thu, 13 Mar 2008 15:00:04 -0400

How might media organizations better engage their audiences online?

Over the past year, I teamed up with several public broadcasters to try and answer this question. We collected lessons while rolling out online participation software at NPR’s Car Talk, KQED, Oregon Public Broadcasting, PRI’s The World and a dozen others. We are learning that the future of media engagement goes beyond invitations for listener comments. The leading examples involve much higher expectations from the "audience"; specifically, their partnership in delivering on more collaborative projects.

Take WNYC's The Brian Lehrer Show, who in late 2007 asked their listeners to share price inequities they found at local grocery stores. The results made national news, and not just for the novel use of crowdsourced journalism (turns out that the state regulates milk prices, and not everyone was playing by the rules). As the demand for richer and more compelling media experiences increase, you’ll likely see less "Come join the discussion" and more "Let’s solve a problem together".

Most important here is the word "together". What participants want is a team-oriented experience that is open, inclusive, and aims to produce valuable outcomes where they can benefit. While these co-directed endeavors can be challenging to conceive and manage, they can drive significantly more participation and yield real, lasting online value (they now have a nice map of beer prices across Manhattan). Successful initiatives give the opportunity for all to be involved, and for many to play the role of expert – whether as an authoritative voice, a creative problem-solver, a data gatherer, or even a tackler of basic tasks. The very best solutions have participants as co-creators, co-directors, and even co-owners of the produced results. In this more collaborative environment, the notion of "the audience" begins to dissolve.

These collaborative projects can involve varying levels of commitment from participants. The following list identifies a spectrum of media-driven initiatives, from those with the least individual involvement to the most.

Opinion & Preference – Extract localized knowledge and insight from your audience in the form of polls, aggregated estimates or prediction markets.

Basic Task Completion – Why not crowdsource a simple electronic task? Well, for starters, coming up with a compelling outcome and building a system to do it efficiently are two likely reasons not to. There are a few good examples of ones that seem to be working, although tying it effectively to media might be a different story.

Shared Experience – Collect narratives around unique themes. Inviting in stories effectively involves finding unexpected, yet invariably human common ground.

Unique Expertise – If you have a big enough audience, track down the needle in the haystack by seeking unique expertise. Proven ideas include troubleshooting car problems, soliciting peace corps volunteers, or getting hot tips on possible stories.

Research Data & Analysis – You don’t need rare skills to roll your sleeves and do some primary research or apply a critical eye. Audience members have proven their ability at spotting celebrities, measuring a city’s SUV density, and helping slog through the JFK files for conspiracy clues.

Creative Content – Accumulating creative submissions around a common theme is a time-tested method for getting media junkies engaged. Consider offering incentives and showcasing the best. Examples are endless: photos, top-10 lists, t-shirt ideas, show names, fan fiction, and full-on radio stations to name but a handful.

Ideas & Solutions – "Given enough eyeballs, all [problems] are shallow." Arguably the oldest crowdsourcing endeavor was the British government trying to solve the longitude problem. And since then, pumping your community for insights to address specific issues has inspired everything from the online suggestion box to trying to find a cure for Lou Gehrig’s disease.

True Collaboration – Bringing a community together, deploying varied skills over time in a dynamic and massively productive process is the holy grail for online participation. It's like applying the complexities of open source software development to the media industry. Three noble efforts in this regard include spurring organized community action, collaborative story coverage, and, of course, cataloging the World's knowledge.

What Motivates Online Social Participation?

Wed, 5 Mar 2008 11:02:36 -0500

Can the motivations that drive individual behavior towards online collaborative production be explained entirely by enlightened self-interest?

Clay Shirky Speaks about His New Book: "Here Comes Everybody"

Fri, 29 Feb 2008 08:38:17 -0500

I had the good fortune to hear Clay Shirky speak last night at Harvard Law School. The event was hosted by Harvard’s Berkman Center as a lead-up to their 10 year anniversary celebration. The event also coincided with the release of Clay’s new book, Here Comes Everybody: The Power of Organizing Without Organizations. Clay spent the majority of the discussion outlining the book. He began by pointing out that the book is not necessarily targeted to just the folks in the room (various flavors of webophile), but rather to a wider and more generalized audience. His argument for this was that "the web is no longer a decoration on society, but a challenge to it," meaning that usage and adoption of the Internet has become ubiquitious and integrated into how we do things to the level that for many of us, the Internet has become "the dashboard for our lives". So, theoretically, the book should have more universal readership.

I attempted to Twitter the presentation. I tried to capture his sound bites and cogent points, but Clay is a veritable font of wisdom and one-liners. I ended up with a serious case of twitterrhea. Below is a slightly cleaned up transcript of my tweats over the course of about an hour. Shirky direct quotes are in quotes. Everything else that isn’t labeled as my own thoughts [Ed:] can be attributed to Clay Shirky.

From Clay Shirky website: "If I had to describe what I write about, it would be "systems where vested interests lose out to innovation."

Historically, media innovations that allow two way communications produce active groups. Broadcast technology... not so good at this.

If Clay had to boil the book down to one bullet point = "Group Action Just Got Easier"

"Groups get complex faster than they get large" [Ed: i.e. the network effect, Reed’s Law, etc.]

The Internet acts as a prosthetic for existing group activity.

New social tools on the Internet make group connections ridiculously easy to form

Email was an afterthought of the Internet

"Reply all" was the Internet's first social feature

Curiously, once the technology gets boring, the social effects get interesting [Ed: by this, he means once the technology gets out of the way, becomes commonplace, and slides beneath the radar of awkward attention, then it becomes integrated into how we function as social creatures and the most interesting social effects of a technology begin to emerge]

"Me First Collaboration" = social effects that emerge from self-serving behavior, e.g. del.icio.us lets me store my bookmarks, but ultimately becomes useful to all [Ed: Or Google extracting social relevance from individually created links]

The annual Coney Island Mermaid Parade is an example where amateur photographers leveraged ad hoc online sharing (via flickr)

HDR photography as an example of using a flickr group to accelerate innovation through a community of practice (what used to take 8 years for a technology/process to emerge from lead users to professional process to documented practice to trade magazines to amateurs to shared understanding now takes weeks)

"every URL is a latent community"

"Sharing + conversation leaves a residue of instruction"

A comparison of a Buffy discussion board moving to a new platform is like a hermit crab changing its shell

Sharing -> Conversation -> Collaboration -> Collective Action are things that require increasing amounts of synchronization of group action.

"Thinking is for doing" [Ed: by this, he means that the purpose for human thought is so that we can then take action; quote attributed to someone I’ve forgotten] => "Publishing is for acting"

"Flashmobs are the Flagpole sitting of 2003"

"Nothing says dictatorship like arresting people for eating ice cream"

Ridiculously easy group-forming improves sharing, conversation, collaboration, and collective action

Behavioral economics states that social behavior online is more than just enlightened self-interest, for example, see the ultimatum game and the self-defeating individual act of punishing defectors

Irrational individual behavior spent towards generating social cohesion cannot justifiably be explained away by enlightened self-interest

Social technology can be used for more than just good… case in point, YM magazine shutting down their discussion boards because pro-anorexic girls were swapping practical tips

What’s the future of investigative journalism and its impact on smaller cities that can’t afford newspapers who have historically played this role? "I don't yet see a way that blogs can create sustained observation that stops civic corruption"

There are no good examples of long-term collective action - institutionalization becomes a problem over time

What works with collective action right now [to stimulate participation and worldwide attention] are surprises... but they are a wasting asset

Where individuals change their behavior BECAUSE they're members of the group is the key definer of collective action

"Immersive games get us out of the hell of continuous partial attention"

Boston Fab Lab

Wed, 6 Feb 2008 18:40:32 -0500

A couple years ago, I wrote about Neil Gershenfeld’s cool MIT Fab Lab (fabrication laboratory). On Monday I was fortunate enough to join the Boston Dorkbot crew for a tour of the Boston Fab Lab. I’ve posted a photoset of a few machines. Pictured are three computer-controlled prototyping machines, including a room-sized router, a micro-milling machine, and a laser cutter. Missing from the photos is a sign/vinyl cutter, several non-computer-controlled tools, and a nicely-outfitted electronics workbench.

The mission of the fab lab is a noble one: to empower creative people to make things with the assumption that, well, we’re all creative. Exposing individuals to commercial prototyping machines encourages people to explore, learn and have a significantly wider range of choices – both in what we might envision and make, but also in how we view the world and imagine our role in its future.

Shifting Tolerance in a Hybrid Economy

Wed, 9 Jan 2008 15:34:45 -0500

In a neighborhood near my home, there is a school playground with an enormous three story chain link fence along one side – presumably as a barrier for errant basketballs. The fence is constructed inches away from an adjacent home. I thought to myself "that would suck - I would probably rather have broken windows than live behind that huge fence". Then I thought of all sorts of examples of aggressive organizational behavior in our society that is tolerated, even though their behavior could easily be perceived as unfair or intrusive. I'm not suggesting that all business behavior is universally tolerated, but rather that their fundamental commercial presence is often quietly accepted. For example, we forgive the school's fence because we deem urban play areas for children are worth the tradeoffs. We also forgive Apple's fierce closedness, Google's ads, and Nike's ubiquitous branding. What's most interesting to me, however, is that we don't have a single standard for what is tolerated. There are some interesting nuances here. For example, I doubt my neighborhood would have tolerated a condo developer building a fence like that, and ubiquitous branding around your religion’s holiday is generally frowned upon.

Looking carefully at our culture's relationship to commerce, every business in some way lives on an unspoken agreement by the community to tolerate an incursive aspect of its existence (I'm presupposing that of course businesses provide meaningful value to customers ahead of their potentially invasive aspects).

Now consider our emerging hybrid economy. An organization operating in this new hybrid economy sits between the commercial economy of financial transactions and the sharing economy that thrives on free and open distribution of value (think of sharing as found within Wikipedia and Open Source Software). Take Google - a business operating in the hybrid economy with, among other things, YouTube. They rely on people openly sharing video content while they generate revenue from the accumulated eyeballs.

The emerging hybrid economy now shines the spotlight more brightly on a business’s tolerated behavior. If people don't embrace all aspects of a business, individuals might not just stop buying their products, they might stop sharing, which is an altogether new and potentially more disastrous fate. Rejection of a business would mean defection from its associated shared commons – to the detriment of society, not just specific product consumers.

The obvious question becomes then, how do you construct a business that leverages a hybrid economy without poisoning the sharing and good will? Where can these businesses carve out a profit and advantage around commercial behavior that is culturally tolerated? What specific aspects of hybrid businesses are required to facilitate social tolerance?

Introducing the Google Infamy Coefficient

Fri, 21 Dec 2007 09:25:43 -0500

What's the smallest portion of a person's name that can be typed into Google before the Suggest feature returns their full name? To allow for meaningful analysis and comparison, I propose the Google Infamy Coefficient (GIC).

GIC = (# successive characters entered into Google Suggest before the full name is revealed) / (# characters in the full name)

The results on the way to my own name are graphed below (The GIC of Keith Hopper = .727). The most infamous Keiths appear to be Keith Richards and Keith Olberman, tying at GIC's of .23. Anyone know what name might have the lowest GIC? Blog props and bragging rights to anyone who figures it out and lets me know.

Hat tip to uber-geek Randall Munroe (.385) for the inspiration.

Has News Innovation Stalled?

Sat, 27 Oct 2007 13:55:09 -0400

Has news innovation stalled? The last decade has seen significant shifts in how news is created and delivered: grassroots publishing and online news aggregators for example have resulted in shifting advertising dollars and widespread panic in traditional mass media outlets. However, fresh approaches both in traditional media and in new media exploration has felt scarce as of late. Most of the recent thinking around news delivery involves slapping the latest social technology idea or delivery device onto a news outlet and calling it innovation. Or worse, a retreat into potential profitability through a focus on niche or hyperlocal audiences. Of course, some exceptions exist, but there is too much opportunity tied up in new technology and the shifting demands of the public to slow down the exploration of new ideas.

I think this lack of exploration is due to limitations in our assumptions about where to innovate. For example, participatory media means more than just tapping first-hand knowledge and citizen footage. Why can’t low-cost production tools be utilized by professional journalists as well as regular citizens? And what about the content itself - why do we assume short-form written articles or anchor-delivered video segments are the only relevant news vehicles? As the lines between producers and consumers of news blurs, can we forge partnerships based less on clearly defined roles and more on where creativity and power surround a specific story? Perhaps this requires organizational innovation and cooperative production that is merely enabled by emerging communications technology. Please stop with the same old approach repackaged on twitter from mobile phones via facebook. It's time to get original again folks.

When the Customer Sets the Price

Sat, 20 Oct 2007 15:55:17 -0400

As you have no doubt heard, Radiohead skipped the middleman with their latest release, offering the album online for download. This resulted in an estimated $10 Million in profits from 1.5 million downloads over the past week, more than the first week sales of their last three albums combined. Not too shabby, particularly when users could set their own price for the download, including being able to set the price of nothing. Radiohead's VRM-like experiment did trigger a flood of promotion, but at the end of the day, fans still volunteered to cough-up an average of $8 per album. Gets one thinking, don't it?

We will undoubtedly see more stunts like this to promote online sales, along with an increasing willingness to go cheaper and wider by offering digital downloads for free. But I want to know, will we see more customer-driven price setting? It feels a little like a public radio pledge drive, essentially asking the customer at transaction time - what is this worth to you? Applying this sort of purchasing model to product transactions is one approach that the VRM project is exploring - where the customer takes a more proactive stance in setting the relationship terms with vendors. Doc Searls introduces this idea in the context of public broadcasting at the tail-end of a Berkman.tv video on the future of public media. Don't miss the first part of the video either, as Jake Shaprio takes on predicting the future.