The cost of transparency and accountability

The MP Expenses issue is a very interesting story. There are lots of reasons why it is spreading so aggressively…

  • in hard times people look for someone to blame for what’s wrong in the world
  • people are learning to expect more transparency from their government
  • the availability of the data compells the curious to dive into all the detail and look for trends and interesting nuggets
  • activities are surfacing that people want to understand
  • the prospect of uncovering abuses that result in the downfall of a politician is too exciting for people who crave gossip to resist
  • …and on and on

The Internet is optimized for this kind of story.

A big pile of personal data was posted publicly in a usable format. (This data has been available via parliament.co.uk as PDFs for years, but once it’s in a convenient spreadsheet format it suddenly becomes meaningful and very shareable.) People then started finding interesting trends with very little effort. And then we got a very public flame war.

Here’s a snapshot of some of the recent triggers around this issue:

Now, despite the fact that it’s incredibly important for this kind of thing to be possible, I think the scale of the conversation about it is very much a distraction. Stephen Fry captured this sentiment in a quip for a BBC journalist:

“Let’s not confuse what politicians get really wrong with things like wars with the rather tedious obsessions about whether or not they charged for wisteria. It’s not that important. It really isn’t. It isn’t what we’re fighting for. It’s a journalistic made up frenzy.” (Only, I disagree that’s a journalistic made up frenzy. The MPs, the public and the mainstream media organizations are all contributing to the noise together.)

If twitter activity can be considered an insight into what MP’s are spending their valuable time thinking about, then this issue is definitely becoming too big. This Tweetminster chart shows that ‘expenses’ are much more relevant today than ‘banks’ amongst MP’s who use twitter, for example:

Again, I’m happy that we live in a world where our politicians who we pay to represent us are accountable in a very open and public way and that we have the ability to ask them hard questions directly from wherever we sit in the social hierarchy.

Interestingly, this case also provides a view into the cost of openness.

Posted in All | Tagged , , , , , , , , , , , , , , , , | 1 Comment

Response to the Open Platform launch

Guardian Open Platform EcosystemThe Open Platform launch earlier this month was one of the more exciting days I’ve had in a long time. We’ve done a good thing at the Guardian, and it seems we’re not alone in thinking that.

Here are some of my favorite Twitter posts about the launch (more here):

  • @IanYorston “Guardian Open Platform may be the most interesting thing to happen to newspapers in ages”
  • @netspaze “When major newspapers are closing down, UK’s Guardian is opening up.”
  • @lisov “Oh my! Take a look at what The Guardian’s done! An open platform!”
  • @newscred “The Guardian’s Open Platform is an awesome initiative, their support & developer engagement is impressive.”
  • @dreamingspires “The Guardian open platform is a genius idea. maybe the way forward for newspapers.”
  • @estragon “Is this the future of journalism?”
  • @evirtus “Seriously impressed by The Guardian Open Platform! The future of news?”
  • @kate_butler “THANK YOU http://www.guardian.co.uk/open-platform i love you more than ever.”
  • @matlock “Guardian Open Platform is a fantastic piece of work. not jealous at all, honestly. ;-)
  • @r1tz “Serious kudos to the Guardian for launching the open API”
  • @tomskitomski “Thinking that Guardian’s Open Platform is what BBC Backstage could and should have become.”
  • @adrianholovaty “Super impressed with the Guardian’s API.”
  • @SamShepherd “Guardian Open Platform – I am a) impressed and b) disheartened. the gulf between the likely-to-survive and the soon-to-be-bankrupt widens”

And here are some of the best quotes from the media and blogosphere (more here):

This is my personal favorite…

  • If content is king, then this is service is a hundred of the king’s best horses, and thousands of his best messengers, sending the Guardian far and wide. A misstep online is unlikely to cost the Guardian much, and should only encourage competitors innovation—the industry sure needs it.

    With this move, the Guardian redraw of where the boundaries of the newspaper industry lie, using to technology to reach as far as possible. It’s enough to make Conrad Black spit his prison breakfast all over his email-inbox.” (Bad Idea Magazine)

The feedback we’ve heard while participating in various events this month has also been very very positive.

  • Phil Wills and Mat Wall were both part of QCon London.
  • Simon Willison was on a panel at SXSW with The New York Times, NPR, Wired and DayLife talking about “the technical hurdles, the internal arguments, the surprising ways in which people have discovered new ways of looking at the news.”

    Simon was also part of Future of Web Apps in Dublin which was a few days before our launch.

  • I shared some of the thinking behind the Open Platform at Changing Media Summit in London last week in a talk called “The Open Strategy“. That presentation is here:

    (Changing Media Summit is “for anyone concerned with creative and commercial success in the digital age. It is aimed at senior executives responsible for strategies in digital, online, new media, mobile, marketing, branding, finance, comms, content, audio and more.”)

  • We also hosted the Rewired State event earlier in the month, and BarCamp London is going to be in our Kings Place offices this weekend which we’re really looking forward to.

There’s a ton of work to do to move closer to our vision for the platform. If we are going to be successful in weaving the Guardian into the fabric of the Internet, then we need to grow the services we rolled out already and develop the additional services that will round out the offering.

But if the Open Platform launch was about creating the conditions for positive things to happen, then I think we’re off to a really good start.

Posted in All | Tagged , , , , , , , , , , , , , , , | 2 Comments

A few interesting data projects

The contagious data bug must be sweeping through the office, as several very different but very interesting data-driven publishing projects rolled out almost simultaneously.

First, infographics editor Paddy Allen explains the global recession through a very elegant interactive piece “Where did all the money go?“. Paddy has quite a collection of brilliant work from his interactive infographics such as the Energy-hungry houses piece to his storytelling through interactive visualization like the map of Heathrow’s planned 3rd runway.

Second, a strong team led by editor David Leigh has begun posting their investigations into “The tax gap,” a study of tax avoidance by big business.

“It has taken a team of specialists more than three months and involved checking scores of trademark registers and sets of company accounts in Luxembourg, the Netherlands, Switzerland and Ireland.”

One of the many ouputs of the investigation is the raw data that is informing some of the work, such as the interactive guide to corporate tax. For example, you can see what British Airways has reported paying compared with what is notionally due against their stated profits. The information is available in XML format, such as this year-by-year feed.

british-airways-tax-gap-guardiancouk

Third, and this is my personal favorite, the Football guys have outdone themselves with a new feature called Chalkboards. The Guardian’s head of sport Ben Clissett explains:

“No football debate will ever be the same again – it’s not about opinion any more, it’s about facts. And our chalkboards give you the ammunition to settle the argument. You can also compare two players side by side – if you want to compare Robbie Keane and Steven Gerrard in the same position for Liverpool, or Michael Essien and Mikel John Obi for Chelsea.

And when you have built your chalkboard, you can save it and start a discussion with your mates simply by pressing the save button and explaining your point. You can also embed images you have created on your blog, and use the tool with social networking sites.”

For example, I can see clearly for myself that Aston Villa’s draw against Wigan on Saturday was not due to a lack of offense. They had 16 attempts on goal, in fact, 4 on target and 3 shots blocked. The level of detail is amazing. I can also see where the teams focused their passing during the game.



 by Guardian Chalkboards

This is the kind of data that typically only team owners and managers have access to. And even though the super fans can keep much of this in their heads, they can’t watch every game.

Now, perhaps the best part of this is the embeddable Chalkboard image. Since much of the Premier League discussion is happening in places all over the Internet, it makes sense to share the Chalkboards that both editors and users are creating both on and off guardian.co.uk.

Simple but very clever.

I love that each of these is so different. But there can be no doubt that data is starting to drive a lot of very creative approaches to the journalism process.

Posted in All | Tagged , , , , , , , , , , , , , | Comments Off

Building communities from Twitter posts

I spent a little time over the last couple of weeks playing around with some Twitter data. I was noticing how several people, myself included, were sharing the funny things their kids say sometimes:

So then I wondered whether there was a way to capture, prioritize and then syndicate the best Twitter posts into a ‘kiddie quote of the day’ or something like that.

My experiment only sort of works, but there are some lessons here that may be useful for community builders out there. Here’s what I did:

  1. Get the quotes: I ran some searches through Twitter Search and collected the RSS feeds from those results to create the pool of content to use for the project. In this case, I used ‘daughter said‘ and ‘son said‘. I put those feeds into Yahoo! Pipes and filtered out any posts with swear words. Then I had a basic RSS feed of quotes to work with.
  2. Prioritize the quotes: I’m not sure the best way to prioritize a collection of sources and content, but the group voting method may do what you want. Jon Udell has another approach for capturing trusted sources using Del.icio.us. For voting, there’s an open source Digg clone called Pligg. I set it up on a domain at Dreamhost (I called it KidTwits…Dreamhost has a one-click Pligg installer that works great) and then pumped the RSS feed I just made into it. In no time I had a view into all the Twitter posts which were wrapped in all the typical social media features I needed (voting, comments, RSS, bookmarking, etc.).
  3. Resyndicate the quotes to Twitter: While you might be able to draw people into the web site, it made more sense in this case to be present where interested people might be socializing already. First, I created a Twitter account called KidTwits. Then I took a feed from the web site and sent it through an auto-post utility called twitterfeed. Now the KidTwits Twitter account gets updated when new posts bubble up to the home page of kidtwits.com.
  4. Link everywhere possible: When building the feed into Pligg I made sure that the twitter ID of each post was captured. This then made it possible to “retweet” with their IDs intact. Thus, the source of the quote would then see the KidTwit posts in their Twitter replies. It works really well. People were showing up at the web site and replying to me on Twitter the same day I began the project.

    Again, I used Yahoo! Pipes to clean up and format the feed back out to Twitter to include the ‘RT’ and @userid prefix to each entry. I played around a bit before arriving at this format.

    I also included a Creative Commons copyright on all the pages of the web site to make sure the rights ownership issues were clear.

    Lastly, I added a search criteria for my feed collector that looks for references to KidTwits. This means people can post directly to the web site either by adding @kidtwits to their posts or #kt. There was already a New Zealand Twitter community forming who began using ‘kt’ to join their posts (short for kiwitweets), but they gave it up. I then had to filter out references to the kidtwits Twitter posts to avoid an infinite loop.

  5. Improve post quality: Now, here’s where things have been failing for me. I can’t think of better search terms to capture the pool of quotes I want, but there are so many extraneous Twitter posts using those words that it seems like I’m getting between 5% and 10% accuracy. Not bad, but certainly not good enough. The good news is that it’s pretty easy to kill the posts you don’t want through the Pligg interfaces. I just don’t have the time or desire to maintain that.
  6. Optimize the site: I then did a bunch of the little things that wrapped up the project. I added Google Analytics tracking, created a simple logo and favicon, customized the Twitter background, and configured Pligg to import the Twitter Search pipe automatically.

There are several things I like and a few I dislike about this little project.

  • I really like the fluidity of Twitter’s platform. It’s amazingly easy to capture and resyndicate Twitter posts.
  • I love the effects of the @reply mechanism. I can essentially notify anyone who gets their Twitter post listed on the home page of kidtwits.com without lifting a finger. And they get credit automatically for their post.
  • I already knew this, but Yahoo! Pipes is just brilliant. I can’t imagine I would have even considered this project without it.
  • Pligg is pretty good, too. It does everything I want it to do.
  • I would love to hand over the management of the voting and quality checks to someone else. Voting naturally invites gaming. At the end of the day, however, the quality control and community management function is what makes a community service interesting to people. You can’t automate everything.
  • I’m actually not a fan of voting approaches to prioritizing content. It will ultimately result in dumbing down the quality. That’s less of an issue for highly niched topics like this, though.
  • The rights issues are a little weird. This wouldn’t be a problem in forming a community whose purpose is noncommercial naturally. But I’m not sure the Twitterverse would respond well to aggregators that make money off their posts without their knowledge or consent. (To be clear, KidTwits is not and never will be a commercial project…it’s just a fun experiment.)
  • Auto-retweeting feels a bit wrong. I wouldn’t be surprised if the KidTwits account gets banned. But I have explicitly included the source and clearly labeled each Twitter post with ‘RT’ to be clear about what I’m doing. I’m not building traffic to my account, the web site, nor am I intentionally misrepresenting anything.
  • By adding “RT @userid” I’ve killed the first 10 or so characters of the post that I’m retweeting. This means the punchline is often dropped which kills the meaning of the retweeted post.
  • Some conversational Twitter posts get through which include @replies to another user. When the KidTwits retweet of that post goes out it’s very confusing.

The potential here, among other things, is in creating cohesive topical communities around what people are saying on Twitter. You can easily imagine thousands of communities forming in similar ways around highly focused interest areas.

In this method the community doesn’t necessarily have the typical collective or person-to-person dynamics to it, but the core Twitter account can act as a facilitator of connections. It can actually create some of the authority dynamics people have been wanting to see. It becomes a broker of contextually relevant connections.

In a very similar way the web site serves as a service broker or activity driver. It’s a functional tool for filtering and fine-tuning the community experience at the edge. The web site is not a destination but more of a dashboard or a control panel for the network.

The experiment feels very unfinished to me still. There’s much more that can be done to create better activity brokering dynamics across the network through the combination of a Twitter account and a web site, I’m sure.

Posted in All, advertising | Tagged , , , , , , , , , | 10 Comments

Breaking through the attention barrier

For some reason I get a bit annoyed when people write about our information overload limits. This happened the other day when I saw Seth Godin’s piece titled “Warning: The internet is almost full.” He writes:

“The decentralized nature of the net means that it will never be physically full. As long as we can keep making hard drives, we won’t run out of space to store those inane videos of your Aunt Sally. What is full is our attention.”

I just refuse to believe that we’ve hit the ceiling of what the human brain can deal with.

There is no doubt that we have a lot of useless information available to us, much of it pushed at us, cluttering our lives in really irritating ways. But information overload is a symptom of some bigger issues that we can and should resolve.

I think it’s about better linguistics, technologies and education, to begin with. More broadly, it’s about how we collectively understand and apply abstraction layers to manage a more complex world.

Like everyone, I hit my attention limit nearly every day. Seth is right when he says “You can’t read every important blog… you can’t even read all the blogs that tell you what the important blogs are saying.”

That’s a reason to explore some more, not to give up. We shouldn’t become fatalistic about the future of information or look down our noses at all that messy stuff strewn about the Internet. I never want the flow of information to slow down or, worse, retract, no matter how much mess gets in the way of finding the stuff that matters to me.

What we may need are more dramatic changes in our language, more effective information discovery services, more experience-based education programs both for kids and adults, and, perhaps even more important than all that, an altered world view that can accommodate and make the most of the vast resources that are now part of our culture forever.

Posted in All | Tagged , , , , , , , , , , , , , , , | Comments Off

Hacking BNP data

Less than a week after trying out some new data mapping concepts at Guardian Hack Day, a big pile of data appeared on the Internet begging to be mapped. Using some of their new skills and a convenient constituency data tool, a small team of innovators got to work to produce some really interesting data-driven journalism.

Mat Wall details what happened behind the scenes:

“[Simon Willison] wrote a piece of code to extract the 12,000 BNP member’s postcodes through the They Work For You constituency API. Now he had a voting constitency for each person on the list. He then injected this data back into his hack day project to plot this information onto the map obtained from Wikipedia. This took about an hour.”

Update: The project didn’t end there, it turns out. The infographics guys used the concept for the newspaper the next day. Here’s a picture of what was printed:
Hack Day Map in The Guardian Newspaper

Posted in All | Tagged , , , , , , , , , | Comments Off

Notes from Hack Day at The Guardian

We hosted our first Hack Day last week at The Guardian. Amazing fun.

Here’s a 15min highlight reel:

We did a lot of the standard stuff that makes Hack Day so interesting, but there were a few innovations to the event format itself that I thought worked really well, too:

  1. DabbleDB. Simon Willison setup a simple hack submission queue using DabbleDB, a handy online database tool. It’s as if the software was designed for this purpose. Two nice benefits: 1) you can upload a screenshot with your submission which it displays nicely, and 2) it prints beautifully. I handed out a hardcopy of the hack demo queue for each judge who then used the list to take notes.
  2. Double Screens. We setup 2 projectors so we could jump back and forth between presentation locations and save some time. While one person was presenting, the next person was setting up on the other screen. I was a little worried it would be distracting, but that wasn’t a problem at all.

    I think this is primarily what kept the pace up. We got through 37 hacks in just about an hour. At that pace you couldn’t really afford to look away. Oh, and Simon’s lightning timer was hugely helpful, too.

    This then had the nice effect of giving the judges more time to deliberate…

  3. Comprehensive recognition. The judges went through every single hack and found a way to acknowledge each participant. Emily Bell did a sort of improv act dishing out the jokes. She first went through all the hacks that “we would have given an award to”. Then she handed out the trophies…
  4. The Guardian Hack Day TrophySilly trophies. These worked perfectly. You can keep it on your desk. It makes no sense to anyone else. And it reinforces the idea that the recognition is for the work itself, not for winning a competition. We did hand out a couple of Flip cameras and Make Magazine generously offered some free subscriptions for the hardware hacks, but the emphasis was clearly on the hackers and their hacks, not the idea of ‘winning’.

Otherwise, it seemed to operate much like other Hack Days, except for the refreshing focus on hacks that mean something. I wasn’t sure what kind of hack quality to expect which was in fact very high, but I loved the fact that most of the hacks had the added dimension of context.

Many times a Hack Day results in a lot of amazing technology solutions for problems that don’t exist. I would never challenge the value of creativity for creativity sake, as that’s a big part of what Hack Day is about. But I was really happy to see that in addition to the impressive technical hacks things like Ben Griffiths’, Rob McKinnon’s and Simon Willison’s hacks (to name a few) presented data and information in new ways that could influence the way people think about what they are reading or interacting with.

Anyhow, the event was fantastic, and I’m really looking forward to doing it again.

Posted in All | Tagged , , , , , , , , , , , , , | 2 Comments

Celebrating in the streets of San Francisco

Off topic here, but this video is worth sharing. My wife and I decided to take a stroll after the election speeches. We were heading for a pub but got sidetracked by all the noise in the streets of San Francisco. Then we saw a crowd forming and cops smiling, not a recognizable combination.

This is what we saw (1 min):

Some other accounts of the event:

Neil Girling: “Extra Action Marching Band led the crowd in jubilation, and there were many cheers and chants of “Obama” and “U S A.” The mood was ecstatic, and the cops were polite and extremely hands-off; a little after midnight, when they finally asked Extra Action Marching Band — who have a reputation for chaos and noise — to start to shut down, they did so with smiles and were met with the same.”

Tim Redmond, SFBay Guardian: “San Francisco is going crazy. I haven’t seen this much excitement in the streets since we shut down the city when the Iraq war began. But this time, we actually have something to celebrate.”

Sean Bonner, SF Metblogs: “My neighborhood went 9 kinds of insane last night.”

Strange Things Will Happen: “It was like Italy had won the World Cup, only with less mopeds and more high-fiving.”

Posted in All | Tagged , , , , , , , , , , , , , , | 2 Comments

Why the open strategy is a good idea

The giant dotcoms and innovative Internet startups have been testing and proving approaches to openness as a strategy over the last few years. The ideas seem to have permeated some of the farther corners of the Internet now, and I think we’re on the cusp of an explosion of open strategies and concepts across all markets, not least of which is the publishing world.

The most recent notable examples came out of The New York Times and BBC.

The New York Times took Federal Elections Commission data and repurposed it for people who build web applications. The FEC site is good and the data is mildly useful there, but The New York Times is able to shine a spotlight on what they are doing and make a more useful interface to their data. Given the power of their brand they can also help pull together people from around the Internet who understand data visualization and how to build interactive web sites.

The New York Times is embracing raw data in ways that give context and meaning to the mashup world that has grown so much in the last few years.

Jeff Jarvis’ NYC startup DayLife is another interesting but different type of example:

“Our technology collects content from thousands of high-quality online sources, deeply analyzes and parses it, and creates a trove of data that can then be reused in an infinite number of ways by publishers of all sizes.”

The DayLife platform gives them the ability to not only create a pretty good destination site but also to power other people’s web sites with interesting content they have identified and classified. We have used it on guardian.co.uk to enhance our Olympics coverage and US Elections coverage, among other things.

But DayLife went the extra step recently in making it possible for any of the content owners in their system to open up and release their content as an API via the DayLife platform, the same way The New York Times released data from the FEC via nytimes.com.

DayLife is playing data aggregator and distributor for publishers who haven’t figured out how to do this themselves:

“Using Enterprise API, you can launch your OWN API to your OWN CONTENT, all powered by Daylife’s proven technology platform. And you can do this in a matter of days.

You’ll get to choose whether to make your API available to the world at large, or limit access to your in-house developers. In either event, Enterprise API lets you break out of the bottleneck of your in-house CMS to start building new stuff with your content, immediately.”

What starts to become clear when you look at these kinds of services is that media organizations should improve how they facilitate information flow. This is actually what journalism has always been all about, releasing important information to people in a useful way. The media businesses that figure out how to make information flow more fluidly across the entire Internet are going to win over time.

That’s one of the reasons we released full content RSS feeds this week on guardian.co.uk. Rather than require people to visit the web site to read articles we post, they can get what they want when and where they want it from us.

We want to make guardian.co.uk useful to people in whatever context matters to them wherever they are on the Internet.

This is a must-have feature of publishing today even though Forrester’s recent study shows that very few people understand RSS. Mark Hopkins of Mashable.com noted that opening out is not just about serving end-users. It’s about being a part of the activity streams happening all across the Internet:

“If you turn your attention to the most popular sites on the web, sites like Facebook, MySpace and Google all have syndicated content strewn all through them. Let alone sites like FriendFeed, Plaxo and and thousands of blogs and news sites out there that rely on aggregation of content via RSS.”

But the open strategy is not just about opening out. It’s also about opening in.

BBC.co.uk/music is a really good example. They recently began integrating data from other sites and then releasing the raw information in ways that developers would be able to use elsewhere, as well.

“By adopting [the MusicBrainz] open standard, our pages are able to benefit from public domain content linked from MusicBrainz such as biographies from Wikipedia and discographies from MusicBrainz. But MusicBrainz IDs also make it straightforward for third parties to work with our data and automate links to our pages.”

BBC is linking both literally and figuratively to the open web.

The benefits to doing this are obvious and immediately tangible on some levels and then much more strategic and a bit abstract on others.

First, Google’s search engine will reward sites that reference and get referenced by authoritative and relevant sources. BBC’s Matthew Shorter adds,

“Having a persistent, and increasingly rich, resource to link to for each artist on the BBC should also help those pages appear higher up the search rankings”

Second, being the essential data source for a particular topic creates lots of opportunity as the number and size of the customers of that data increases.

For example, you can be sure that Tele Atlas made a lot of money when Google committed to a 5-year deal for their location information:

“The agreement spans Google’s current and future map-based services and navigation offerings across mobile, online and desktop environments. These include the Google Maps™ and Google Earth™ services and mobile applications such as Google Maps for Mobile™. The agreement also gives Tele Atlas access to edits for its maps from Google’s community of users, whose suggested changes can help the company further increase the quality and richness of Tele Atlas maps.”

But no single source of data is ever guaranteed to be the most important or relevant source on the Internet forever.

Actually, it’s not inconceivable that OpenStreetMap will be more valuable than NavTeq and Tele Atlas very soon, as it is has the added benefit of being enhanced by humans every day. You can think of it like a Wikipedia for geography.

Plus, it’s free to use.

The business of openness is about being a part of the wider ecosystem in addition to creating your own. When you’re open you can be relevant to people wherever they are on the Internet in addition to when they make the effort to visit you. And when that relationship becomes meaningful the revenue streams will find their way to you, too.

eBay, Salesforce.com, Flickr, and Amazon owe much of their success to their approach to openness. They’ve opened up their platforms in ways that allow other sites and participants in the Internet ecosystem to both take from and add to their services.

If you need clarity on the revenue model, look no further than Google’s AdSense. AdSense accounts for well over 30% of Google’s total revenue. They wrote checks totalling about $3 billion in the first half of 2008 to all the partners who carry the ‘Ads by Google’ ad unit out there. That’s a pretty good incentive to participate in their ecosystem.

With a little creativity, the open strategy will create a lot of opportunity for any media organization. And sometimes I even wonder if it will be the only model that works at some point in the not too distant future.

Posted in All | Tagged , , , , , , , , , , , , , , , , , , | 8 Comments

The opportunity cost of noiselessness

At minute 4:30 in LCD Soundsystem’sYr City’s A Sucker‘ a tightly bound harmonic ‘Aaah’ and the shout that arises from beneath it speaks volumes about what the media business often means to people.

What we want is what you want. What you want is a case of the hah hah hah’s.

It’s like casinos and gamblers, drug dealers and addicts — a sort of degenerative codependence.

The ‘Aaah’ is brief. It sounds nice and pleasant and makes you think everything is happy here, production and consumption joined for the good of all.

Behind it, however, is an angry or perhaps exhausted shout that breaks through just for a moment at the end. It’s the musical representation of The Narrator’s struggle in Fight Club:

“We’re consumers. We are by-products of a lifestyle obsession. Murder, crime, poverty, these things don’t concern me. What concerns me are celebrity magazines, television with 500 channels, some guy’s name on my underwear.”

The media business is not the only space in which creativity wants to escape the dominant and manipulative incumbent power structures. Finance. Healthcare. Government. Law.

Product design is a great example. In a recent TechTalk at The Guardian Matt Webb argued that people want to use physical objects to connect with people. Social networking is a feature that can be unlocked from within everything we touch.

Nearly as interesting as his philosophy and his prototypes is the fact that Matt was able to build these things on his own. With very little cash he circumvented traditional product manufacturing to make these new ideas real.

Matt Webb's Olinda Radio

After his talk one of the staff asked whether the entire last century was a weird anomaly in the history of mankind. He wondered whether the means of production had become so sophisticated and expensive that they ultimately crushed man’s natural tendency and desire to build things. That’s a good question.

Did the machines and systems and processes and subsequently their impact set the bar for success so high that many people stopped trying?

Lucas Gonze explores this thinking in terms of music. Clay Shirky sees similar patterns in television.

You could argue that the second industrial revolution was the beginning of the great numbing of humanity. While we changed the world at unprecedented scales, the consequence was a systematic reduction of the noise that comes from wider participation.

Human messiness was suppressed to pursue perfect design.

But maybe the noise of participation has music within it that our ears don’t yet understand.

Jeremy Keith got me thinking about some of this further in his dConstruct keynote. He talked a bit about evolution, randomness and power. Once a power law is established it puts a large percentage of the participants in the system at a disadvantage.

Those systems undoubtedly created huge opportunities and changed lives dramatically, frequently for the better, but the indirect costs are becoming more clear today.

In another song called ‘Yeah‘ on the LCD Soundsystem album, James Murphy challenges people to wake up. He repeats ‘Yeah’ over and over like a mindless chant. He doesn’t sound interested or excited. He just agrees as if he lost the will to disagree. And then he breaks out of the trance for a moment and says:

“Everybody keeps on listening in. Nobody listening up.
Everybody keeps on talking about it. Nobody’s getting it done.
I’m tired, tired, tired now of listening, listening… knowing that the ship’s gotta run.”

The optimist hopes forces such as the Internet will reengage the world and empower people to do things they felt excluded from doing before, to participate again and to add to the collective experience of humanity.

The pessimist fears that people are being played by markets designed to take from them and that they are failing to recognize the impact of consuming the goods sold to them…that we are complicit in the growth of the forces that hurt us.

Fred Wilson sees opportunity across all markets to use the Internet as a way to empower people again. He writes about the wider strategy in the investments he makes at Union Square Ventures:

“[The Internet] is taking power away from existing large institutions and pushing it out to smaller entities and often all the way to individuals. In the process it is building up new institutions (such as Google), but the net result appears to be a distinct shift of ‘power to the people.’”

In Adam Greenfield’s insightful essay ‘Waiting for the Whirlwind‘ (via Tim O’Reilly) he articulates some of the deeper fears in America that cause and result in the nomination of someone like Sarah Palin to such incredible political heights.

“The things that endear this onetime nowhere-burg mayor to Americans are indicators that a whole lot of people think tomorrow came too soon…Where they were once called to dream and to believe that their best days as a community still lay ahead, [mainstream Americans] are now at war with the future.”

If Palin was a surprise to anyone then they weren’t paying attention when California voted in a seemingly unqualified feel-good entertainer to govern the region….twice. We elected one of them President…twice.

Palin simply reflects a common desire to maintain the co-dependence of our current political structures.

I have to agree with one of the comments posted in response to Mr. Greenfield’s essay where Daniel Erwin challenged people to participate usefully in whatever this trend is about rather than run away and point fingers.

“Don’t be one of those people who tries to stop the train because most of the world is “crazy” and values things you (and I) don’t understand. Just keep doing your work and you’ll do much better than all this fearful complaining.”

The test for the next century may play out in the way we engage our diverse natures to advance as a whole or rather as many parts of a whole. What do we advance toward? I’m not sure it matters…as long as lots of people are participating and that we recognize how to make corrections dynamically along the way.

James McLurkin studies and builds swarming robotics which are inspired by an obsession with insects. Ants, for example, make lots of mistakes, dropping food and stepping on eachother, but they recognize signals around them that give them clues as to what decisions to make and thus accomplish amazing things as a whole.

The mathematical theory behind his swarming robots is derived from research on distributed algorithms — the idea that problem solving can be tackled by different systems on a network.

It’s about zooming out, abstracting beyond our differences so that individual uniqueness becomes a point of leverage for something bigger collectively instead of worrying too much about the future which is guaranteed to be full of errors in judgment no matter what we do.

Imagine if Google chose not to index less popular web sites or perhaps only the left-leaning political sites or maybe only scientific research documents. They could have focused on eliminating the noise entirely.

Instead, a gigantic market grew around Google’s search engine because they delivered on the expectation that everything on the Internet can be found there, no matter how uninteresting or useless or potentially offensive the unique individual parts of the whole collection seemed to be.

Google embraced the noise. They didn’t care to be perfect. And now the opportunity before them seems nearly boundless.

Posted in All | Tagged , , , , , , , , , , , , , , , , | 1 Comment