retweetradar.com – One days work from concept to launch with Google App Engine… Scobleized!

retweetradar.com

So I was getting a little restless and decided to work on another Google App Engine app, this time without all the Python learning curve and with some real world experience with the Google tools under the belt from http://spy.appspot.com. The goal was to see how fast I could go from concept to useful application leveraging a few of the revolutionary tools we all have at our fingertips today. In the end with about one days work an app was released, likely with a few bugs, but some fun things happened and I believe a bit of foreshadowing of the future of building web apps.

The Concept

I had an idea that I really wanted to extract meaning from a large-ish set of social media messages in near real time and visually trend it over time, showing topics heating up in conversations even while still slightly off the conventional news radar. We’ve all seen lately the groundswell social media conversation routinely outpacing tradition broadcast media in speed and openess of accounting, this app would be yet another way to put your finger on that pulse.

The class of information that looked interesting was “retweets” in other words messages where Twitter users were quoting someone else’s post, essentially saying they liked it, or spreading the word. Tech blogger Robert Scoble called out the same last Friday saying “[Retweets] …by the way, great place to find news!

The How

mashup

So now to the how, obviously Google App Engine was my choice for delivering this application, it’s ease of access, familiar development environment, ease to scale and obvious lack of initial cost make it a winner — Paul McDonald and Tom Stocky being very great folks to talk to, among other Googlers on the App Engine team I am sure, helps as well.

Next I needed the information, Twitter’s great search API acquired with the Summize purchase makes pulling tweets in near real time a non event. Now the value add, the real magic in the idea was to pull relevant information from the tweets and trend them, for that the lesser known Yahoo Term Extraction API was chosen, it’s simple interface, reliability and quality results. So the parts were chosen… we have the ability to capture social media posts, process out key terms, save, count and display them on the web… very nice. So in the equivalent of one days work over the last two days I took these parts and pieces, shook them up with jQuery and released http://retweetradar.com to the world.

The Outcome

The outcome was astounding http://www.retweetradar.com launched publicly via a Tweet and FriendFeed posts at around 8pm CST on Saturday, given the work done on Friday and Saturday certainly no greater than one common work day from start to launch. Once Sunday came around I tweeted the news to a few folks, Dan Zarrella was one he has done work on the data behind viral messaging on Twitter another of note was Robert Scoble to close the loop on his tweet about the value of retweets… then things took and unexpected turn… an inconspicuous but cool “like” came in from Scoble on Friendfeed.

Screenshot-Ben Hedrington - FriendFeed - Mozilla Firefox

Next thing I know Robert Scoble is using me as an example in a great blog post about events the mainstream media and even Internet media miss…

Robert says:

I love developers who try new things out. Check this out. Is this on TechMeme? No. Plus using Google’s App Engine, which is another trend we’re tracking: cloud computing.

I couldn’t agree more with the topic of that blog, even if I wasn’t involved! You did read it right?

This isn’t about launching another web app…

The fact this is possible is the real star here, the ability for anyone to bring an idea to the web in a highly reliable and scalable way for little to no initial investment shows a bright light toward the future… folks used to say the same for picking up some shared hosting for $5.95 and knocking out some PHP but realistically that app tipped over the second it saw real traffic and was hard to say whether it would be up day by day based on the other people, number of whom soaring each month, who shared your hardware.

Google App Engine and Open APIs clearly show where the web is going, the playing field is leveled… get out there and deploy those ideas you say you have scrawled on those napkins that you say are going to revolutionize the world, the tools you need to prove it are out there right now.

So, draw your own conclusions to the viability of my new app retweetradar – No, please do! Contact me with feedback on whether it is useful and any ideas to make it better – it’s really not a huge concern long term… but I don’t believe it is possible to argue that these tools be it social media, cloud computing or whatever you want to call them are truly leveling the playing field, flattening the world and company hierarchies and making whatever the future of the web will be possible for anyone.

Related posts:

  1. ‘spy’ makes “15 Useful Google App Engine Applications” on LouisGray.com!
  2. Can Making Social Media a Spectator Sport Move it to the Mainstream? – Why I Created spy.appspot.com.
This entry was posted in Social Media and tagged , , , , , , . Bookmark the permalink.

15 Responses to retweetradar.com – One days work from concept to launch with Google App Engine… Scobleized!

  1. Andy says:

    Awesome! Nice work, Ben!

  2. Ben:

    You provide simultaneous motivation and opportunity to sit in a shame spiral. For example, my existential dilemma is…..OK, it’s (value-added app-ing) is do-able if you put in the time. So study up, and ply the trade – so to speak. The other hell based voice is….see these guys know what they are doing, you’ll never get this tech/app stuff despite your ostensible interest in learning.

    Net/net, is I am inspired by your work. Thanks, bro.

  3. Ben says:

    Wow Gregg, never thought about it from that perspective. My goal is motivation and to show what is possible but I see that the other “I don’t get this” could can hang over people and be hard to shake. Maybe I need to do posts about the number of builds of these apps that break in production or open source the code so others can comment on some of it’s ugliness.

    We all are learning, very few know this stuff backwards and forwards and I am certainly not one… I still say to those in the boat Gregg describes go for it… you’ll figure it out.
    -Ben

  4. Sean Scott says:

    Ben,

    Inspiring. You and your app is encapsulate exactly what i love about the web. Anyone with an idea and a minimum of time can add value to many many many lives.
    Inspiring!! Keep up the good work.

  5. Pingback: All feedback is good feedback… especially when it’s from Tim O’Reilly! - retweetradar.com - buildcontext

  6. andrew korf says:

    super nice work on this one – the emphasis on good design at the display layer/ui pays off big time in first impressions.

    look forward to following your work going forward.

  7. Joe Lazarus says:

    Nice work! I’m trying to learn Google App Engine now after getting inspired by this post. I don’t suppose you would be willing to share your code, would you? I’m not a developer, but I’m pretty good at figuring out how things work if I can see sample code. I haven’t found many good examples online that show how to interact with third party API’s like those from Twitter & Yahoo!. I would love to see how you built this.

  8. Pingback: I Never make Predictions and Never Will: IT Predictions For 2009 « Martin’s Weblog

  9. Pingback: Turulcsirip - Peter Halasz

  10. I just listed retweetradar in the Twitter Applications Database at Twitdom.

  11. Pingback: Exploring your way into Social Media: The Presentation? - buildcontext

  12. Pingback: Google App Engine - Why The Web Will Change The World - Life of a Web Programmer

  13. richweaver says:

    RE: Ben:
    You provide simultaneous motivation and opportunity to sit in a shame spiral. For example, my existential dilemma is…..OK, it’s (value-added app-ing) is do-able if you put in the time. So study up, and ply the trade – so to speak. The other hell based voice is….see these guys know what they are doing, you’ll never get this tech/app stuff despite your ostensible interest in learning.
    Net/net, is I am inspired by your work. Thanks, bro.

    End:

    I agree with Ben in some ways, but on the other hand; the demand to learn FAST (i.e. FASTER), is in direct relation to ones wallet size. Hence, there are no Art collectors on skidrow.

  14. richweaver says:

    ADD: Sorry forgot, I was caught up in my own misery there for a second. GREAT APP! 3 WOOTS or it that TWOOTS! TWOOTS! TWOOTS!

  15. Pingback: Best Buy speaks Google App Engine at Google I/O 2009 - buildcontext

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>