So I was getting a little restless and decided to work on another Google App Engine app, this time without all the Python learning curve and with some real world experience with the Google tools under the belt from http://spy.appspot.com. The goal was to see how fast I could go from concept to useful application leveraging a few of the revolutionary tools we all have at our fingertips today. In the end with about one days work an app was released, likely with a few bugs, but some fun things happened and I believe a bit of foreshadowing of the future of building web apps.
The Concept
I had an idea that I really wanted to extract meaning from a large-ish set of social media messages in near real time and visually trend it over time, showing topics heating up in conversations even while still slightly off the conventional news radar. We’ve all seen lately the groundswell social media conversation routinely outpacing tradition broadcast media in speed and openess of accounting, this app would be yet another way to put your finger on that pulse.
The class of information that looked interesting was “retweets” in other words messages where Twitter users were quoting someone else’s post, essentially saying they liked it, or spreading the word. Tech blogger Robert Scoble called out the same last Friday saying “[Retweets] …by the way, great place to find news!”
The How

So now to the how, obviously Google App Engine was my choice for delivering this application, it’s ease of access, familiar development environment, ease to scale and obvious lack of initial cost make it a winner — Paul McDonald and Tom Stocky being very great folks to talk to, among other Googlers on the App Engine team I am sure, helps as well.
Next I needed the information, Twitter’s great search API acquired with the Summize purchase makes pulling tweets in near real time a non event. Now the value add, the real magic in the idea was to pull relevant information from the tweets and trend them, for that the lesser known Yahoo Term Extraction API was chosen, it’s simple interface, reliability and quality results. So the parts were chosen… we have the ability to capture social media posts, process out key terms, save, count and display them on the web… very nice. So in the equivalent of one days work over the last two days I took these parts and pieces, shook them up with jQuery and released http://retweetradar.com to the world.
The Outcome
The outcome was astounding http://www.retweetradar.com launched publicly via a Tweet and FriendFeed posts at around 8pm CST on Saturday, given the work done on Friday and Saturday certainly no greater than one common work day from start to launch. Once Sunday came around I tweeted the news to a few folks, Dan Zarrella was one he has done work on the data behind viral messaging on Twitter another of note was Robert Scoble to close the loop on his tweet about the value of retweets… then things took and unexpected turn… an inconspicuous but cool “like” came in from Scoble on Friendfeed.
Next thing I know Robert Scoble is using me as an example in a great blog post about events the mainstream media and even Internet media miss…
Robert says:
I love developers who try new things out. Check this out. Is this on TechMeme? No. Plus using Google’s App Engine, which is another trend we’re tracking: cloud computing.
I couldn’t agree more with the topic of that blog, even if I wasn’t involved! You did read it right?
This isn’t about launching another web app…
The fact this is possible is the real star here, the ability for anyone to bring an idea to the web in a highly reliable and scalable way for little to no initial investment shows a bright light toward the future… folks used to say the same for picking up some shared hosting for $5.95 and knocking out some PHP but realistically that app tipped over the second it saw real traffic and was hard to say whether it would be up day by day based on the other people, number of whom soaring each month, who shared your hardware.
Google App Engine and Open APIs clearly show where the web is going, the playing field is leveled… get out there and deploy those ideas you say you have scrawled on those napkins that you say are going to revolutionize the world, the tools you need to prove it are out there right now.
So, draw your own conclusions to the viability of my new app retweetradar – No, please do! Contact me with feedback on whether it is useful and any ideas to make it better – it’s really not a huge concern long term… but I don’t believe it is possible to argue that these tools be it social media, cloud computing or whatever you want to call them are truly leveling the playing field, flattening the world and company hierarchies and making whatever the future of the web will be possible for anyone.


9 Comments
Awesome! Nice work, Ben!
Ben:
You provide simultaneous motivation and opportunity to sit in a shame spiral. For example, my existential dilemma is…..OK, it’s (value-added app-ing) is do-able if you put in the time. So study up, and ply the trade – so to speak. The other hell based voice is….see these guys know what they are doing, you’ll never get this tech/app stuff despite your ostensible interest in learning.
Net/net, is I am inspired by your work. Thanks, bro.
Wow Gregg, never thought about it from that perspective. My goal is motivation and to show what is possible but I see that the other “I don’t get this” could can hang over people and be hard to shake. Maybe I need to do posts about the number of builds of these apps that break in production or open source the code so others can comment on some of it’s ugliness.
We all are learning, very few know this stuff backwards and forwards and I am certainly not one… I still say to those in the boat Gregg describes go for it… you’ll figure it out.
-Ben
Ben,
Inspiring. You and your app is encapsulate exactly what i love about the web. Anyone with an idea and a minimum of time can add value to many many many lives.
Inspiring!! Keep up the good work.
super nice work on this one – the emphasis on good design at the display layer/ui pays off big time in first impressions.
look forward to following your work going forward.
Nice work! I’m trying to learn Google App Engine now after getting inspired by this post. I don’t suppose you would be willing to share your code, would you? I’m not a developer, but I’m pretty good at figuring out how things work if I can see sample code. I haven’t found many good examples online that show how to interact with third party API’s like those from Twitter & Yahoo!. I would love to see how you built this.
I just listed retweetradar in the Twitter Applications Database at Twitdom.
RE: Ben:
You provide simultaneous motivation and opportunity to sit in a shame spiral. For example, my existential dilemma is…..OK, it’s (value-added app-ing) is do-able if you put in the time. So study up, and ply the trade – so to speak. The other hell based voice is….see these guys know what they are doing, you’ll never get this tech/app stuff despite your ostensible interest in learning.
Net/net, is I am inspired by your work. Thanks, bro.
End:
I agree with Ben in some ways, but on the other hand; the demand to learn FAST (i.e. FASTER), is in direct relation to ones wallet size. Hence, there are no Art collectors on skidrow.
ADD: Sorry forgot, I was caught up in my own misery there for a second. GREAT APP! 3 WOOTS or it that TWOOTS! TWOOTS! TWOOTS!
6 Trackbacks
[...] buildcontext the personal blog of Ben Hedrington Skip to content AboutTwitterFriendFeedLinkedInFacebookSocial Media ’spy’retweetradar.com « retweetradar.com – One days work from concept to launch with Google App Engine… Scoble… [...]
[...] Platform, Google App engine or Microsoft’s Azure to create their own applications like this Twitter search using Google App engine or this Twitter search using Microsoft Azure. By the end of 2009 I am expecting to see more people [...]
[...] : retweetradar.com – One days work from concept to launch with Google App Engine… Scobleized! http://www.buildcontext.com/blog/2008/12/22/retweet-radar-google-app-engine-retweetradarcom-robert-s... « előző | Peter Halasz — 2009. 02. 08. [...]
[...] conversation’s value by experimenting with it… not just technology hijinks (although that’s interesting [...]
[...] at the open tools he had available to make things happen and just freaking did it. Then he wrote an amazing blog post telling how he did it. Did I mention it was written in one in one day? Yeah, I’m still a little [...]
[...] Buy was asked to come speak about App Engine and our point of view, that we have shared many times, that it projects a strong model for the future of web development that allows the [...]