Alex Barnett blog : SaaS

Why OData Matters (IMHO)

alexbarnett — Fri, 19 Mar 2010 15:24:00 GMT

Earlier this week I was in the MIX10 crowd as Douglas Purdy announced the Open Data Protocol (it was a great presentation - summarized here).

I want to share with you why I think OData could be a very big deal…But before we go there...let's start with the basics...

What is OData? Where Did OData Come From?

To understand the history of how OData came to be, you need to understand how project "Astoria" came to be...I won't go over that again as this is already pretty well documented. ~~Astoria~~ OData has come a long way since.

In a nutshell: Today, OData builds on a few conventions, popularized by AtomPub (see OData AtomPub Format), to using REST-based data services. These services allow resources, identified using Uniform Resource Identifiers (URIs) and defined in an abstract data model (see OData URI Conventions, to be read and edited by web clients using simple HTTP messages (see OData Operations).

An Open Data Protocol for the Web

OData offers a standardized way for programmable data to be made available across the web and in turn allowing "consumers" of that data to rely on a set of conventions to be followed that in turn allows many interesting things to happen if widely adopted...

...And to this end:

As announced, OData has been released by Microsoft under the Open Specification Promise (OSP) "to allow anyone to freely interoperate with OData implementations" . Since then, the W3C has invited the OData team to Bring OData to a W3C Incubator (I haven't seen a public response yet but I urge the team to do so.).
OData is not a Microsoft-only thing and it won’t succeed if it is. The originating philosophy was about transparency in the design process, with an Open end-point as the goal - not a .NET lock-in play (“agree on standards and compete on implementation”). This approach has already yielded an initial set of clients, servers, services, and tools. Today, a number of OData SDKs and libraries are available for .NET, Java, PHP, iPhone (Objective-C) and more – and there’ll be more coming.
There is a small but growing ecosystem of non-Microsoft "producers" and "consumers" - (where OData "producers" include Netflix’s catalog as OData and the VanGuide (a social map of Vancouver Open Data) and Public data from the city of Edmonton as OData) and OData “consumers” - standard web browsers, RIA "data explorers" – such as Sesame OData Browser, and the client libraries mentioned above – p.s. somebody build a javascript-only data browser please!)

Where can OData take us?

The clue is in the OData icon (next to the RSS feed icon. Can you see the similarities?

The big idea here is that in the same way we have the "RSS" feed icon, we'll get used to seeing the "OData" icon on commercial and non-commercial websites everywhere (especially for government-related data). So in the same way you know today that the RSS icon means "get an XML feed for this content", the "OData" icon means "get this web data" - you'll know (and your client will know) what to expect in terms of how to read in, and navigate through and query structured web data sets - and in many cases write against them - using a common syntax.

Q: Right, But So What?

A1: Open Government OData. From Open Government Data Principles

The Internet is the public space of the modern world, and through it governments now have the opportunity to better understand the needs of their citizens and citizens may participate more fully in their government. Information becomes more valuable as it is shared, less valuable as it is hoarded. Open data promotes increased civil discourse, improved public welfare, and a more efficient use of public resources.

That’s great, but it needs to be practicable…And number 5 of the 8 Principles of Open Government Data sensibly states that the data should be (via David Eaves):

5. Machine processable

Data is reasonably structured to allow automated processing.

It'll be down to each government agency (and local government) as to how they decide to implement this principle, but wouldn't it be great if they agreed to a standard (and a powerfully simple, web-oriented one at that)? This is what Jon Udell concluded here:

"The open data movement, in government and elsewhere, aims to help people engage with and participate in processes represented by the data. When you publish data in a fully articulated way, you build a framework for engagement, a trellis for participation. This is a huge opportunity, and it’s what most excites me about OData"

A2: To ODatarize your data is to RESTify your data.

As more data-oriented web APIs come online, each team responsible for the design of each web API is confronted by the same kinds of questions, and each team answers these in their own particular way. Increasingly, “RESTful” is a design goal of web APIs. Great…but what does that mean? How do you expose the data, the relationships between the entities inside the model, and what should the querying syntax look like? Unfortunately, there are as many answers to these questions as there are RESTful web APIs. And there needn’t be.

For to ODatarize your data is to RESTify your data. Do spend the time at the value layer - figure out the way your developers / consumers want to see the data and expose it that way. Do make it easy for devs / consumers to learn / navigate about the data and use it. Do not make them learn about the unique idiosyncrasies you’ve built into your API (or those that leak out of your originating store) :-)

From a developer’s standpoint, OData is ultimately about productivity.

For the OData “Production Developer”: Point at your data store – define your entity model and map it to the data model you already have (so your developers consume / program against the data that makes most sense to them – effectively ORM’ing) and expose as an OData service, inheriting: all the REST characteristics; entity relationship self-discovery; and querying goodness.
For the OData “Consuming Developer”: If you know the web API is OData…great! Pick up a client library, get to the API end-point (data.foo.org/blah.svc). Point and Shoot: Traverse the data model, query it (and bookmark as needed – it’s a URI)…play!

(see links at the bottom of this post to technical content that provides details on all this)

A3: Since the announcement, I’ve seen quite a bit of excitement around the web (especially Twitter) by developers who see the potential here…there is plenty of experimentation going on. At Intuit, my team is also experimenting with ODatarizing some of our data services, exploring how it might be applied across a number of our cloud based data services. And when our team’s architect Tweets that “Looks like #odata is going to be a good fit for our data services”, I know there’s something interesting going on here…

So I encourage you to find out more about OData and get involved.

More Resources

An easy way to set up an OData feed from your SQL Azure database - Stephen Forte
OData interoperability with .NET, Java, PHP, iPhone and more - MSFT Interop team
Microsoft, Bring OData to a W3C Incubator - W3C blog -
Silverlight 4 + RIA Services - Ready for Business: Exposing OData Services-4-ria-services-ready-for-business-exposing-odata-services.aspx - Brad Abrams (MSFT)
Open Data for the Open Web - Douglas Purdy (MSFT)
Producing and consuming OData feeds: An end-to-end example - Jon Udell (MSFT)
OData for collaborative sense-making - Jon Udell
The three laws of open government data – David Eaves
8 Open Government Data Principles
Open Data Protocol (OData) with Pablo Castro - Hanselminutes podcast interview with Pablo Castro (MSFT – Architect for OData)
OData, a RESTful contender for your API - Andy Thompson
Announcing Sesame Data Browser - Fabrice Marguerie
Retrieving Data with the OData SDK for PHP - Brian Swann
Got SQL Azure? Then you've got OData - OData blog
Implementing only certain aspects of OData-only-certain-aspects-of-odata.aspx - Pablo Castro
Every SharePoint 2010 server is a Data Services server - Pablo Castro
Microsoft Creates New OData.org Website for Open Data Protocol – CMS Wire
Microsoft delivers updates on OData, Houston, Dallas - ZDNet
Timeline of Project Astoria - Pablo Castro
How ADO.NET Data Services came to be (formerly known as Project Astoria) - Alex Barnett
previous Astoria / OData posts - Alex Barnett

Connecting Clouds: Intuit Partner Platform and Windows Azure

alexbarnett — Wed, 20 Jan 2010 16:33:00 GMT

How about I break my blogging “hiatus” by sharing some cool stuff the Intuit Partner Platform team has been working on for a little while that involves Windows Azure?

OK, then… :-)

This morning, Intuit and Microsoft have announced very cool news for Intuit and Microsoft developers and for Small Businesses…

From the IPP team blog post, Alex Chriss, Director of IPP (er…my boss):

“Today, we’re thrilled to announce an alliance between Intuit and Microsoft that brings IPP a giant step closer to our ecosystem vision. Starting today, SaaS developers can access the beta of the Windows Azure SDK for IPP - a set of tools, code samples, and services, designed to make it easy for developers of SaaS applications developed on Windows Azure to federate those SaaS apps on to IPP and sell them to millions of Small Businesses in the Intuit Workplace App Center.”

Connecting these two clouds has been fun and it’s just the start…the bits we’re releasing today is a beta…but fully functional: it provides everything an Azure developer needs to federate their apps on to IPP. In the v1.0 release of the Windows Azure SDK for IPP (expected to launch sometime in February) will also include built-in support for IPP’s Intuit Data Services, the web API that allows those SaaS apps to fully integrate with QuickBooks customer data and program against the common data model and cloud repository that all Intuit Workplace App Center leverage…this is how the SaaS apps from different vendors as well as Intuit’s SaaS offerings work together at the data level.

So the developer story is pretty awesome.

The other aspect to the news released this morning is about the plan to federate Microsoft Business Productivity Online Standard Suite (BPOS) on to IPP and become one of the great set of apps available on Intuit Workplace App Center. BPOS includes a set of messaging and collaboration solutions hosted by Microsoft, and consists of Exchange Online, SharePoint Online, Office Live Meeting, and Office Communications Online.

I recorded a short interview with Jeff Collins, Group Architect for IPP, and Jarred Keneally, Developer Support Engineer to talk about what’s in the SDK and what’s coming soon. Enjoy!

Some more info links:

Official Press Release at Microsoft.com
IPP Team blog post: Intuit Partner Platform + Windows Azure = Win for Small Businesses
IPP Dev Center – Windows Azure SDK for IPP
Intuit Workplace App Center

Update - some reactions to the news coming in now:

Dennis Howlett - ZDNet - Intuit and Microsoft partner: more PaaS to put in your aaS environment

My take: Intuit is joining a growing band of apps vendors that see PaaS as a way of delivering all sorts of aaS functionality, expanding its reach, developing deep domain expertise and helping it accelerate growth. These are bold ambitions and fit well with the idea that a single cloud platform should provide the ecosystem framework needed to achieve these goals. There is no reason why the SMB market should not benefit from these initiatives so at this level it is good to see both Microsoft and Intuit step up to the plate of opening up access to a large group of developers.

Ben Kepes - CloudAve - Intuit and Microsoft Sign Deal to Serve SMBs

"This really is massive news for anyone involved in small or medium business – be it as a business themselves or in anyway selling technology products or services to SMBs....APIs are great – wonderfully valuable things that allow applications to work together. But a common data model of the sort that the IPP is built around, is even better, allowing applications to be built from the start around an underlying and consistent model of data."

Sam Diaz - Between The Lines - Microsoft and Intuit become cloud partners

"The idea, of course, is to link Microsoft’s business applications to the financial data that’s found within Quickbooks to help businesses operate more efficiently. For months, Intuit has been working to push the cloud and open its arms to developers....In July, Intuit launched an open-source community where users could share information to enhance the apps on Intuit’s platform. Prior to that, the company announced Federated Applications, which allows developers to use any programming language, host those apps on any cloud infrastructure and connect them to Intuit’s platform, marketing them to business customers who use Intuit products."

Mary Jo Foley - Microsoft partners with Intuit to shore up Redmond's small-business cloud play

“Customers don’t want a one-point small-business solution. They want a whole suite,” said Walid Abu-Hadba, Microsoft Corporate Vice President of the Developer & Platform Evangelism. He said that this kind of partnership with Intuit was an example of how Microsoft plans to address the needs of small-business developers and customers.”

Dave Rosenberg, CNET,

“According to Alex Chriss, director of IPP, the technology took just a few months to build because the strategy was already aligned. The integration is based on a common data model that is an extension of Quickbooks data. The data model lives in the cloud and developers are able to use the SDK to integrate between the desktop, cloud, and other applications in the ecosystem…For well over a year I've been suggesting that Microsoft needs to take advantage of it's massive developer base to make any real progress with Azure. While this deal with Intuit is still a bit of a baby step, there are many other applications, both online and off, that could use Azure for a variety of purposes. This bodes well not just for Microsoft but for the cloud in general.”

The Microsoft Blog - Microsoft, Intuit team up to encourage cloud apps

“Azure is Microsoft's new platform as a service (PaaS) offering, designed to automatically manage and scale applications hosted on Microsoft's public cloud. Fueled by Microsoft's vast network of partners familiar with its programming languages, Azure will compete against similar offerings such as Google App Engine and Force.com.”

Oh...and we made techmeme :-)

More...

Phil Wainewright - Why Microsoft and Intuit need each other's clouds

“Cloud platforms share many of the ingredients of conventional software platforms, but they add several crucial new ingredients. One thing that hasn’t changed is the need to build momentum among developers and customers for the platform. Intuit and Microsoft have plenty of both, which guarantees attention for what they’ve announced today. But the tie-up between these two giants is important too for the light it shines on the special characteristics of cloud platforms and how they change the game in so many ways for ISVs, developers and platform vendors…

...the link-up combines Microsoft’s strengths in developer tools and functional scope with Intuit’s advanced skills and investment in service delivery on IPP”

Federated Apps on the Intuit Partner Platform

alexbarnett — Wed, 03 Jun 2009 13:52:00 GMT

So what have I been working on since joining Intuit? A bunch of stuff, but something I wanted to shout about is the release of “Federated Applications” on the Intuit Partner Platform.

Working closely with five new developers to Intuit's Platform as a Service (PaaS), VerticalResponse, DimDim, Rypple, Setster, and ExpenseWare, we've got some kick-ass apps federated into the platform.

Some nice coverage so far this morning, including:

Ben Kepes, CloudAve Intuit Launches the IPP Version 2

"After the briefing I have to say that it looks to me like IPP is finally offering to fulfil the promise of the end-to-end integrated small business software platform that I’ve been evangelising for a few years now – my catch cry of late has been that application integration should only be seen as the very first step in building a SaaS ecosystem. Much more important is the aggregation of applications. This may be data aggregation, UI aggregation, sign-on integration or billing integration – and ideally users and vendors would determine what parts of the integration they bought into."

Leena Rao at TechCrunch - Intuit’s Partner Platform Goes Multilingual With Federated Apps

“The “Federated Applications” functionality lets developers who have existing SaaS applications that are built with any programming language, database or cloud computing platform publish their apps on Intuit Marketplace. Applications won’t have to be rewritten to conform to QuickBooks but will instead go through a minor configuration process.”

Phil Wainewright, ZDNet: Intuit makes two-pronged PaaS and SaaS push

“The significant element of Intuit’s PaaS announcement is that it is a land-grab to capture mindshare among developers on other cloud platforms, who can take their AppEngine, Amazon Web Services or self-hosted applications and make them available using Intuit’s single sign-on, billing and QuickBooks integration infrastructure. Market reach being one of the key attributes developers look for in a new platform, perhaps the most appealing factor is that applications will be showcased within the Intuit Marketplace, with a potential reach to the four-million-strong installed base of QuickBooks accounting software customers and their estimated 25 million employees.”

What I've found very cool about this new Federated Apps capability for IPP is that fact that these different SaaS apps are developed on a variety of stacks and hosted outside of the IPP platform.. One of the apps is built on Java. Another is built enirely on .NET. Another is a mix of RoR and LAMP. Another built of Flex (on their own hosting environment - not IPP). If an app was running on EC2, that would work too, as would an app built on Google's AppEngine. It doen't matter - the integration points for Federated Apps are just that and pretty lightweight (one of the partners was able to turnaround the work with 1 developer in less than two weeks, including time for the technical review of the app). We made a deliberate decision to make IPP agnostic to the technology that developers want to use. Yes, we have a "native" stack also, but the options we are providing developers now means there is no technology lock-in to speak of.

Here is some more information on the details of federation and how you as a developer can get started.

Oh, and a quick plug on the talk I'll be giving on how to federate applications to IPP at the Startups and the Cloud event next week in the Boston area.

Startups and the Cloud: free event in Waltham, MA, sponsored by Intuit

alexbarnett — Thu, 28 May 2009 10:41:00 GMT

This is an event I'm helping to organize...hope you can join! From the App Gap blog:

"On June 11th we’re organizing a gathering in Waltham, MA called Startups and the Cloud to talk about how starting a successful software business has changed now that cloud computing/ platforms have become highly viable, and in some cases, essential components of a startup’s strategy.

We’re keeping it compact at about four hours and we’ve been able to pack a ton of great content in. The agenda is here, but there’s a talk with Scott Cook, the founder of Intuit, a panel of local Venture Capitalists, and a panel of local CEOs. In addition, we’ll be hosting a social event where you’ll get a chance to meet some of the top thought leaders in this new wave of innovation. It’s a great group of tech leaders and, even better, it’s free!"

See: agenda and how to register.

Joining Intuit

alexbarnett — Sun, 21 Sep 2008 22:02:00 GMT

Firstly - thanks to everyone who has reached out to me in the last three weeks via email, phone calls and comments since I shared the news of my pursuit for the next adventure - I have really appreciated everyone's support and interest in my next steps.

The great news is I'll be joining Intuit as a Group Manager working in a fast growing start-up team responsible for leading the Intuit Partner Platform. Below is a snippet and some links to blog posts and articles that should give you a fairly good idea about where my focus will be a week from now.

Although I'll be working from the Orem office (Utah) to start off with, the plan is to ultimately move to the greater Boston area - another new adventure. I've visited Boston three times in the last year or so and have loved it more and more with each visit, so watch out Boston!

This is a fantastic opportunity for me personally - the team has ambitious goals and an amazing set of existing assets to leverage (see some of the numbers below) in becoming a significant player in the cloud computing space. I look forward to sharing stories of my new journey with you.

Intuit Partner Platform Opens to Developers (Sept 15 2008)

"The Intuit Partner Platform not only gives developers the opportunity to build Web-based applications, but successful SaaS businesses by taking the complexity out of managing infrastructure, hosting, user management, integration and billing. Now developers can focus on developing innovative on-demand software solutions that solve unique and important problems for the four million small and mid-market businesses across the U.S. that use QuickBooks and the 25 million employees that work in those companies.

The platform-as-a-service offering allows developers to combine the powerful open source Flex framework and Adobe Flex Builder and the proven database of Intuit QuickBase to build rich Internet applications that work with QuickBooks data. They can also leverage Adobe AIR to provide additional desktop-like functionality in their applications, such as pop-up notifications, local file system access, local data storage, and the ability to create a fully branded user experience.

"We have now accepted more than 1,000 developers into the program and it is exciting to hear their ideas and energy about what they want to build," said Alex Chriss, business leader for the Intuit Partner Platform. "Customers will benefit greatly from the imagination and expertise that developers use to solve problems facing their specific industries." "

Web 2.0 Expo NYC - Intuit Connected Services (Sept 19 2008)
Intuit Makes SaaS Play Guns For Salesforce (Sept 18 2008)
Intuit’s flexy PaaS (Aug 14 2008)
Intuit enters the PaaS wars (April 28 2008)
Intuit’s Radical New Flex + QuickBase Cloud Platform (April 16 2008)

The Great Bungee Jump

alexbarnett — Thu, 28 Aug 2008 00:21:00 GMT

Well, the great Bungee Jump has come. Martin Plaehn, CEO of Bungee Labs has shared the news of the company the letting go of 15 regular employees and contractors. Unfortunately, I am among this set of affected Bungee Labs employees.

A Voyage of Discovery

As Martin explained in today's post, Bungee Labs has been on a voyage of discovery. There are many lessons for me and the company to take away from the whole experience of the last year or so, but the bottom line is that we were overly optimistic about what it takes to achieve the rate and scale of developer adoption - real traction - and therefore the development of killer apps by the developer community that would drive the platform and the business forward at the velocity that makes a VC-backed venture "interesting".

So where does Bungee Labs go from here? Well, I think Martin eluded to the key clue:

"Over the next several months, Bungee Labs will lay out the course for a business object solution framework for user configurable enterprise-class applications that demonstrate these principles"

It'll be very interesting to see how this manifests and the impetus it will provide to the platform's adoption.

No Regrets

No regrets, none at all. When I considered the opportunity of joining Bungee Labs (and by doing so leave a relatively safe harbor in order to do so) I knew of the risks involved. Bungee Labs' mission was - and still is - of the kind that aims to "change the world". To have been a member of the team tasked with realizing the company's hugely ambitious mission has been nothing short of an entirely worthwhile and educational pursuit.

In my mind at least, Bungee Labs has made its mark in the brave new world of cloud computing. It has opened the eyes to many in the industry about what might be and can be. It has made cloudy ideas and visions more concrete and helped to define the concepts a (Platform as a Service, or PaaS) and memes that are contributing to the next generation of cloud computing platforms.

I've learned a great deal in the past 16 months working closely with a very talented, smart and creative set of teammates. And although it is probably unfair to call out individuals - for it implies those not mentioned weren't of similar caliber (which is not the case) - I do want to thank Martin Plaehn, Bungee Labs' CEO in particular for his mentorship during my tenure at Bungee Labs' and from whom I've learned an enormous amount management and leadership. I'll also miss the inane banter with Ted in those podcasts we put together (and the "Shushee" lunches).

What Next?

And so...on to my next adventure. What will that be exactly? Frankly, I have no idea yet...but whatever it is, I need to know I'll be trying to change the world :-)

I'm open to ideas...so if you have some, please get in touch.

How ADO.NET Data Services came to be (formerly known as Project Astoria)

alexbarnett — Thu, 21 Aug 2008 02:16:00 GMT

Pablo Castro has recounted some of his timelined memories about how "Project Astoria" evolved from a lunch time conversation to bits in .NET 3.5 SP1 and Visual Studio 2008 SP1 now known as ADO.NET Data Services Framework). Nice write up.

Three memories of my own to add to the story:

1. I was reading up on the whole REST thing in the summer of 2006 - its origins, philosophy and design patterns. I knew there was something interesting going on and some potential dots to join, but I wasn't sure which dots...So I collated and circulated a bunch of research / links to the team, then blogged the links (I liked How I explained REST to my wife. More recently see Explaining REST to Damien Katz). I got a few proverbial (and some literal) blank stares as I shared my enthusiasm for REST, asking how we could apply the ideas to the various projects we were working on. It was Pablo, and (as Pablo attests) Britt Johnston (now a PUM for SQL Business) who were able to develop the initial conceptual leaps into something more concrete like a Think Week Paper and a prototype demo.

2. When it came to brainstorming the code name, the team agreed on a "cloud" theme. A number of proposals were floated around along with their rationales, including "cumulus" and "cirrus". We were then advised that city and town code names were legal-safe. So there we were, struggling to agree on some city or town name we all liked (or at least not hate nor be confused by..."how about Nameless?"...), and then Mike Pizzo's proposal came in: "Astoria - hey, it's the cloudiest city in the USA!" (at least it was in 2006). Sold.

3. I think my favorite memory of all is the reaction Gary Flake provided (of Microsoft's Live Labs) to the prototype Pablo demo'd at one of the pitch meetings: "As God himself would have designed it!" Dr Flake exclaimed..."Cool", I thought to myself - "but does that mean no REST for the wicked?"

Join me at Web 2.0 Expo New York - Building in the Clouds: Scaling Web 2.0

alexbarnett — Fri, 08 Aug 2008 13:06:00 GMT

I'll be taking part in one of the Cloud computing panels at Web 2.0 Expo New York this September, details below. If you want to meet up, let me know.

Building in the Clouds: Scaling Web 2.0

Jason Hoffman (Joyent, Inc.), Alistair Croll (Bitcurrent), Alex Barnett, Dwight Merriman (10gen), Jinesh Varia (Amazon Web Services)

10:30am - 11:20am Thursday, 09/18/2008

Performance & Scaling
Location: 1A23 & 24

Cloud computing is self-serve outsourcing for web companies. Clouds give even the smallest startup access to world-class infrastructure that can grow as needed. And developers build apps faster because they start with the building blocks of online applications: authentication, storage, messaging, and the social graph.

But the range of Cloud offerings is daunting. From self-contained development tools to virtual “bare metal,” selecting the right layer of Cloud offerings fundamentally changes how you run your business, what tools you can use, and ultimately how much control you have over your future.

Join this panel of Cloud computing innovators for the silver linings—and dark sides—of the Cloud.

Project Management as SaaS, Programmable Wikis and more

alexbarnett — Fri, 25 Jul 2008 17:52:00 GMT

Two new interview podcasts to share (recorded by me and Ted) for the Bungee Line:

Nate Bowler, CTO of @Task

@task (or AtTask) is a Utah-based tech company providing a comprehensive, web-based project and portfolio-management package delivered in both a SaaS and on-premise model with a very rich web API set. We talked with Nate about the evolution of their web services design and @task's future product plans in light of the market opportunities presented by the availability of the increasing number of 3rd party programmable web services.

Steve Bjorg, Founder and CTO of MindTouch

Prior to founding MindTouch Steve worked in advanced strategies at Microsoft focusing on distributed systems and web services. We talked with Steve about the MindTouch platform, its rich set of web APIs and the implications of a programmable wiki. MindTouch goes beyond providing open source wiki collaboration and content management - it's delivering a leading edge application integration and development platform called MindTouch Deki. Michael Coté, an industry analyst with RedMonk (analyst firm) picked up on both the podcast interview and news of the latest release of MinTouch Deki.

(About The Bungee Line: The audio podcast for web developers, covering web API's, software development, and the creation of (extremely) interactive web applications.)

Open Source in a SaaS World

alexbarnett — Fri, 16 May 2008 03:01:00 GMT

About a year ago, I took part in a meeting where the question: "What does open source "mean" in a SaaS world?" came up in conversation.

A year later, that same question is becoming increasingly pertinent as the IT industry's move to Software-as-a-Service (SaaS) and cloud-based computing accelerates.

For Bungee Labs (I work there), where

we provide an entire platform-as-a-service (PaaS)
developers create, share and re-use code and deploy apps in the cloud
developers "consume" and program against third party web apis and will create their own

...the "meaning" of FOSS is central within these different contexts and has many possible answers with many non-trivial implications...Three dimensional chess as it were.

(pic source: Memory Alpha, the Star Trek wiki)

For this post, I want to share some of the considerations relating to # 1) above: the context of open sourcing Bungee Labs' own system (Bungee Connect). Last month we stated that:

"Bungee Labs is evaluating several Free and Open Source Software (FOSS) licenses for the software components that comprise the complete Bungee Connect system. However, the task of reviewing the various FOSS licenses, and then identifying which of them best aligns with the software components and subsystems created by Bungee Labs–as well as ensuring compatibility with third-party components upon which Bungee Connect relies–requires considerable review and source code preparation. And we want to do this right, with the community’s involvement."

Since and before that announcement, Ted Haeger (who runs the Bungee Connect Developer Network) has been discussing some of the issues at hand and some of the options we see before us with some very "FOSS savvy" communities at events such as Socal Linux Expo, LugRadio Live USA and LinuxFest Northwest and of course with Bungee Connect's own growing developer community.

Today there's an interesting conversation going on between Ted and Simon Wardley, ex-COO of Zimki / Fotago who resigned last year over the company's decision not to open source their platform (the video of his announcement at a OSCON 2007 talk he gave "Commoditisation of IT and What the Future Holds" makes for entertaining and informative viewing all of its own...Simon discusses open source in a SaaS context. Update: Simon let me know of this video which also includes the slides

Anyway, back to the thread:

Simon wrote a post this morning providing his thoughts on the some the FOSS options available to Bungee Labs
Ted wrote back responding to Simon sharing his point of view
Then Simon responded to Ted

All three posts (and more to come no doubt) make an informative and interesting read, but I want to highlight one of the key issues in discussion.

The SaaS Loophole

The issue goes back to the question: "What does open source "mean" in a SaaS world?" and specifically the licensing issues. I'm going to quote and edit from Ted's post somewhat liberally (Ted owes me a Sushi, so we're quits now :P ) and isolate an (if not "the") open source licensing issue in the context of SaaS (my emphasis):

"Personally, I think that GPLv3 is the wrong license for freeing any SaaS or PaaS offering. The Free Software Foundation has a better license for this purpose.

GPLv3 is inadequate because it does not mandate that modifications that others make be opened. Originally, GPLv3 was planned to close up the “SaaS Loophole” (a.k.a. the “ASP Loophole”) in GPLv2. However, as I understand it, several large companies pressured the FSF to remove the key clause that would have closed the loophole.

What is the loophole? It’s this: if you take free software and offer it as a hosted service, then you are not conveying the software, and are therefore not obligated to reciprocate your modifications to the original code. In the context of service providers, GPLv3 is effectively the same as the BSD license. Many companies, Google among them, live inside this loophole. (For now, Bungee Labs is also in that camp.) Some remain there deliberately. Others are in it simply as a matter of course…that is, where they are in their business development process."

So that's the "SaaS loophole". Where's the loophole now? Ted explains:

"Perhaps the argument could have been made in the age of GPLv2 that the SaaS Loophole was an oversight, but now that GPLv3 has the loophole by design, it’s really no longer a loophole. The latest version of the license supports the practice. (And just to be clear, I am not advocating this for Bungee Connect.)

...Say Bungee Labs opens Bungee Connect under GPLv3. Is there a danger that small companies could replicate our offering? I don’t think that’s the case. But could a well-funded company do the same, fork the code, and then fund an engineering team to outpace the original inventors?

...The Free Software Foundation also provides the GNU Affero General Public License version 3, or AGPLv3. AGPLv3 specifically closes the SaaS loophole. Instead of being triggered by conveying the software, AGPLv3 is triggered by accessing the service. This helps to reduce the risk that a company could not branch the code and then out-engineer the originators, as the vulture company would be obligated to share-alike terms with their derivations."

So, is the AGPLv3 the right license for Bungee Labs to pursue? Is it the right license for SaaS providers? Is it enough on its own? (back to Simon Wardley's point in his post). Each company has their own unique circumstances and they each need to think through the 3D chess game. We're still working it out at Bungee Labs.

For us at least, I think some of the potential answers are becoming clearer, and others not yet. But it is the kinds of discussions that Ted is having with Simon that are a critical part of Bungee Labs' decision making process around FOSS. It cannot be an insular process.

Designing Web APIs - Twitter Learnings

alexbarnett — Thu, 01 May 2008 11:08:00 GMT

Although I made it to Web 2.0 Expo in San Francisco last week, I didn't make it to a session Matt McAlister blogged about by Twitter’s Alex Payne and Michael Migurski of Stamen Design who presented learnings from the perspective of an API provider.

But I can see the slide deck discussing the Twitter API and so can you:

| View | Upload your own

More Web 2.0 session slides available here. Recommended:

Videos of sessions here. Check out Clay Shirky's session, author of Here Comes Everybody: The Power of Organizing Without Organizations (a good read btw).

Bungee Connect news x3 to share with you this morning

alexbarnett — Wed, 23 Apr 2008 12:46:00 GMT

Three big pieces of Bungee Connect news to share with you this morning:

1. Bungee Grid now running on Amazon EC2 and accessible to Bungee Developers

Bungee-powered application hosting on Bungee Grid-EC2 using Amazon’s Elastic Computing Cloud (EC2) infrastructure is available today upon special request for deployed Bungee-powered applications. The Bungee Grid-EC2 option is in addition to Bungee Grid-US, Bungee Grid-Europe. As a live example of a Bungee-powered app running on Bungee Grid-EC2, we've now deployed WideLens.com on Bungee Grid-EC2. Pricing model and other details available here.

2. Announcing Bungee Application Server

This is sweet: Developers wanting to deploy Bungee-powered applications on their own servers will be able to download a complete single-server Bungee Grid as virtual software appliance called the “Bungee Application Server”. The Bungee Application Server uses VMware technology and operates as a single complete management and delivery server for Bungee-powered applications. The Bungee Application Server will be first made available in June 2008 to BCDN Early Adopter Program (EAP) members. General Availability for sustained commercial deployment is expected in Q4 2008. More details including pricing and licensing info here.

3. Community Source Code Licensing plans for Bungee Connect technologies

Bungee Labs will make the source code available to the Bungee Application Server and the Bungee Pulse Client under several software source code licenses.

Two of these software licenses are available as of today in ‘draft form’ to facilitate community feedback prior to formalization in June 2008. These draft licenses are:

We're also answering this question:

Q: Is Bungee Labs is considering Free and Open Source Software (FOSS) licenses for the software components that comprise the complete Bungee Connect system?

Great question. Answers here...

Btw, I'm at Web 2.0 Expo in San Francisco this week. Let me know if you want to hook up!

So what is this Platform as a Service thing?

alexbarnett — Tue, 08 Apr 2008 14:54:00 GMT

The "platform-as-a-service", or PaaS meme is getting more air play the last 24 hours as news of Google App Engine makes its way through the tech media and blogs. ReadWriteWeb has a good write up and Phil Wainewright's summation by declaring "Let the PaaS wars begin" I think fairly captures the mood and reaction to the news.

Exciting times ahead no doubt, and pretty cool that Bungee Labs is getting mentioned in a number of blogs reacting to the Google App Engine news an example of the new generation of companies emerging in the PaaS space.

So, what is Platform-as-a-service? And why is PaaS interesting? Last week I had the opportunity to talk to Dana Gardner and Phil Wainewright in this sponsored podcast - full transcript available here - all about PaaS. I've taken the liberty of copy and pasting a snippet of the conversation below that speaks directly to the whole notion and definition of PaaS.

"Gardner: Okay, we’ve established that the tide is turning to the Internet, that there are some great Web-based services available, that technologies are now bubbling up to allow for better and easier connectivity. And yet, there is still a need for the right platform and the right infrastructure to make this all mission-critical and enterprise-ready.

So let’s get into PaaS as a possible stepping stone that, in a sense, bridges the best of the Web-oriented architecture and the available SaaS and the APIs-world with what developers inside organizations -- be they ISVs, service providers, or enterprises -- need to make these approaches acceptable and within the acceptable risk parameters.

I noticed that Bungee Labs does not call this "Development-as-a-Service" or "Deployment-as-a-Service" or "Integration-as-a-Service" -- but "Platform" as a service. Alex, give us the primer. What does "Platform-as-a-Service" really mean?

Barnett: That’s what we are trying to define at Bungee Labs. PaaS is one of those terms that we’re going to be hearing more and more. And they are going to be different -- varying levels of definition and interpretation of what that means.

But what we’ve done is put a stake in the ground in this respect, and then saying that in order to really be a PaaS -- and not just any one of those single pieces that you’ve mentioned plus more individual pieces -- that you need to be able to provide the end-to-end services to really call it a "platform."

From the developer’s standpoint, which is the development cycle, this means the tools that they need to develop applications, to be able to then test those applications, to be able to connect to Web services and to combine them, and to have all those kinds of capabilities -- and to then deploy and to make those applications instantly available to the business users.

Literally, we mean a URL that is the end-point for the end-user. From that, they can start consuming the application.

So, PaaS means having an environment in which you deploy inherently and have built-in scalability, reliability, and security. Once you’ve deployed your application, you know that you don't have to take care of all the infrastructure in the datacenter and the capital investments and the bodies that are required to make it scale when newer applications increases in use.

There is also the ability to connect to the various distributed data sources or functionality that the application needs to be able to consume. You can get that inside of that platform, the ability to be able to do that in a Web-native way, and so take advantage of the architectures we descried earlier, such as SOA.

There is also the ability -- and we touched on it earlier -- for developers to be able to collaborate on projects that are built-out in the cloud. They can share code, check in code, do all the standard revisions and collaborative-type functionality that developers need when they’re working on projects with teams distributed across the world or across your offices. And they can do this without having that entire infrastructure on-premise.

And then, the last, but critical, piece is having deep instrumentation and an analytics ability around the use of the application -- of how it’s being used, of where the connections are -- right across the board from the "glass of the window," the browser, for example, and right on through to the Web services in the CPU, or the rest of it.

As a result, you are able to understand performance. You are able to understand your billing, if it’s a billing proposition that you have. And all of what I described is comprised within six pillars [of Bungee's offerings]. All of that is delivered and available purely as a service, so there are no on-premises requirements for any of those components across the development and platform used in a utility model. You use it as much as you pay for, or as much as you use in a utility-based model -- all in the cloud. No bit needs to be installed on any machine at the enterprise in order to take advantage of all those Web services and functionalities.

Gardner: For our listeners who are just getting used to this concept of PaaS, let’s just get right in quickly and describe what Bungee Labs is. It’s a young, innovative company. And you’ve come out with a service called Bungee Connect. This is essentially one place online where you can go to develop, mash up, and access data, to put together Web-based applications and services, and then instantly -- with a click of a button, and perhaps I am oversimplifying -- develop and deploy in basically an integrated continuum. Is that correct?

Barnett: Yes, and provide very rich user experiences as part of that, with highly interactive application functionality. We’ve built out essentially that stack that I’ve described earlier. We've made that available for organizations to take advantage of. We're specifically targeted at developers who really want to be able to build very sophisticated Web applications that leverage orchestration workflow around connecting to Web services.

We are not in the business of being able to provide non-programmers with the ability to do these nice simple mashups.

Gardner: Well, if you can do that, let me know, because that would be a very good trick. I am sure the world would love to have development by anybody!

Barnett: Yeah, and that’s a great dream to be able to have, but inherent in that is inflexibility, because you are simplifying it all for the end-user. What we really offer is for the developers who are tasked with building sophisticated Web applications to do just that, deploy that, and then deliver very rich user experiences out on the Web.

Gardner: And to be clear, this is not just open source. This is commercial code, if they wish. The people who develop on this system, that code is their intellectual property. Is that right?

Barnett: The intellectual property of the code that is developed by the developers is absolutely their own intellectual property and remains so. We do have a community side of things that allows developers -- just as in the open source world -- to be able to share code and even entire applications as open source running on our grid.

But in terms of a company, it’s entirely their intellectual property that they developed and they are able to literally export the code. And if they want then re-factor that for a different kind of a grid or runtime, it’s their property.

Gardner: Phil, how do you see the relationship between PaaS and what Bungee Connect is doing, and then the larger SaaS trend? Do you see a relationship of one aiding and abetting the other? Or are they in separate orbits? How does that work out?

Wainewright: I think they are very much in a similar orbit. And to an extent, I don't think of PaaS as being part of SaaS or vice versa. It’s just everything moving to the cloud. These are two examples of that happening.

One of the things I want to highlight, as Alex was saying, is the useful experience. When people start developing for the Web, for the cloud, then it’s not just building the infrastructure -- it’s also learning what is involved in writing applications for that environment.

There is much more emphasis on the user experience. There is much more emphasis on reusing what other people have done, whether it’s by mash-ups or by reusing other people’s code, as opposed to reinventing the wheel every time. There is much more emphasis on developing applications and programs that can adapt and change to future opportunities in business conditions.

All of those things also have to be learned, at the same time as building the infrastructure. Using PaaS enables you to tap into that shared expertise in a way that you can’t do, if you try all by yourself.

The other thing that’s happening here is that we’re connecting into the resources of the Web, and getting onto the Web, so that we can interact with partners and customers and connect into those other Web resources. This is what we're really expected to do as businesses today, in order to stay competitive. So, there’s a tremendous pressure building to be able to do this kind of thing.

Now, there are three ways you can get onto the cloud. You can go to a cloud-computing provider and basically build your stuff in that cloud, which gets to some of the infrastructure, but, there's still the issue of how do I write applications in this environment and connect to other client resources.

Second, you can go to pure SaaS whereby you get a ready made application and you can do some customization, but there are going to be quite a few gaps around what that provides and what you actually want to do. There are going to be quite big gaps in terms of integrating that into your existing on-premises applications and to the other client application that you use.

Third, where PaaS comes in, it allows for the ability:

A) To get much faster to the custom applications that you need to build for that environment

B) To do the integrations to fill in the gaps and to access other SaaS applications and services, and to patch and connect back to the existing on-premises applications. "

Full transcript available here and podcast here. Bungee Labs' definition of Platform as a Service here.

Sync Google Calendar with Outlook and more with WideLens

alexbarnett — Thu, 06 Mar 2008 05:37:00 GMT

Google has just released a very cool utility (.exe download for Windows) providing users with the ability to synchronize their Google Calendar with Outlook.

Some nice features in their 0.9.3.0 release:

schedule the sync frequency: every x minutes
define directional flow: 2-way, and 1-way (either way)

A bit of a buzz going on about this...

Now, what if you could do the same over the web - no download, just use your browser (IE, FF, Safari)...? And not just Google Calendar <> Outlook, but others too...?

Well, it's certainly possible...First, watch this screencast I put together tonight (apologies for sound quality...done from home equipment):

About WideLens

A couple of weeks back Bungee Labs released a reference calendaring application, called WideLens, designed to show off some of the power of the Bungee Connect platform, from the kind of rich AJAX UI experiences delivered through to the high level of functionality developers can create by wiring up and integrating multiple web services and distributed web data sources into a single web app.

Video: WideLens User Experience
Video: Developer Overview

WideLens connects to Microsoft Exchange calendar, Google Calendar, Salesforce.com, Facebook, MySQL and iCalendar feeds, representing a variety of protocols and authentication schemes. MS Exchange is accessed through WebDav, Google Calendar through gData, Salesforce.com via SOAP, Facebook through REST and MySQL connectivity is based on client libraries provided by MySQL (integrated directly inside Bungee Connect).

WideLens is an uber-mashup.

WideLens connects to each of the sources in real-time, presenting the user with live data. With the exception of Facebook and iCalendar, users can create and modify events and those changes are immediately posted back to the source. MySQL pulls double duty, serving as both a WideLens native calendar source and as the persistence layer for all kinds of application data including user preferences and credential information for each service.

Developers: Have At it!

As mentioned above, WideLens has been released as a Bungee Connect reference application where we're encouraging Bungee Connect developers to customize the WideLens application as much as they want, deploy their own version of the app as their own app - to their own domain, at no charge, branded however they want and with whatever features / cuts / modifications / extended they want - the WideLens code is released under a BSD licence (read more here).

To get going with Bungee Connect and develop your own vision of what WideLens could do, sign up for your Bungee Connect account.

Astoria at MIX08 (REST in Vegas)

alexbarnett — Wed, 05 Mar 2008 02:11:00 GMT

As much as I'd love to make it to MIX08 this week, time will not allow me...But if I were, then I'd be going to the following three sessions related to the Project Formerly Known as Astoria:

Wed, March 5th - RESTful Data Services with the ADO.NET Data Services Framework
Fri, March 7th - Accessing Windows Live Services via AtomPub
Fri, March 7th - Building RESTful Real World Applications with the ADO.NET Data Services Framework