Microsoft's First Open Source DataCamp

Rarely do the words "open source" come to mind when the Microsoft Corporation is mentioned. As the maintainer of the SQL Server stack for both Ruby & Rails, and a long time Apple/UNIX fan, I have been engineering solutions to make working with SQL Server as easy as possible. Often times the work has required outside in hacks to a closed & proprietary set of technologies. That changed last week.

First day of introductions at Microsoft's OSSDataCamp

Both Sean Griffin and I were invited to represent the Ruby/Rails community at Microsoft's first #OSSDataCamp. The idea is simple; to open up and engage our community at an intimate level. The results so far are incredibly positive and these new relationships feel lasting and honest.

This post contains interesting details if you want to learn more about Microsoft's Azure platform. We were lucky enough to be exposed to some candid inner workings of their latest service offerings which look to be a strong competitor to Amazon's Web Services.

We Want To Learn From You

That sentiment was echoed by everyone I met. From engineers to leadership and various product managers in-between, Microsoft is hungry to learn and this time it does not feel like the old consume & conquer strategies from the IronRuby days. Instead their new culture closely reflects that of CustomInk's own Inkers. Our hosts were the most upbeat and polite folks I have seen.

Windows Support - A Diversity Issue

As Sean Griffin put it, we cannot require new engineers to buy a MacBook Pro to learn Ruby. Be it a Rails Girls workshop or your local meetup group, a poor Windows experience can literally lose good, diverse talent in our community. Thanks to projects like RailsInstaller, and the modern replacement RubyInstaller, we are stronger than we have historically been. But we can do better.

To that end, Microsoft has kindly agreed to provide key projects like Rails, TinyTDS, and the ActiveRecord SQLServerAdapter with funded continuous integration using AppVeyor services. Such a small cost can greatly impact our feedback loop and identify pain points quickly.

A Changing Culture

Jack Yang learns Ruby in 1 day!Change is hard on all sides. For me, getting into the mindset that Microsoft can help was a big step. When Sean found issues with execjs that led back to Windows Script Host, they introduced us to that team. Likewise, the SQL Server adapter has always needed a bullet-proof cross platform binary to dump the schema. "We can help and here are the engineers..." was the reply. Wow!

Some issues sit well in Microsoft's sphere to solve. What most impressed me was how eager they were to address them. Being a large company, often times the immediate answer was to schedule a series of 1-on-1s with the team(s) responsible. Connections and conversations like this quickly led to even pondering if Ruby could be installed on Windows by default. Or maybe even build cross platform SQL Server development binaries! 😱

Quid Pro Quo

Sean Griffin keeps it weird while helping you not blow up.So what did Microsoft learn most from us? Other than Rubyists keep it weird? Likely their biggest takeaway was that Sean Griffin loves to play the Keep Talking and Nobody Explodes game. I mean he really loves to play this game.

It's simple, use 2-way, fast-paced, verbal communication to quickly identify and defuse a virtual ticking time bomb. As it turned out, this is a great team building exercise. Becoming a bomb defusing expert is high on my list and I can not wait to play with a group of my fellow Inkers. Thanks Sean!

Coming Soon To Ruby/Rails

We got a lot of work done along with establishing some big milestones for those using Windows and/or SQL Server with Ruby. Here are some things you can look forward to:

These items are tracked in the TinyTDS and/or the SQL Server Adapter milestones on GitHub. Follow along or contribute if anything interests you.

Microsoft Azure In Brief

Azure != SQL Server, it is much more. Think AWS (Analytics, IoT, CDN, Etc) with a better frontend portal. Microsoft's Azure platform and PaaS offerings are amazing and accessible for anyone looking to rapidly build out their new web application suite of microservices. Seriously, you really should consider it next time you are looking for a Heroku-style marketplace. Here is a quick brief:

Command Line & Application Interfaces

Portal smortal, who wants GUIs? The real power is in the command line and automation. Just like Heroku's toolbelt, Azure has cross platform binaries that are open source on GitHub. This client has rich 2FA and is packed with interfaces. Services can even be stood up with a simple JSON template hosted on GitHub. Need an application interface? They have a Ruby SDK too.

Services Marketplace

Their marketplace and open source service offerings are seriously impressive. One that stood out is their Elasticsearch service and how well it can integrate with any data source. They literally built an entire frontend GUI that can help you build out super impressive search indexes.

The message, "We give you 99.99% uptime, you worry about how search works, and we take care of the rest." really stood out to me as a market differentiator. Maintaining shard strategies and the complexities of Elasticsearch is not what I want to do.

SQL Server 2016

Stretch On-Premises SQL Servers to Azure.I can't even begin to go into all the amazing features of SQL Server 2016 now available on Azure. A quick list includes:

One feature that stood out was SQL Server's ability to stretch or archive historical data transparently and securely. This can be done entirely via their hosted service or coupled with your on-premises SQL Server databases. All without the application caring about managing that cold <=> hot data.

Many Thanks!

Special thanks to Microsoft as a whole. Especially to Andrea Lam and Meet Bhagdev for their personal & professional support during our trip. You made us feel right at home. Also in attendance for the first #OSSDataCamp were Michael Manfre, Michiya Takahashi, and Tim Graham. All of whom represented the Python/Django community and helped our open source cause.

This is a process and one that I hope continues with Ruby and other languages. It will succeed if Microsoft actively contributes back to open source and in some cases, champions certain projects with an earnest level of excellence.

Tobias Ternstrom helped make FETCH happen in SQL Server.To the right is Tobias Ternstrom and myself. The reason I am so happy in that photo is that Tobias literally helped make FETCH happen in SQL Server. Supporting a sane limit/offset model allowed projects like the ActiveRecord adapter to delete hundreds of lines of code while becoming more maintainable. Thanks so much Tobias! All ORMs everywhere love you.

And lastly, I want to give a shout out to Lars Kanis who has been a huge contributor over the past many months by making TinyTDS work well on Windows. Let him know it if you see his pull requests!


by Ken Collins