On the eve of the very first Spark Summit, there is a lot to be excited about.
The past few months have been quite eventful for the Spark community – The Apache Software Foundation accepted Spark as an official incubator project and graduated Apache Mesos to a Top-Level Project, Databricks was founded to commercialize Spark with $14 million from Andreessen Horowitz and the Apache Spark community has grown to become one of the most active big data developer communities.
And what’s most exciting…. this is just the beginning.
When I think back to the founding of ClearStory a few years ago and the problems we set out to solve – if Spark wasn’t already being developed by Matei and others at the AMPLab then we would have most likely built something like it ourselves. The performance, flexibility and breadth of the Berkeley Data Analytics Stack is incredibly impressive and by extending many of the stack’s components as part of ClearStory’s Data Intelligence platform, we’re enabling organizations to utilize data in entirely new ways to benefit their business.
I am looking forward to participating in tomorrow’s summit and interacting with the growing Apache Spark community. If you happen to be going to the conference, feel free to check out my presentation, Using Spark and Shark for Fast-cycle Analysis on Diverse Data, where I will be discussing how and why we’re using Spark and Shark at ClearStory Data.
See you at the summit.