Apache Spark version 1.1 shipped a few weeks ago. I’ve been enjoying enhancements to MLlib, Spark SQL, and Spark Streaming. Next week I’ll be hosting a webcast with Spark’s release manager – and Databricks co-founder – Patrick Wendell. (Full disclosure: I’m an advisor to Databricks.)
In this webcast, Patrick Wendell from Databricks will be speaking about Spark’s new 1.1 release. This release includes significant extensions to Spark’s SQL, MLlib and Streaming libraries. It also adds several performance and robustness improvements to Spark’s core engine. Patrick will also cover Spark internals and other more advanced concepts regarding Spark’s internal execution to explain what has changed. This talk will focus on providing lower level details to help users who are performance-testing or debugging Spark, or trying out new Spark applications.