Apache Spark in the Enterprise and in China

Enterprise Adoption

IBM’s announcements at the recent Spark Summit in SF bodes well for enterprise adoption of Spark. Ben Horowitz jokingly referred to IBM’s endorsement as akin to a Rabbi blessing Spark as kosher for use in an enterprise.

I recently sat down with a set of luminaries at the Spark Summit and asked them about how Spark is perceived in enterprises. Below is a selection of responses:

  • Mike Olson, Chairman and co-founder of Cloudera
  • Martin Van Rysk, SVP of Engineering at Datastax
  • Beth Smith, GM of the analytics Platform at IBM

China

As I noted in a recent Radar article, Spark is very popular in China:

Unbeknownst to many, the largest Spark deployments are in China. Tencent publicly discussed their 8,000 node Spark cluster at Strata + Hadoop World in San Jose this past February, and other large Chinese companies such as Alibaba and Baidu have shared lessons from running large Spark deployments.

I recently spoke with a variety of people who’ve been following the rise of Apache Spark in China. Here are some highlights:

  • Michael A. Greene, VP at Intel
  • Reynold Xin, co-founder of Databricks
  • Bing Xiao, Head of Big Data at Huawei

Leave a Reply

%d bloggers like this: