Category: Data Engineer
-
Apache Spark 1.3, the new Dataframe API, and Spark performance
Over the course of a week, I’ll be hosting two good webcasts featuring Spark release manager Patrick Wendell and Spark committer Kay Ousterhout. Register now! Patrick Wendell: Spark 1.3 and Spark’s New Dataframe API (March 25th…
-
Turning Ph.D.s into industrial data scientists and data engineers
[A version of this post appears on the O’Reilly Radar blog.] Editor’s note: The ASI will offer a two-day intensive course, Practical Machine Learning, at Strata + Hadoop World in London in May. Back when I…
-
Time-turner: Strata San Jose 2015, day 1
[Our friends at Dato created an interesting content-based, Strata session recommender. Check it out here.] There are so many good talks happening at the same time that it’s impossible to not miss out on good sessions.…
-
Hardcore Data Science: 2015 California
Ben Recht and I hosted another great edition of Hardcore Data Science yesterday. From the very first talk, the room was full, the audience was attentive, and the energy in the room was high. It remained…
-
Spark 1.2 and Beyond
Next week I’ll be hosting a webcast with Spark’s release manager – and Databricks co-founder – Patrick Wendell. (Full disclosure: I’m an advisor to Databricks.) In this webcast, Patrick Wendell from Databricks will be speaking about…
-
Apache Spark’s journey from academia to industry
[A version of this post appears on the O’Reilly Radar blog.] Three projects from UC Berkeley’s AMPLab have been keenly adopted by industry: Apache Mesos, Apache Spark, and Tachyon. As an early user, it’s been fun…
-
Building Apache Kafka from scratch
[A version of this post originally appeared on the O’Reilly Radar blog.] In this episode of the O’Reilly Data Show Podcast, Jay Kreps talks about data integration, event data, and the Internet of Things. At the…
-
Spark + Cassandra: Technical Integration Details
I’ll be hosting a Nov 12th webcast on two of the most popular components in the big data ecosystem: Apache Spark and Apache Cassandra. As highlighted in a recent Databricks blog post, recent improvements to Spark’s…
-
Anomaly Detection with ElasticSearch
One of the technologies that I’m hearing more about is ElasticSearch. In particular the combination of ElasticSearch, Logstash, and Kibana (the ELK stack) has proven to be a popular platform for real-time analytics on both structured…
-
Time-turner: Strata NYC 2014, day 2
There are so many good talks happening at the same time that it’s impossible to not miss out on good sessions. But imagine I had a time-turner necklace and could actually “attend” 2 (maybe 3) sessions…