Gradient Flow

Category: Data Engineer

  • Building self-service tools to monitor high-volume time-series data

    [A version of this post appears on the O’Reilly Radar.] The O’Reilly Data Show Podcast: Phil Liu on the evolution of metric monitoring tools and cloud computing. One of the main sources of real-time data processing…

  • Apache Spark: Powering applications on-premise and in the cloud

    [A version of this post appears on the O’Reilly Radar.] As organizations shift their focus toward building analytic applications, many are relying on components from the Apache Spark ecosystem. I began pointing this out in advance…

  • Israel conference on Big Data, Analytics and Machine Learning

    The first Big Data, Analytics and Machine Learning (Israel Innovation) conference was a resounding success. Kudos to the organizers Danny Bickson, Assaf Araki, and Avner Algom. I was happy to help them invite speakers, publicize the…

  • More tools for managing and reproducing complex data projects

    A survey of the landscape shows the types of tools remain the same, but interfaces continue to improve. [A version of this post appears on the O’Reilly Radar.] As data projects become complex and as data…

  • The Spark Spot at Spark Summit East 2015 – NYC

    I had a series of conversations with a few lead developers and users of Apache Spark, at the recent Spark Summit NYC conference. You can view them on Youtube or using the player below:

    The Spark Spot at Spark Summit East 2015 – NYC

  • Coming full circle with Bigtable and HBase

    The O’Reilly Data Show Podcast: Michael Stack on HBase past, present, and future. [A version of this post appears on the O’Reilly Radar.] Subscribe to the O’Reilly Data Show to explore the opportunities and techniques driving…

  • Spark Summit East panel

    Here’s a video of our well-received panel from a few weeks ago, featuring Abhishek Mehta , Tresata – Founder & CEO George Mathew , Alteryx – President & COO Patrick Wendell , Databricks – Co-founder Martin…

    Spark Summit East panel

  • Building big data systems in academia and industry

    [A version of this post appears on the O’Reilly Radar blog.] The O’Reilly Data Show Podcast: Mikio Braun on stream processing, academic research, and training. Mikio Braun is a machine learning researcher who also enjoys software…

  • A real-time processing revival

    [A version of this post appears on the O’Reilly Radar blog.] Things are moving fast in the stream processing world. There’s renewed interest in stream processing and analytics. I write this based on some data points…

  • Redefining power distribution using big data

    [A version of this post appears on the O’Reilly Radar blog.] The O’Reilly Data Show Podcast: Erich Nachbar on testing and deploying open source, distributed computing components. When I first hear of a new open source…