Gradient Flow

Tag: workflow

  • We need open and vendor-neutral metadata services

    [A version of this article appears on the O’Reilly Radar.] Comprehensive metadata collection and analysis can pave the way for many interesting applications. As I spoke with friends leading up to Strata + Hadoop World NYC…

  • Bridging the divide: Business users and machine learning experts

    [A version of this articles appears on the O’Reilly Radar.] Subscribe to the O’Reilly Data Show Podcast to explore the opportunities and techniques driving big data and data science. As tools for advanced analytics become more…

  • 6 reasons why I like KeystoneML

    [A version of this article appears on the O’Reilly Radar.] The O’Reilly Data Show Podcast: Ben Recht on optimization, compressed sensing, and large-scale machine learning pipelines. As we put the finishing touches on what promises to…

  • More tools for managing and reproducing complex data projects

    A survey of the landscape shows the types of tools remain the same, but interfaces continue to improve. [A version of this post appears on the O’Reilly Radar.] As data projects become complex and as data…

  • Building and deploying large-scale machine learning pipelines

    [A version of this post appears on the O’Reilly Radar blog.] There are many algorithms with implementations that scale to large data sets (this list includes matrix factorization, SVM, logistic regression, LASSO, and many others). In…

  • Streamlining Feature Engineering

    Researchers and startups are building tools that enable feature discovery [A version of this post appears on the O’Reilly Data blog.] Why do data scientists spend so much time on data wrangling and data preparation? In…

  • Bits from the Data Store

    Semi-regular field notes from the world of data: I’m always on the lookout for interesting tools and ideas for reproducing and collaborating on long data workflows. Reproducibility and collaboration are topics that we’re following closely at…

  • Instrumenting collaboration tools used in data projects

    Built-in audit trails can be useful for reproducing and debugging complex data analysis projects [A version of this post appears on the O’Reilly Data blog.] As I noted in a previous post, model building is just…

  • Interface Languages and Feature Discovery

    It’s easier to “discover” features with tools that have broad coverage of the data science workflow [A version of this post appears on the O’Reilly Data blog and Forbes.] Here are a few more observations based…

  • IPython: A unified environment for interactive data analysis

    [A version of this post appears on the O’Reilly data blog and Forbes.] As I noted in a recent post on reproducing data projects, notebooks have become popular tools for maintaining, sharing, and replicating long data…