Experiment Tracking and Experiment Management Tools
There are a variety of open-source and commercial tools available to support machine learning teams during the modeling phase. Experiment tracking and experiment management tools log all relevant metadata and results, and most of these tools include collaboration and visualization features to make ML experiments easier to manage and analyze. Learn which of these tools have the most traction:
Read The Post
Data Exchange podcast
- Software-Defined Assets: Nick Schrock is co-creator of GraphQL and Dagster. We discuss an ambitious new product direction for Dagster built around an abstraction that asserts that the primary identity for an asset should be a software definition, rather than a specific materialization.
- Dataframes at scale: Devin Petersohn is the creator of Modin, a fast, scalable, drop-in replacement for the popular Pandas library.
Data+AI Summit 2022
There were a series of interesting announcements at Data+AI Summit 2022, among the most significant were (1) ALL of Delta Lake is now open source, and (2) Project Lightspeed, an initiative that takes Spark Structured Streaming to the next generation. Databricks also announced a marketplace for data products, major updates to their unified governance solution and to Delta Live Tables, an impressive new orchestration solution, and a new framework for creating production-grade ML pipelines. As a result of these updates, Databricks has become the easiest and most affordable way to build and manage data and AI apps with popular open source tools.
FREE Reports
State of Workflow Orchestration: In the past decade, several notable open source and SaaS orchestration systems have been released and a related group of startups has raised over $450 million in funding. Our survey attracted nearly 600 respondents, and this report examines the orchestration tools respondents use, the features they value, and the challenges they face.
Identity Management Survey: The proliferation of software services and platforms comes at a time when security threats and data breaches continue to grow. To understand current trends and issues in identity security and management, we conducted an industry survey focused on challenges, key features, use cases, and emerging technologies.
Ranking Low-code Development Platforms
While they present their own challenges, low-code and no-code tools have the potential to vastly expand the pool of people who can build software applications and products. Enterprise low-code development platforms enable rapid application development and deployment using low-code and no-code methods, and some enable simplified one-button deployment.
Read The PostIf you enjoyed this newsletter please support our work by encouraging your friends and colleagues to subscribe: