Trends shaping the future of AI infrastructure

Subscribe • Previous Issues The PARK Stack Is Becoming the Standard for Production AI In a previous article, I argued that the open-source project Ray has become the compute substrate many modern AI platforms are standardizing on — bridging model development, data pipelines, training, and serving without locking into a single vendor. Ray Summit is my favoriteContinue reading “Trends shaping the future of AI infrastructure”

How to build an AI business that survives the bubble

Subscribe • Previous Issues Boom, Bubble, or Bust? How to Build a Resilient AI Business Comparisons to the dot-com bust are common but this AI boom rests on short-cycle hardware. Frontier training chases each GPU generation, rendering last year’s chips economically obsolete for training even as they stay serviceable for inference — forcing relentless reinvestment. This dynamicContinue reading “How to build an AI business that survives the bubble”

Inside the race to build agent-native databases

Subscribe • Previous Issues Reimagining the Database for AI Agents In a recent piece, I explored the growing mismatch between our existing data infrastructure and the demands of emerging AI agents. Since then, I have had the opportunity to speak with some founders and engineering leaders who are tackling this challenge directly. Their work confirms that theContinue reading “Inside the race to build agent-native databases”

Agentic AI Applications: A Field Guide

Subscribe • Previous Issues Hard Truths About AI Agents: What Works, What Doesn’t, and Why If you’ve been captivated by demos of agentic AI, you’ve likely also encountered the immense challenge of making them work in production. While demos promise unprecedented capabilities, the path to building reliable, scalable, and cost-effective agents is fraught with challenges. This fieldContinue reading “Agentic AI Applications: A Field Guide”

The Convergence of Data, AI, and Agents: Are You Prepared?

Subscribe • Previous Issues Autonomous Agents are Here. What Does It Mean for Your Data? By Ciro Greco and Ben Lorica. A striking factoid emerges from Anthropic’s latest Economic Index report: directive AI usage, where users delegate complete tasks to Claude, has surged from 27% to 39% on Claude.ai in just eight months.  Among API customers buildingContinue reading “The Convergence of Data, AI, and Agents: Are You Prepared?”

Think Smaller: The Counterintuitive Path to AI Adoption

Subscribe • Previous Issues Escaping Prototype Purgatory: A Playbook for AI Teams We’re living through a peculiar moment in AI development. On one hand, the demos are spectacular: agents that reason and plan with apparent ease, models that compose original songs from a text prompt, and research tools that produce detailed reports in minutes. Yet many AIContinue reading “Think Smaller: The Counterintuitive Path to AI Adoption”

Beyond RL: A New Paradigm for Agent Optimization

Subscribe • Previous Issues A Better Way to Build and Refine Agents Modern AI applications have evolved far beyond single models. Many systems orchestrate multiple specialized agents — planners that decompose tasks, extractors that gather data, generators that create content — all coordinating through external tools and APIs. This architectural shift creates a fundamental optimization problem: theContinue reading “Beyond RL: A New Paradigm for Agent Optimization”

Is your LLM overkill?

Subscribe • Previous Issues A Tiered Approach to AI: The New Playbook for Agents and Workflows A Small Language Model (SLM) is a neural model defined by its low parameter count, typically in the single-digit to low-tens of billions. These models trade broad, general-purpose capability for significant gains in efficiency, cost, and privacy, making them ideal forContinue reading “Is your LLM overkill?”

Why Your Database Can’t Handle the Coming Agent Swarm

Subscribe • Previous Issues Rethinking Databases for the Age of Autonomous Agents As the AI community buzzes with the potential of autonomous agents, I’ve been pondering a less glamorous but critical question: what does this mean for our data infrastructure? We are designing intelligent, autonomous systems on top of databases built for predictable, human-driven interactions. What happensContinue reading “Why Your Database Can’t Handle the Coming Agent Swarm”

A pragmatic guide to enterprise search that works

Subscribe • Previous Issues The Enterprise Search Reality Check Before the AI hype cycle exploded with ChatGPT in late 2022, I was focused on a less glamorous, but equally important shift: the resurgence of enterprise search. Neural retrieval and vector embeddings finally looked practical. After the release of ChatGPT, an assumption among some AI teams was thatContinue reading “A pragmatic guide to enterprise search that works”