Subscribe • Previous Issues The Complete Guide to AI Evaluation In the context of AI applications, “eval” means systematically assessing the quality, reliability, and business impact of AI-generated outputs—from text and code to complex agent decisions. In my recent AI playbook, I argued that a robust evaluation framework is not just a best practice but proprietary intellectualContinue reading “Quick Wins for your AI eval strategy”
Author Archives: Ben Lorica
The Knowledge Work Agent Ecosystem
Recent coverage about the impact of AI on jobs has rightfully focused on coding and software development, since AI tools in these areas continue to make tremendous progress, and foundation model builders often track their progress through solving programming and mathematical problems. We also hear a lot about the impact of AI on knowledge work—marketing,Continue reading “The Knowledge Work Agent Ecosystem”
A new framework for AI knowledge work
Subscribe • Previous Issues The Knowledge Work Agent Ecosystem Recent coverage about the impact of AI on jobs has rightfully focused on coding and software development, since AI tools in these areas continue to make tremendous progress, and foundation model builders often track their progress through solving programming and mathematical problems. We also hear a lot aboutContinue reading “A new framework for AI knowledge work”
Mid-2025 AI Update: What’s Actually Working in Enterprise
As we cross the midpoint of 2025, the conversation around AI is shifting from potential to practice. While the race to build the next frontier model dominates headlines, the more critical story is one of diffusion—how this technology is actually being woven into the fabric of business. As I recently noted, China is accelerating thisContinue reading “Mid-2025 AI Update: What’s Actually Working in Enterprise”
Your AI playbook for the rest of 2025
Subscribe • Previous Issues Mid-2025 AI Update: What’s Actually Working in Enterprise As we cross the midpoint of 2025, the conversation around AI is shifting from potential to practice. While the race to build the next frontier model dominates headlines, the more critical story is one of diffusion—how this technology is actually being woven into the fabricContinue reading “Your AI playbook for the rest of 2025”
Is Your AI Ready for the Next Wave of Governance?
As artificial intelligence seeps into everything from triage decisions in hospitals to the way capital is allocated on Wall Street, the question is less whether we should govern AI than how quickly we can build guard-rails that keep pace with the underlying technology. Over the past decade the focus has shifted from high-level principles draftedContinue reading “Is Your AI Ready for the Next Wave of Governance?”
How to future-proof your AI governance strategy
Subscribe • Previous Issues Is Your AI Ready for the Next Wave of Governance? As artificial intelligence seeps into everything from triage decisions in hospitals to the way capital is allocated on Wall Street, the question is less whether we should govern AI than how quickly we can build guard-rails that keep pace with the underlying technology.Continue reading “How to future-proof your AI governance strategy”
From Monoliths to Specialists: The New Era of AI
In a previous analysis, I examined how a company could build a highly effective AI application for writing database queries without any fine-tuning, relying instead on semantic catalogs and validation loops to mirror how experienced analysts write SQL. This approach worked exceptionally well for that specific, targeted application. However, it represents just one narrow sliceContinue reading “From Monoliths to Specialists: The New Era of AI”
Building better AI agents, for less
Subscribe • Previous Issues From Monoliths to Specialists: The New Era of AI In a previous analysis, I examined how a company could build a highly effective AI application for writing database queries without any fine-tuning, relying instead on semantic catalogs and validation loops to mirror how experienced analysts write SQL. This approach worked exceptionally well forContinue reading “Building better AI agents, for less”
How Two Sigma & Nubank Rewire Finance with Foundation Models
Financial services has always been my bellwether for how new technologies are rolled out, and generative AI is the latest example. My own stint as a quant at a hedge fund many years ago has kept me interested in the intersection of finance and technology. This ongoing interest led me to pay close attention toContinue reading “How Two Sigma & Nubank Rewire Finance with Foundation Models”