Category Archives: Uncategorized

By Assaf Araki and Ben Lorica. The world of technology is no stranger to hype. From the dot-com bubble to the rise of cloud computing, we’ve witnessed cycles of intense excitement followed by disillusionment. Two prominent examples of transformative technologies in recent times are Big Data and Generative AI (GenAI). While Big Data promised toContinue reading “Avoiding the Pitfalls and Embracing the Opportunities of GenAI Adoption”

Driving Performance, Efficiency, and Developer-Friendly Features As someone who frequently leverages large language models (LLMs) to build solutions, I find the recent advancements in the field both exciting and promising. The release of Databricks DBRX, Meta Llama 3, and Snowflake Arctic highlights the priorities of LLM creators in delivering powerful, efficient, and developer-friendly solutions. TheContinue reading “Architectural Enhancements in Recent Open LLMs”

Geopolitics, Data Privacy, and the Future of Social Media As President Biden signed a foreign aid package that includes a bill requiring TikTok’s China-based parent company ByteDance to divest the app within a year or face a ban, I find myself grappling with the complex implications of this decision. While I understand the national securityContinue reading “TikTok’s Ticking Clock”

In the evolving landscape of AI, Large Language Models (LLMs) have emerged as powerful tools for generating human-like text. However, their reliance on internal knowledge, or “priors,” can lead to limitations in applications requiring up-to-date, accurate information. Retrieval Augmented Generation (RAG) systems aim to address this by augmenting LLMs with external knowledge retrieved from variousContinue reading “Balancing Act: LLM Priors and Retrieved Information in RAG Systems”

A recent survey of large enterprises reveals a significant shift towards in-house application development, driven by the rise of foundation models offering accessible APIs. This move away from reliance on external vendors for AI-driven solutions has major implications for the industry. For instance, companies that once relied on third-party chatbots and custom recommenders can nowContinue reading “Generative AI: Insights from the Frontlines”

What is Llama 3 and why is it significant? Llama 3 is the next generation of Meta’s open-source large language model (LLM). This release marks a step in making advanced AI capabilities more accessible and steerable, particularly in applications that benefit from improved natural language understanding and generation. Llama 3 represents a significant leap overContinue reading “Llama 3 Unpacked”

Constitutional AI (CAI), pioneered by Anthropic, is an approach to training AI systems that leverages a set of principles, akin to a constitution, to guide the AI’s behavior. This method prioritizes implementation of human value through these established principles, supplemented by minimal examples for fine-tuning prompts. It aims to reduce reliance on extensive human labelingContinue reading “Judicial AI: A Legal Framework to Manage AI Risks”