{"id":3768,"date":"2026-06-19T15:00:00","date_gmt":"2026-06-19T15:00:00","guid":{"rendered":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/"},"modified":"2026-06-19T15:00:00","modified_gmt":"2026-06-19T15:00:00","slug":"from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai","status":"publish","type":"post","link":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/","title":{"rendered":"From prediction to decision:  Smaller models will reshape how we build AI"},"content":{"rendered":"<p>I&#8217;ve spent the better part of a decade working on personalization, search, and recommendations at scale, most recently at Netflix, and now in a new chapter at Zoctok. The through line has stayed the same for me: recommendations, search, personalization.But the way I think about building these systems has shifted dramatically over the last couple of years, and that shift is what I want to walk you through.We&#8217;ve all heard plenty about large models. Hopefully you&#8217;ve also had a large coffee at some point today, because what I want to talk about is a little different. I want to talk about what happens when smaller models start making the bigger decisions.A state gutted its AI law. Then Congress stepped in.America\u2019s AI regulatory landscape just had a month that made legal counsel everywhere reach for stronger coffee. Colorado\u2019s landmark AI Act, once celebrated as the country\u2019s first comprehensive state AI law, was gutted and replaced before it ever took effect.A decade of building prediction systemsLet me set some context. Over the past ten years, I&#8217;ve worked on large-scale systems that make billions of decisions every day: prediction infrastructure, search systems, candidate generation, ranking.Early in my career, most of the work centered on improving the predictions themselves. Better ranking models. Better relevance signals. Better signal quality for search.And generally, when predictions improved, the systems improved. That was the loop we were optimizing for.Lately, though, something has changed in how we work. We&#8217;re still building increasingly sophisticated models, and we&#8217;re still investing heavily in the infrastructure that supports them.But the hardest problems are no longer purely about model quality. They&#8217;ve shifted to how we make decisions across technical and organizational layers, and how we connect those dots.With the rise of generative AI and more specialized, smaller models, that shift has only accelerated. We&#8217;re moving from building prediction models to building decision systems. And that&#8217;s worth talking about.<\/p>\n<p>                            For expert advice like this straight to your inbox every other Friday, sign up for Pro+ membership.You&#8217;ll also get access to 300+ hours of exclusive video content, a complimentary Summit ticket, and so much more.So, what are you waiting for?<\/p>\n<p>                            Get Pro+<\/p>\n<p>GPS vs autopilotI&#8217;m a visual thinker, so here&#8217;s how I frame it: GPS versus autopilot.GPS gives you predictions at a first-principles level. Take this route. Avoid this traffic. You&#8217;ll arrive at this time. After that, the system stops. You&#8217;re still driving. You&#8217;re still adapting to traffic, reacting to changes, and making the decisions.Autopilot works differently. It continuously adjusts. It&#8217;s taking actions and reasoning on your behalf. It observes conditions, reacts to turbulence, and makes decisions in real time.<\/p>\n","protected":false},"excerpt":{"rendered":"<div>The bottleneck in AI systems isn&#8217;t model intelligence anymore, but decision agility. Mallika Rao, engineering manager and former Netflix infrastructure lead, breaks down why smaller, task-specific models are outrunning foundational ones, and what that means for every team building at scale.<\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[1,23,22],"tags":[3],"class_list":["post-3768","post","type-post","status-publish","format-standard","hentry","category-ai-and-ml","category-articles","category-membership-content","tag-ai"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v26.7 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>From prediction to decision: Smaller models will reshape how we build AI - Imperative Business Ventures Limited<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"From prediction to decision: Smaller models will reshape how we build AI - Imperative Business Ventures Limited\" \/>\n<meta property=\"og:description\" content=\"The bottleneck in AI systems isn&#039;t model intelligence anymore, but decision agility. Mallika Rao, engineering manager and former Netflix infrastructure lead, breaks down why smaller, task-specific models are outrunning foundational ones, and what that means for every team building at scale.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\" \/>\n<meta property=\"og:site_name\" content=\"Imperative Business Ventures Limited\" \/>\n<meta property=\"article:published_time\" content=\"2026-06-19T15:00:00+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\/\/blog.ibvl.in\/#\/schema\/person\/55b87b72a56b1bbe9295fe5ef7a20b02\"},\"headline\":\"From prediction to decision: Smaller models will reshape how we build AI\",\"datePublished\":\"2026-06-19T15:00:00+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\"},\"wordCount\":478,\"keywords\":[\"AI\"],\"articleSection\":[\"AI and ML\",\"Articles\",\"Membership content\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\",\"url\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\",\"name\":\"From prediction to decision: Smaller models will reshape how we build AI - Imperative Business Ventures Limited\",\"isPartOf\":{\"@id\":\"https:\/\/blog.ibvl.in\/#website\"},\"datePublished\":\"2026-06-19T15:00:00+00:00\",\"author\":{\"@id\":\"https:\/\/blog.ibvl.in\/#\/schema\/person\/55b87b72a56b1bbe9295fe5ef7a20b02\"},\"breadcrumb\":{\"@id\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.ibvl.in\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"From prediction to decision: Smaller models will reshape how we build AI\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.ibvl.in\/#website\",\"url\":\"https:\/\/blog.ibvl.in\/\",\"name\":\"Imperative Business Ventures Limited\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.ibvl.in\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.ibvl.in\/#\/schema\/person\/55b87b72a56b1bbe9295fe5ef7a20b02\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.ibvl.in\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4d20b2cd313e4417a599678e950e6fb7d4dfa178a72f2b769335a08aaa615aa9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4d20b2cd313e4417a599678e950e6fb7d4dfa178a72f2b769335a08aaa615aa9?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"https:\/\/blog.ibvl.in\"],\"url\":\"https:\/\/blog.ibvl.in\/index.php\/author\/admin_hcbs9yw6\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"From prediction to decision: Smaller models will reshape how we build AI - Imperative Business Ventures Limited","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/","og_locale":"en_US","og_type":"article","og_title":"From prediction to decision: Smaller models will reshape how we build AI - Imperative Business Ventures Limited","og_description":"The bottleneck in AI systems isn't model intelligence anymore, but decision agility. Mallika Rao, engineering manager and former Netflix infrastructure lead, breaks down why smaller, task-specific models are outrunning foundational ones, and what that means for every team building at scale.","og_url":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/","og_site_name":"Imperative Business Ventures Limited","article_published_time":"2026-06-19T15:00:00+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/#article","isPartOf":{"@id":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/"},"author":{"name":"admin","@id":"https:\/\/blog.ibvl.in\/#\/schema\/person\/55b87b72a56b1bbe9295fe5ef7a20b02"},"headline":"From prediction to decision: Smaller models will reshape how we build AI","datePublished":"2026-06-19T15:00:00+00:00","mainEntityOfPage":{"@id":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/"},"wordCount":478,"keywords":["AI"],"articleSection":["AI and ML","Articles","Membership content"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/","url":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/","name":"From prediction to decision: Smaller models will reshape how we build AI - Imperative Business Ventures Limited","isPartOf":{"@id":"https:\/\/blog.ibvl.in\/#website"},"datePublished":"2026-06-19T15:00:00+00:00","author":{"@id":"https:\/\/blog.ibvl.in\/#\/schema\/person\/55b87b72a56b1bbe9295fe5ef7a20b02"},"breadcrumb":{"@id":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blog.ibvl.in\/index.php\/2026\/06\/19\/from-prediction-to-decision-smaller-models-will-reshape-how-we-build-ai\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.ibvl.in\/"},{"@type":"ListItem","position":2,"name":"From prediction to decision: Smaller models will reshape how we build AI"}]},{"@type":"WebSite","@id":"https:\/\/blog.ibvl.in\/#website","url":"https:\/\/blog.ibvl.in\/","name":"Imperative Business Ventures Limited","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.ibvl.in\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blog.ibvl.in\/#\/schema\/person\/55b87b72a56b1bbe9295fe5ef7a20b02","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.ibvl.in\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/4d20b2cd313e4417a599678e950e6fb7d4dfa178a72f2b769335a08aaa615aa9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4d20b2cd313e4417a599678e950e6fb7d4dfa178a72f2b769335a08aaa615aa9?s=96&d=mm&r=g","caption":"admin"},"sameAs":["https:\/\/blog.ibvl.in"],"url":"https:\/\/blog.ibvl.in\/index.php\/author\/admin_hcbs9yw6\/"}]}},"_links":{"self":[{"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/posts\/3768","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/comments?post=3768"}],"version-history":[{"count":0,"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/posts\/3768\/revisions"}],"wp:attachment":[{"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/media?parent=3768"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/categories?post=3768"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.ibvl.in\/index.php\/wp-json\/wp\/v2\/tags?post=3768"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}