<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Is It Just Me]]></title><description><![CDATA[Daily Contamination Free AI Evals.]]></description><link>https://iijme.substack.com</link><image><url>https://substackcdn.com/image/fetch/$s_!To8T!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5cf51d4-5d86-42fc-afb7-fb054386713c_369x369.png</url><title>Is It Just Me</title><link>https://iijme.substack.com</link></image><generator>Substack</generator><lastBuildDate>Tue, 04 Aug 2026 22:25:33 GMT</lastBuildDate><atom:link href="https://iijme.substack.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Liquid Tensor LLC]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[iijme@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[iijme@substack.com]]></itunes:email><itunes:name><![CDATA[Is It Just Me]]></itunes:name></itunes:owner><itunes:author><![CDATA[Is It Just Me]]></itunes:author><googleplay:owner><![CDATA[iijme@substack.com]]></googleplay:owner><googleplay:email><![CDATA[iijme@substack.com]]></googleplay:email><googleplay:author><![CDATA[Is It Just Me]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[DeepSeek V4 is Good Enough, and Practically Free]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; August 4, 2026]]></description><link>https://iijme.substack.com/p/deepseek-v4-is-good-enough-and-practically</link><guid isPermaLink="false">https://iijme.substack.com/p/deepseek-v4-is-good-enough-and-practically</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Tue, 04 Aug 2026 15:47:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!71jX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!71jX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!71jX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 424w, https://substackcdn.com/image/fetch/$s_!71jX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 848w, https://substackcdn.com/image/fetch/$s_!71jX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!71jX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!71jX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png" width="1449" height="1086" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c77d71cc-aa53-4b5f-a0e6-8cd7315ca17d_1449x1086.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1086,&quot;width&quot;:1449,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1988686,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209800835?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc77d71cc-aa53-4b5f-a0e6-8cd7315ca17d_1449x1086.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!71jX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 424w, https://substackcdn.com/image/fetch/$s_!71jX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 848w, https://substackcdn.com/image/fetch/$s_!71jX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!71jX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe5e302fb-e134-4a1e-8632-ac1db4784977_1449x1086.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.5.</strong> It scored <strong>70%</strong>, ending its sibling&#8217;s six-board reign with a <strong>4&#8211;2</strong> head-to-head win over Sol and significant margins across the bottom half of the field.</p></li><li><p><strong>Cheapest closed model: Grok 4.5.</strong> For once, the cheap model is also on the podium: <strong>$0.18 per correct answer</strong> from the <strong>#2</strong> seat, its first podium on this board.</p></li><li><p><strong>Best open-weights model: DeepSeek V4 Flash.</strong> On debut, it scored <strong>55%</strong>, five points clear of the rest of the open field, at <strong>$0.013 per correct answer</strong>. Those are the cheapest results we have ever ranked this high.</p></li><li><p><strong>Real churn.</strong> Just <strong>27 of 36</strong> order calls between returning models repeated today (<strong>&#964; = 0.50</strong>). The crown changed hands, Grok climbed three seats, and Nemotron fell five.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Im-v!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Im-v!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!Im-v!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!Im-v!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!Im-v!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Im-v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png" width="1456" height="1003" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/74d49833-fd1f-4b15-bde2-7ea98a5a37cd_1800x1240.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1003,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:218476,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209800835?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74d49833-fd1f-4b15-bde2-7ea98a5a37cd_1800x1240.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!Im-v!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!Im-v!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!Im-v!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!Im-v!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761a720f-8617-4451-ac9c-0b6120fb0bd9_1800x1240.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><h2>What to do with today&#8217;s board</h2><p>Two debuts, one dethroning, and a board mostly defined by money.</p><p><strong>DeepSeek V4 Flash</strong> just did what Luna did on Friday, but five seats higher: <strong>55%</strong>, above Gemini and Opus 5, at a realized cost 17X cheaper than Sol&#8217;s. It is not fast. With a typical answer taking ~7 minutes. It&#8217;s a better fit for batch work than interactive loops. Within that lane, however, it is the best price per result option on the board.</p><p>Grok&#8217;s first podium comes with the same warning it always carries: the cheapest results in the top half, but one in eight attempts died to the clock.</p><p>The GPTs remain the safe pick, and today the order is GPT-5.5 first.</p><p>And if you were waiting for Qwen 3.8 Max to justify its price increase over the 3.7 model it replaces, today&#8217;s debut did not do it. The results were still mid table. The answers were faster. The bill was higher.</p><p>That is our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><p>Three stories lead today&#8217;s board. The rest are quick hits.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><h2>1. The siblings trade the crown again</h2><p>Sol&#8217;s six-board reign ended the way these things tend to end here: quietly, on the strength of a <strong>4&#8211;2</strong> head-to-head.</p><p>It is the first time in a week that either sibling has beaten the other by more than one problem.</p><p>GPT-5.5 took <strong>#1 at 70%</strong>. Sol&#8217;s fall to third says less about Sol, whose misses were again concentrated on problems nobody solved, than it does about today&#8217;s slate.</p><p>Our comparability controls read today&#8217;s problems as more difficult than Friday&#8217;s. Most of the field gave back points. The two models that did not, GPT-5.5 and Grok, moved past them.</p><p>The GPT pair has now occupied the top two seats on eight of the last nine boards and traded the crown twice in a week.</p><p>Every other vendor is competing for third.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!TcZo!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!TcZo!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!TcZo!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!TcZo!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!TcZo!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!TcZo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png" width="1456" height="1168" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1173f974-ecb4-455c-b72f-cd2f81e286f0_1800x1444.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1168,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:287647,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209800835?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1173f974-ecb4-455c-b72f-cd2f81e286f0_1800x1444.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!TcZo!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!TcZo!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!TcZo!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!TcZo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bce823b-629e-4759-9032-befe6a1b6da0_1800x1444.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. Grok&#8217;s first podium, earned uphill</h2><p>Grok 4.5&#8217;s ended today at <strong>#2</strong>, its first podium.</p><p>Grok finished level with Sol at <strong>65%</strong> and moved ahead on the tiebreak. More importantly, it made the climb on a tougher slate, which makes the improvement harder to dismiss as noise.</p><p>It also remained the cheapest model in the top half of the table at <strong>$0.18 per correct answer</strong>.</p><p>The asterisk has not moved. One in eight attempts ran out the clock, and a typical answer takes nearly five minutes. Its wins arrive more slowly and less reliably than those of the models around it.</p><p>But a month ago, Grok was a budget row with reliability problems.</p><p>Today, it is a podium model with reliability problems, at roughly one-fifth the price of the models it just outscored.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xMph!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xMph!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!xMph!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!xMph!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!xMph!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xMph!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5f1c8f94-ee13-481b-8956-bb8653fe1699_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:170414,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209800835?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5f1c8f94-ee13-481b-8956-bb8653fe1699_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xMph!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!xMph!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!xMph!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!xMph!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb8962625-cb2d-4fe3-83a0-6d93e8ae0e0e_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>3. DeepSeek does Luna&#8217;s trick, five seats higher</h2><p>Friday&#8217;s story was a subpenny model solving 40% of the board.</p><p>Today, DeepSeek V4 Flash debuted at <strong>55%</strong>, good for <strong>#5</strong>, above Gemini and Opus 5, at <strong>$0.013 per correct answer</strong>.</p><p>That is roughly double Luna&#8217;s solve rate and still just 1/17th of Sol&#8217;s cost, from a model that outscored half the board on its first morning.</p><p>The debut profile was clean:</p><ul><li><p>A full slate</p></li><li><p>One clock loss</p></li><li><p>A miss mix weighted toward problems the entire field found difficult</p></li></ul><p>Its head to head results look like those of a real midtable contender. DeepSeek beat Nemotron <strong>6&#8211;2</strong>, edged Gemini, split with the budget field, and lost clearly to the GPTs.</p><p>The catch is the stopwatch.</p><p>A typical answer takes about <strong>seven minutes</strong>, making it the second-slowest model on the board. For interactive work, that is likely disqualifying.</p><p>For anything that can run overnight, the cost comparison is not close.</p><p>The open weights crown changes hands on day one.</p><h2>Quick hits</h2><ul><li><p><strong>Fable 5</strong> held <strong>#4 at 60%</strong>, its seventh consecutive top-four finish. It still produces the board&#8217;s most expensive results at <strong>$1.04 per correct answer</strong>.</p></li><li><p><strong>Qwen 3.8 Max</strong> debuted at <strong>48%</strong>, roughly where the 3.7 model it replaces tended to land. It was much faster, with a typical answer taking <strong>331 seconds</strong> instead of its predecessor&#8217;s routine 700-plus, but one-sixth of its attempts still died to the clock. Better manners, same grades, bigger bill.</p></li><li><p><strong>Nemotron 3 Ultra</strong> fell five seats to last at <strong>46%</strong>, surrendering its open-weights lead in one bad morning. The slate was clean, so the misses were real.</p></li><li><p><strong>Kimi K3</strong> rebounded four seats to <strong>50%</strong>, recovering most of yesterday&#8217;s collapse. Its four-board line, <strong>52, 45, 36, 50</strong>, is the most volatile on the board.</p></li><li><p><strong>GLM-5.2</strong> matched its best score in weeks at <strong>50%</strong>, although another handful of provider errors cut its slate short.</p></li><li><p><strong>Gemini 3.6 Flash</strong> cooled to <strong>#6 at 52%</strong>. It remains the fastest model on the board, with a typical answer taking <strong>82 seconds</strong>, but it is now flanked below by a debutant costing roughly one-fortieth as much and above by models it has not recently been able to catch.</p></li></ul><h2>Why the board moves at all</h2><p>Just <strong>27 of 36</strong> order calls between returning models repeated today, producing a Kendall rank correlation of <strong>&#964; = 0.50</strong>.</p><p>Unusually, the churn reached the top of the table:</p><ul><li><p>A crown change</p></li><li><p>A first ever podium</p></li></ul><p>All three happened on the same morning.</p><p>Our comparability controls read today&#8217;s slate as more difficult than Friday&#8217;s, and most of the field&#8217;s scores fell with it. That makes the two models that improved anyway, GPT-5.5 and Grok, the day&#8217;s clearest signal.</p><p>When the same measurement produces a frozen board one week and a reshuffled board the next, both readings are doing their job. The quiet period showed that the ruler was steady. Today, that ruler caught three genuine moves at once.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!jH3c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jH3c!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!jH3c!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!jH3c!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!jH3c!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jH3c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a26d02c8-93d3-44dd-9e00-6abcdc693d2a_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:219632,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209800835?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa26d02c8-93d3-44dd-9e00-6abcdc693d2a_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!jH3c!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!jH3c!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!jH3c!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!jH3c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa413d24a-f135-45cf-bd5f-427a310ebbcc_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why not just trust the benchmarks you have already seen?</h2><p>Public benchmarks eventually leak into training data. Scores inflate, and the benchmark begins measuring memorization instead of ability.</p><p>They are also snapshots. They may be accurate on the day they are published, but they become less representative as models, providers, and serving systems change.</p><p>We generate <strong>fresh, novel problems every day</strong>.</p><p>No model can have trained on a problem that did not exist until this morning. That is how a model that appeared four days ago can debut against the frontier on equal terms and take the open weights lead before its launch coverage has even cooled.</p><p>Today&#8217;s board used roughly <strong>$113 in compute over 14M tokens</strong>.</p><p><strong>Subscribe, and each morning you will get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Luna solves for a penny, Kimi Collapses]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; August 3, 2026]]></description><link>https://iijme.substack.com/p/luna-solves-for-a-penny-kimi-collapses</link><guid isPermaLink="false">https://iijme.substack.com/p/luna-solves-for-a-penny-kimi-collapses</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Mon, 03 Aug 2026 15:52:27 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!sY6c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sY6c!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sY6c!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 424w, https://substackcdn.com/image/fetch/$s_!sY6c!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 848w, https://substackcdn.com/image/fetch/$s_!sY6c!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!sY6c!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!sY6c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png" width="1448" height="1086" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/be89019c-47ad-4103-ae05-280feac05c6b_1448x1086.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1086,&quot;width&quot;:1448,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1381802,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209653218?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe89019c-47ad-4103-ae05-280feac05c6b_1448x1086.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sY6c!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 424w, https://substackcdn.com/image/fetch/$s_!sY6c!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 848w, https://substackcdn.com/image/fetch/$s_!sY6c!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!sY6c!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1d8d5bd8-d507-419d-bd74-c2c035d4102b_1448x1086.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT 5.6 Sol, on a tiebreak.</strong> Sol and GPT 5.5 finished dead level at <strong>72%</strong> and split their head to head <strong>1&#8211;1</strong>. Sol&#8217;s sixth straight crown rests on the strength of schedule math.</p></li><li><p><strong>Cheapest closed model: GPT 5.6 Luna, if 40% clears your bar.</strong> It delivered a correct answer for <strong>$0.007</strong>, the first sub penny figure we have ever printed. If 40% does not clear your bar, Terra solved half the board for <strong>a nickel per correct answer</strong>.</p></li><li><p><strong>Best open weights model: Nemotron 3 Ultra.</strong> It scored <strong>56%</strong>, holding the open lead for a third straight day, this time on a nearly clean slate.</p></li><li><p><strong>Steady board.</strong> <strong>41 of 45</strong> order calls between returning models repeated, for a Kendall <strong>&#964; of 0.82</strong>. The entire returning top seven held its seat.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> the two debutants are the two fastest models we have ever measured. Terra answered in a typical <strong>54 seconds</strong> and Luna in <strong>48</strong>, both beating the stopwatch record Gemini had owned since its debut.</p><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p></li></ul><h2>What to do with today&#8217;s board</h2><p>The top of the board says what it has said for two weeks: the GPT flagships first, Fable at a premium, and Gemini for speed.</p><p>What changed today is the bottom of your bill.</p><p>Terra solved <strong>half the board</strong> at <strong>$0.054 per correct answer</strong>, one quarter of Sol&#8217;s rate, and answered faster than anything we had ever timed until its sibling posted 48 seconds. For a high volume workload dominated by easy to medium calls, the play this week is a router:</p><p><strong>Terra or Luna first. Escalate to Sol on failure. Let the expensive model touch only what the cheap one misses.</strong></p><p>Luna&#8217;s 40% will not carry hard work, and its losing records against the entire top half say so plainly. But it does not need to. At less than a penny per correct answer, it only needs to catch the easy volume, and it did.</p><p>Kimi owners should read the quick hits.</p><p>That is our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2Wsp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2Wsp!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 424w, https://substackcdn.com/image/fetch/$s_!2Wsp!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 848w, https://substackcdn.com/image/fetch/$s_!2Wsp!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 1272w, https://substackcdn.com/image/fetch/$s_!2Wsp!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2Wsp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png" width="1456" height="1074" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/134f9930-6791-48b7-a956-7726be497231_1800x1328.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/aa929c68-a573-4f30-aa23-da6aa5013486_1800x1328.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1074,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:219075,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209653218?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa929c68-a573-4f30-aa23-da6aa5013486_1800x1328.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2Wsp!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 424w, https://substackcdn.com/image/fetch/$s_!2Wsp!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 848w, https://substackcdn.com/image/fetch/$s_!2Wsp!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 1272w, https://substackcdn.com/image/fetch/$s_!2Wsp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F134f9930-6791-48b7-a956-7726be497231_1800x1328.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest is quick hits.</p><h2>1. The GPT ladder is now a full staircase</h2><p>OpenAI put four models on today&#8217;s board, and they finished <strong>#1, #2, #8, and #11</strong>.</p><p>That sounds like a mixed day until you look at the price column:</p><ul><li><p><strong>Sol:</strong> 72% at <strong>$0.22</strong> per correct answer</p></li><li><p><strong>Terra:</strong> 50% at <strong>$0.054</strong></p></li><li><p><strong>Luna:</strong> 40% at <strong>$0.007</strong></p></li></ul><p>Luna&#8217;s entire slate cost roughly what a coffee stirrer costs.</p><p>The debutants&#8217; head to head records against the leaders are honestly bad. Terra went <strong>0&#8211;9 against Sol</strong>, and Luna went <strong>1&#8211;14</strong>. Neither model threatens anything above the middle of the table on capability.</p><p>That is not what they are for.</p><p>What they establish is a complete price ladder inside one vendor: full accuracy at a rate we already called the board&#8217;s best value, then roughly 70% of that accuracy at one-quarter of the price, then roughly 55% of it at one-thirtieth.</p><p>Nobody else on the board offers the middle and bottom rungs at anything close to those prices. Both new rungs also answer faster than every incumbent, including the model that previously held the speed record.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!i4gq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!i4gq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 424w, https://substackcdn.com/image/fetch/$s_!i4gq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 848w, https://substackcdn.com/image/fetch/$s_!i4gq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 1272w, https://substackcdn.com/image/fetch/$s_!i4gq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!i4gq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png" width="1456" height="1181" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a965ee6d-1181-4061-9c39-e6a98c0df8a0_1800x1460.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1181,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:178678,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209653218?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa965ee6d-1181-4061-9c39-e6a98c0df8a0_1800x1460.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!i4gq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 424w, https://substackcdn.com/image/fetch/$s_!i4gq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 848w, https://substackcdn.com/image/fetch/$s_!i4gq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 1272w, https://substackcdn.com/image/fetch/$s_!i4gq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F183fe7ab-1d1d-47a0-adea-82603b320341_1800x1460.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. A dead heat at the top, decided by the schedule</h2><p>Sol&#8217;s sixth straight crown is its narrowest.</p><p>Sol and GPT 5.5 both finished at <strong>72%</strong>, split their head to head <strong>1&#8211;1</strong>, and forced the ranking to the strength of schedule tiebreak, which weighs each model&#8217;s full record against the field.</p><p>Sol&#8217;s record was the sturdier one. It finished unbeaten against all eleven competitors and posted five statistically significant margins. GPT 5.5 dropped a handful more of the matchups beneath it.</p><p>That is about as thin as a crown gets.</p><p>It is also the <strong>tenth crown Sol has collected in just over two weeks</strong>. Sol and GPT 5.5 have now locked out the top two seats for seven consecutive boards, and nothing else today finished within seven percentage points of either one.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5fIo!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5fIo!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 424w, https://substackcdn.com/image/fetch/$s_!5fIo!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 848w, https://substackcdn.com/image/fetch/$s_!5fIo!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 1272w, https://substackcdn.com/image/fetch/$s_!5fIo!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5fIo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png" width="1456" height="1181" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0f143451-ca9c-4bd5-bd89-578e223d228c_1800x1460.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1181,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:179392,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209653218?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0f143451-ca9c-4bd5-bd89-578e223d228c_1800x1460.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5fIo!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 424w, https://substackcdn.com/image/fetch/$s_!5fIo!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 848w, https://substackcdn.com/image/fetch/$s_!5fIo!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 1272w, https://substackcdn.com/image/fetch/$s_!5fIo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F548b607b-07de-4083-bb88-cfd6fa241396_1800x1460.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The anatomy of a penny</h2><p>Luna&#8217;s 40% deserves a closer look because its failure profile is the healthiest kind.</p><p>It finished every problem. It lost nothing to the clock and nothing to its provider. It also answered faster than any model we have ever timed.</p><p>Every miss was simply a wrong answer.</p><p>Just over half of those misses came on problems the leaders solved, roughly the same mix seen among models charging forty times more in the same region of the table.</p><p>Compare that with Inkling&#8217;s July debut. Inkling also failed only by being wrong, but it scored 5%. Luna fails the honest way at eight times the accuracy and roughly one-hundredth of the price.</p><p>There is no hidden reliability tax here.</p><p>Luna is exactly what it says it is: a small, blisteringly fast model that gets six problems in ten wrong, priced like it knows it.</p><h2>Quick hits</h2><ul><li><p><strong>Fable 5</strong> took <strong>#3 at 65%</strong> on the Elo tiebreak over Gemini. It has now reached the podium six days straight, while remaining the board&#8217;s most expensive result at <strong>$0.92 per correct answer</strong>.</p></li><li><p><strong>Gemini 3.6 Flash</strong> matched Fable at <strong>65%</strong> and lost the stopwatch title it had held since debut, twice in one morning, to models costing a fraction as much. It remains the fastest model in the top half at <strong>85 seconds</strong>.</p></li><li><p><strong>Grok 4.5</strong> climbed to <strong>60%</strong>, its strongest board in two weeks, although one-sixth of its attempts still ran out the clock.</p></li><li><p><strong>Opus 5</strong> held <strong>#7 at 52%</strong>, consistent with its emerging mid-table pattern. One-tenth of its attempts timed out. Its seven board line has settled into the low fifties, wobble included.</p></li><li><p><strong>Qwen 3.7 Max</strong> remained the slowest model at <strong>48%</strong>. One-third of its attempts timed out, its worst reliability result of the month.</p></li><li><p><strong>GLM-5.2</strong> posted <strong>44%</strong> on yet another provider clipped slate, with one-fifth of its attempts lost before judging.</p></li><li><p><strong>Kimi K3</strong> collapsed to last among the incumbents at <strong>36%</strong>, its worst board ever. The slate was clean and the clock caused no trouble. The misses were real, and a majority came on problems the leaders solved. Four boards ago, Kimi cracked the top five. The budget tier gives and takes quickly.</p></li></ul><h2>Why the board moves at all</h2><p><strong>41 of 45</strong> order calls between returning models repeated today, producing a Kendall <strong>&#964; of 0.82</strong>.</p><p>Every returning model in the top seven held its exact position. The only flips came from Kimi&#8217;s fall and the shuffle it caused beneath it.</p><p>Our comparability controls judged today&#8217;s slate level with Friday&#8217;s, and no model tripped the drift check.</p><p>A board this stable, on the same day two new models arrive, gives us the cleanest kind of debut reading. Terra and Luna entered a settled field, so where they landed is likely where they belong, not an artifact of a chaotic morning.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tCcm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tCcm!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!tCcm!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!tCcm!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!tCcm!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tCcm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/07894e14-a9d6-4122-a920-af58b39b835f_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:226638,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209653218?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F07894e14-a9d6-4122-a920-af58b39b835f_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tCcm!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!tCcm!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!tCcm!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!tCcm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe138f3f5-2715-4920-90c8-033a49a4cc8c_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why not just trust the benchmarks you have already seen?</h2><p>Public benchmarks leak into future training runs. Scores inflate and gradually start measuring memorization instead of ability.</p><p>They are also snapshots: true on the day they are taken, and less true every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until this morning.</p><p>That is how we can price a brand new model&#8217;s actual output, including a correct answer for <strong>$0.007</strong>, on the same slate and the same morning as the champion it undercuts.</p><p>Today&#8217;s board consumed roughly <strong>$104 in compute over 13M tokens</strong>.</p><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to reach that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[July's Best Models: Fable owned the first half, Sol owns the momentum]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 31, 2026]]></description><link>https://iijme.substack.com/p/julys-best-models-fable-owned-the</link><guid isPermaLink="false">https://iijme.substack.com/p/julys-best-models-fable-owned-the</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Fri, 31 Jul 2026 15:35:59 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!8zg-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8zg-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8zg-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!8zg-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!8zg-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!8zg-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8zg-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f1fddecd-b243-4cb8-8651-befd88be05fa_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1646624,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209267106?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff1fddecd-b243-4cb8-8651-befd88be05fa_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8zg-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!8zg-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!8zg-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!8zg-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F79f807bd-32da-46c1-8811-fbd4011b78e5_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3></h3><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>72%</strong>, a fifth straight crown to close the month, with a winning record against all nine rivals.</p></li><li><p><strong>Cheapest closed model: also Sol.</strong> <strong>$0.21 per correct answer</strong>, the cheapest results on the board outright for the third day out of four. Grok&#8217;s discount sticker is within a cent, but its solve rate is 17 points lower.</p></li><li><p><strong>Best open weights model: Nemotron 3 Ultra.</strong> <strong>53%</strong>, holding the open lead for a second day as Kimi continues to slide.</p></li><li><p><strong>Steady top, busy middle.</strong> <strong>39 of 45</strong> ordering calls between returning models repeated today (<strong>&#964; = 0.73</strong>). The top three seats have not moved in three days.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> July&#8217;s crown ledger closed at <strong>nine apiece for Fable 5 and Sol</strong>, with four for GPT 5.5. Every one of Fable&#8217;s crowns came in the first half of July. Every one of Sol&#8217;s came after.</p></li></ul><h2>What to do with today&#8217;s board</h2><p>Month end is a fair moment to zoom out.</p><p>The GPT pair has locked out the top two seats for six straight boards. Sol has been the best, and usually the cheapest, model on the table for two weeks. Nothing in today&#8217;s data argues against making it your default going into August.</p><p>The month&#8217;s other lesson is about launches. Two flagships debuted in July, and the board now has one of them oscillating around the middle of the table and the other off the roster entirely.</p><p>Opus 5 answered the question we left it yesterday, whether it could post a second strong board, with a six point retreat and a three seat slide. The second look it earned on Wednesday goes back on the shelf.</p><p>If you want Anthropic, the answer remains Fable, at a price.</p><p>That&#8217;s our read. Argue with it. Tomorrow&#8217;s board opens a new month to prove it wrong.</p><p>Two stories lead today&#8217;s board. The rest are quick hits.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!AkyY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!AkyY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!AkyY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!AkyY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!AkyY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!AkyY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png" width="1456" height="932" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/58f3bae6-68ba-41b5-87d5-e53e3a880d81_1800x1152.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:932,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:194724,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209267106?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58f3bae6-68ba-41b5-87d5-e53e3a880d81_1800x1152.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!AkyY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!AkyY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!AkyY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!AkyY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce3a7d04-3821-440d-8734-5fcc40ac5c37_1800x1152.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>1. The month the crown changed dynasties</h2><p>Sol&#8217;s fifth straight crown closed July&#8217;s ledger at <strong>nine crowns for Fable, nine for Sol, and four for GPT 5.5</strong>.</p><p>The split could not be more lopsided in time. Fable&#8217;s reign belonged to the first half of the month, and it has not worn the crown since. Sol&#8217;s nine include the last five boards without interruption, four of them while also posting the cheapest results on the table.</p><p>Today was typical of the streak:</p><ul><li><p><strong>72% solve rate</strong></p></li><li><p>A winning record against every rival</p></li><li><p>Significant margins over the budget half of the board</p></li><li><p><strong>10&#8211;2 over Opus 5</strong> (<strong>p = 0.04</strong>)</p></li><li><p>A <strong>5&#8211;4 squeaker over GPT-5.5</strong>, preserving the GPT one-two for a sixth straight day</p></li></ul><p>Dynasties on this board have ended abruptly before. Fable&#8217;s ended the morning after it looked permanent.</p><p>But right now, the gap between Sol and everything not named GPT 5.5 is the most dependable fact we measure.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!mdRb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mdRb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!mdRb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!mdRb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!mdRb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!mdRb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/abd48e15-b360-486c-a79e-54c643d925b9_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:157176,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209267106?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fabd48e15-b360-486c-a79e-54c643d925b9_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!mdRb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!mdRb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!mdRb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!mdRb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff5e180ca-9331-4922-b74f-3df8f17d24a5_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. Opus 5 could not do it twice</h2><p>Yesterday, we wrote that Opus 5&#8217;s first strong board needed a second one before it meant anything.</p><p>Today answered:</p><ul><li><p><strong>52%</strong>, down six points</p></li><li><p>Three seats back to <strong>#7</strong></p></li><li><p>A statistically significant deficit to Sol again, <strong>2&#8211;10</strong> (<strong>p = 0.04</strong>)</p></li></ul><p>The fair share of the drop is smaller than it looks, since our comparability controls read today&#8217;s slate as a few points stiffer for everyone. But even after that correction, Opus gave back real ground.</p><p>Its six-board line now reads:</p><p><strong>57, 55, 45, 48, 59, 52</strong></p><p>That looks less like a trajectory and more like a level: a model that belongs in the low fifties, wobbling on either side of it.</p><p>At <strong>$0.95 per correct answer</strong>, only its own stablemate is a worse deal on the board today.</p><p>Anthropic&#8217;s premium tier goes into August with Fable holding the podium and the newer flagship holding a question mark.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!RePn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!RePn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!RePn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!RePn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!RePn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!RePn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fd85476b-621e-4079-b54a-c18bc198e4cc_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:205340,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209267106?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd85476b-621e-4079-b54a-c18bc198e4cc_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!RePn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!RePn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!RePn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!RePn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4cfd86e4-8160-4dbd-83b3-ce225c009199_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><h2>The anatomy of a 27%</h2><p>GLM-5.2&#8217;s worst board of the month is a rare specimen: all three failure modes at once.</p><p>A fifth of its attempts ran out the clock. Its provider dropped or errored another fifth, shortening the slate it was even judged on. Of the misses it earned honestly, a majority were problems the leaders solved.</p><p>Any one of those is a bad day. All three stacked together is how a model that scored in the forties twice this week lands at <strong>27%</strong>.</p><p>The prescription is different for each part, which is why we decompose the result instead of simply reading the number:</p><ul><li><p>The <strong>clock failures</strong> belong to the model.</p></li><li><p>The <strong>capability misses</strong> belong to the model.</p></li><li><p>The <strong>dropped slate</strong> belongs to the provider.</p></li><li><p>None of the three belongs to the exam, because the same slate handed Sol its fifth straight crown.</p></li></ul><h2>Quick hits</h2><ul><li><p><strong>GPT-5.5</strong> logged <strong>70%</strong>, its sixth straight top-two finish. It has quietly finished within three points of Sol on four of the last five boards. The duopoly is two models, not one model and its shadow.</p></li><li><p><strong>Fable 5</strong> held <strong>#3 at 62%</strong>, its fifth straight podium to close the month it began as champion. It remains the priciest model on the board, though its <strong>$0.97 per correct answer</strong> is its best rate in a week.</p></li><li><p><strong>Gemini 3.6 Flash</strong> reclaimed <strong>#4 at 57%</strong> and the stopwatch. Its typical latency was <strong>73 seconds</strong>, fastest on the board for the sixth time in seven days.</p></li><li><p><strong>Grok 4.5</strong> rebounded four seats to <strong>#5 at 55%</strong> and fixed its reliability overnight. Yesterday&#8217;s abandoned-attempt pile shrank to almost nothing. Its week reads <strong>52, 48, 46, 55</strong>.</p></li><li><p><strong>Nemotron 3 Ultra</strong> held the open-weights lead at <strong>53%</strong>, despite a provider hiccup trimming its slate around the edges.</p></li><li><p><strong>Qwen 3.7 Max</strong> slid to <strong>48%</strong>, with a quarter of its attempts running out the clock. It remains the board&#8217;s slowest model at a typical <strong>734 seconds</strong>.</p></li><li><p><strong>Kimi K3</strong> extended its slide to <strong>45%</strong>, three boards removed from its top-five breakthrough. Its week reads <strong>52, 50, 49, 45</strong>: a slow leak, not a collapse.</p></li></ul><h2>Why the board moves at all</h2><p><strong>39 of 45</strong> ordering calls between returning models repeated today (<strong>&#964; = 0.73</strong>).</p><p>For a third straight day, every flip happened below the podium:</p><ul><li><p>Grok rose four places.</p></li><li><p>Gemini rose two.</p></li><li><p>Opus 5 fell three.</p></li></ul><p>Scores dipped a few points across most of the field, and our comparability controls attribute that decline to a slightly stiffer slate rather than deterioration in the models.</p><p>That is the mirror image of yesterday&#8217;s correction, applied in the opposite direction.</p><p>The symmetry is the point of measuring it at all. A friendlier morning should not manufacture a comeback story, and a stiffer one should not invent a collapse.</p><p>What survives both corrections this week is the same picture: two GPTs on top, a settled podium, and a second tier that reshuffles daily.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!MVMi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!MVMi!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!MVMi!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!MVMi!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!MVMi!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!MVMi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/93f4f09b-3588-4d2a-9c6a-ea761a1bc188_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:159794,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209267106?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F93f4f09b-3588-4d2a-9c6a-ea761a1bc188_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!MVMi!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!MVMi!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!MVMi!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!MVMi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8df428a4-264a-4ad6-ae23-35afe2fa92fb_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into future training runs, so scores inflate and gradually start measuring memorization instead of ability.</p><p>They are also snapshots: accurate on the day they are taken, then less representative every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until this morning.</p><p>That is what makes a month-long ledger meaningful: a crown race that finished nine apiece at the top, measured across twenty-three different exams that no model saw twice.</p><p><em>Today&#8217;s board used approximately <strong>$107 in compute over 11.5M tokens</strong>.</em></p><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Even peak Opus 5 cannot catch GPT 5.5, Grok 4.5 Descends the Ranks]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 30, 2026]]></description><link>https://iijme.substack.com/p/even-peak-opus-5-cannot-catch-gpt</link><guid isPermaLink="false">https://iijme.substack.com/p/even-peak-opus-5-cannot-catch-gpt</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Thu, 30 Jul 2026 15:43:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!lytV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!lytV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!lytV!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!lytV!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!lytV!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!lytV!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!lytV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/68e05c8b-9fe1-4935-852d-ebb33583d429_1254x1254.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:666718,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209129627?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F68e05c8b-9fe1-4935-852d-ebb33583d429_1254x1254.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!lytV!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!lytV!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!lytV!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!lytV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e035480-e263-4dd2-9e0e-bb8d4607e96c_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>74%</strong>, a fourth straight crown and an eighth overall, with a winning record against all nine rivals.</p></li><li><p><strong>Cheapest closed model: Grok 4.5, on the sticker.</strong> Its correct answers cost <strong>$0.18</strong> each, but at a 46% solve rate, Sol remains the better buy. Its results cost three cents more and land 28 points higher.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra.</strong> <strong>58%</strong>, a five-seat surge that takes the open lead back from Kimi after two days.</p></li><li><p><strong>Churny middle, steady ends.</strong> <strong>34 of 45</strong> order calls between returning models repeated today, with <strong>&#964; = 0.51</strong>. The top three stayed frozen while every position from 4th through 9th moved.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> Sol did not miss a single problem that another model solved. Every problem it missed was failed by the entire board. Relative to the field, you cannot do better than that.</p></li></ul><h2>What to do with today&#8217;s board</h2><p>The headline decision belongs to Anthropic.</p><p>Opus 5 posted its best board yet, finishing <strong>#4 at 59%</strong>, beating Gemini for the first time and escaping the significant deficits it carried throughout launch week. If you shelved it after its first few boards, today offers the first real argument for taking another look, with one important caveat discussed below.</p><p>Fable still beat it head-to-head, and both GPTs remain ahead on performance and price. Even on Opus 5&#8217;s best day, the pecking order holds: Sol first, GPT-5.5 second, then decide whether Anthropic loyalty is worth the premium.</p><p>Gemini remains the speed pick. Its fall to sixth still came with the fastest answers on the board, a typical <strong>75 seconds</strong>.</p><p>Grok owns the cheapest sticker, but it also had its worst reliability day of the month. Treat that <strong>$0.18</strong> as a sale price on a model that did not show up today.</p><p>That is our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dv-f!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dv-f!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!dv-f!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!dv-f!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!dv-f!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!dv-f!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png" width="1456" height="932" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d5952305-4150-4bb6-815c-d3554754c309_1800x1152.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7871642d-9931-4108-9930-013fcd4a3bfd_1800x1152.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:932,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:197012,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209129627?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7871642d-9931-4108-9930-013fcd4a3bfd_1800x1152.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!dv-f!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!dv-f!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!dv-f!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!dv-f!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5952305-4150-4bb6-815c-d3554754c309_1800x1152.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest are quick hits.</p><h2>1. Opus 5&#8217;s best board, with an asterisk it half-earns</h2><p>Five boards: <strong>57%, 55%, 45%, 48%, and now 59%</strong>.</p><p>The jump is real on the scoreboard. Opus climbed three seats to <strong>#4</strong>, finished above Gemini for the first time, and erased the statistically significant deficits to Sol and GPT-5.5 that defined its week. Today&#8217;s head-to-head records were <strong>1-7 against Sol</strong> and <strong>3-8 against GPT-5.5</strong>, neither statistically significant.</p><p>The asterisk is slate difficulty.</p><p>Our comparability controls indicate that today&#8217;s problems were slightly friendlier than yesterday&#8217;s, and most of the field rose with them. Opus 5&#8217;s improvement exceeded the field-wide lift, which is the part it earned.</p><p>What it has not earned yet is a flagship&#8217;s place in the hierarchy.</p><p>Fable still won their head-to-head <strong>4-2</strong>. Both GPTs still sit above Opus on results while delivering correct answers at roughly half the realized price. One strong board after four soft ones is still only one data point.</p><p>The trendline argument we made two days ago cuts both ways. Now Opus needs a second board like this one.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pjQl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pjQl!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!pjQl!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!pjQl!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!pjQl!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pjQl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4bef7737-1e7d-4ce0-bcf7-d8cf9f084baa_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:201658,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209129627?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4bef7737-1e7d-4ce0-bcf7-d8cf9f084baa_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pjQl!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!pjQl!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!pjQl!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!pjQl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F09fad510-75af-4e8e-9552-ac1d48d553fe_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. Four crowns in a row, and a perfect miss profile</h2><p>Sol&#8217;s <strong>74%</strong> came with something we have not measured before: not one of its misses was a problem another model solved.</p><p>The entire board went zero-for on every problem Sol dropped.</p><p>Otherwise, its sweep of the field looked familiar. Sol posted winning records against all nine rivals, including significant margins over the budget half of the board:</p><ul><li><p><strong>13-2 over Grok</strong>, with <strong>p = 0.007</strong></p></li><li><p><strong>10-0 over Kimi</strong></p></li></ul><p>GPT-5.5 kept the race close again, losing the direct comparison <strong>3-2</strong>, and quietly logged another strong day at <strong>72%</strong>.</p><p>The pair have now locked out the top two seats for five straight days. The GPT duopoly has become the most stable fact on the board.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!VZsk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!VZsk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!VZsk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!VZsk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!VZsk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!VZsk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png" width="1456" height="1077" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1a54781e-b54c-4a33-9b9c-38ecda62002f_1800x1332.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1077,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:259062,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209129627?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a54781e-b54c-4a33-9b9c-38ecda62002f_1800x1332.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!VZsk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!VZsk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!VZsk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!VZsk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F386a2e0d-a00d-4b16-bd5f-4ee2885f8b66_1800x1332.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The anatomy of a recovery</h2><p>Opus 5&#8217;s jump decomposes cleanly.</p><p>Its clock problem stayed fixed. For a second straight day, barely any attempts were lost to the deadline, following the reliability wobble earlier in the week.</p><p>Its wrong answers also improved. Yesterday, roughly half of its misses were on problems that the leaders solved. Today, that number fell to about a third. In other words, the problems Opus missed were more often the problems that stumped everyone. That is the signature of a stronger day, not merely a luckier one.</p><p>Its speed held too, at a typical <strong>123 seconds</strong>, second-fastest among the leaders.</p><p>Grok&#8217;s collapse is the same decomposition in reverse. Nearly a fifth of its attempts died to the clock, and a majority of its misses came on problems the leaders solved.</p><p>One model closed both gaps at once. The other opened both.</p><h2>Quick hits</h2><ul><li><p><strong>Fable 5</strong> held <strong>#3 at 64%</strong>, earning its fourth straight podium. It remains the board&#8217;s most expensive model at <strong>$1.28 per correct answer</strong>, roughly six times Sol&#8217;s rate.</p></li><li><p><strong>Nemotron 3 Ultra</strong> surged five seats to <strong>#5 at 58%</strong>, its best board this month, and reclaimed the open-weights lead. Its recurring provider errors barely affected today&#8217;s run.</p></li><li><p><strong>Qwen 3.7 Max</strong> matched its best score of the month at <strong>56%</strong>, while remaining the board&#8217;s slowest model at a typical <strong>863 seconds</strong>. Nearly a quarter of its attempts ran out the clock.</p></li><li><p><strong>Kimi K3</strong> gave back its rebound, falling three seats to <strong>#8 at 49%</strong>. Two strong boards followed by one soft one leave the open-weights race with Nemotron looking like a week-to-week coin flip.</p></li><li><p><strong>Grok 4.5</strong> fell to <strong>#9 at 46%</strong>, with its worst reliability day of the month. The cheapest sticker on the board also bought the most abandoned attempts.</p></li><li><p><strong>GLM-5.2</strong> brought up the rear at <strong>42%</strong>, on another slate clipped by provider errors and carrying another asterisk.</p></li><li><p><strong>Roster note:</strong> Inkling sat out today&#8217;s board after three consecutive finishes in the basement.</p></li></ul><h2>Why the board moves at all</h2><p><strong>34 of 45</strong> order calls between returning models repeated today, producing <strong>&#964; = 0.51</strong>.</p><p>The churn was concentrated entirely in the middle:</p><ul><li><p>Nemotron rose five seats.</p></li><li><p>Opus 5 rose three.</p></li><li><p>Kimi fell three.</p></li><li><p>Grok fell three.</p></li></ul><p>The top three positions did not move for a second straight day.</p><p>Scores increased across most of the field at once, and our comparability controls attribute most of that lift to the slate rather than the models. That correction is essential before interpreting Opus 5&#8217;s jump, and it is why we apply it.</p><p>A churny middle beneath a frozen top is the board sorting its second tier, not questioning its first.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8pNK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8pNK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!8pNK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!8pNK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!8pNK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8pNK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f3828e60-1fc9-462d-8dec-ef5dfe1cc1c5_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:155328,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/209129627?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff3828e60-1fc9-462d-8dec-ef5dfe1cc1c5_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8pNK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!8pNK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!8pNK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!8pNK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fff5e2c25-71b1-4a7c-ba81-c4ea07a532cc_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into future training runs. Scores inflate, and the benchmark gradually measures memorization instead of ability.</p><p>They are also snapshots: accurate on the day they are taken, and increasingly wrong every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until this morning. When a day&#8217;s slate is friendlier or more difficult than usual, we measure that too and correct for it before crediting a model&#8217;s jump.</p><p>Today&#8217;s board required <strong>$110.91 in compute over 12M tokens</strong>.</p><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to reach that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Kimi K3 is hot. Gemini 3.6 is available]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 29, 2026]]></description><link>https://iijme.substack.com/p/kimi-k3-is-hot-gemini-36-is-available</link><guid isPermaLink="false">https://iijme.substack.com/p/kimi-k3-is-hot-gemini-36-is-available</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Wed, 29 Jul 2026 15:34:57 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Xw5W!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Xw5W!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Xw5W!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!Xw5W!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!Xw5W!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!Xw5W!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Xw5W!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f9e4220f-a8f7-4e24-bff0-69b582bdf01d_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:747348,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208988557?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff9e4220f-a8f7-4e24-bff0-69b582bdf01d_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Xw5W!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!Xw5W!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!Xw5W!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!Xw5W!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F733b2765-ab05-49d2-8088-cb5aa7b6f598_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> A <strong>70%</strong> solve rate delivered its third consecutive crown and seventh overall. Sol posted a winning record against all ten rivals, with statistically significant margins over seven.</p></li><li><p><strong>Cheapest closed model: also Sol, again.</strong> At <strong>$0.21 per correct answer</strong>, Sol produced the board&#8217;s cheapest results for a second straight day. Grok finished two cents behind while solving far fewer problems.</p></li><li><p><strong>Best open-weights model: Kimi K3.</strong> A <strong>50%</strong> solve rate secured the open lead for a second day and put Kimi in the top five for the first time.</p></li><li><p><strong>The calmest board we have measured.</strong> <strong>51 of 55</strong> order calls between returning models repeated, producing <strong>&#964; = 0.85</strong>. The top four seats did not move at all.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> Inkling has doubled its debut score across three boards, from <strong>5% to 10%</strong>. At this rate, it reaches the middle of the table sometime in September. It is still last and still lost to every model on the board.</p></li></ul><div><hr></div><h2>What to do with today&#8217;s board</h2><p>Nothing changed at the top, which is itself the finding.</p><p>After a week of dethronings, debuts, and collapses, the market finally gave you a stable answer:</p><ul><li><p><strong>Sol</strong> is the pick on both results and price.</p></li><li><p><strong>GPT-5.5</strong> is the cautious second choice.</p></li><li><p><strong>Fable 5</strong> is the Anthropic pick, at a substantial premium.</p></li><li><p><strong>Gemini 3.6 Flash</strong> is the speed pick, one notch down on capability.</p></li></ul><p>If you spent the last week waiting for the churn to settle before committing a workload, this is what settled looks like.</p><p>The quiet board also sharpens one decision. Opus 5 arrested its slide at <strong>48%</strong>, but four boards in, it has yet to finish above its own house&#8217;s alternative. It also continues to lose to both GPTs by significant margins.</p><p>Waiting for board five is no longer caution. It is a choice.</p><p>That&#8217;s our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!C80m!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!C80m!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!C80m!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!C80m!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!C80m!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!C80m!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png" width="1456" height="1003" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0027295c-de10-4cac-a9f6-b813ee2c9757_1800x1240.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1003,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:208174,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208988557?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0027295c-de10-4cac-a9f6-b813ee2c9757_1800x1240.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!C80m!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!C80m!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!C80m!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!C80m!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1c88b922-fef0-4af6-8303-5df0784b2d92_1800x1240.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest are quick hits.</p><div><hr></div><h2>1. Seven crowns, and the misses that prove it</h2><p>Sol&#8217;s third straight crown came at <strong>70%</strong>, accompanied by the usual sweep: winning records against all ten rivals and statistically significant margins against seven.</p><p>That included:</p><ul><li><p><strong>10&#8211;1 over Opus 5</strong> <em>(p = 0.01)</em></p></li><li><p><strong>24&#8211;0 over Inkling</strong></p></li></ul><p>The sharper evidence, however, is in what the leaders got wrong.</p><p>Sol and GPT-5.5 each missed only a handful of problems today, and those misses were almost entirely problems that nobody on the board solved. The two GPTs are not dropping problems the field can handle. They are being stopped only where everyone is stopped.</p><p>Contrast that with the bottom half of the table, where at least a third of each model&#8217;s misses came on problems the leaders successfully cleared.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!g5iQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!g5iQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!g5iQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!g5iQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!g5iQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!g5iQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png" width="1456" height="1168" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d8e767ab-eb47-4fcc-add8-36816a03563c_1800x1444.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1168,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:276554,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208988557?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8e767ab-eb47-4fcc-add8-36816a03563c_1800x1444.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!g5iQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!g5iQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!g5iQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!g5iQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bd316fe-6758-4a6c-a5b6-54b07ef47873_1800x1444.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. Opus 5 stops falling, which is not the same as recovering</h2><p><strong>Board four: 48%. One seat gained. Slide arrested.</strong></p><p>The good news for Anthropic&#8217;s newest flagship ends there.</p><p>Opus 5 still:</p><ul><li><p>Lost <strong>1&#8211;10 to Sol</strong>, a significant margin</p></li><li><p>Lost <strong>1&#8211;9 to GPT-5.5</strong>, also significant</p></li><li><p>Went <strong>0&#8211;5 against Fable 5</strong> <em>(p = 0.06)</em></p></li></ul><p>Its four-board line now reads:</p><blockquote><p><strong>57% &#8594; 55% &#8594; 45% &#8594; 48%</strong></p></blockquote><p>That looks less like a temporary stumble and more like a model that has found its level. That level is the middle of the table.</p><p>Opus remains quick, with a typical solve time of <strong>129 seconds</strong>, and it reduced its clock losses from yesterday. But it is priced against the flagships while solving against the middle of the field.</p><p>One seat of recovery on the calmest day of the week is thin evidence of a turnaround.</p><p>What would change the story is a board above Fable. Opus 5 has not come close to one yet.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Hb7o!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Hb7o!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!Hb7o!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!Hb7o!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!Hb7o!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Hb7o!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/840d938b-3c6c-4858-90b2-988fa838800a_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:213553,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208988557?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F840d938b-3c6c-4858-90b2-988fa838800a_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Hb7o!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!Hb7o!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!Hb7o!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!Hb7o!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa66d7e59-7cc8-42d7-a7e8-cb8d82b7afab_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Quick hits</h2><h3>GPT-5.5 remains the closest challenger</h3><p>GPT-5.5 held <strong>#2 at 68%</strong>, recording its fourth top-two finish in five boards. The sibling gap was <strong>1&#8211;2</strong> today, about as close to a tie as the math allows.</p><h3>Fable holds its seat, but not its value</h3><p>Fable 5 slipped to <strong>60%</strong> but retained third place. Its results remain the most expensive on the board at <strong>$1.27 per correct answer</strong>, roughly six times Sol&#8217;s rate.</p><h3>Gemini still owns the clock</h3><p>Gemini 3.6 Flash held <strong>#4 at 57%</strong> and remained the board&#8217;s fastest model, with a typical solve time of <strong>75 seconds</strong>.</p><p>Five boards in, Gemini&#8217;s latency floor looks like everyone else&#8217;s ceiling.</p><h3>Kimi K3 confirms the rebound</h3><p>Kimi K3 reached <strong>50%</strong>, climbed one seat to fifth, and recorded its first top-five finish. It also retained the open-weights lead for a second consecutive day.</p><h3>Qwen keeps the slowest-model title</h3><p>Qwen 3.7 Max held at <strong>45%</strong>, with roughly one-fifth of its attempts running out the clock.</p><h3>GLM improves, with another provider asterisk</h3><p>GLM-5.2 improved to <strong>43%</strong> on another provider-shortened slate. It was the model&#8217;s second-highest score this month, once again accompanied by an asterisk it did not earn itself.</p><h3>Inkling reaches double digits</h3><p>Inkling climbed to <strong>10%</strong> on its third board, its best result yet. It still posted a losing record against every model and remains farther from the leaders than anything else we track.</p><div><hr></div><h2>Why the board moves at all</h2><p>Today, it mostly did not.</p><p><strong>51 of 55</strong> order calls between returning models repeated, producing <strong>&#964; = 0.85</strong>, the highest stability we have recorded. The only four flips were single-seat swaps in the middle of the table.</p><p>Scores drifted down by a few points across nearly the entire field. Our comparability controls attribute that dip to the models and their serving conditions rather than to a harder problem set. It is the same quiet variance that moves every model slightly on any given day.</p><p>A stable board is what makes the volatile ones meaningful.</p><p>When the same measurement produces a four-way tie one week and a frozen top four the next, you are watching the models change, not the ruler.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PFnC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PFnC!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!PFnC!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!PFnC!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!PFnC!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!PFnC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6960427c-4095-4626-953f-d4c9687c5b68_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:169274,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208988557?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6960427c-4095-4626-953f-d4c9687c5b68_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PFnC!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!PFnC!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!PFnC!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!PFnC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff2af8ef8-5c8a-4184-b169-fc46bed8c401_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into subsequent training runs. Scores inflate and gradually begin measuring memorization instead of ability.</p><p>They are also snapshots: true on the day they are taken, and less representative every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until this morning.</p><p>That is why a stable week means something here. The order held across five consecutive sets of problems that no model had ever seen, not five reruns of the same exam.</p><p><strong>Today&#8217;s board consumed $114.77 in compute.</strong></p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to achieve that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Opus 5 Has a Trendline Now, and It Points Straight Down]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 28, 2026]]></description><link>https://iijme.substack.com/p/opus-5-has-a-trendline-now-and-it</link><guid isPermaLink="false">https://iijme.substack.com/p/opus-5-has-a-trendline-now-and-it</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Tue, 28 Jul 2026 15:10:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!UkVY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!UkVY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!UkVY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 424w, https://substackcdn.com/image/fetch/$s_!UkVY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 848w, https://substackcdn.com/image/fetch/$s_!UkVY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!UkVY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!UkVY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png" width="1448" height="1086" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1086,&quot;width&quot;:1448,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2602549,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208841928?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!UkVY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 424w, https://substackcdn.com/image/fetch/$s_!UkVY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 848w, https://substackcdn.com/image/fetch/$s_!UkVY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!UkVY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8603d5f3-9c4a-471e-aef3-7f36c96819bc_1448x1086.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>75%</strong> for a second straight day and a sixth crown overall, with a winning record against every rival and statistical separation from more than half the board.</p></li><li><p><strong>Cheapest closed model: also Sol.</strong> <strong>$0.21 per correct answer</strong>, the cheapest result on the entire board. The best model is currently also the best deal, which does not happen often.</p></li><li><p><strong>Best open-weights model: Kimi K3.</strong> <strong>52%</strong>, a five seat rebound from its worst board, taking the open lead from Nemotron.</p></li><li><p><strong>Steady up top, churn below.</strong> <strong>48 of 55</strong> order calls between returning models repeated, for a <strong>Kendall &#964; of 0.75</strong>, with most of the movement concentrated in the middle.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> Opus 5&#8217;s slide has a trendline now. Three boards: <strong>57%, 55%, 45%</strong>. Today, its deficits to both GPTs and its own stablemate Fable became statistically significant, including a <strong>0&#8211;9</strong> blanking by Fable.</p></li></ul><div><hr></div><h2>What to do with today&#8217;s board</h2><p>Sol needs no caveats today: best results, cheapest results, near fastest, and six crowns in nine boards.</p><p>If you are running anything else for this class of work, the burden of proof has flipped to the anything else.</p><p>The Anthropic story has inverted. Fable 5 is the house&#8217;s standard-bearer at <strong>#3 with a 68% solve rate</strong>, and it beat the newer, cheaper Opus 5 nine problems to zero. If you migrated from Opus 4.8 to Opus 5 during launch week, these three boards say to migrate back or sideways to Fable.</p><p>Kimi K3 is the quiet value note: back to <strong>52%</strong> at <strong>$0.24 per correct answer</strong>, making it the best open-weights buy today.</p><p>And Inkling&#8217;s second board, at <strong>8%</strong>, confirms its first.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dR7C!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dR7C!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!dR7C!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!dR7C!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!dR7C!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!dR7C!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png" width="1456" height="1003" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8b471a44-01a4-4556-a327-10b3fa4d6869_1800x1240.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1003,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:212553,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208841928?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b471a44-01a4-4556-a327-10b3fa4d6869_1800x1240.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!dR7C!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!dR7C!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!dR7C!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!dR7C!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F73301594-d97d-485d-9104-8722dff6fa3b_1800x1240.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest are quick hits.</p><div><hr></div><h2>1. Six crowns, and the cheapest seats in the house</h2><p>Sol repeated at <strong>75%</strong> and separated further from the field: a winning record against all ten rivals and statistically significant margins over seven of them.</p><p>Those margins ranged from <strong>13&#8211;1 against Opus 5</strong>, with <strong>p = 0.002</strong>, down through the budget half of the board.</p><p>Against its closest peers, the gaps stayed friendly but consistent:</p><ul><li><p><strong>5&#8211;2</strong> over Fable 5</p></li><li><p><strong>4&#8211;2</strong> over GPT-5.5</p></li><li><p><strong>7&#8211;2</strong> over Gemini 3.6 Flash</p></li></ul><p>What makes this crown different from the five before it is the price column.</p><p>At <strong>$0.21 per correct answer</strong>, Sol delivered the cheapest results on the board, beating models that solved barely half as much.</p><p>When the accuracy leader is also the value leader, the usual capability-versus-cost tradeoff disappears. The Pareto chart below is one dot followed by excuses.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!wivX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!wivX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!wivX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!wivX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!wivX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!wivX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7b43026b-410f-4f90-b484-ac71dfba04dd_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:211623,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208841928?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7b43026b-410f-4f90-b484-ac71dfba04dd_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!wivX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!wivX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!wivX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!wivX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5904d60b-64cd-4555-8684-d153f0cba14d_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. Opus 5&#8217;s trendline points the wrong way</h2><p><strong>Board one:</strong> 57%, soft debut.<br><strong>Board two:</strong> 55%, benefit of the doubt.<br><strong>Board three:</strong> <strong>45%</strong>, and the doubt is gone.</p><p>The deficits that were merely suggestive are now statistically significant:</p><ul><li><p><strong>1&#8211;13 against Sol</strong>, p = 0.002</p></li><li><p><strong>2&#8211;12 against GPT-5.5</strong>, p = 0.01</p></li><li><p><strong>0&#8211;9 against Fable 5</strong>, p = 0.004</p></li></ul><p>That Fable result marks the first time this month one flagship has blanked another.</p><p>Our comparability controls read today&#8217;s slate as level with yesterday&#8217;s, and no model tripped the drift check. This is therefore a story about the model and its serving, not the exam.</p><p>With Opus 4.8 off today&#8217;s roster, the awkward direct comparison is gone, but the conclusion is not: Anthropic&#8217;s newest model is currently its weakest ranked offering, at a price that only undercuts its own stablemates.</p><p>Three boards is a pattern. Tomorrow tells us whether it holds.</p><div><hr></div><h2>The anatomy of a 45%</h2><p>Opus 5&#8217;s slide decomposes into two failure modes, and neither flatters it.</p><p>First, straightforward wrong answers. <strong>Half of its misses came on problems that a majority of the leaders solved</strong>, up from its debut. The gap is not the slate getting harder.</p><p>Second, a new clock problem. A tenth of its attempts ran out the time budget today, its worst showing there yet, even though its completed answers stayed fast at a typical <strong>105 seconds</strong>.</p><p>Fast when it finishes, wrong too often when it does, and now not always finishing. That is a capability problem with a reliability problem stacked on top.</p><p>Contrast that with Kimi K3, whose rebound came the honest way: one lost attempt all day, quick answers, and misses concentrated on the problems everyone found difficult.</p><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>GPT-5.5</strong> climbed back to <strong>#2 at 70%</strong>, restoring the GPT one-two. The sibling gap remained a coin flip at <strong>2&#8211;4</strong>, but the pair has now owned the top of the board for two consecutive days.</p></li><li><p><strong>Fable 5</strong> added ten points across two boards to reach <strong>#3 at 68%</strong>, its best finish in a week, though it still produced the priciest results at <strong>$0.98 per correct answer</strong>.</p></li><li><p><strong>Gemini 3.6 Flash</strong> cooled to <strong>#4 at 62%</strong>, while remaining the fastest model on the board at a typical <strong>79 seconds</strong>. This looks more like regression than a slide; its four-board average still beats everything below the GPTs.</p></li><li><p><strong>Grok 4.5</strong> reached <strong>#5 at 55%</strong>, but one in eight attempts ran out the clock, its worst reliability day this month.</p></li><li><p><strong>Qwen 3.7 Max</strong> matched Kimi at <strong>52%</strong>, yet remained the board&#8217;s slowest model at a typical <strong>899 seconds</strong>, with nearly a quarter of its attempts dying to the clock.</p></li><li><p><strong>GLM-5.2</strong> fell to <strong>32%</strong>, with a third of its slate lost to the clock rather than wrong answers. Different failure, same unusable result.</p></li><li><p><strong>Inkling</strong> improved to <strong>8%</strong> on board two. It also picked up a new habit: one-sixth of its attempts now run out the clock, which did not happen during its debut. Two boards, no case for a workload yet.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yq6X!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yq6X!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!yq6X!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!yq6X!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!yq6X!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yq6X!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6e66b14d-c74e-4041-8cc1-dcca7133c3b8_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:165732,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208841928?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e66b14d-c74e-4041-8cc1-dcca7133c3b8_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!yq6X!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!yq6X!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!yq6X!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!yq6X!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F314b704b-4e9b-45c3-aa43-13799db8b52f_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Why the board moves at all</h2><p><strong>48 of 55</strong> order calls between returning models repeated today, producing a <strong>Kendall &#964; of 0.75</strong>.</p><p>The seven flipped comparisons live almost entirely in the middle of the table:</p><ul><li><p>Kimi rebounded five seats.</p></li><li><p>GPT-5.5 and Fable each climbed two.</p></li><li><p>Gemini and Opus 5 gave seats back.</p></li></ul><p>The top seat did not move. Neither did the bottom one.</p><p>Our comparability controls read the slate as level with yesterday&#8217;s, and no model tripped the drift check. The mid-table churn therefore looks like serving variation and ordinary day-to-day variance doing what they do.</p><p>Meanwhile, the two ends of the board, a champion pulling away and a debutant confirming its floor, are about as stable as anything we measure.</p><p>That mix, stable extremes and a restless middle, is what most mornings actually look like.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nr8J!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nr8J!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!nr8J!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!nr8J!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!nr8J!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!nr8J!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2cd90920-013f-478d-aee8-4922db3f27b6_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:166988,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208841928?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2cd90920-013f-478d-aee8-4922db3f27b6_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!nr8J!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!nr8J!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!nr8J!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!nr8J!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9117803-b707-415f-98b8-54ab6f9314e1_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, causing scores to inflate until they begin measuring memorization instead of ability.</p><p>They are also snapshots: true on the day they are taken, and less true every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>.</p><p>No model can have trained on a problem that did not exist until this morning. That is how a three board trendline on a brand new flagship can exist at all: the same measurement process, fresh material, three mornings in a row.</p><p>Today&#8217;s board consumed <strong>$102.17 in compute</strong>.</p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Mira Murati’s 1st Model Inkling Lands at 5%]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 27, 2026]]></description><link>https://iijme.substack.com/p/mira-muratis-1st-model-inkling-lands</link><guid isPermaLink="false">https://iijme.substack.com/p/mira-muratis-1st-model-inkling-lands</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Mon, 27 Jul 2026 15:12:24 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pYgz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pYgz!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pYgz!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!pYgz!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!pYgz!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!pYgz!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pYgz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/60344d85-59fe-46d2-9f4c-29131b78551f_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2014691,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208694015?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F60344d85-59fe-46d2-9f4c-29131b78551f_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pYgz!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!pYgz!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!pYgz!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!pYgz!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8778874d-a2a5-4dbe-b7dc-16148a76bf8b_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>75%</strong>, back on top after two days off the throne, and this time it beat every other model head-to-head, the first board in weeks with real separation at #1.</p></li><li><p><strong>Cheapest closed model: Grok 4.5.</strong> <strong>$0.19</strong> per correct answer at 52%, edging Sol and Gemini (both $0.21). At a two-cent spread, the crown is still the better buy.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra.</strong> <strong>42%</strong>, holding the open lead for a fourth board despite a rough day for the whole open field.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> Thinking Machines&#8217; Inkling debuted at <strong>5%</strong>, a twentieth of the champion&#8217;s rate, against every rival&#8217;s double digits. It was fast and cheap about it, which does not help.</p></li></ul><div><hr></div><h2>What to do with today&#8217;s board</h2><p>Sol is the pick today without an asterisk: highest solve rate, a winning record against all twelve rivals, near-cheapest results, and quick. If you standardized on it during the four-crown streak, nothing that happened since should move you.</p><p>Gemini remains the value alternative one notch down, same $0.21 per correct answer, fastest of the leaders.</p><p>On Opus 5, the second board says what the first did, just softer: it climbed to #6 at 55%, still below Opus 4.8, still losing the direct matchup to Sol 2-10. Anthropic loyalists should stay on Opus 4.8 for another board at least.</p><p>And give Inkling a wide berth: at a 5% solve rate, the 93% discount buys you answers you cannot use.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-91g!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-91g!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 424w, https://substackcdn.com/image/fetch/$s_!-91g!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 848w, https://substackcdn.com/image/fetch/$s_!-91g!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 1272w, https://substackcdn.com/image/fetch/$s_!-91g!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!-91g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png" width="1456" height="1145" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/49833cec-0837-4e5e-b92a-16f3faa35f63_1800x1416.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1145,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:242240,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208694015?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F49833cec-0837-4e5e-b92a-16f3faa35f63_1800x1416.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!-91g!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 424w, https://substackcdn.com/image/fetch/$s_!-91g!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 848w, https://substackcdn.com/image/fetch/$s_!-91g!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 1272w, https://substackcdn.com/image/fetch/$s_!-91g!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81431444-3aed-415a-9b05-96ef837729c9_1800x1416.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong>Three stories lead today&#8217;s board; the rest is quick hits.</strong></p><div><hr></div><h2>1. Sol&#8217;s crown, this time with a gap</h2><p>Three days ago the top of the board was a four-way tie and GPT-5.5 held the crown by a single problem.</p><p>Today Sol took it back the emphatic way: <strong>75%</strong>, ten points clear of second place, with a winning record against all twelve rivals.</p><p>The margins against its peers were not coin-flips this time: <strong>7-1</strong> over Fable (p=0.07), <strong>6-1</strong> over Opus 4.8, <strong>7-2</strong> over its sibling GPT-5.5, <strong>10-2</strong> over Opus 5 (p=0.04), and clean sweeps of the budget field topped by <strong>28-0</strong> over the debutant.</p><p>We have measured five Sol crowns now, and this is the first where the gap to the rest of the leaders looks like a gap rather than noise. Whether it holds is tomorrow&#8217;s question; today the board had one best model by a distance.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!N4M8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!N4M8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 424w, https://substackcdn.com/image/fetch/$s_!N4M8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 848w, https://substackcdn.com/image/fetch/$s_!N4M8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 1272w, https://substackcdn.com/image/fetch/$s_!N4M8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!N4M8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png" width="1456" height="1255" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a19c43ba-7b1d-4dca-bd86-6fa6f1e157ed_1800x1552.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1255,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:185128,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208694015?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa19c43ba-7b1d-4dca-bd86-6fa6f1e157ed_1800x1552.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!N4M8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 424w, https://substackcdn.com/image/fetch/$s_!N4M8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 848w, https://substackcdn.com/image/fetch/$s_!N4M8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 1272w, https://substackcdn.com/image/fetch/$s_!N4M8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6d37a551-040f-4d0f-afea-e9d26b60a342_1800x1552.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/p/mira-muratis-1st-model-inkling-lands?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/p/mira-muratis-1st-model-inkling-lands?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p><div><hr></div><h2>2. Inkling debuts at 5%</h2><p>Thinking Machines&#8217; first board is the worst debut we have measured: <strong>5%</strong>, with a losing record against every model on the table, including <strong>2-11</strong> against Muse Spark, the board&#8217;s perennial basement.</p><p>The strange part is how healthy the failure looks. It answered every problem, quickly, a typical <strong>80 seconds</strong>, among the fastest, with substantial, confident output every time. The answers were simply wrong, almost every time.</p><p>And despite the bargain sticker, at <strong>$0.94</strong> per correct answer its results cost more than four times Sol&#8217;s.</p><p>Nothing about the day offers it an excuse, either: it got a full slate, healthy serving, and plenty of clock, and on problems it had never seen it could not hang with a single incumbent.</p><p>You will read a very different account of this model elsewhere this week. We can only tell you what it solved.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dsgN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dsgN!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 424w, https://substackcdn.com/image/fetch/$s_!dsgN!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 848w, https://substackcdn.com/image/fetch/$s_!dsgN!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 1272w, https://substackcdn.com/image/fetch/$s_!dsgN!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!dsgN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png" width="1456" height="1349" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f7afa2c3-9d40-4c21-b45e-b5629ca40583_1800x1668.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1349,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:327224,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208694015?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff7afa2c3-9d40-4c21-b45e-b5629ca40583_1800x1668.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!dsgN!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 424w, https://substackcdn.com/image/fetch/$s_!dsgN!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 848w, https://substackcdn.com/image/fetch/$s_!dsgN!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 1272w, https://substackcdn.com/image/fetch/$s_!dsgN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F200f61d2-6af2-4907-a76a-236548bb23df_1800x1668.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The anatomy of a 5%</h2><p>There are three ways to fail on this board:</p><ol><li><p><strong>Wrong answers</strong></p></li><li><p><strong>The clock</strong></p></li><li><p><strong>Your provider</strong></p></li></ol><p>Today produced a clean specimen of each, and they deserve different reactions.</p><h3>Inkling: the model failed</h3><p>Inkling&#8217;s failure is the first kind, undiluted.</p><p>It finished everything it started, quickly, and got nearly all of it wrong. Just under two thirds of its misses were problems a majority of the leaders solved.</p><p>That pattern points at the model, not the infrastructure.</p><h3>Qwen 3.7 Max: the clock won</h3><p>Qwen 3.7 Max is the second kind.</p><p>When it actually finished, it passed nearly two thirds of the time. But almost a third of its attempts ran out the clock, and those count against it.</p><p>Give it a workload without a deadline and it is a different model.</p><h3>GLM-5.2: the provider failed</h3><p>GLM-5.2 is the third kind.</p><p>Its 40% came on a slate its provider&#8217;s errors cut short, so the number describes the serving as much as the model.</p><p>One of these three earns an <strong>avoid</strong>, one earns a <strong>use-with-patience</strong>, and one earns a <strong>check-back-tomorrow</strong>.</p><p>The scoreboard alone will not tell you which is which; the failure mode does.</p><div><hr></div><h2>3. Opus 5, board two: better, still behind its predecessor</h2><p>Opus 5 climbed two seats to <strong>#6 at 55%</strong>, up from its soft debut.</p><p>The direction is right and some of the detail is encouraging: it was quick again, a typical <strong>107 seconds</strong>, and its results improved where the field&#8217;s mostly slipped.</p><p>But the two comparisons that define its debut have not flipped. It still trails <strong>Opus 4.8</strong>, 62% to 55%, and lost the direct matchup <strong>5-8</strong>. And against the champion it went <strong>2-10</strong>, one of only two significant separations Sol recorded among the leaders.</p><p>Two boards in, the pattern reads: a faster, somewhat cheaper Opus that solves less than the one it replaces. If that is the trade Anthropic intended, the price cut is doing the arguing.</p><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>Gemini 3.6 Flash</strong> held <strong>#2 at 65%</strong>, fastest of the leaders again and tied with Sol on cost per correct answer. Four boards in: one wobble, three strong finishes. It has earned the default-alternative slot.</p></li><li><p><strong>GPT-5.5</strong> gave back the crown with a ten-point slide to <strong>62%</strong>, and lost the sibling matchup 2-7. Its day-one dominance is now a one-day story.</p></li><li><p><strong>Fable 5</strong> parked at <strong>#5 (60%)</strong> again, mid-pack results at nearly the priciest rate on the board. The case for its premium shrinks by the day.</p></li><li><p><strong>Kimi K3</strong> had the roughest day of the returning field, sliding to <strong>35%</strong>, its worst board yet.</p></li><li><p><strong>GLM-5.2</strong> scored 40% on the sharply shortened slate its provider&#8217;s errors left it; read that number with the asterisk it comes with.</p></li><li><p><strong>Qwen 3.7 Max</strong> returned to the board at <strong>45%</strong> and immediately reclaimed its old title: slowest model measured, a typical answer at <strong>653 seconds</strong>.</p></li><li><p><strong>Muse Spark 1.1</strong> logged <strong>30%</strong> on its seventh straight incomplete slate.</p></li></ul><div><hr></div><h2>Why the board moves at all</h2><p><strong>37 of 45</strong> order calls between returning models repeated today (&#964; = 0.64), and the flips sit almost entirely below the podium: Kimi and Nemotron sliding, Opus 5 climbing, GPT-5.5 dropping out of the tie at the top.</p><p>Our comparability controls read today&#8217;s slate as statistically level with the last board, and no model tripped the drift check, so the swings, Sol&#8217;s surge included, are the models and their serving rather than the problems.</p><p>Worth naming: a 75% day and a 5% day landed on the same slate, on the same morning, which is the widest spread between best and worst we have ever measured on identical fresh problems.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!uz3B!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!uz3B!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!uz3B!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!uz3B!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!uz3B!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!uz3B!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2f307e9f-b240-4200-9b9d-e452e547deb3_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:233611,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208694015?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f307e9f-b240-4200-9b9d-e452e547deb3_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!uz3B!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!uz3B!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!uz3B!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!uz3B!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ca6e716-a0b6-4392-ba02-b454c8abc71e_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, so scores inflate and start measuring memorization instead of ability. They&#8217;re snapshots: true the day they&#8217;re taken, wronger every day after.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that didn&#8217;t exist until this morning, which is how a lab&#8217;s first model can be measured against the frontier the week it ships and land at 5% while the launch coverage says otherwise.</p><p><em>(Today&#8217;s board took about <strong>$137</strong> in compute.)</em></p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Opus 5 is... in 8th place]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 24, 2026]]></description><link>https://iijme.substack.com/p/opus-5-is-in-8th-place</link><guid isPermaLink="false">https://iijme.substack.com/p/opus-5-is-in-8th-place</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Fri, 24 Jul 2026 21:56:01 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!8MJG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8MJG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8MJG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!8MJG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!8MJG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!8MJG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8MJG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2438113,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208387732?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8MJG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!8MJG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!8MJG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!8MJG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d8cc2d7-eb52-49a8-8e94-56514837826c_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><blockquote><p>Today&#8217;s board cost <strong>$147.78</strong> in compute over <strong>12.3M</strong> tokens. So listen up.</p></blockquote><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.5.</strong> <strong>75%</strong>, a new #1 at <strong>$0.40</strong> per correct answer, though the lead is a coin-flip: <strong>4-3</strong> over both Sol and Gemini, neither separation significant.</p></li><li><p><strong>Cheapest closed model: Gemini 3.6 Flash.</strong> <strong>$0.195</strong> per correct answer at <strong>72%</strong>, the cheapest results on the whole board from a model sitting second. It is the value pick.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra.</strong> <strong>57%</strong>, holding the open lead for a third day.</p></li><li><p><strong>Real reshuffle.</strong> Only <strong>27 of 36</strong> order calls between returning models repeated (&#964; = 0.50): Sol&#8217;s four-day reign ended and Gemini climbed four seats in a day.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> the new flagship landed soft. <strong>Opus 5 debuts at #8 (57%)</strong>, well below <strong>Opus 4.8 at #4 (72%)</strong>, and it lost to its own predecessor <strong>3-8</strong>.</p></li></ul><div><hr></div><h2>What to do with today&#8217;s board</h2><p>The top of the board is a four way tie: GPT-5.5, Gemini, Sol, and Opus 4.8.</p><p>So pick on price and speed, not the ranking.</p><p>Gemini is the clear value call, cheapest results on the board and second-fastest, sitting one point off the top. GPT-5.5 is the nominal #1 if you want the highest raw number.</p><p>The one thing not to do today is rush to Opus 5. On its first board it is slower on results than the Opus it replaces, more expensive per correct answer than everything except the two Anthropic flagships, and it lost head-to-head to Opus 4.8.</p><p>Stay on Opus 4.8, or move to the GPTs or Gemini, until Opus 5 proves a second board.</p><p>And Fable&#8217;s premium is still the hardest to defend on the table: #5 at <strong>$1.24</strong> per correct answer.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xk83!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xk83!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!xk83!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!xk83!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!xk83!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xk83!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png" width="1456" height="932" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/96611d8f-4b88-4a82-8c54-b1548df13e04_1800x1152.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:932,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:196846,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208387732?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F96611d8f-4b88-4a82-8c54-b1548df13e04_1800x1152.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xk83!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!xk83!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!xk83!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!xk83!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3bca73cf-99e4-40fa-b411-ae6c7b4af3ae_1800x1152.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Three stories lead today&#8217;s board; the rest are quick hits.</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div><h2>1. Opus 5 arrives, and Opus 4.8 beats it</h2><p>The headline launch of the week landed at <strong>#8</strong>.</p><p>Opus 5 solved <strong>57%</strong> on its first board, and the model directly above it in the lineage, Opus 4.8, solved <strong>72%</strong> and beat it head-to-head <strong>8-3</strong>.</p><p>Against the top of the table it was worse: <strong>2-9</strong> to Sol, GPT-5.5, and Gemini alike, each at p=0.065, which is as close to a real gap as one board can show.</p><p>The new model is not slow: a typical answer took <strong>88 seconds</strong>, among the quickest on the board. But three of its attempts ran out the clock, and the answers it did return cost <strong>$0.80</strong> per correct one, the third-priciest results on the table.</p><p>A debut this soft from a top line flagship is the kind of thing we exist to catch, because you would not learn it from the launch post.</p><p>It&#8217;s one board, and the model may climb. Today it sits in the bottom third, under the model it was built to replace.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!KEeA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!KEeA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!KEeA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!KEeA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!KEeA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!KEeA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1fbe5bb8-e3f3-46df-afb1-c873e12e46a2_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:159980,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208387732?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1fbe5bb8-e3f3-46df-afb1-c873e12e46a2_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!KEeA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!KEeA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!KEeA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!KEeA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4b85183-3991-462f-854f-59f71cdc7887_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. GPT 5.5 is today&#8217;s best</h2><p>Sol&#8217;s streak ended at four.</p><p>GPT-5.5 moved up to <strong>#1 at 75%</strong>, but calling it a lead overstates things. It went <strong>4-3</strong> over Sol, <strong>4-3</strong> over Gemini, and <strong>5-3</strong> over Opus 4.8, and not one of those is significant.</p><p>The four best models are inside three points of each other, tighter than yesterday&#8217;s top.</p><p>Where GPT-5.5 does pull clear is the field below: <strong>8-1</strong> over Grok (p=0.04), <strong>11-0</strong> over Kimi, <strong>16-0</strong> over Muse, all decisive.</p><p>So the useful way to read today&#8217;s #1 is not &#8220;GPT-5.5 is the best model&#8221; but &#8220;four models are effectively tied at the top and GPT-5.5 has the cleanest record against everything beneath them.&#8221;</p><p>Sol did nothing wrong; it solved <strong>72%</strong> and lost the crown by a single problem to a sibling it splits evenly.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!71uT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!71uT!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!71uT!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!71uT!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!71uT!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!71uT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8156d079-ca26-4998-bde8-16651e2e906f_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:201347,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208387732?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8156d079-ca26-4998-bde8-16651e2e906f_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!71uT!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!71uT!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!71uT!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!71uT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F434edf69-3044-4f45-8660-0fa81251b6db_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>3. Gemini&#8217;s redemption arc</h2><p>Two days ago Gemini debuted at #3 and then slid to #6, and the read here was to give it a third board before judging.</p><p>The third board is in: <strong>#2 at 72%</strong>, up four seats, tying both GPTs head-to-head and beating Fable <strong>6-2</strong>.</p><p>It did it while staying the cheapest and second-fastest model on the table, <strong>$0.195</strong> per correct answer at a <strong>65-second</strong> typical answer.</p><p>That combination, top of table accuracy at the bottom of the price and latency charts, is the strongest value case on the board right now.</p><p>The debut wobble looks like noise; the model looks real.</p><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>Fable 5</strong> slid to <strong>#5 at 62%</strong>, down three seats, still the priciest results on the board at <strong>$1.24</strong> per correct answer. The slide matters more than the sticker.</p></li><li><p><strong>Grok 4.5</strong> landed <strong>#6 at 59%</strong> and was the slowest model on the board today, a <strong>464-second</strong> typical answer. Cheap per correct answer, but you wait for it.</p></li><li><p><strong>Nemotron 3 Ultra</strong> kept the open-weights lead at <strong>57%</strong>, a hair ahead of the debuting Opus 5 and comfortably clear of the rest of the open field.</p></li><li><p><strong>Kimi K3</strong> held mid-pack at <strong>#9, 48%</strong>, one of the steadier budget buys at <strong>$0.30</strong> per correct answer.</p></li><li><p><strong>Muse Spark 1.1</strong> brought up the rear at <strong>29%</strong> on another clipped slate, its sixth incomplete board in a row. The API still can&#8217;t finish what the model starts.</p></li></ul><div><hr></div><h2>Why the board moves at all</h2><p>Only <strong>27 of 36</strong> order calls between returning models repeated today (&#964; = 0.50), the loosest board in a week, and the churn is real rather than mechanical: Sol falling two, Gemini climbing four, Fable dropping three, GPT-5.5 rising two.</p><p>Our comparability controls read today&#8217;s slate as statistically as hard as yesterday&#8217;s, and no model tripped the drift check, so those swings are the models and their serving on the day, not an easier or harder exam.</p><p>A &#964; this low with the difficulty held flat is what a genuine reordering looks like.</p><p>Two models left the board today and one arrived, but the reshuffle among the nine that stayed is the part that counts.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!8O_u!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!8O_u!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!8O_u!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!8O_u!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!8O_u!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!8O_u!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0248ef0b-5cd3-44a6-91a5-52199f5782e7_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:160413,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208387732?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0248ef0b-5cd3-44a6-91a5-52199f5782e7_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!8O_u!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!8O_u!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!8O_u!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!8O_u!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbdc0e543-7e9b-4ec4-a057-30ded9fe07f7_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, so scores inflate and start measuring memorization instead of ability.</p><p>They&#8217;re snapshots: true the day they&#8217;re taken, wronger every day after.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that didn&#8217;t exist until this morning, which is how a brand-new flagship can be measured against five-week incumbents the same day it ships, and land where the problems say it lands rather than where the launch says it should.</p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Sol Wins Again, but the AI Model Race Is Now a Coin Flip]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 23, 2026]]></description><link>https://iijme.substack.com/p/sol-wins-again-but-the-ai-model-race</link><guid isPermaLink="false">https://iijme.substack.com/p/sol-wins-again-but-the-ai-model-race</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Thu, 23 Jul 2026 16:31:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!HSzg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!HSzg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!HSzg!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!HSzg!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!HSzg!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!HSzg!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!HSzg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png" width="1254" height="1254" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1254,&quot;width&quot;:1254,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:718355,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208221184?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!HSzg!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 424w, https://substackcdn.com/image/fetch/$s_!HSzg!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 848w, https://substackcdn.com/image/fetch/$s_!HSzg!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 1272w, https://substackcdn.com/image/fetch/$s_!HSzg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6ed4ad6-7e8a-4a3d-8b13-26a6d544cb97_1254x1254.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>70%</strong>, a fourth straight crown at <strong>$0.22</strong> per correct answer. But its lead over second place is now a coin-flip: <strong>6-5</strong> over Fable 5, significant only against the budget tail.</p></li><li><p><strong>Cheapest closed model: Grok 4.5, on the sticker.</strong> <strong>$0.20</strong> per correct answer at 57.5%, though Sol matches it within two cents while solving a fifth more problems, so the crown is still the better buy.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra.</strong> <strong>54%</strong>, holding the open lead for a second day despite provider-side errors again nicking its slate.</p></li><li><p><strong>Shuffled at the top.</strong> <strong>46 of 55</strong> order calls between returning models repeated (&#964; = 0.67): Fable climbed two seats back to the podium while Gemini gave back its whole debut and dropped three to sixth.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> the podium collapsed. Sol, Fable, and GPT-5.5 finished <strong>70 / 68 / 68</strong>, with Opus a step back at 62. The four best models on the board are separated by eight points, the tightest top we have measured.</p></li></ul><div><hr></div><h2>What to do with today&#8217;s board</h2><p>Sol stays the default, and now the safe value pick too: nothing outscores it, and nothing worth running is meaningfully cheaper per correct answer. The live question is what to do with Anthropic&#8217;s flagship. Fable 5 climbed ten points overnight into a genuine #2, but it still charges <strong>$1.16</strong> per correct answer, roughly five times Sol&#8217;s rate, and it lost the head-to-head to Sol.</p><p>If you&#8217;re paying Fable or Opus prices for competitive-coding-style work, run Sol or GPT-5.5 in parallel this week and you&#8217;ll get equal-or-better results at a fraction of the bill. Don&#8217;t over-read yesterday&#8217;s Gemini hype; it regressed a full three seats today, so give it a third board before you rewire anything. And bench Qwen 3.7 Max until it can finish on time, because nearly a quarter of its attempts ran out the clock.</p><p>That&#8217;s our read. Argue with it; tomorrow&#8217;s board is the rebuttal.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!zUB9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!zUB9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!zUB9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!zUB9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!zUB9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!zUB9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png" width="1456" height="1003" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c209e71f-b62e-47e5-bbd3-6373e3975a4c_1800x1240.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1003,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:214671,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208221184?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc209e71f-b62e-47e5-bbd3-6373e3975a4c_1800x1240.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!zUB9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!zUB9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!zUB9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!zUB9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fce6facb5-2bc9-43a5-9076-f13011e9c205_1800x1240.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>isitjustme leaderboard, July 23, 2026</em></p><p>Three stories lead today&#8217;s board; the rest is quick hits.</p><div><hr></div><h2>1. A fourth crown, and the closest one yet</h2><p>Sol holds <strong>#1 at 70%</strong>, its fourth morning in a row on top. But the margin that used to be a clean sheet is now a coin-flip. Against Fable it went <strong>6-5</strong>, one problem, and against GPT-5.5 just <strong>2-1</strong>.</p><p>The separation only reappears further down: <strong>9-1</strong> over Kimi (p=0.02), <strong>10-1</strong> over Qwen (p=0.01), <strong>12-0</strong> over GLM, <strong>16-0</strong> over Muse.</p><p>So the read is unchanged where it matters for your wallet. Sol still wins the budget half decisively and still books results at the cheapest rate of any model you&#8217;d actually deploy. What changed is the shape at the top: it&#8217;s no longer Sol and a gap but Sol and a cluster, three models inside two points, with the leader winning its closest matchup by a single solve.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!JVZb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!JVZb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!JVZb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!JVZb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!JVZb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!JVZb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ea891af8-9a45-451b-a116-06fb12e86d90_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:169520,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208221184?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea891af8-9a45-451b-a116-06fb12e86d90_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!JVZb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!JVZb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!JVZb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!JVZb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1cf9b883-ce17-41b9-9824-301230fc564b_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Elo with confidence intervals, July 23, 2026</em></p><div><hr></div><h2>2. Fable storms back to the podium</h2><p>The biggest mover on the board is Anthropic&#8217;s flagship. Fable 5 jumped from fourth to <strong>#2 at 68%</strong>, a ten-point climb overnight, and it earned it: <strong>8-3</strong> over Gemini, <strong>6-4</strong> over Opus, and a dead-even <strong>5-5</strong> with GPT-5.5 that it wins only on the Elo tiebreak.</p><p>Our day-to-day comparability controls read this morning&#8217;s slate as equal in difficulty to yesterday&#8217;s, so the leap is the model and its serving, not an easier board.</p><p>The catch is the one that has dogged Fable all month: it is still the priciest results on the table at <strong>$1.16</strong> per correct answer, roughly five times Sol&#8217;s, and it still lost its one meeting with the champion. A stronger Fable is real news for anyone locked into the Anthropic stack, but it is not yet a reason to pay the premium over the model beating it.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!0CEC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!0CEC!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!0CEC!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!0CEC!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!0CEC!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!0CEC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png" width="1456" height="1168" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9c9e0227-e261-440d-a09e-b80d87337b47_1800x1444.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1168,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:287326,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208221184?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9c9e0227-e261-440d-a09e-b80d87337b47_1800x1444.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!0CEC!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!0CEC!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!0CEC!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!0CEC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed1a0b36-3509-48c0-a691-9255350239a2_1800x1444.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Head-to-head record, July 23, 2026</em></p><div><hr></div><h2>3. Gemini&#8217;s debut hangover</h2><p>Yesterday Gemini 3.6 Flash walked in at #3 and owned the stopwatch. Today it gave the whole debut back, dropping three seats to <strong>#6 at 55%</strong>, its head-to-heads with the top now underwater: <strong>3-8</strong> against Fable, <strong>2-7</strong> against GPT-5.5, <strong>2-8</strong> against Sol.</p><p>The one thing it kept is the speed, a typical <strong>73-second</strong> answer that is still the fastest on the board, a hair ahead of Fable&#8217;s 75 and well under Sol&#8217;s 118.</p><p>This is the asterisk that debuts usually arrive with and this one skipped: a strong first impression is one board, and the second is where you find out whether it holds. Gemini&#8217;s second board didn&#8217;t. It&#8217;s still a fast, cheap, mid-table option worth a side-by-side, but the &#8220;above both Anthropic flagships&#8221; line from yesterday lasted exactly one day.</p><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>Opus 4.8</strong> ticked up a seat to <strong>#4 at 62%</strong>, but it sits behind both GPTs and its own sibling, and it&#8217;s the slowest of the leaders at a <strong>302-second</strong> median. Roughly level on results with the pack ahead, and well behind on latency.</p></li><li><p><strong>Grok 4.5</strong> owns the cheapest sticker on the board at <strong>$0.20</strong> per correct answer, but at 57.5% and a 374-second median it&#8217;s a value play, not a default. You&#8217;re trading accuracy and time for the last two cents.</p></li><li><p><strong>Qwen 3.7 Max</strong> melted down: nearly a quarter of its attempts ran out the clock, dragging its median to a board-worst <strong>720 seconds</strong>. When it answers it&#8217;s fine; too often it doesn&#8217;t answer in time.</p></li><li><p><strong>GLM-5.2</strong> landed second-to-last at <strong>40%</strong>, yet our comparability controls actually read its underlying level as higher than its baseline, not lower, so today&#8217;s score is the serving and the clock (three timeouts, three errors), not a capability drop.</p></li><li><p><strong>Kimi K3</strong> climbed two seats to <strong>#8 at 49%</strong>, quietly one of the better budget buys at $0.25 per correct answer.</p></li><li><p><strong>Muse Spark 1.1</strong> improved to <strong>34%</strong> and again on an incomplete slate, its fifth clipped board in a row. The model keeps inching up while the API keeps standing still.</p></li><li><p><strong>Nemotron 3 Ultra</strong> held the open-weights lead at <strong>54%</strong>, its recurring provider-side errors trimming the slate but not the crown.</p></li></ul><div><hr></div><h2>Why the board moves at all</h2><p><strong>46 of 55</strong> order calls between returning models repeated today (&#964; = 0.67), and the nine that flipped cluster at the top: Fable&#8217;s two-seat surge, Gemini&#8217;s three-seat slide, and an Opus-over-Grok swap account for nearly all of them.</p><p>That&#8217;s the useful reading of a middling &#964;. The movement isn&#8217;t noise smeared across the table; it&#8217;s concentrated in the handful of models that actually moved. The comparability controls tell us the slate was statistically as hard as yesterday&#8217;s, so Fable climbing, Gemini falling, and Sol holding are the models and their serving, not the problems.</p><p>A day like this, with a compressed top and one big climb against one big slide, is exactly why we re-measure every morning instead of trusting last week&#8217;s ranking.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QvcZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QvcZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 424w, https://substackcdn.com/image/fetch/$s_!QvcZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 848w, https://substackcdn.com/image/fetch/$s_!QvcZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 1272w, https://substackcdn.com/image/fetch/$s_!QvcZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!QvcZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png" width="1456" height="847" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d2e7e679-1fd4-4a5c-9428-471027d0c2b2_2392x1392.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:847,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:280467,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208221184?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd2e7e679-1fd4-4a5c-9428-471027d0c2b2_2392x1392.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!QvcZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 424w, https://substackcdn.com/image/fetch/$s_!QvcZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 848w, https://substackcdn.com/image/fetch/$s_!QvcZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 1272w, https://substackcdn.com/image/fetch/$s_!QvcZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f100f7a-0c34-4d8b-9f3b-f9a69a7487ba_2392x1392.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Solve-rate heatmap, July 23, 2026</em></p><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, so scores inflate and start measuring memorization instead of ability. They&#8217;re snapshots: true the day they&#8217;re taken, wronger every day after.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that didn&#8217;t exist until this morning, which is how a model that surged ten points overnight and one that surrendered a debut can both be caught on the same board, the same week, on equal footing.</p><p><em>(Today&#8217;s board costed <strong>$126.75</strong> in compute.)</em></p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Gemini 3.6 beats Fable on performance, speed, & cost, and Sol takes gold for 3rd day in a row]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 22, 2026]]></description><link>https://iijme.substack.com/p/gemini-36-beats-fable-on-performance</link><guid isPermaLink="false">https://iijme.substack.com/p/gemini-36-beats-fable-on-performance</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Wed, 22 Jul 2026 15:11:53 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!kohc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kohc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kohc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!kohc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!kohc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!kohc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!kohc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1891f821-f9ac-48a5-87c8-ba6abdf13ecf_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1867577,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208070484?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1891f821-f9ac-48a5-87c8-ba6abdf13ecf_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kohc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!kohc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!kohc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!kohc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbed95ee7-3c88-4ca7-9132-0fa4daae3b1a_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>70%</strong>, a third straight crown at <strong>$0.22</strong> per correct answer, with decisive wins over the entire budget half of the board.</p></li><li><p><strong>Cheapest closed model: Sol, by a whisker.</strong> Gemini 3.6 Flash debuted at $0.23 per correct answer, two tenths of a cent behind. The value race just became a race.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra.</strong> <strong>50%</strong>, with a caveat: provider-side errors clipped a fifth of its slate.</p></li><li><p><strong>Steady board.</strong> <strong>39 of 45</strong> order calls between returning models repeated (&#964; = 0.73), and our comparability checks read today&#8217;s slate as equal in difficulty to yesterday&#8217;s, so the moves you see are real.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> the debutant owns the stopwatch. Gemini&#8217;s typical answer took <strong>73 seconds</strong>, the fastest we have ever measured, from a model that also finished top-three on accuracy.</p><div class="callout-block" data-callout="true"><p>Kimi K3 continues to disappoint due to insufficient infra.<br><br>Gemini 3.6 Flash was given the compute it needs.<br><br>Don&#8217;t trust the headlines, look at the numbers below.</p></div></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!JG5T!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!JG5T!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!JG5T!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!JG5T!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!JG5T!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!JG5T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png" width="1456" height="1003" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d72a1fd6-055a-4897-916a-f4770867fe72_1800x1240.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1003,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:212603,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208070484?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd72a1fd6-055a-4897-916a-f4770867fe72_1800x1240.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!JG5T!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!JG5T!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!JG5T!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!JG5T!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F02818a53-b40d-4ce1-8664-2d2e4617fcd1_1800x1240.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>What to do with today&#8217;s board</h2><p>Sol stays the default: three crowns, cheapest results, and nothing above it. The new decision is Gemini 3.6 Flash. On one day&#8217;s evidence it delivers near-Sol accuracy at Sol&#8217;s price in roughly half Sol&#8217;s time, so if your workload is latency-sensitive, start a side-by-side today; if it holds a second board we have a genuine two-horse race at the top of the value chart.</p><p>Fable&#8217;s premium remains hard to defend at $1.40 per correct answer against a debutant that beat it 7&#8211;5 while charging a sixth as much. And treat Muse Spark as benched until its API can finish a slate: that&#8217;s four clipped boards in a row.</p><p>That&#8217;s our read. Argue with it; tomorrow&#8217;s board is the rebuttal.</p><p><em>Two stories lead today&#8217;s board; the rest is quick hits.</em></p><div><hr></div><h2>1. Google shows up, and the stopwatch changes hands</h2><p>First day on the board for Gemini 3.6 Flash, and it did three things at once.</p><p>It finished <strong>#3 at 62.5%</strong> on a full slate, above both Anthropic flagships, taking Fable <strong>7&#8211;5</strong> and Opus <strong>6&#8211;3</strong> on the problems that separated them.</p><p>It matched the champion&#8217;s economics at <strong>$0.23 per correct answer</strong>.</p><p>And it answered in a typical <strong>73 seconds</strong>, the fastest figure we have ever recorded, comfortably ahead of Fable&#8217;s 105 and about half of Sol&#8217;s 136.</p><p>The gap to the GPTs is real (1&#8211;4 against Sol, 3&#8211;6 against GPT-5.5, neither significant yet), so this is a strong third place rather than a threat to the crown. But debuts usually arrive with an asterisk, and this one arrived with a full slate, a healthy drift check, and the best latency on the board.</p><p>We have not seen a cleaner first day.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!jW_5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jW_5!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!jW_5!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!jW_5!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!jW_5!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jW_5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9575ac48-36b2-4929-bf58-0d95582067e4_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:217395,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208070484?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9575ac48-36b2-4929-bf58-0d95582067e4_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!jW_5!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!jW_5!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!jW_5!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!jW_5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb47c7262-b3c1-4459-bef4-104b79c5db94_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hRY7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hRY7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!hRY7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!hRY7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!hRY7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!hRY7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d8f64a65-aeeb-4b03-81d9-64c289056bfe_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:169192,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208070484?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8f64a65-aeeb-4b03-81d9-64c289056bfe_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!hRY7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!hRY7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!hRY7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!hRY7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F382a0d58-b0c3-4e94-b94d-5a7f20b3a084_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. Sol&#8217;s three-peat, with a memento mori</h2><p><strong>70%</strong>, a third consecutive #1, and the usual clean sheet against the budget field:</p><ul><li><p><strong>8&#8211;1</strong> over Grok (p=0.04)</p></li><li><p><strong>12&#8211;0</strong> over Kimi K3</p></li><li><p><strong>8&#8211;0</strong> over Nemotron</p></li><li><p><strong>10&#8211;0</strong> over Qwen</p></li><li><p><strong>16&#8211;0</strong> over Muse</p></li></ul><p>All decisive.</p><p>Against its sibling it went 3&#8211;1, and against the debutant 4&#8211;1.</p><p>The streak now equals the longest we have recorded, which is the cautionary part: Fable&#8217;s three-day run ended the morning after it looked inevitable, at the hands of a model nobody was watching. Today a model nobody here was watching just took third place with better latency and identical pricing.</p><p>Sol earned every crown; it should still sleep lightly.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yM3N!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yM3N!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!yM3N!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!yM3N!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!yM3N!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yM3N!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png" width="1456" height="1168" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/761025b7-5044-4ede-8964-36178907bc04_1800x1444.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1168,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:284040,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/208070484?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F761025b7-5044-4ede-8964-36178907bc04_1800x1444.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!yM3N!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!yM3N!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!yM3N!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!yM3N!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F371a6708-5346-40dc-a4d5-1d60efa53953_1800x1444.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>Fable 5</strong> stopped the bleeding at <strong>57.5%</strong>, unchanged from yesterday, still #4 and still the priciest results at $1.40 per correct answer. Flat is better than falling. It is not a case for the premium.</p></li><li><p><strong>Opus 4.8</strong> slipped to #5 at <strong>55%</strong>, statistically level with Fable (4&#8211;3). The two Anthropic flagships are now interchangeable on results and separated only by price.</p></li><li><p><strong>GLM-5.2</strong> gave back some of yesterday&#8217;s high at <strong>42.5%</strong>, though our comparability checks still read its underlying level as elevated; nine of its problems ran out the clock today, which is the real story.</p></li><li><p><strong>Nemotron 3 Ultra</strong> took the open-weights lead at <strong>50%</strong> on 32 scored problems; the other eight died to provider-side errors, its recurring weakness.</p></li><li><p><strong>Muse Spark 1.1</strong> improved again to <strong>30%</strong>, and again on a clipped slate. Four boards, four incomplete slates. The model is inching up; the API is standing still.</p></li></ul><div><hr></div><h2>Why the board moves at all</h2><p><strong>39 of 45</strong> order calls between returning models repeated today (&#964; = 0.73), and the swaps concentrate below the top four, where a one-seat mechanical shift from the debutant&#8217;s arrival mixes with GLM and Kimi K3 easing back.</p><p>The more interesting reading is the one our comparability checks gave us: today&#8217;s slate was statistically equivalent in difficulty to yesterday&#8217;s, which means the score movements you see, Sol holding, Fable flattening, GLM retreating, are the models and their serving, not the problems.</p><p>Days like this are why we run the same measurement every morning instead of trusting last week&#8217;s.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, so scores inflate and start measuring memorization instead of ability. They&#8217;re snapshots: true the day they&#8217;re taken, wronger every day after.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that didn&#8217;t exist until this morning, which is why a model that launched into public availability can be measured against five-week incumbents on equal footing the same week.</p><p><em>(Today&#8217;s board took about <strong>$111</strong> in compute.)</em></p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model. Plus the fastest and cheapest way to get that performance. In your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[GPT-5.6-Sol is a Steal at $0.22, GLM-5.2 posts its best day ever]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 21, 2026]]></description><link>https://iijme.substack.com/p/gpt-56-sol-is-a-steal-at-022-glm</link><guid isPermaLink="false">https://iijme.substack.com/p/gpt-56-sol-is-a-steal-at-022-glm</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Tue, 21 Jul 2026 20:39:34 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ajda!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ajda!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ajda!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!ajda!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!ajda!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!ajda!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ajda!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a7ca8b41-4579-44c1-bc0c-091fce9c2152_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1105059,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207966617?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa7ca8b41-4579-44c1-bc0c-091fce9c2152_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ajda!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!ajda!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!ajda!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!ajda!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd50aaa53-af6c-4d0d-836c-f70d6a67cfeb_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.6 Sol.</strong> <strong>72.5%</strong>, a second straight crown, and a second straight day as the cheapest result on the board at <strong>$0.22</strong> per correct answer.</p></li><li><p><strong>Cheapest closed model: also Sol, again.</strong> Grok 4.5 is a few cents behind ($0.26) at 22 points fewer. Two boards running, the crown and the value column share a row.</p></li><li><p><strong>Best open-weights model: GLM-5.2.</strong> A first. <strong>45%</strong>, its best board ever, #6 overall and three seats up.</p></li><li><p><strong>Steady board.</strong> <strong>40 of 45</strong> order calls between returning models repeated (&#964; = 0.78). The one real mover was GLM climbing past Qwen, Kimi K3, and Nemotron.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> across nine opponents and every problem where results diverged, Sol lost a total of <strong>three problems all day</strong>. One to Fable, two to GLM, none to anyone else.</p></li></ul><div class="pullquote"><p>Gemini 3.6 Flash will be in tomorrow&#8217;s post</p></div><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!83A8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!83A8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!83A8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!83A8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!83A8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!83A8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png" width="1456" height="932" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b0ec4000-1ba2-4aba-945c-e784b28bcec7_1800x1152.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:932,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:191311,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207966617?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb0ec4000-1ba2-4aba-945c-e784b28bcec7_1800x1152.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!83A8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!83A8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!83A8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!83A8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e4b93f0-eb3b-465e-85aa-42771b8dddb7_1800x1152.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>What to do with today&#8217;s board</h2><p>Sol is the default again, and the argument got stronger: champion, cheapest result on the board, and it dropped three discordant problems all day.</p><p>If you&#8217;re on GPT-5.5 the switch remains free.</p><p>Fable needs a reason now, and &#8220;fastest&#8221; stopped being one today; if you&#8217;re paying its premium, run Opus beside it this week and check whether you notice the difference anywhere but the invoice.</p><p>Open-weights buyers should actually look at GLM-5.2 for the first time, with the caveat that its history is volatile and one great board is one great board.</p><p>And Qwen users with deadlines: eleven problems ran out the clock today. That risk is yours too.</p><p>That&#8217;s our read. Argue with it; tomorrow&#8217;s board is the rebuttal.</p><div><hr></div><p><strong>Subscribe, and each day you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:&quot;button-wrapper&quot;}" data-component-name="ButtonCreateButton"><a class="button primary button-wrapper" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p><p>Two stories lead today&#8217;s board; the rest is quick hits.</p><div><hr></div><h2>1. Sol&#8217;s second crown was more convincing than its first</h2><p>Yesterday Sol took #1 on a tiebreak. Today it took #1 on the merits: <strong>72.5%</strong>, with statistically decisive wins over six of its nine opponents.</p><p><strong>9&#8211;0</strong> over Grok (p=0.004), <strong>14&#8211;0</strong> over both Kimi K3 and Nemotron (p=0.0001), <strong>12&#8211;0</strong> over Qwen, <strong>18&#8211;0</strong> over Muse, <strong>13&#8211;2</strong> over GLM.</p><p>Against the models above the budget line it went 2&#8211;0 on GPT-5.5, 4&#8211;0 on Opus, and 7&#8211;1 on Fable (p=0.07, a hair short of significance).</p><p>Add the price, <strong>$0.22 per correct answer</strong> for the second day straight, and the case writes itself.</p><p>The one caution we&#8217;d offer: two crowns in a row is a streak, and we watched a three-day Fable streak end badly last week. Streaks are rented.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!N0tY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!N0tY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!N0tY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!N0tY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!N0tY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!N0tY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/74f907d0-b0ed-441b-82bb-41a53b2967b7_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:158663,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207966617?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F74f907d0-b0ed-441b-82bb-41a53b2967b7_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!N0tY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!N0tY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!N0tY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!N0tY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84ee9c3e-3cf1-47d8-9e3c-9481c3a34ee0_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><div><hr></div><h2>2. Fable&#8217;s slide reaches four boards</h2><p>The sequence now reads 80%, 70%, 60%, <strong>57.5%</strong>, and the rank line reads #1, #2, #4, #4.</p><p>Today Fable took just <strong>1 of 8</strong> discordant problems against Sol, at <strong>$1.69 per correct answer</strong>, its worst value figure yet and nearly eight times the champion&#8217;s.</p><p>Even the consolation title moved: for the first time in six boards, the fastest typical answer belonged to someone else (Muse Spark, on its reduced slate, with Fable close behind).</p><p>We keep looking for the floor here. A 57% day from the priciest model on the board is not it, and the only argument left for the premium is a speed edge measured in seconds.</p><p>Anthropic loyalists should be watching Opus, which quietly outrank Fable for a second straight day at a third less per answer.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!FbUy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!FbUy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!FbUy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!FbUy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!FbUy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!FbUy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4a9d2a74-e050-41ba-887c-a35408b0b680_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:193529,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207966617?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4a9d2a74-e050-41ba-887c-a35408b0b680_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!FbUy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!FbUy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!FbUy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!FbUy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0d7b2a42-ae26-421e-b2de-c5cc66501776_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">We&#8217;ve Never Seen a Pareto Board Like this Before, Hard Top Right Clustering</figcaption></figure></div><div class="captioned-button-wrap" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/p/gpt-56-sol-is-a-steal-at-022-glm?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="CaptionedButtonToDOM"><div class="preamble"><p class="cta-caption">Thanks for reading! This post is public so feel free to share it. </p></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/p/gpt-56-sol-is-a-steal-at-022-glm?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/p/gpt-56-sol-is-a-steal-at-022-glm?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p></div><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>GLM-5.2</strong> finished <strong>#6 at 45%</strong>, its best board since we started tracking it, and now leads the open-weights field outright. Five boards ago it solved one problem. The serving change behind it keeps paying.</p></li><li><p><strong>GPT-5.5</strong> held #2 at <strong>67.5%</strong> with a significant 8&#8211;1 over Grok. Its $0.43 per correct answer is double Sol&#8217;s, a sentence nobody expected to type two weeks ago.</p></li><li><p><strong>Grok 4.5</strong> fell to 50%, went 0&#8211;9 against Sol on their discordant problems, and its frozen-set drift score has sagged for a third board. Something may have changed behind that name too.</p></li><li><p><strong>Qwen 3.7 Max</strong> ran out the clock on eleven problems, its worst count yet. Its slow tail is now the main thing standing between it and the top half.</p></li><li><p><strong>Muse Spark 1.1</strong> improved to <strong>28%</strong> on a slate again clipped by provider-side errors (about a fifth of its problems went unscored). Fast, cheap, last, and slightly less last than before.</p></li></ul><div><hr></div><h2>Why the board moves at all</h2><p><strong>40 of 45</strong> order calls between returning models repeated today (&#964; = 0.78), which is the steady end of our range, and the movement that did happen was concentrated in one climber: GLM stepping past Qwen, Kimi K3, and Nemotron in a single day.</p><p>The top four held their seats exactly.</p><p>When a board this stable still shows a 25-point swing at one model (Grok&#8217;s 9-point drop, GLM&#8217;s 5-point rise), the explanation usually lives in serving stacks rather than model weights, and our frozen-problem comparability checks pointed the same direction today.</p><p>Fresh problems daily is what lets us say that with a straight face.</p><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, so scores inflate and start measuring memorization instead of ability.</p><p>They&#8217;re snapshots: true the day they&#8217;re taken, wronger every day after.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that didn&#8217;t exist until this morning, which is how a two-week-old flagship defends a crown and a written-off budget model climbs into the top six on the same page.</p><p><em>(Today&#8217;s board took about <strong>$123</strong> in compute.)</em></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[Kimi K3 beaten by Nemotron 54–45, GPT Sol finishes #1 and is 77% cheaper than Fable]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 20, 2026]]></description><link>https://iijme.substack.com/p/kimi-k3-beaten-by-nemotron-5445-gpt</link><guid isPermaLink="false">https://iijme.substack.com/p/kimi-k3-beaten-by-nemotron-5445-gpt</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Mon, 20 Jul 2026 14:09:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Xjmg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Xjmg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Xjmg!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!Xjmg!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!Xjmg!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!Xjmg!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Xjmg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/20a9178a-1bbc-4f2e-b1ad-e922fef8f9de_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1677739,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207775563?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F20a9178a-1bbc-4f2e-b1ad-e922fef8f9de_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Xjmg!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!Xjmg!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!Xjmg!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!Xjmg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6b4b88b6-8175-46dc-a79c-a685f625982c_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>TL;DR</h2><ul><li><p><strong>Best and cheapest closed model: GPT-5.6 Sol.</strong> <strong>72.5%</strong>, #1 on a tiebreak over its own sibling GPT-5.5 (identical solve rate, <strong>3&#8211;3</strong> head to head), at <strong>$0.22</strong> per correct answer. The champion is also the cheapest result on the board.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra.</strong> <strong>54%</strong> at $0.35 per correct answer, ahead of Kimi K3 (45%) in its debut week.</p></li><li><p><strong>Shakeup.</strong> <strong>36 of 45</strong> order calls between returning models repeated since Thursday&#8217;s board (&#964; = 0.60). The movement was real: the GPTs went one-two, Opus climbed to #3, Fable slid to #4, Qwen fell three seats.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> Muse Spark 1.1 returned, and this time it answered. Most of its slate scored (a handful of problems still lost to provider-side errors), fast (~112s typical) and cheap ($0.37 per answer). It also finished last at <strong>23.5%</strong>, swept 20&#8211;0 by the champion.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Mqm6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Mqm6!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!Mqm6!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!Mqm6!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!Mqm6!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Mqm6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png" width="1456" height="1003" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b01a28de-7c66-462a-bcdb-2212bd05e7c3_1800x1240.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1003,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:213451,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207775563?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb01a28de-7c66-462a-bcdb-2212bd05e7c3_1800x1240.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Mqm6!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 424w, https://substackcdn.com/image/fetch/$s_!Mqm6!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 848w, https://substackcdn.com/image/fetch/$s_!Mqm6!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 1272w, https://substackcdn.com/image/fetch/$s_!Mqm6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F69cea9ba-1b0e-4d15-822b-04fb9ec38225_1800x1240.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/p/kimi-k3-beaten-by-nemotron-5445-gpt?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/p/kimi-k3-beaten-by-nemotron-5445-gpt?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p><p>Three stories lead today&#8217;s board; the rest is quick hits.</p><h2>1. Sol&#8217;s arc completes: quiet-quitter to champion at the best price we&#8217;ve printed at #1</h2><p>A week ago Sol lost to its own predecessor 0&#8211;4 and we called it a speed tax. Thursday it posted the board&#8217;s best economics and we said we&#8217;d wait for a second day.</p><p>The second day came in at <strong>#1, 72.5%</strong>, dead even with GPT-5.5 at <strong>3&#8211;3</strong> and ahead only on strength of schedule.</p><p>For your bill, the number is <strong>$0.22 per correct answer</strong>: the cheapest results on the entire board, from the model wearing the crown.</p><p>Against the rest of the field it wasn&#8217;t subtle. <strong>8&#8211;0</strong> over Qwen (p=0.008), <strong>11&#8211;0</strong> over Kimi K3 (p=0.001), <strong>20&#8211;0</strong> over Muse, <strong>7&#8211;1</strong> over Grok.</p><p>The GPT lane now holds first and second place, and choosing between the siblings has become a matter of taste: identical results, with Sol a shade faster and cheaper today. A week ago that sentence would have been a joke.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!DvYU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!DvYU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!DvYU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!DvYU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!DvYU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!DvYU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3936d53a-7618-420a-a943-dd10768a4c26_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:167140,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207775563?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3936d53a-7618-420a-a943-dd10768a4c26_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!DvYU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!DvYU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!DvYU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!DvYU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa42f4d47-e902-430f-b94e-c4c7b9306f8f_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. Fable&#8217;s premium is now a speed premium only</h2><p>Fable&#8217;s last three boards read 80%, 70%, 60%, and its rank went #1, #2, #4.</p><p>Today it lost <strong>3&#8211;8 against both GPTs</strong> on the problems that separated them (p=0.23, so not yet significant, but pointing one direction), fell out of the top three entirely, and remained the priciest model on the board at <strong>$1.15 per correct answer</strong>, five times Sol&#8217;s rate for twelve points fewer.</p><p>What&#8217;s left of the case is speed, and that part is real: fastest again at ~102s typical, the fifth straight board it has held that title.</p><p>If your workload pays for the fastest excellent answer, Fable still cashes. If it pays for the best answer, this week the board says that&#8217;s a GPT, at a fifth the price.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!BIA6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!BIA6!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!BIA6!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!BIA6!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!BIA6!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!BIA6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png" width="1456" height="1107" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/dcce4063-b7b7-4484-9545-d25fc369d6a9_1800x1368.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1107,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:166135,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207775563?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcce4063-b7b7-4484-9545-d25fc369d6a9_1800x1368.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!BIA6!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 424w, https://substackcdn.com/image/fetch/$s_!BIA6!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 848w, https://substackcdn.com/image/fetch/$s_!BIA6!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 1272w, https://substackcdn.com/image/fetch/$s_!BIA6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F377242ca-1acd-49d9-9201-69ff579a6511_1800x1368.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>3. Muse Spark came back, and now we know what it is</h2><p>Ten days after a launch where roughly 9 in 10 of its requests failed, Muse Spark 1.1 rejoined the roster, and the infrastructure mostly behaved this time: the bulk of its slate produced scoreable answers, with a handful of problems lost to provider-side errors.</p><p>The results are another matter. Last place at <strong>23.5%</strong>, swept <strong>20&#8211;0</strong> by Sol, <strong>19&#8211;1</strong> by GPT-5.5 and Opus, <strong>16&#8211;0</strong> by Fable, each of those statistically decisive.</p><p>The odd part is the shape: it answers in about 112 seconds, second fastest on the board, at $0.37 per correct answer. It gets the hard ones wrong quickly and cheaply.</p><p>Not a contender on this board, but Meta is presumably iterating on it, and we&#8217;ll keep scoring it.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!btKh!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!btKh!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!btKh!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!btKh!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!btKh!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!btKh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png" width="1456" height="1168" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0889e20a-8301-4abb-b1d0-6e5eb171ca7e_1800x1444.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1168,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:284242,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207775563?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0889e20a-8301-4abb-b1d0-6e5eb171ca7e_1800x1444.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!btKh!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 424w, https://substackcdn.com/image/fetch/$s_!btKh!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 848w, https://substackcdn.com/image/fetch/$s_!btKh!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 1272w, https://substackcdn.com/image/fetch/$s_!btKh!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0bc0e517-a757-427c-a76c-fff6ecf8efbb_1800x1444.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Quick hits</h2><ul><li><p><strong>Opus 4.8</strong> climbed to #3 at <strong>67%</strong>, its best rank in over a week, including a significant 9&#8211;1 over Kimi K3. Its results stay the second priciest at $0.88 per answer.</p></li><li><p><strong>Grok 4.5</strong> held #5 at <strong>57%</strong> and matched Sol&#8217;s per-answer price ($0.22). Sol&#8217;s 7&#8211;1 edge on their discordant problems says the same dollar buys a different ceiling.</p></li><li><p><strong>Qwen 3.7 Max</strong> gave back half of Thursday&#8217;s surge, 70% to <strong>52%</strong>. The slowest answers on the board finally cost it: a quarter of its slate ran out the clock and scored as failures.</p></li><li><p><strong>Kimi K3</strong> beat its sibling for the first time, 45% to K2.7&#8217;s 40%, on full slates. Both trail Nemotron, and K3&#8217;s answers stay slow.</p></li><li><p><strong>GLM-5.2</strong> held its new level at <strong>40%</strong>, two boards running. The serving change was real.</p></li></ul><div><hr></div><h2>Why the board moves at all</h2><p><strong>36 of 45</strong> order calls between returning models repeated since Thursday&#8217;s board (&#964; = 0.60), and the exceptions were concentrated moves rather than noise: the GPTs rising together, Fable stepping down two, Qwen&#8217;s surge partly unwinding, the Kimi siblings swapping.</p><p>Serving stacks keep shifting under several of these names (Thursday&#8217;s thirty-point jumps, today&#8217;s partial retreats).</p><p>A board that re-measures everything on brand-new problems each morning is the only way to see what these names deliver today, rather than what they delivered whenever someone last ran an eval.</p><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve seen?</h2><p>Public benchmarks leak into the next training run, so scores inflate and start measuring memorization instead of ability. They&#8217;re snapshots: true the day they&#8217;re taken, wronger every day after.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that didn&#8217;t exist until this morning, which is how a model can go from quiet quitting to champion inside a week, and how a relaunched model gets judged on what it does now rather than on its press cycle.</p><div class="callout-block" data-callout="true"><p style="text-align: center;"><em>Today&#8217;s board took about <strong>$105</strong> in compute.</em></p></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Subscribe for Free!</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>What to do with today&#8217;s board</h2><p>The GPT lane is the default this morning.</p><p><strong>Sol at $0.22 per correct answer is the champion and the cheapest result at once.</strong></p><p>If you&#8217;re on GPT-5.5, switching costs nothing and gains a little speed. If you&#8217;re on anything pricier, the burden of proof just moved to your invoice.</p><p>Fable is a specialist buy now: pay the premium if the fastest excellent answer is the product.</p><p>Kimi&#8217;s infrastructure limitations are potentially holding back amazing performance. Let them sort it out. If you need to build around an open weights model, try Nemotron or </p><p>Skip Muse for real work, since fast and cheap doesn&#8217;t survive 20&#8211;0, but keep an eye on it; Meta ships fast.</p><p>And if your Qwen workloads have deadlines, that 52% understates the risk, because its slow tail is now failing problems outright.</p><p>That&#8217;s our read. Argue with it; tomorrow&#8217;s board is the rebuttal.</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model.</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Kimi K3 you say? No, it's Qwen 3.7's day, GPT 5.5 Dominates the board]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 17, 2026]]></description><link>https://iijme.substack.com/p/kimi-k3-you-say-no-its-qwen-37s-day</link><guid isPermaLink="false">https://iijme.substack.com/p/kimi-k3-you-say-no-its-qwen-37s-day</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Fri, 17 Jul 2026 22:32:11 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!uRX9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!uRX9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!uRX9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!uRX9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!uRX9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!uRX9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!uRX9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/aa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/069b7571-9693-4938-b09b-d155924cef23_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1966172,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207487993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F069b7571-9693-4938-b09b-d155924cef23_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!uRX9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!uRX9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!uRX9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!uRX9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faa985833-96b2-41a8-8bc8-7046cb17e07d_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3></h3><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.5</strong> at <strong>75%</strong>. It takes its second #1 of the week and, for once, the champion is also a value pick at <strong>$0.38 per correct answer</strong>.</p></li><li><p><strong>Cheapest closed model: GPT-5.6 Sol</strong> at <strong>$0.22 per correct answer</strong> and a <strong>70%</strong> solve rate, the best economics on the entire board today.</p></li><li><p><strong>Best open-weights model: Nemotron 3 Ultra</strong> at <strong>48%</strong>, finally measured on a full slate, at <strong>$0.37 per correct answer</strong>.</p></li><li><p><strong>The shakeup:</strong> only <strong>29 of 36</strong> order calls between returning models repeated, for <strong>&#964; = 0.61</strong>. Nearly every meaningful swap happened in the bottom half.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> Qwen 3.7 Max jumped <strong>37 percentage points</strong> into a tie for the second-best solve rate. GLM-5.2 went from one solve to <strong>38%</strong>. Our frozen-problem controls indicate that the problems did not get easier. The serving paths changed.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ZauM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZauM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!ZauM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!ZauM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!ZauM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZauM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png" width="1456" height="932" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bafa58c4-1f8c-4d16-8c70-5e0e69016149_1800x1152.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:932,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:194050,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207487993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbafa58c4-1f8c-4d16-8c70-5e0e69016149_1800x1152.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZauM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!ZauM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!ZauM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!ZauM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd3db1cb1-6918-4e5b-9a8d-d77fd0f404ef_1800x1152.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest is quick hits.</p><div><hr></div><h2>1. GPT-5.5 is champion and value pick at the same time</h2><p>Fable&#8217;s streak ends at three.</p><p>GPT-5.5 takes #1 at <strong>75%</strong>, giving it a weekly run of:</p><p><strong>#1 &#8594; #4 &#8594; #2 &#8594; #1</strong></p><p>For the first time this week, the crown and the value title sit in the same row. GPT-5.5 cost <strong>$0.38 per correct answer</strong>, roughly one-third of what Fable charged while producing more correct answers.</p><p>The margin still deserves honesty. The top four are a statistical pileup:</p><ul><li><p><strong>3&#8211;1 over Fable</strong></p></li><li><p><strong>3&#8211;1 over GPT-5.6 Sol</strong></p></li><li><p><strong>3&#8211;1 over Qwen 3.7 Max</strong></p></li></ul><p>Those are coin flips, not decisive wins. The flagships agreed on nearly every problem today.</p><p>Fable still owns speed, with a typical response time of roughly <strong>102 seconds</strong>, making it the fastest model again. Three days ago, the premium argument was:</p><blockquote><p>Best, fastest, and statistically significant.</p></blockquote><p>Today, it is simply:</p><blockquote><p>Fastest.</p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Em9G!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Em9G!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!Em9G!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!Em9G!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!Em9G!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Em9G!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f61e6cb7-6370-4325-a7b6-4c0de760ef65_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:157353,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207487993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff61e6cb7-6370-4325-a7b6-4c0de760ef65_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Em9G!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!Em9G!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!Em9G!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!Em9G!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6ba4d9b8-99ce-417d-b755-66ba9129debe_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. The bottom half is unrecognizable</h2><p>The largest moves did not happen among the flagships.</p><p>They happened here:</p><ul><li><p><strong>Qwen 3.7 Max:</strong> 32% &#8594; <strong>70%</strong></p></li><li><p><strong>GLM-5.2:</strong> one solve &#8594; <strong>38%</strong></p></li><li><p><strong>Nemotron 3 Ultra:</strong> <strong>48%</strong> on a full slate</p></li></ul><p>Models do not learn this much overnight.</p><div class="callout-block" data-callout="true"><p>Our day to day comparability controls point to the serving layer instead. This happens in the real market more often than benchmark watchers acknowledge. The model name stays fixed, while the serving stack, inference configuration, routing, context handling, or provider infrastructure changes underneath it.</p></div><p>The result can be materially different capability under the same label.</p><p>That cuts both ways for consumers.</p><p>The Qwen available today is a genuinely different proposition from the one that scored 32% yesterday. At the same time, any evaluation performed on last week&#8217;s serving stack may already be stale.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ctua!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ctua!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!ctua!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!ctua!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!ctua!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ctua!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/678a01b6-20b2-41a7-8689-a1b1ec0a0941_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:157670,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207487993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F678a01b6-20b2-41a7-8689-a1b1ec0a0941_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ctua!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!ctua!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!ctua!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!ctua!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4b9346be-7838-435d-8cc9-b980e8a501da_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Quick hits</h2><h3>GPT-5.6 Sol quietly posted the board&#8217;s best economics</h3><p>Sol reached <strong>70%</strong> at just <strong>$0.22 per correct answer</strong>, while operating at nearly Fable-level speed.</p><p>That is the best price-performance result on today&#8217;s board. If it holds for a second day, the conversation around what users are actually paying for starts over.</p><h3>Grok 4.5 slowed down sharply</h3><p>Grok held fifth place at <strong>68%</strong>, but its typical response stretched to roughly <strong>10 minutes</strong>, more than triple its usual pace.</p><p>Latency-sensitive users should check current performance before placing large workloads in the queue.</p><h3>Opus 4.8 remains directionless</h3><p>Opus slipped to sixth at <strong>62%</strong>, falling below Qwen while remaining near the top of the cost table at <strong>$1.09 per correct answer</strong>.</p><p>Its week has not been disastrous. It has simply lacked a clear argument.</p><h3>Kimi K3&#8217;s debut is now complete</h3><p>Kimi K3 finished at <strong>40%</strong> on a full slate.</p><p>The diagnosis changed once the full run completed. Its main problem is speed, not reliability. <strong>Nearly 1/4<sup>th</sup> of its slate ran out the clock (1,800s)</strong> and counted as failures.</p><p>On problems both Kimi models completed, K2.7 edged K3 by <strong>6&#8211;5</strong>.</p><p><strong>A faster K3 could become a serious contender. This version is not there yet.</strong></p><h3>Kimi K2.7 Code loses the open-weights crown</h3><p>Kimi K2.7 finished at <strong>42%</strong>, losing the open-weights lead to Nemotron.</p><p>Its successor, Kimi K3, finished just one solved problem behind it.</p><div><hr></div><h2>Why the board moved</h2><p>This was a genuine shakeup day.</p><p>Only <strong>29 of 36</strong> order calls between returning models repeated, producing <strong>&#964; = 0.61</strong>, the lowest stability reading in a week.</p><p>But the location of the movement matters.</p><p>The top five mostly reshuffled within statistical noise. The real volatility appeared in the bottom half, precisely where the serving-side changes landed.</p><p>That is the board doing its job.</p><p>When the system actually being served under a model&#8217;s name changes, yesterday&#8217;s score stops being strong evidence. Only a fresh measurement, using problems nobody could have trained on, reveals what users are buying today.</p><div><hr></div><h2>Transparency note</h2><p>Today&#8217;s board required two measurement passes:</p><ul><li><p>First pass: roughly <strong>8.8 hours</strong></p></li><li><p>Second pass: roughly <strong>7.0 hours</strong></p></li><li><p>Total wall-clock measurement time: approximately <strong>15&#190; hours</strong></p></li></ul><p>The second pass completed Kimi K3&#8217;s full slate after provider-side API errors erased roughly one-third of its debut run. It also re-attempted a small number of problems that encountered infrastructure failures for other models.</p><p>Every model shown above is scored on its complete slate.</p><p>One verdict changed after re-examination: a Nemotron pass did not reproduce, moving its score from <strong>50% to 48%</strong>.</p><p>Everything else held.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!AZQy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!AZQy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!AZQy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!AZQy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!AZQy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!AZQy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png" width="1456" height="1077" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8f460451-702a-4ad3-8052-559d4b236881_1800x1332.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1077,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:262672,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207487993?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8f460451-702a-4ad3-8052-559d4b236881_1800x1332.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!AZQy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!AZQy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!AZQy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!AZQy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25fa5235-ab3c-4c13-a618-5dff2d4d6fa8_1800x1332.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Why not trust the benchmarks you have already seen?</h2><p>Public benchmarks leak into future training runs. Scores rise, but the metric gradually shifts from measuring capability to measuring familiarity.</p><p>They are also snapshots. Even when a benchmark is valid on the day it is published, it becomes less representative as models and serving systems change.</p><p>Today&#8217;s board shows that model drift is only half the problem.</p><p>The serving stack behind a model name can change overnight and move observed capability by more than 30 percentage points.</p><p>We generate <strong>fresh, novel problems every day</strong> and re-measure every model each morning.</p><p>Today&#8217;s board cost approximately <strong>$121</strong> in compute. <strong>But you can subscribe for free!</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><div><hr></div><h2>What to do with today&#8217;s board</h2><p>The GPT lane won today&#8217;s argument.</p><p><strong>GPT-5.5 is the champion at 75% and a value pick at $0.38 per correct answer.</strong> If you already use it, there is little reason to move. If you are paying more elsewhere, today is a reasonable day to ask what the premium is buying.</p><p>Watch GPT-5.6 Sol closely. <strong>$0.22 per correct answer at 70%</strong> is the best economics we have printed, pending confirmation on a second day.</p><p>Fable users are not wrong. It remains elite and continues to be the fastest model on the board. But the winning streak is over, the statistically significant separation is gone, and the premium now needs another justification.</p><p>Most importantly, treat every budget model opinion formed before today as expired.</p><p>The Qwen, GLM, and Nemotron being served now are not the same systems users evaluated yesterday.</p><p>That is our read.</p><p>Argue with it in the comments below. Tomorrow&#8217;s board is the rebuttal.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe, and stay ahead of the model madness. Totally free!</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[GPT 5.6 and 5.5 continue flipping, Grok 4.5 is just budget; not performance]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 16, 2026]]></description><link>https://iijme.substack.com/p/gpt-56-and-55-continue-flipping-grok</link><guid isPermaLink="false">https://iijme.substack.com/p/gpt-56-and-55-continue-flipping-grok</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Thu, 16 Jul 2026 15:01:54 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!d8XV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!d8XV!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!d8XV!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!d8XV!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!d8XV!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!d8XV!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!d8XV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5ae7690b-b0c7-4ca8-9332-ed1e5cce9cbc_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1774851,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207298171?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5ae7690b-b0c7-4ca8-9332-ed1e5cce9cbc_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!d8XV!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!d8XV!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!d8XV!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!d8XV!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b3e43a7-93e1-4783-a835-49afa948aea9_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: Fable 5</strong>, #1 for a third straight day at <strong>80%</strong>. It did not lose a single problem to anyone ranked sixth or below: <strong>31&#8211;0</strong> over GLM, the most lopsided result we have ever published, plus 19&#8211;0 over Qwen, 18&#8211;0 over Nemotron, and 12&#8211;0 over Kimi.</p></li><li><p><strong>Cheapest closed model: Grok 4.5</strong>, <strong>$0.37 per correct answer</strong> at 58%. The value remains strong, but it has now taken three straight statistically significant losses to Fable, including <strong>3&#8211;12 today</strong> (p=0.04).</p></li><li><p><strong>Best open-weights model: Kimi K2.7 Code</strong>, <strong>49%</strong> at <strong>$0.15 per correct answer</strong>, unchallenged again.</p></li><li><p><strong>A steady board:</strong> <strong>33 of 36</strong> order calls between returning models repeated (&#964; = 0.83). The only swaps were GPT-5.5 climbing past Sol and Opus, and Nemotron moving past Qwen.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> GLM-5.2 solved <strong>one problem all day</strong>, its second one-solve day this month. Its recent oscillation, 2% &#8594; 22% &#8594; 12% &#8594; 2%, is the strangest signature we track.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QiVQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QiVQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!QiVQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!QiVQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!QiVQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!QiVQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png" width="1456" height="861" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b87c48e9-4d39-49ad-92f8-3d90e42ee8be_1800x1064.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:861,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:183836,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207298171?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb87c48e9-4d39-49ad-92f8-3d90e42ee8be_1800x1064.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!QiVQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!QiVQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!QiVQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!QiVQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb44301-989c-403b-943a-241e37aaca13_1800x1064.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest is quick hits.</p><h2>1. Day three: Fable&#8217;s floor is perfect, but its ceiling has company</h2><p>The streak held.</p><p>Fable finished at <strong>80%</strong>, ranked #1 for a third straight day, and once again produced the fastest typical answer on the board at roughly 107 seconds.</p><p>Against the bottom half of the field, it was flawless: four budget models, 40 separating problems, <strong>zero losses</strong>.</p><p>Its <strong>31&#8211;0</strong> result against GLM-5.2 is the most lopsided head-to-head we have ever published.</p><p>But the honest story at the top is less decisive.</p><p>Yesterday&#8217;s daylight narrowed considerably:</p><ul><li><p><strong>5&#8211;3</strong> over GPT-5.5, down from 8&#8211;1 yesterday (p=0.73)</p></li><li><p><strong>5&#8211;2</strong> over GPT-5.6 Sol</p></li><li><p><strong>7&#8211;2</strong> over Opus 4.8</p></li><li><p><strong>12&#8211;3</strong> over Grok 4.5 (p=0.04)</p></li></ul><p>Only the Grok matchup remained statistically significant, and this was Fable&#8217;s third significant win over Grok in a row.</p><p>Three days in, Fable&#8217;s claim to #1 rests on two things: a sustained winning streak and a perfect floor against weaker models. It does <strong>not</strong> yet have clear statistical separation from the other flagships.</p><p>The price also moved in the wrong direction. At <strong>$1.53 per correct answer</strong>, this was Fable&#8217;s most expensive day yet, widening the value gap between the champion and the models immediately below it.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!3lss!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!3lss!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!3lss!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!3lss!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!3lss!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!3lss!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8e3d4608-8352-40be-95df-2364df4dcc1b_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:187381,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207298171?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8e3d4608-8352-40be-95df-2364df4dcc1b_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!3lss!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!3lss!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!3lss!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!3lss!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F697844c1-3ac5-4dbb-86f0-bee1db5c7877_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><h2>2. The GPT seesaw swings back: GPT-5.5 jumps from #4 to #2</h2><p>Monday&#8217;s champion. Yesterday&#8217;s #4. Today&#8217;s #2.</p><p>GPT-5.5 rebounded to <strong>75%</strong>, passed both Sol and Opus, and edged its successor <strong>3&#8211;2</strong> on their discordant problems.</p><p>It also delivered the runaway best value among the top four: <strong>$0.76 per correct answer</strong>, roughly half the cost of the models ranked immediately around it.</p><p>Sol did not slump. It improved slightly from yesterday&#8217;s 70% to roughly <strong>72%</strong> today. GPT-5.5 simply passed it again.</p><p>The last three boards now look like this:</p><ul><li><p><strong>GPT-5.5:</strong> #1 &#8594; #4 &#8594; #2</p></li><li><p><strong>GPT-5.6 Sol:</strong> #5 &#8594; #2 &#8594; #3</p></li></ul><p>Each individual swing has had a plausible explanation. Taken together, though, the honest conclusion is simpler: the two models remain statistically interchangeable on results and durably different on price.</p><p>Until one of them produces a sustained run of separation, treat the GPT rank churn as weather.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!w26a!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!w26a!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!w26a!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!w26a!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!w26a!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!w26a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/71eb8eac-5564-4297-983b-d274f731c303_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:149382,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207298171?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71eb8eac-5564-4297-983b-d274f731c303_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!w26a!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!w26a!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!w26a!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!w26a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3e41f276-74ec-4fe4-8158-c55765245405_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">The best model changes by the day. Subscribe to stay updated.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h2>Quick hits</h2><h3>Opus 4.8: displaced, not degraded</h3><p>Opus slipped one seat to #4 at <strong>68%</strong>, but it did not meaningfully get worse. The GPT models moved around it.</p><p>It remained statistically level with both, going 2&#8211;4 and 3&#8211;6 on separating problems, but at <strong>$1.21 per correct answer</strong>, it was never the value pick.</p><h3>Grok 4.5: still cheap, no longer a budget flagship</h3><p>Grok held #5 at <strong>58%</strong> and retained the best closed-model price at <strong>$0.37 per correct answer</strong>.</p><p>But three consecutive statistically significant losses to Fable settle the &#8220;budget flagship&#8221; question for now.</p><p>It is budget. It is not currently flagship.</p><h3>Nemotron 3 Ultra: same accuracy, five times slower</h3><p>Nemotron retained the cheapest-results crown at <strong>$0.04 per correct answer</strong>, with every cell successfully judged for once.</p><p>The problem was latency.</p><p>Its typical answer took <strong>12.6 minutes</strong>, compared with 2.5 minutes yesterday, a slowdown of nearly fivefold at roughly the same accuracy.</p><p>Something appears to have changed server-side. Watch this one.</p><h3>Qwen 3.7 Max: the climb ends</h3><p>Qwen&#8217;s three-board rise stalled. Its solve rate fell from 38% to <strong>32%</strong>, allowing Nemotron to pass it again.</p><h3>GLM-5.2: one solve</h3><p>One correct answer all day.</p><p>There is no price at which a 2% solve rate becomes a deal.</p><h2>Why the board moves at all</h2><p>This was another steady day where it mattered.</p><p><strong>33 of 36</strong> order calls between returning models repeated, producing a Kendall &#964; of <strong>0.83</strong>.</p><p>All three swaps came from two movers:</p><ol><li><p>GPT-5.5 rebounded past Sol and Opus.</p></li><li><p>Nemotron edged past a fading Qwen.</p></li></ol><p>The top seat remained unchanged for a third straight day.</p><p>Meanwhile, the largest absolute score movement, GLM&#8217;s 20-point collapse to one solve, happened in the part of the board where it changes no real decision.</p><p>Fresh problems cause raw scores to breathe. Three consecutive days with the same model on top is what signal begins to look like.</p><h2>Why not just trust the benchmarks you have already seen?</h2><p>Public benchmarks eventually leak into training data.</p><p>As that happens, scores inflate and begin measuring memorization rather than capability. A benchmark may be accurate when it launches, then become less informative with every subsequent training run.</p><p>We generate <strong>fresh, novel problems every day</strong>.</p><p>No model can have trained on a problem that did not exist until that morning. That lets us measure a three-day winning streak, a two-day crown, and a one-solve collapse on exactly the same footing.</p><p>Today&#8217;s board required approximately <strong>$158 in compute</strong>.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><h2>What to do with today&#8217;s board</h2><p>Nothing at the top changed enough to force a switch.</p><p><strong>Already using Fable?</strong> Three straight days at #1 says stay.</p><p><strong>Already using GPT-5.5?</strong> Today&#8217;s #2 finish at <strong>$0.76 per correct answer</strong>, roughly half the price of the models around it, says you are still in the right seat. Sol&#8217;s value case weakened today rather than strengthening.</p><p>The one real operational warning is Nemotron. If you chose it partly for speed, check your production latencies. It ran nearly five times slower today without delivering better accuracy.</p><p>And if any of your workloads still route to GLM-5.2, today it answered one question correctly.</p><p>That is our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe to get the day&#8217;s best model, plus the fastest and cheapest way to achieve that performance, in your inbox before you start work.</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[GPT 5.6 barely crests Opus, Grok keeps sliding, Kimi 2.7 is best open weights model]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 15, 2026]]></description><link>https://iijme.substack.com/p/gpt-56-barely-crests-opus-grok-keeps</link><guid isPermaLink="false">https://iijme.substack.com/p/gpt-56-barely-crests-opus-grok-keeps</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Wed, 15 Jul 2026 16:15:05 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!i_wW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!i_wW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!i_wW!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 424w, https://substackcdn.com/image/fetch/$s_!i_wW!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 848w, https://substackcdn.com/image/fetch/$s_!i_wW!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!i_wW!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!i_wW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png" width="1448" height="1086" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c9432960-a1f9-44b6-a555-75631a908beb_1448x1086.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1086,&quot;width&quot;:1448,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1369284,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207171788?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9432960-a1f9-44b6-a555-75631a908beb_1448x1086.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!i_wW!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 424w, https://substackcdn.com/image/fetch/$s_!i_wW!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 848w, https://substackcdn.com/image/fetch/$s_!i_wW!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 1272w, https://substackcdn.com/image/fetch/$s_!i_wW!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30987b6b-4c72-4212-95ff-2910cc2f9c8f_1448x1086.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: Fable 5</strong> &#8212; <strong>82%</strong>, with a second straight day of real separation: <strong>8&#8211;1</strong> over GPT-5.5 (p=0.04), <strong>12&#8211;2</strong> over Grok 4.5 (p=0.01), and clean sweeps across the budget half of the board, including <strong>28&#8211;0</strong> over GLM-5.2.</p></li><li><p><strong>Cheapest closed model: Grok 4.5</strong> &#8212; <strong>$0.34 per correct answer</strong> at 57%. The value case holds, but Fable has now beaten it decisively on two consecutive boards.</p></li><li><p><strong>Best open-weights model: Kimi K2.7 Code</strong> &#8212; undisputed today at <strong>49%</strong> and <strong>$0.13 per correct answer</strong>, while Nemotron fell eighteen points.</p></li><li><p><strong>A steady board.</strong> <strong>33 of 36</strong> order calls between returning models repeated (&#964; = 0.83). Nearly every swap came from two movements: Sol and Opus stepping over GPT-5.5, and Nemotron falling beneath Kimi and Qwen.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> GPT-5.5 went from <strong>#1 on Monday</strong> to <strong>#2 yesterday</strong> to <strong>#4 today</strong>. The board giveth.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ZOwk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZOwk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!ZOwk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!ZOwk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!ZOwk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZOwk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png" width="1456" height="861" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bf1f1ac5-c544-4a4e-bb13-9be78f2d3ae1_1800x1064.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:861,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:182436,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207171788?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbf1f1ac5-c544-4a4e-bb13-9be78f2d3ae1_1800x1064.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZOwk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!ZOwk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!ZOwk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!ZOwk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa04c1fca-19da-4ddf-80ec-5bcff6602140_1800x1064.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest is quick hits.</p><h2>1. Fable 5, day two: the gap is starting to look structural</h2><p>One day of daylight can be a good draw. Two starts to look like a pattern.</p><p>Fable 5 followed yesterday&#8217;s breakout with an <strong>82% solve rate</strong>, and the statistical picture moved from &#8220;ahead&#8221; to &#8220;significantly ahead of almost everyone.&#8221;</p><p>It beat:</p><ul><li><p>GPT-5.5 <strong>8&#8211;1</strong> (p=0.04)</p></li><li><p>Grok 4.5 <strong>12&#8211;2</strong> (p=0.01)</p></li><li><p>Kimi K2.7 Code <strong>14&#8211;1</strong></p></li><li><p>Qwen 3.7 Max <strong>19&#8211;1</strong></p></li><li><p>GLM-5.2 <strong>28&#8211;0</strong></p></li></ul><p>That last result is the most lopsided head-to-head we have ever printed.</p><p>Only Sol (<strong>7&#8211;2</strong>, p=0.18) and Opus (<strong>7&#8211;1</strong>, p=0.07) escaped statistical significance, and neither by much.</p><p>Fable also remained the fastest model on the board, producing a typical answer in roughly <strong>106 seconds</strong>. At <strong>$1.26 per correct answer</strong>, it even cost less per successful result than Sol one seat below it.</p><p>Two days ago, paying for Fable became defensible. Today, it is starting to look like the default.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!16Wd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!16Wd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!16Wd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!16Wd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!16Wd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!16Wd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png" width="1456" height="987" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b7154897-a89e-419f-80d4-1285a75f6187_1800x1220.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:987,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:243148,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207171788?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb7154897-a89e-419f-80d4-1285a75f6187_1800x1220.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!16Wd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!16Wd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!16Wd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!16Wd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f7204fb-aad1-4f1c-b473-9545c654f739_1800x1220.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. The GPT seesaw: Sol completes the redemption arc as 5.5 gives back the crown</h2><p>On Monday, Sol lost <strong>0&#8211;4</strong> to its own predecessor. We said it needed to prove the premium for two consecutive days.</p><p>Consider it proven.</p><p>Sol finished <strong>#3 yesterday</strong> and <strong>#2 today</strong>, reaching a <strong>70% solve rate</strong>. For the first time, it also finished above GPT-5.5, edging their direct matchup <strong>5&#8211;3</strong>.</p><p>Meanwhile, GPT-5.5 went from champion to runner-up to <strong>#4</strong> in 48 hours, shedding roughly seven and a half percentage points along the way.</p><p>Before migrating anything, however, the economics still favor 5.5.</p><p>GPT-5.5 delivered its 65% solve rate at <strong>$0.87 per correct answer</strong>, compared with <strong>$1.38</strong> for Sol. That makes 5.5 the cheapest source of correct answers in the top four by a wide margin.</p><p>Their direct matchup also remains statistically indistinguishable from a coin flip (p=0.73).</p><p>Sol has earned the flagship label. GPT-5.5 still owns the value label.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kXqb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kXqb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!kXqb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!kXqb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!kXqb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!kXqb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/861f50b3-5930-41d5-b824-777134e184a9_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:148287,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207171788?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861f50b3-5930-41d5-b824-777134e184a9_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kXqb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!kXqb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!kXqb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!kXqb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2f33c581-6ebd-40c8-a035-22685ca9cc91_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Quick hits</h2><ul><li><p><strong>Opus 4.8</strong> quietly climbed to #3 at <strong>68%</strong>, finishing effectively level with Sol in their head-to-head (3&#8211;4) and GPT-5.5 (4&#8211;3). Steady and capable, but still not the value pick at <strong>$1.21 per correct answer</strong>.</p></li><li><p><strong>Grok 4.5</strong> held #5 at <strong>57%</strong> and retained the best closed-model price on the board at <strong>$0.34 per correct answer</strong>. But it has now suffered two consecutive significant losses to Fable. The &#8220;level with the leaders&#8221; era is over. The &#8220;80% cheaper than them&#8221; era continues.</p></li><li><p><strong>Nemotron 3 Ultra</strong> surrendered its spike, falling from 54% to <strong>36%</strong> and sliding below both Kimi and Qwen. It also lost cells to provider-side API errors for the <strong>fourth consecutive board</strong>, making it the least reliable model we track.</p></li><li><p><strong>Qwen 3.7 Max</strong> improved for a third straight board: 33% &#8594; 35% &#8594; <strong>38%</strong>. It remains tied with GLM as the slowest model on the board.</p></li><li><p><strong>GLM-5.2</strong> posted its worst result yet at <strong>12%</strong>, including a <strong>28&#8211;0</strong> sweep by Fable.</p></li></ul><h2>Why the board moves at all</h2><p>This was a steady day.</p><p><strong>33 of 36</strong> order calls between returning models repeated, producing a Kendall rank correlation of <strong>&#964; = 0.83</strong>.</p><p>The three changes all came from two genuine movements:</p><ol><li><p>GPT-5.5 eased beneath Sol and Opus.</p></li><li><p>Nemotron&#8217;s Monday spike unwound, dropping it below Kimi and Qwen.</p></li></ol><p>Nothing else moved.</p><p>The same fresh-problems-daily machinery that produced last week&#8217;s shakeup produced near-stasis today. That is exactly what the system should do when the models themselves are the thing that did not meaningfully change.</p><h2>Why not just trust the benchmarks you&#8217;ve already seen?</h2><p>Public benchmarks eventually leak into training data. Scores rise, and the benchmark gradually starts measuring memorization instead of ability.</p><div class="pullquote"><p>Note Grok admitted to contamination this past Friday. See disclaimer 2 on the bottom.<br>https://cursor.com/blog/grok-4-5<br><br>This newsletter is unaffected by data contamination.</p></div><p>They are also snapshots: accurate on the day they are collected, and less representative every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until that morning.</p><p>That is how a five-day-old flagship&#8217;s redemption arc, a champion&#8217;s rapid fall, and a two-day winning streak can all be measured on identical footing.</p><p>Today&#8217;s board required roughly <strong>$151 in compute</strong>.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><h2>What to do with today&#8217;s board</h2><p>If you moved to Fable after Monday&#8217;s board, stay there. Two consecutive days of statistically meaningful separation, combined with the fastest response time on the board, is about as strong a signal as this leaderboard can produce.</p><p>If you are choosing between the GPTs, Sol now appears to be the stronger model. But <strong>GPT-5.5 at $0.87 per correct answer remains the best value in the top four</strong>. Pay for Sol only when its roughly one-minute speed advantage is worth paying about 60% more per successful result.</p><p>Keep Grok for cost-sensitive workloads, but stop expecting it to tie the leaders.</p><p>For open weights, the answer today is simple: <strong>Kimi</strong>. Nemotron&#8217;s spike did not survive contact with a second day.</p><p>That is our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Fable at the top, Opus ties GPT 5.6 Sol, Grok slips hard]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 14, 2026]]></description><link>https://iijme.substack.com/p/fable-at-the-top-opus-ties-gpt-56</link><guid isPermaLink="false">https://iijme.substack.com/p/fable-at-the-top-opus-ties-gpt-56</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Tue, 14 Jul 2026 17:16:36 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!g3Q6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!g3Q6!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!g3Q6!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!g3Q6!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!g3Q6!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!g3Q6!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!g3Q6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6a75f4eb-2dc0-4cf3-9fc4-5475e5a906d7_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1157032,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207046691?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6a75f4eb-2dc0-4cf3-9fc4-5475e5a906d7_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!g3Q6!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!g3Q6!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!g3Q6!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!g3Q6!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa757d049-345f-4f09-af8a-94caa2c73e59_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: Fable 5.</strong> It finished at <strong>80%</strong>, taking #1 with the first statistically significant daylight any leader has shown in a week. Fable went <strong>10&#8211;2</strong> against Grok 4.5 (p=0.04), <strong>14&#8211;0</strong> against Kimi (p=0.0001), and beat every flagship head-to-head.</p></li><li><p><strong>Cheapest closed model: Grok 4.5.</strong> It delivered correct answers for <strong>$0.34 each</strong> at a 60% solve rate. But read the quick hits: for the first time, a leader put Grok away decisively.</p></li><li><p><strong>Best open-weights model: disputed.</strong> Nemotron 3 Ultra ranks higher at <strong>54%</strong>, but its slate was clipped by provider-side errors. Full-slate Kimi K2.7 Code finished at <strong>45%</strong>, cost $0.14 per correct answer, and won their head-to-head <strong>5&#8211;2</strong>. Our pick is Kimi.</p></li><li><p><strong>A steady board.</strong> <strong>32 of 36</strong> order calls between returning models repeated (&#964; = 0.78), the steadiest day in nearly a week. The swaps were Fable over GPT-5.5, Sol and Opus over Grok, and Nemotron trading places with Kimi.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> the best model was also the <em>fastest</em>. Fable&#8217;s typical answer landed in about <strong>one minute and forty seconds</strong>, quicker than every budget model on the board. <strong>Accuracy and speed have never shared the same row before.</strong></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7jPl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7jPl!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!7jPl!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!7jPl!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!7jPl!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!7jPl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png" width="1456" height="861" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/55eda63f-3a0c-4817-87b0-b8398a8dea72_1800x1064.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:861,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:182063,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207046691?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F55eda63f-3a0c-4817-87b0-b8398a8dea72_1800x1064.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7jPl!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!7jPl!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!7jPl!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!7jPl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe997811d-35f6-483f-b6cc-6f5f54350b1c_1800x1064.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest is quick hits.</p><div><hr></div><h2>1. Fable 5 didn&#8217;t just take the crown back. It broke the gridlock.</h2><p>Three straight boards ended in coin flips at the top.</p><p>Today didn&#8217;t.</p><p>Fable 5 posted an <strong>80% solve rate</strong>, opened 4.5 points of Elo daylight, and <strong>created the first statistically significant separation from the value pack</strong> since the top of the board seized up:</p><ul><li><p><strong>10&#8211;2</strong> over Grok 4.5 (p=0.04)</p></li><li><p><strong>14&#8211;0</strong> over Kimi K2.7 Code (p=0.0001)</p></li><li><p><strong>9&#8211;0</strong> over Nemotron 3 Ultra (p=0.004)</p></li></ul><p>Against the other flagships, the margins were friendlier but consistent:</p><ul><li><p><strong>6&#8211;3</strong> over GPT-5.5</p></li><li><p><strong>7&#8211;3</strong> over GPT-5.6 Sol</p></li><li><p><strong>7&#8211;3</strong> over Opus 4.8</p></li></ul><p>Fable beat <em>every model</em> on the problems that separated them.</p><p>It also did all of this while being the <strong>fastest model on the entire board</strong>. Its typical answer arrived in about 100 seconds.</p><p>At <strong>$1.15 per correct answer</strong>, Fable was also cheaper per successful result than Sol ($1.43) and Opus ($1.18).</p><p>The priciest sticker bought the best results, the fastest answers, and a mid-flagship realized cost.</p><p>Days like this are why the sticker-price column is not the cost column.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!cNgb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!cNgb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!cNgb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!cNgb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!cNgb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!cNgb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ba2676f4-6534-47fd-97dc-e06508f6da18_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:147800,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207046691?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fba2676f4-6534-47fd-97dc-e06508f6da18_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!cNgb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!cNgb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!cNgb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!cNgb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2754d781-b715-4a53-b0de-acecb0a6d81b_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. Sol answers yesterday&#8217;s embarrassment, halfway</h2><p>Yesterday, GPT-5.6 Sol lost to its own predecessor <strong>0&#8211;4</strong>.</p><p>We said: prove the premium, or the board keeps saying &#8220;buy 5.5.&#8221;</p><p>Today, Sol rebounded from #5 to <strong>#3 at 70%</strong>, and its head-to-head against GPT-5.5 evened out at <strong>3&#8211;4</strong> (p=1.0).</p><p>That completes half the assignment.</p><p>The other half remains open:</p><ul><li><p>GPT-5.5 still ranks higher.</p></li><li><p>GPT-5.5 costs <strong>$0.80 per correct answer</strong>, compared with Sol&#8217;s <strong>$1.43</strong>.</p></li><li><p>Sol produced the most expensive correct answers on today&#8217;s board.</p></li><li><p>GPT-5.5 has now spent two straight boards above its successor.</p></li></ul><p>One more day like today and Sol starts looking like a real flagship.</p><p>One more day of &#8220;statistically even, nearly twice the price,&#8221; and it is just a speed tax.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5Nbk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5Nbk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!5Nbk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!5Nbk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!5Nbk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!5Nbk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png" width="1456" height="987" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6f558a6e-9688-494d-adc5-a2eb07e9d91b_1800x1220.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:987,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:246058,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/207046691?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6f558a6e-9688-494d-adc5-a2eb07e9d91b_1800x1220.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!5Nbk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!5Nbk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!5Nbk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!5Nbk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff57aabd8-bd3f-4360-9f69-2081fd6072ef_1800x1220.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Quick hits</h2><h3>Grok 4.5 hits its first wall</h3><p>Grok dropped to #5 at <strong>60%</strong>, and Fable beat it <strong>10&#8211;2</strong>, the first statistically significant loss Grok has taken since joining the board.</p><p>The value case survives. Grok still costs just <strong>$0.34 per correct answer</strong> and remains statistically level with GPT-5.5.</p><p>But &#8220;cheap and tied with the leaders&#8221; has now become just &#8220;cheap.&#8221;</p><h3>Opus 4.8 posts a personal best</h3><p>Opus recorded its best score on our board at <strong>70%</strong> and finished dead even with Sol in their head-to-head, <strong>4&#8211;4</strong>.</p><p>It was also the only model to leave problems unanswered, for the second board in a row.</p><h3>Nemotron ranks above Kimi, with an asterisk</h3><p>Nemotron 3 Ultra ranked #6 at <strong>54%</strong>, but provider-side API errors clipped its slate for the third consecutive board.</p><p>It is the flakiest model we track.</p><p>Full-slate Kimi won their head-to-head <strong>5&#8211;2</strong>. Nemotron still produces the cheapest correct answers anywhere, at <strong>$0.05 each</strong>, when its API shows up.</p><h3>GLM-5.2 gives the gains back</h3><p>GLM&#8217;s three-board climb reversed.</p><p>It finished at <strong>18%</strong>, in last place, and was the slowest model on the board.</p><p>The bounce was noise.</p><div><hr></div><h2>Why the board moves at all</h2><p>This was the steadiest board in nearly a week.</p><p><strong>32 of 36</strong> order calls between returning models repeated, producing a Kendall rank correlation of <strong>&#964; = 0.78</strong>.</p><p>The four swaps all happened at the seams:</p><ul><li><p>Fable edged past GPT-5.5 at the top.</p></li><li><p>Sol and Opus stepped over a slipping Grok.</p></li><li><p>Nemotron and Kimi traded places in the budget tier.</p></li></ul><p>Individual scores still moved. Sol gained 12 percentage points, while GLM lost five.</p><p>That is exactly the pattern our day-to-day comparability controls are designed to referee.</p><p>Fresh problems change the difficulty costume every morning. A mostly stable ranking, with a few genuine movers, is what real signal looks like.</p><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve already seen?</h2><p>Public benchmarks leak into subsequent training runs.</p><p>Scores inflate, and the benchmark gradually starts measuring memorization instead of ability.</p><p>They are also snapshots. They may be accurate on the day they are run, but they become less representative every day afterward.</p><p>We generate <strong>fresh, novel problems every morning</strong>. No model can have trained on a problem that did not exist until today.</p><p>That is how a four-day-old flagship&#8217;s redemption arc and a week-old champion&#8217;s counterpunch can be measured on identical footing, morning after morning.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Today&#8217;s board required about <strong>$150 </strong>in<strong> compute</strong>. But you can <strong>subscribe</strong> for <strong>free!</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>What to do with today&#8217;s board</h2><p>Today is the first board in a week where paying top dollar is clearly defensible.</p><p>Fable 5 was:</p><ul><li><p>The best model</p></li><li><p>The fastest model</p></li><li><p>Mid-pack on realized cost</p></li></ul><p>If your work justifies flagship pricing at all, today it justifies Fable.</p><p>If it doesn&#8217;t, GPT-5.5 remains the sane default. It ranks #2, costs <strong>$0.80 per correct answer</strong>, and still has not lost to its more expensive successor.</p><p><strong>Pause the Grok side-by-side if you started one based on our earlier results.</strong> A statistically significant <strong>10&#8211;2</strong> loss to the champion is the first real evidence against it. One more board like this ends the experiment.</p><p><strong>For open weights, stay on Kimi. Do not move to Nemotron until it completes a full slate.</strong></p><p>That&#8217;s our read.</p><p>Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div><hr></div><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p>]]></content:encoded></item><item><title><![CDATA[GPT-5.6-Sol Quiet Quits, GPT-5.5 Shows Up Strong]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 13, 2026]]></description><link>https://iijme.substack.com/p/gpt-56-sol-quiet-quits-gpt-55-shows</link><guid isPermaLink="false">https://iijme.substack.com/p/gpt-56-sol-quiet-quits-gpt-55-shows</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Mon, 13 Jul 2026 17:28:02 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!VaxE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!VaxE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!VaxE!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!VaxE!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!VaxE!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!VaxE!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!VaxE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6192a7ea-3532-4d69-aa79-bdea1f8a3db5_1672x941.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1615768,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206882995?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6192a7ea-3532-4d69-aa79-bdea1f8a3db5_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!VaxE!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!VaxE!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!VaxE!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!VaxE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05e3ea6e-6b9b-457e-928f-a8b330cd616f_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><ul><li><p><strong>Best closed model: GPT-5.5.</strong> It finished #1 at <strong>68%</strong>, dead even with Fable 5 on solve rate and head-to-head results (<strong>4&#8211;4</strong>). GPT-5.5 cost <strong>$0.86 per correct answer</strong>, compared with Fable&#8217;s <strong>$1.43</strong>.</p></li><li><p><strong>Cheapest closed model: Grok 4.5.</strong> It delivered a <strong>62%</strong> solve rate for <strong>$0.32 per correct answer</strong> and remained statistically level with both leaders. It went 5&#8211;7 against Fable 5 (p=0.77).</p></li><li><p><strong>Best open-weights model: Kimi K2.7 Code.</strong> It scored <strong>46%</strong> at <strong>$0.17 per correct answer</strong> and beat Nemotron 3 Ultra <strong>4&#8211;1</strong> on the problems where they disagreed.</p></li><li><p><strong>Today&#8217;s shakeup:</strong> <strong>29 of 36</strong> order calls between returning models repeated (&#964; = 0.61). GPT-5.5 climbed past Fable, Grok, and Sol; Opus 4.8 rebounded past Kimi; Nemotron and Qwen swapped places.</p></li><li><p><strong>Today&#8217;s tidbit:</strong> GPT-5.6 Sol, statistically level with the leaders on its Thursday debut, fell to <strong>#5</strong> and went <strong>0&#8211;4</strong> against its own predecessor at nearly twice the realized cost. So far, the new-model premium is just a premium.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2_5s!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2_5s!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!2_5s!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!2_5s!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!2_5s!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2_5s!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png" width="1456" height="861" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2b194123-b58a-41ae-b175-4712e17d8024_1800x1064.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:861,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:183166,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206882995?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2b194123-b58a-41ae-b175-4712e17d8024_1800x1064.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2_5s!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!2_5s!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!2_5s!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!2_5s!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd66c6159-0355-44cc-aae8-7c23682bb925_1800x1064.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Two stories lead today&#8217;s board. The rest are quick hits.</p><h2>1. GPT-5.5 and Fable 5 tied for the crown, but only one charges 40% less</h2><p>Identical solve rates at <strong>68%</strong>. A perfect <strong>4&#8211;4</strong> split on the problems that separated them. Elo ratings just three points apart.</p><p>This is about as tied as two models can get.</p><p>The ranking algorithm gave GPT-5.5 the top spot on strength of schedule, by the thinnest margin we have published. The bill was not nearly as close: GPT-5.5 delivered its half of the tie for <strong>$0.86 per correct answer</strong>, compared with <strong>$1.43</strong> for Fable 5.</p><p>One seat below them, Grok 4.5 remains statistically level with both leaders. It scored <strong>62%</strong>, went 5&#8211;7 against Fable (p=0.77), and cost just <strong>$0.32 per correct answer</strong>.</p><p>The podium is therefore less a performance ranking than a three-model argument about how much you enjoy paying.</p><p>The Elo chart below captures it well: one overlapping blur at the summit.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ds12!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ds12!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!ds12!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!ds12!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!ds12!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ds12!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a6a09dd0-5b52-48be-a9a7-a353374655c5_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:148009,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206882995?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa6a09dd0-5b52-48be-a9a7-a353374655c5_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ds12!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!ds12!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!ds12!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!ds12!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F884453df-8f97-414d-a8cc-db52caf7991d_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. Sol&#8217;s crown lasted one news cycle</h2><p>On Thursday&#8217;s debut, we wrote: &#8220;Watch this one. Debuts move.&#8221;</p><p>They move in both directions.</p><p>GPT-5.6 Sol finished <strong>#5 at 58%</strong> today, behind the predecessor it is supposed to replace. It went <strong>0&#8211;4</strong> against GPT-5.5 on the problems where they disagreed (p=0.13) and <strong>3&#8211;7</strong> against Fable 5.</p><p>Sol kept its speed advantage, producing a typical answer in about two minutes, although even Fable was faster today. Its verbosity, however, kept the meter running.</p><p>Sol cost <strong>$1.68 per correct answer</strong>, effectively tying Fable for the most expensive result on the board. That came from a model that just lost head-to-head against a sibling costing roughly half as much.</p><p>One day is not a verdict. But the question has flipped since launch:</p><p><strong>Can Sol prove the premium, or will the board keep saying &#8220;buy 5.5&#8221;?</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!c80j!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!c80j!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!c80j!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!c80j!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!c80j!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!c80j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png" width="1456" height="987" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/98afddc3-25c9-444e-a9a6-d3a67a4d9f47_1800x1220.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:987,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:246720,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206882995?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F98afddc3-25c9-444e-a9a6-d3a67a4d9f47_1800x1220.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!c80j!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!c80j!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!c80j!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!c80j!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fec7d1316-fd4d-4183-b515-a852f900d766_1800x1220.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Quick hits</h2><ul><li><p><strong>Opus 4.8 rebounded hard:</strong> 38% &#8594; <strong>60%</strong>, climbing three seats to #4. Its value still trails its performance, at <strong>$1.55 per correct answer</strong>, more than either model ranked above it.</p></li><li><p><strong>Nemotron 3 Ultra recovered:</strong> 22% &#8594; <strong>40%</strong>, gaining two seats. It produced the fastest typical answer on the board and the cheapest results anywhere at <strong>$0.07 per correct answer</strong>. Kimi&#8217;s 4&#8211;1 head-to-head edge, however, keeps the open-weights title with Moonshot.</p></li><li><p><strong>Qwen 3.7 Max ticked up to 32%.</strong> It remains the budget model that somehow costs about twice as much per result as its budget rivals, at <strong>$0.34 per correct answer</strong>.</p></li><li><p><strong>GLM-5.2 improved for a third straight board:</strong> 2% &#8594; 15% &#8594; <strong>22%</strong>. Watch this space. Eventually.</p></li></ul><h2>Why did the board move?</h2><p>Every returning model scored higher than it did on the previous board. Today&#8217;s problem slate was easier, and our day-to-day comparability controls attribute that broad lift to the problems, not to a simultaneous improvement across every model.</p><p>The ordering is where the news lives.</p><p>Of the <strong>36</strong> order calls between returning models, <strong>29 repeated</strong> (&#964; = 0.61). Most of the seven swaps came from two genuine movers:</p><ol><li><p>GPT-5.5 climbed through the top four.</p></li><li><p>Opus 4.8 rebounded through the middle.</p></li></ol><p>Sol also slipped below both.</p><p>Raw percentages are a model&#8217;s daily costume. Rankings and head-to-head results are the body underneath.</p><h2>Why not trust the benchmarks you have already seen?</h2><p>Public benchmarks eventually leak into training data. Scores inflate, and what once measured ability starts measuring memorization.</p><p>They are also snapshots: accurate on the day they are run, then progressively less representative as models, serving infrastructure, quantization, and inference behavior change.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until that morning.</p><p>That lets us measure a model released on Thursday against six-week incumbents on identical footing. It also lets us retest the launch-day shine four days later.</p><p>Today&#8217;s board required approximately <strong>$155 in compute</strong>. <strong>But you can subscribe for free!</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><h2>What to do with today&#8217;s board</h2><p><strong>Using GPT-5.5? Stay put.</strong></p><p>Today, it matched the most expensive model on the board at 60% of the realized cost and beat its own successor head-to-head. There is currently no demonstrated reason to migrate.</p><p><strong>Paying Fable prices? Run Grok 4.5 alongside it for a week.</strong></p><p>Grok cost <strong>$0.32 per correct answer</strong>, compared with Fable&#8217;s <strong>$1.43</strong>, while remaining statistically level. Let your own workload settle the argument.</p><p><strong>Considering a move to GPT-5.6 Sol? Hold off.</strong></p><p>Wait until it beats GPT-5.5 on this board for at least two consecutive days. Speed is currently its only proven advantage, and today you paid nearly twice as much per correct answer for it.</p><p>That is our read. Argue with it. Tomorrow&#8217;s board is the rebuttal.</p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe to get each day&#8217;s best model, plus the fastest and cheapest way to reach that level of performance.</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xCei!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xCei!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!xCei!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!xCei!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!xCei!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xCei!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/351f8b4c-9e2a-4077-b715-af76deb7ef22_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:153142,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206882995?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F351f8b4c-9e2a-4077-b715-af76deb7ef22_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xCei!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!xCei!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!xCei!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!xCei!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd4fe99dc-c38a-4436-97a2-c776f726efc7_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div>]]></content:encoded></item><item><title><![CDATA[GPT 5.6 Sol beaten by Grok 4.5, Meta's Muse fails 90% of requests]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 10, 2026]]></description><link>https://iijme.substack.com/p/gpt-56-sol-beaten-by-grok-45-metas</link><guid isPermaLink="false">https://iijme.substack.com/p/gpt-56-sol-beaten-by-grok-45-metas</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Fri, 10 Jul 2026 18:29:39 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!kO17!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kO17!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kO17!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 424w, https://substackcdn.com/image/fetch/$s_!kO17!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 848w, https://substackcdn.com/image/fetch/$s_!kO17!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 1272w, https://substackcdn.com/image/fetch/$s_!kO17!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!kO17!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png" width="1456" height="794" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1a604a8e-182b-4a3d-b620-a76c4b4635bb_2816x1536.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:794,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:5054358,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206478849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1a604a8e-182b-4a3d-b620-a76c4b4635bb_2816x1536.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kO17!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 424w, https://substackcdn.com/image/fetch/$s_!kO17!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 848w, https://substackcdn.com/image/fetch/$s_!kO17!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 1272w, https://substackcdn.com/image/fetch/$s_!kO17!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa49c2c59-b002-4b85-8d1e-854d84d69804_2816x1536.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>TL;DR</h2><p><strong>Best closed model: Fable 5.</strong> It holds #1 for a seventh straight day, but only on a tiebreak. Grok 4.5 matched its <strong>53%</strong> solve rate, and the two split their head-to-head <strong>8&#8211;8</strong>.</p><p><strong>Cheapest closed model: Grok 4.5.</strong> It delivered champion-level results at <strong>$0.36 per correct answer</strong>, roughly one-fifth of Fable&#8217;s <strong>$1.95</strong>.</p><p><strong>Best open weights model: Kimi K2.7 Code.</strong> It reached <strong>42%</strong>, statistically level with GPT-5.5, at just <strong>$0.15 per correct answer</strong>.<br><br><strong>The board shook up.</strong> Only <strong>23 of 28</strong> pairwise orderings between returning models held from yesterday <em>(&#964; = 0.64)</em>. Every swap came from three movers: Opus 4.8 falling, while Grok 4.5 and Kimi K2.7 Code climbed.</p><p><strong>Today&#8217;s tidbit:</strong> Meta&#8217;s Muse Spark 1.1 tops the raw table at <strong>75%</strong>, but it does not get the crown. Roughly <strong>9 in 10 API requests failed</strong> on launch day, and Meta still billed for the failed calls. Count the full bill, and Muse cost about <strong>$25 per correct answer</strong>, the most expensive results on the board disguised behind its cheapest sticker.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_JUd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_JUd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 424w, https://substackcdn.com/image/fetch/$s_!_JUd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 848w, https://substackcdn.com/image/fetch/$s_!_JUd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 1272w, https://substackcdn.com/image/fetch/$s_!_JUd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!_JUd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png" width="1456" height="887" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6bd38e81-b3a4-4292-83c8-62217befa6fa_1800x1096.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:887,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:198903,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206478849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6bd38e81-b3a4-4292-83c8-62217befa6fa_1800x1096.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!_JUd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 424w, https://substackcdn.com/image/fetch/$s_!_JUd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 848w, https://substackcdn.com/image/fetch/$s_!_JUd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 1272w, https://substackcdn.com/image/fetch/$s_!_JUd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb9350ca0-0638-4396-920a-099d5d71a0bc_1800x1096.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Five things worth your attention today</h2><h2>1. Grok 4.5 catches the champion, and the price gap is a chasm</h2><p>Yesterday, Grok debuted mid pack and we called it the value pick.</p><p>Today, it caught the leader outright.</p><p>Grok 4.5 and Fable 5 both solved <strong>53%</strong> of the slate. On the problems where they disagreed, they split them <strong>8&#8211;8</strong> <em>(p = 1.0)</em>.</p><p>You cannot get more tied than that.</p><p>Fable keeps the higher rank on Elo because it beat stronger opponents, but the money column is not close:</p><ul><li><p><strong>Grok 4.5:</strong> $0.36 per correct answer</p></li><li><p><strong>Fable 5:</strong> $1.95 per correct answer</p></li></ul><p>That is more than five times the results per dollar.</p><p>Grok also did something no budget priced model has managed on this board: it separated from the cheap pack.</p><p>It swept GLM 5.2 <strong>15&#8211;0</strong> <em>(p &lt; 0.001)</em>, thumped Nemotron 3 Ultra <strong>14&#8211;2</strong> <em>(p = 0.004)</em>, and beat Qwen 3.7 Max <strong>15&#8211;5</strong> <em>(p = 0.04)</em>.</p><p>Fable&#8217;s consolation is speed. It was the fastest full slate model on the board, with a typical answer in about <strong>a minute and a half</strong>, compared with roughly four minutes for Grok.</p><p>If today repeats tomorrow, the daily driver question has a new default answer.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!VwTw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!VwTw!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!VwTw!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!VwTw!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!VwTw!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!VwTw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4d7539e2-89ee-4964-8c92-37764dd6a290_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:160253,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206478849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4d7539e2-89ee-4964-8c92-37764dd6a290_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!VwTw!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!VwTw!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!VwTw!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!VwTw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc16844ab-2f2a-44e4-bcd6-564fac3f2d9d_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>2. About Meta: Muse Spark&#8217;s debut mostly didn&#8217;t happen</h2><p>Meta&#8217;s first paid model would&#8217;ve topped the table at <strong>75%</strong>.</p><p>We are not crowning it.</p><p>Roughly <strong>nine out of every ten attempts</strong> came back as errors from Meta&#8217;s day one API and never produced an answer to score.</p><p>On the small fraction that got through, Muse was quick, with a typical answer in about a minute. But the confidence interval around its 75% score runs from approximately <strong>30% to 95%</strong>.</p><p>That is statistics speak for: <strong>we know almost nothing yet.</strong></p><p>You can see it in the Elo chart below, where Muse&#8217;s error bars dwarf everyone else&#8217;s.</p><p>There is also a launch day pricing trap.</p><p>The leaderboard&#8217;s cost column only meters answers that came back successfully. Meta, however, billed for the failed attempts too.</p><p>Count everything on the bill, and Muse&#8217;s correct answers cost about <strong>$25 each</strong>.</p><p>That makes them the most expensive results on today&#8217;s board by an order of magnitude, despite Muse wearing the cheapest sticker in the table.</p><p>Launch day API instability is normal, and these failures were on Meta&#8217;s side rather than the model&#8217;s. But until the API survives a full slate, Muse is neither the best model on this board nor remotely the cheapest.</p><div><hr></div><h2>3. GPT 5.6 Sol arrives: better than GPT 5.5, but pricier per result</h2><p>OpenAI&#8217;s new flagship landed at <strong>#3</strong> on day one.</p><p>It edged GPT 5.5 <strong>7&#8211;5</strong> head to head <em>(p = 0.77)</em>. That is directionally an upgrade, but statistically still a coin flip.</p><p>The catch is efficiency.</p><p>GPT 5.6 Sol carries the same sticker price as GPT 5.5, but it produced roughly <strong>60% more output</strong> to get its answers. Its realized cost therefore came out higher:</p><ul><li><p><strong>GPT 5.6 Sol:</strong> $2.10 per correct answer</p></li><li><p><strong>GPT 5.5:</strong> $1.44 per correct answer</p></li></ul><p>Sol was quick about it, with a typical answer just over two minutes, compared with roughly five and a half minutes for GPT 5.5. It also completed the entire slate.</p><p>Against Fable 5, it is already statistically level, with a <strong>7&#8211;9</strong> split <em>(p = 0.80)</em>.</p><p>If you are using GPT 5.5 today, Sol buys you a few more solves and a faster answer. It charges you for the extra words.</p><p>Watch this one. Debuts move.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!30w2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!30w2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!30w2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!30w2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!30w2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!30w2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png" width="1456" height="1077" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d704e462-64d1-4e16-8f3c-4bd87aed4709_1800x1332.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1077,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:265974,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206478849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd704e462-64d1-4e16-8f3c-4bd87aed4709_1800x1332.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!30w2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!30w2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!30w2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!30w2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F865a95c1-f207-4ff7-8912-780a21a1b953_1800x1332.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Subscribe (free!) to stay ahead of the best model of the day</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>4. Opus 4.8 fell five places, and every part of its line got worse</h2><p>After spending two weeks at or near the top, Opus 4.8 dropped to <strong>38%</strong> today, down from 48%.</p><p>It fell past GPT 5.5, Grok 4.5, and Kimi K2.7 Code on the way to seventh place.</p><p>Against Grok, it lost <strong>5&#8211;11</strong> on their discordant problems.</p><p>Opus was also the only model to leave problems unanswered today. That unfinished work still appeared on the bill.</p><p>Its <strong>$2.18 per correct answer</strong> in metered spend was the worst value among the models that completed most of their slate.</p><p>One brutal day is a data point, not a verdict. Fable had clear daylight over Opus yesterday, and the two remain statistically level today at <strong>11&#8211;5</strong> <em>(p = 0.21)</em>.</p><p>But for the first time, the Anthropic premium bought seventh place results.</p><div><hr></div><h2>5. Kimi K2.7 Code just gate crashed the flagship club</h2><p>Quietly, Kimi delivered the day&#8217;s biggest climb in raw score.</p><p>Kimi K2.7 Code jumped from 22% to <strong>42%</strong>.</p><p>It finished statistically dead even with GPT 5.5, splitting their discordant problems <strong>8&#8211;7</strong> <em>(p = 1.0)</em>. It also edged Opus 4.8 <strong>9&#8211;8</strong> on the problems where the two models disagreed.</p><p>Its cost: <strong>$0.15 per correct answer</strong>, the second cheapest results anywhere on the board.</p><p>The rest of the bargain tier also had a day.</p><p>GLM 5.2 recovered from yesterday&#8217;s one solve catastrophe to reach <strong>15%</strong>, while Nemotron 3 Ultra remained the absolute cheapest model per result at <strong>$0.12</strong>, with a typical answer in under two minutes.</p><p>But Kimi is the story.</p><p>If it holds anywhere near this line, &#8220;flagship results at 94% off&#8221; stops being a hypothetical.</p><div><hr></div><h2>Why the board moves at all</h2><p>Eight models returned from yesterday, and today&#8217;s board genuinely reshuffled.</p><p>Of the <strong>28</strong> pairwise orderings between returning models, <strong>23 repeated</strong>, producing a Kendall rank correlation of <strong>&#964; = 0.64</strong>.</p><p>All five swaps trace back to two movers:</p><ul><li><p>Opus 4.8 fell behind GPT 5.5, Grok 4.5, and Kimi K2.7 Code.</p></li><li><p>Grok 4.5 climbed past GPT 5.5.</p></li></ul><p>That is the useful kind of low stability day.</p><p>It was not noise smearing the entire board. It was two models genuinely trading altitude.</p><p>Providers update serving stacks silently. Models drift. Inference is nondeterministic. Our day to day comparability controls put today&#8217;s swings on the models&#8217; side of the ledger.</p><p>That is exactly why we re-measure every morning instead of trusting last week&#8217;s board.</p><div><hr></div><h2>Why not just trust the benchmarks you&#8217;ve already seen?</h2><p>Public benchmarks leak into future training runs.</p><p>Scores inflate, and eventually the benchmark starts measuring memorization rather than ability.</p><p>They are also snapshots: accurate on the day they are taken, and less useful every day afterward.</p><p>We generate <strong>fresh, novel problems every day</strong>. No model can have trained on a problem that did not exist until that morning.</p><p>That is also why debutants such as GPT 5.6 Sol, tested only hours after general availability, can be evaluated on exactly the same footing as models we have tracked for weeks.</p><p>Today&#8217;s board required about <strong>$242 in compute</strong>.</p><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Quit the expensive model guessing game. Find out every day for free</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div><hr></div><h2>Start your day with the right model</h2><p>The best model is a daily fact, not a permanent one.</p><p>Today, a six day champion got caught by a challenger charging a fifth as much. A new flagship debuted mid pack. Last week&#8217;s #2 fell five places.</p><p>Tomorrow decides which of those moves was real.</p><p><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to get that performance, in your inbox before you start work.</strong></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Grok 4.5 budget king: near GPT 5.5 and Opus class results at a 70% discount]]></title><description><![CDATA[isitjustme daily model leaderboard &#183; July 9, 2026]]></description><link>https://iijme.substack.com/p/grok-45-budget-king-near-gpt-55-and</link><guid isPermaLink="false">https://iijme.substack.com/p/grok-45-budget-king-near-gpt-55-and</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Thu, 09 Jul 2026 14:13:20 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!4Ecl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4Ecl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4Ecl!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 424w, https://substackcdn.com/image/fetch/$s_!4Ecl!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 848w, https://substackcdn.com/image/fetch/$s_!4Ecl!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 1272w, https://substackcdn.com/image/fetch/$s_!4Ecl!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!4Ecl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png" width="1032" height="991" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/efe65675-2b71-40f4-9fad-019311e50e45_1032x991.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:991,&quot;width&quot;:1032,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1986758,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206234689?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0c287138-70e5-4a7b-9810-86bc1086e584_2816x1536.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!4Ecl!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 424w, https://substackcdn.com/image/fetch/$s_!4Ecl!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 848w, https://substackcdn.com/image/fetch/$s_!4Ecl!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 1272w, https://substackcdn.com/image/fetch/$s_!4Ecl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F301e2133-bd5e-496b-a655-b956b37cea5b_1032x991.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><blockquote><p><em>Grok 4.5: ~70% cheaper than Opus per correct answer (69.6% exactly), but only ~53% cheaper than GPT-5.5 per correct answer, because GPT-5.5 is itself much cheaper per result than Opus today.</em></p></blockquote><p><em><br>The field compresses, the order holds, and the value math resets.</em></p><p>Today&#8217;s fresh problems ran hard.</p><p>Every returning model scored lower than yesterday, yet the order at the top did not move an inch. That tells you the drop came from the day&#8217;s exam, not the students taking it.</p><p>Fable 5 held #1 for a <strong>sixth straight day</strong> at <strong>57%</strong>.</p><p>The debutant, SpaceXAI&#8217;s Grok 4.5, landed mid-pack at <strong>35%</strong>. It was statistically level with every flagship except Fable, while costing <strong>79% less</strong> than the priciest model on the board.</p><p>And GLM-5.2 solved exactly <strong>one problem all day</strong>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!J1x9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!J1x9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!J1x9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!J1x9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!J1x9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!J1x9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png" width="1456" height="932" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5103e9d7-23da-461b-bebf-8399113cf49c_1800x1152.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:932,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:180245,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206234689?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5103e9d7-23da-461b-bebf-8399113cf49c_1800x1152.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!J1x9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 424w, https://substackcdn.com/image/fetch/$s_!J1x9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 848w, https://substackcdn.com/image/fetch/$s_!J1x9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 1272w, https://substackcdn.com/image/fetch/$s_!J1x9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F333256f6-e584-40cc-b9b0-7068d9660d45_1800x1152.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Five things are worth your attention today.</p><h2>1. Six straight days of Fable 5, on the day the test pushed back hardest</h2><p>On a slate that knocked double digits off every flagship&#8217;s score, Fable 5 kept roughly the same daylight it had yesterday.</p><p>It finished #1 at <strong>57%</strong>, nine points clear of Opus 4.8.</p><p>But the statistics remained humble.</p><p>Fable&#8217;s edge over Opus 4.8 was <strong>9&#8211;5</strong> on the problems that separated them, with <strong>p=0.42</strong>, effectively a coin flip. Against GPT-5.5, it went <strong>10&#8211;5</strong>, with <strong>p=0.30</strong>.</p><p>In fact, the only matchup anywhere in the top six that cleared statistical significance was Fable over the newcomer Grok 4.5: <strong>13&#8211;4</strong>, with <strong>p=0.049</strong>.</p><p>Fable also finished <strong>everything it started</strong>. It left zero problems unanswered.</p><p>At <strong>$1.61 per correct answer</strong>, Fable now sits between Opus 4.8 at $1.88 and GPT-5.5 at $1.21 per result, despite carrying the highest sticker price.</p><p>The crown holds. The moat is still measured in head-to-head wins, not certainty.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QhC5!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QhC5!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!QhC5!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!QhC5!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!QhC5!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!QhC5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png" width="1456" height="1032" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e02917de-654b-43cd-8245-882f3cec29b2_1800x1276.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1032,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:155231,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206234689?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe02917de-654b-43cd-8245-882f3cec29b2_1800x1276.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!QhC5!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 424w, https://substackcdn.com/image/fetch/$s_!QhC5!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 848w, https://substackcdn.com/image/fetch/$s_!QhC5!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 1272w, https://substackcdn.com/image/fetch/$s_!QhC5!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3451468-d7d8-4d15-a071-d0fe36eb4377_1800x1276.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>2. Grok 4.5&#8217;s debut resets the value math</h2><p>On its first day on the board, Grok 4.5 immediately became the price-performance story.</p><p>At a <strong>35% solve rate</strong>, it was statistically indistinguishable from:</p><ul><li><p>Opus 4.8</p></li><li><p>GPT-5.5</p></li><li><p>GPT-5.4</p></li><li><p>Opus 4.6</p></li></ul><p>That is every flagship except Fable 5.</p><p>Grok delivered those results at <strong>$0.57 per correct answer</strong>. That is less than half of GPT-5.5&#8217;s $1.21 and roughly one-third of Fable&#8217;s $1.61.</p><p>It also answered <strong>every problem it was given</strong>. There were no timeouts and no abandoned attempts. A typical answer took about five minutes.</p><p>For workloads that live in the &#8220;very good, but not necessarily the absolute best&#8221; band, today&#8217;s board says Grok 4.5 is where the dollars go furthest among the major models.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!433t!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!433t!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!433t!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!433t!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!433t!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!433t!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png" width="1456" height="802" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c0d53ee1-5d07-422b-9d18-873544b556c7_1960x1080.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:802,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:198123,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206234689?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc0d53ee1-5d07-422b-9d18-873544b556c7_1960x1080.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!433t!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 424w, https://substackcdn.com/image/fetch/$s_!433t!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 848w, https://substackcdn.com/image/fetch/$s_!433t!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 1272w, https://substackcdn.com/image/fetch/$s_!433t!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5cdbf04-fb14-4e6a-802b-97b42511f9e0_1960x1080.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>3. Opus 4.6 is on the board too, and it is a cautionary tale</h2><p>The other newcomer had a much rougher landing.</p><p>Opus 4.6 matched GPT-5.4&#8217;s solve count, but <strong>one-quarter of its attempts ended without an answer at all</strong>.</p><p>That was by far the worst reliability on the board, on a day when seven of the ten models finished every problem they attempted.</p><p>Between its near-flagship sticker price, only 8% below the most expensive model, and the unanswered problems, Opus 4.6 reached <strong>$2.27 per correct answer</strong>.</p><p>That was the most expensive result anywhere on today&#8217;s board.</p><p>It was also cost-dominated: Grok 4.5 matched it on results while beating it decisively on price.</p><p>For Anthropic users, Opus 4.8 is the better buy. The generation old discount is not much of a discount.</p><p>Sonnet 5, yesterday&#8217;s reliability story, sat today&#8217;s board out.</p><h2>4. GPT 5.4&#8217;s discount is now slow and expensive</h2><p>GPT-5.4 held its place alongside the flagships at <strong>38%</strong>, but it was also the <strong>slowest model on the board</strong>.</p><p>A typical answer took around <strong>twenty minutes</strong>, compared with roughly three minutes for GPT-5.5.</p><p>The verbosity that keeps erasing GPT-5.4&#8217;s sticker discount also got worse. It produced roughly <strong>twice as much output</strong> as GPT-5.5.</p><p>As a result, the supposedly cheaper model landed at <strong>$1.48 per correct answer</strong>, compared with <strong>$1.21</strong> for GPT-5.5.</p><p>The conclusion is the same as yesterday, now with a stopwatch attached:</p><p><strong>Between the two GPT models, buy 5.5.</strong></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pAZO!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pAZO!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!pAZO!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!pAZO!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!pAZO!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pAZO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png" width="1456" height="1077" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/cdc9ee62-8983-4b2e-aa1e-edf0dbcef7d7_1800x1332.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1077,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:261415,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206234689?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fcdc9ee62-8983-4b2e-aa1e-edf0dbcef7d7_1800x1332.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pAZO!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 424w, https://substackcdn.com/image/fetch/$s_!pAZO!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 848w, https://substackcdn.com/image/fetch/$s_!pAZO!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 1272w, https://substackcdn.com/image/fetch/$s_!pAZO!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc3673d5a-5ae7-4adf-b341-0e90883dde30_1800x1332.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>5. GLM 5.2 did not slump. It vanished.</h2><p>Yesterday, GLM-5.2 bounced from 8% to 20%.</p><p>Today, it solved <strong>one problem</strong>.</p><p>It was shut out by models in its own price neighborhood:</p><ul><li><p><strong>0&#8211;13</strong> against Grok 4.5</p></li><li><p><strong>0&#8211;8</strong> against Kimi K2.7 Code</p></li><li><p><strong>0&#8211;7</strong> against Qwen 3.7 Max</p></li><li><p><strong>0&#8211;7</strong> against Nemotron 3 Ultra</p></li></ul><p>Fable 5 swept it <strong>22&#8211;0</strong>.</p><p><strong>When the problems become difficult, GLM 5.2 currently has nothing to offer. A 97% sticker-price discount is not a bargain when the model solves 2% of the test.</strong></p><p>The budget money belongs where it went yesterday.</p><p><strong>Kimi K2.7 Code</strong> held up best in the bargain bin, with a <strong>22% solve rate</strong> and a cost of <strong>$0.24 per correct answer</strong>.</p><p><strong>Nemotron 3 Ultra</strong> remained the cheapest source of correct answers anywhere on the board at <strong>$0.15 per result</strong>. It answered every problem and typically finished within four minutes.</p><h2>Why the board moves at all</h2><p>Nine models returned from yesterday.</p><p>Every one of them scored lower today, yet the top four finished in <strong>exactly the same order</strong>.</p><p>That pattern is the tell.</p><p>Nothing suddenly decayed overnight. Fresh problems differ from day to day, and today&#8217;s set was simply harder. Our day-to-day comparability controls also place the change on the problems&#8217; side of the ledger, not the models&#8217;.</p><p>That is why the numbers to trust across days are the rankings and head-to-head results, not the raw percentages alone.</p><p>A board that does <strong>not</strong> reshuffle on a brutal day is evidence that the ranking is real.</p><h2>Why not just trust the benchmarks you have already seen?</h2><p>Public benchmarks eventually leak into future training runs.</p><p>Scores inflate, and the benchmark gradually begins measuring memorization rather than ability.</p><p>They are also snapshots. A result may be accurate on the day it is measured, then become less useful with every model and infrastructure update that follows.</p><p>We generate <strong>fresh, novel problems every day</strong>.</p><p>No model can have trained on a problem that did not exist until that morning.</p><p>That also means a newcomer such as Grok 4.5 is evaluated on the same footing as models we have tracked for weeks. Its first day on the board uses the same fresh test as everyone else.</p><p>Today&#8217;s board required about <strong>$168 in compute</strong>.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><blockquote><p>GPT 5.6 is expected later today and will be included in the next post.</p></blockquote><h2>Start your day with the right model</h2><p>The best model is a daily fact, not a permanent one.</p><p>Today, the champion made it six days in a row, a debutant rewrote the value math, and last week&#8217;s comeback story forgot how to answer.</p><p>Tomorrow will tell us which of those signals was real.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe, and each morning you will get the day&#8217;s best model, plus the fastest and cheapest way to reach that level of performance, in your inbox before you start work.</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[The pack catches Fable 5, GPT-5.4 crashes the flagship party, and Sonnet 5 stops answering]]></title><description><![CDATA[isitjustme daily rankings &#183; July 8, 2026]]></description><link>https://iijme.substack.com/p/the-pack-catches-fable-5-gpt-54-crashes</link><guid isPermaLink="false">https://iijme.substack.com/p/the-pack-catches-fable-5-gpt-54-crashes</guid><dc:creator><![CDATA[Is It Just Me]]></dc:creator><pubDate>Wed, 08 Jul 2026 14:38:05 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!tyhP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tyhP!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tyhP!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 424w, https://substackcdn.com/image/fetch/$s_!tyhP!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 848w, https://substackcdn.com/image/fetch/$s_!tyhP!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 1272w, https://substackcdn.com/image/fetch/$s_!tyhP!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tyhP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png" width="1456" height="794" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/aaa00587-e02a-4347-967d-2a883891a4a1_2816x1536.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:794,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:6419120,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206052937?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Faaa00587-e02a-4347-967d-2a883891a4a1_2816x1536.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tyhP!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 424w, https://substackcdn.com/image/fetch/$s_!tyhP!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 848w, https://substackcdn.com/image/fetch/$s_!tyhP!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 1272w, https://substackcdn.com/image/fetch/$s_!tyhP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff700b130-a276-41fc-ac41-e0db6877ff23_2816x1536.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h4>The crown holds for a fifth day, but the race at the top is suddenly a coin flip</h4><p>Yesterday, Fable 5 swept Opus 4.8 <strong>7&#8211;0</strong> on the problems that separated them.</p><p>Today, that same matchup went <strong>5&#8211;3</strong>, effectively a coin flip (p=0.73).</p><p>Fable 5 holds the top spot for a fifth straight day at <strong>78%</strong>, but Opus 4.8 climbed to <strong>72%</strong>, up from 65%, while GPT-5.5 surged to <strong>72%</strong>, up from 60%. GPT-5.4 also climbed all the way into the flagship pack.</p><p>The top four models are now statistically inseparable.</p><p>The model that <em>is</em> separated, in the wrong direction, is Sonnet 5.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!g9aG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!g9aG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!g9aG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!g9aG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!g9aG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!g9aG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png" width="1456" height="861" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6e9e855c-a501-4476-b9cd-ef56150d3863_1800x1064.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:861,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:175914,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206052937?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6e9e855c-a501-4476-b9cd-ef56150d3863_1800x1064.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!g9aG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 424w, https://substackcdn.com/image/fetch/$s_!g9aG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 848w, https://substackcdn.com/image/fetch/$s_!g9aG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 1272w, https://substackcdn.com/image/fetch/$s_!g9aG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff4d6ea28-5bba-4e0d-9f26-45bc30361470_1800x1064.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Four things worth your attention today</h2><h3>1. The crown held. The moat didn&#8217;t.</h3><p>Fable 5&#8217;s fifth day at #1 was its most contested yet.</p><p>Its edge over Opus 4.8 went from a clean sweep to <strong>5&#8211;3</strong>, and its matchup with GPT-5.5 is just as much of a tie.</p><p>What still separates Fable from the pack it can no longer statistically beat?</p><p>It was the <strong>fastest flagship by a wide margin</strong>. Its typical answer arrived in under two minutes, while the other flagships took between three and seven minutes.</p><p>At <strong>$1.20 per correct answer</strong>, it was also cheaper per <em>result</em> than Opus 4.8 at $1.23, despite carrying the highest sticker price on the board.</p><p>If today&#8217;s board is your buying guide, Fable is still the pick at the top. Just not by the margin yesterday suggested.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!HLt8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!HLt8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!HLt8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!HLt8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!HLt8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!HLt8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/77170658-3acb-424b-9565-f04d5b5d2fa2_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:150452,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206052937?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F77170658-3acb-424b-9565-f04d5b5d2fa2_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!HLt8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!HLt8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!HLt8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!HLt8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6de26516-212f-45a3-97df-69f6f460f9d1_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>2. GPT-5.4 crashed the flagship party</h3><p>The quiet story of the day is GPT-5.4.</p><p>It jumped to <strong>68%</strong> and is now statistically indistinguishable from Opus 4.8 and GPT-5.5, while carrying a sticker price 44% below Fable 5.</p><p>There is one caveat before you swap it in everywhere: its famous discount keeps getting eaten by verbosity.</p><p>GPT-5.4 produced roughly twice as much output as GPT-5.5 today. Its realized cost landed at <strong>$0.77 per correct answer</strong>, compared with <strong>$0.73</strong> for GPT-5.5.</p><p>The half-price model was, per successful result, slightly <em>more</em> expensive.</p><p><strong>Between those two, buy GPT-5.5</strong>. Against Opus 4.8 at $1.23 per solve, either GPT is the value call today.</p><h3>3. Sonnet 5 is the odd flagship out, and it&#8217;s a reliability story</h3><p>Sonnet 5 landed at <strong>50%</strong>, and today the gap above it is no longer statistical noise.</p><p>It lost its head-to-head matchups against:</p><ul><li><p>Fable 5: <strong>12&#8211;1</strong> (p=0.003)</p></li><li><p>Opus 4.8: <strong>11&#8211;2</strong> (p=0.022)</p></li><li><p>GPT-5.5: <strong>1&#8211;10</strong> (p=0.012)</p></li></ul><p>The failure mode matters as much as the final score.</p><p>More than <strong>a quarter of Sonnet 5&#8217;s attempts ended with no answer at all</strong>, by far the worst rate on the board. Every budget model completed everything it started.</p><p>A relatively affordable premium model that silently fails to answer is a worse deal than its $0.61 per solve suggests.</p><p>If you are paying mid-tier money, GPT-5.4 occupies roughly the same cost-per-result neighborhood while delivering results a full tier above.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Z4aR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Z4aR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!Z4aR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!Z4aR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!Z4aR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Z4aR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png" width="1456" height="987" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/70705f94-4d1d-43d9-aac0-03866492425b_1800x1220.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:987,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:244989,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206052937?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F70705f94-4d1d-43d9-aac0-03866492425b_1800x1220.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Z4aR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 424w, https://substackcdn.com/image/fetch/$s_!Z4aR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 848w, https://substackcdn.com/image/fetch/$s_!Z4aR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 1272w, https://substackcdn.com/image/fetch/$s_!Z4aR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F64a6e3cc-e28e-446d-a1f4-3f015ca3969c_1800x1220.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h3>4. The bargain bin reshuffled again</h3><p>GLM-5.2 bounced off yesterday&#8217;s floor, climbing from <strong>8% to 20%</strong>.</p><p>It still finished dead last, got shut out by its own price peers, and was the slowest model on the board:</p><ul><li><p><strong>0&#8211;8</strong> against Qwen 3.7 Max</p></li><li><p><strong>0&#8211;9</strong> against Kimi K2.7 Code</p></li></ul><p>The steadier story is <strong>Kimi K2.7 Code</strong>.</p><p>Across three boards, it has posted three consecutive improvements:</p><p><strong>32% &#8594; 40% &#8594; 42%</strong></p><p>It also recorded zero unanswered problems and delivered correct answers for <strong>$0.12 each</strong>.</p><p>Right now, Kimi is the most dependable sub-$5 model we track.</p><p>Nemotron 3 Ultra cooled from <strong>44% to 38%</strong>, but retained both crowns that matter for high-volume work:</p><ul><li><p><strong>Fastest model on the board</strong>, with a typical answer in about 70 seconds</p></li><li><p><strong>Cheapest correct answers anywhere</strong>, at $0.08 per solve</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!MbTr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!MbTr!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!MbTr!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!MbTr!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!MbTr!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!MbTr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png" width="1456" height="958" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png&quot;,&quot;srcNoWatermark&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c63a0ac8-2986-4065-aa26-209af91e7439_1800x1184.png&quot;,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:958,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:150563,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://iijme.substack.com/i/206052937?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc63a0ac8-2986-4065-aa26-209af91e7439_1800x1184.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!MbTr!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 424w, https://substackcdn.com/image/fetch/$s_!MbTr!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 848w, https://substackcdn.com/image/fetch/$s_!MbTr!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 1272w, https://substackcdn.com/image/fetch/$s_!MbTr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F15e17f04-2c15-4974-a4b1-b84898300e60_1800x1184.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why does the board move at all?</h2><p>No model on this board shipped a version bump in the past 24 hours.</p><p>Yet a 7&#8211;0 sweep became a coin flip, GPT-5.5 gained 12 percentage points, and GLM-5.2 recovered half of Monday&#8217;s collapse.</p><p>Providers silently change serving infrastructure. Capacity and routing shift. Quantization, inference settings, and nondeterminism do the rest.</p><p>Our day-to-day comparability controls put these swings on the models&#8217; side of the ledger, not ours.</p><h2>Why not just trust the benchmarks you&#8217;ve already seen?</h2><p>Public benchmarks leak into future training runs. Scores inflate and gradually begin measuring memorization rather than ability.</p><p>They are also snapshots: accurate on the day they are measured, and less representative with every day that passes.</p><p>We generate <strong>fresh, novel problems every morning</strong>. No model can have trained on a problem that did not exist until today.</p><p>A strong score here reflects genuine ability, not recall.</p><p>We then run the entire field and evaluate capability alongside cost and speed.</p><p>Today&#8217;s board required roughly <strong>$137 in compute</strong>.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://iijme.substack.com/subscribe?"><span>Subscribe now</span></a></p><h2>Start your day with the right model</h2><p>The best model is a daily fact, not a permanent one.</p><p>Today, the champion kept the crown but lost the moat. A discounted flagship earned its seat at the top table. A premium model forgot to answer.</p><p>Tomorrow will tell us which of those signals was real.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://iijme.substack.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><strong>Subscribe, and each morning you&#8217;ll get the day&#8217;s best model, plus the fastest and cheapest way to achieve that performance, in your inbox before you start work.</strong></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item></channel></rss>