<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[12 Grams of Carbon]]></title><description><![CDATA[I'm increasingly certain no one knows anything about anything. Current founder @ noriagentic.com. Previous founder 
@ soot.com. Before that was googling.

Writes about programming, AI, startups, video games, and misc other things.]]></description><link>https://12gramsofcarbon.com</link><image><url>https://substackcdn.com/image/fetch/$s_!gBHe!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcd3ac2a-1029-4838-afb3-085f4a7d0583_540x540.png</url><title>12 Grams of Carbon</title><link>https://12gramsofcarbon.com</link></image><generator>Substack</generator><lastBuildDate>Fri, 20 Nov 2026 20:45:43 GMT</lastBuildDate><atom:link href="https://12gramsofcarbon.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[theahura]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[theahura@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[theahura@substack.com]]></itunes:email><itunes:name><![CDATA[theahura]]></itunes:name></itunes:owner><itunes:author><![CDATA[theahura]]></itunes:author><googleplay:owner><![CDATA[theahura@substack.com]]></googleplay:owner><googleplay:email><![CDATA[theahura@substack.com]]></googleplay:email><googleplay:author><![CDATA[theahura]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[You can’t spell ennui without AI]]></title><description><![CDATA[I'm increasingly certain no one knows anything about anything. Current founder @ noriagentic.com. Previous founder 
@ soot.com. Before that was googling.

Writes about programming, AI, startups, video games, and misc other things.]]></description><link>https://12gramsofcarbon.com/p/you-cant-spell-ennui-without-ai</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/you-cant-spell-ennui-without-ai</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Fri, 20 Nov 2026 03:03:15 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!RzaB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>About two months ago, we got GrokBot. GrokBot is an interface to an agent running on a cloud. You can create a bunch of different GrokBots, and they can all work together and be organized into a team. Later, we got OpenAI Dots. A Dot is an interface to an agent running on a cloud. You can create a bunch of different dots, and they can all work together and be organized into a team. We also got Muse and Instinct, which are different things &#8212; they are an interface to an agent in the cloud, but you can only create one of them. And a few weeks after that we also got Claude Duet, which is also an interface to an agent in the cloud, but it makes up for its lack of creativity by only letting you create one of them. Yesterday, Devin Bots released. And I feel ennui.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!X6Cc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!X6Cc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 424w, https://substackcdn.com/image/fetch/$s_!X6Cc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 848w, https://substackcdn.com/image/fetch/$s_!X6Cc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 1272w, https://substackcdn.com/image/fetch/$s_!X6Cc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!X6Cc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png" width="524" height="650" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:650,&quot;width&quot;:524,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:190306,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/225737830?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!X6Cc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 424w, https://substackcdn.com/image/fetch/$s_!X6Cc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 848w, https://substackcdn.com/image/fetch/$s_!X6Cc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 1272w, https://substackcdn.com/image/fetch/$s_!X6Cc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe842d6c6-5d45-43c3-8f02-bbfa7f8db7c5_524x650.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!RzaB!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!RzaB!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 424w, https://substackcdn.com/image/fetch/$s_!RzaB!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 848w, https://substackcdn.com/image/fetch/$s_!RzaB!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!RzaB!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!RzaB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg" width="640" height="640" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:640,&quot;width&quot;:640,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Watchmen's Doctor Manhattan - Powers, Spoilers, Love Interests&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Watchmen's Doctor Manhattan - Powers, Spoilers, Love Interests" title="Watchmen's Doctor Manhattan - Powers, Spoilers, Love Interests" srcset="https://substackcdn.com/image/fetch/$s_!RzaB!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 424w, https://substackcdn.com/image/fetch/$s_!RzaB!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 848w, https://substackcdn.com/image/fetch/$s_!RzaB!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!RzaB!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd60db830-aa7e-4995-b75a-d3c095cdbe0f_640x640.jpeg 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">I&#8217;m tired of these products, these AI companies. I&#8217;m tired of being caught in the unoriginality of their marketing.</figcaption></figure></div><p>That first paragraph was really just a perfect bite sized post, so feel free to stop reading. The rest is just a bunch of other scattered related thoughts that dilutes the punchiness of the first part. I added more, but I can also tell that all the additional words dilute the punchiness of the first part, so I&#8217;m doing a halfway compromise by diluting the text anyway but calling it out so it looks like I&#8217;m self aware.</p><p>Self awareness seems to be the watchword these days. Are the AI systems self aware? What about the tech entrepreneurs? Everyone seems to be maintaining a policy of strategic ambiguity about how self aware they are.</p><p>I was at AIE Code Summit last week, and as part of my usual tour I wandered between the booths to get a pulse of the market. I&#8217;m always interested in hearing where the puck is moving. The problem is, no one knows. When I went to ask the Devin folks why I should use them over Factory, they said that they are higher quality for less tokens, and they have a really cool multi-agent orchestrator. Then when I went over to the Factory folks &#8212; conveniently located right next to Devin &#8212; and asked why I should use them over Devin, they said that they have a really cool multi-agent orchestrator, and also that they are higher quality for less tokens. Overcut uniquely offers a multi agent orchestrator that is cheaper than the rest, and Warp Factories is cheap and also has a multi agent orchestrator. The only software factory offering that was differentiated was AWS Kiro, which stood out because it <em>didn&#8217;t</em> have a multi agent orchestrator (which was odd, given that they literally serve all the models).</p><p>I realize I already made this joke above and it&#8217;s poor form to make the same joke twice. Maybe I&#8217;m out of practice. I haven&#8217;t written a Tech Things post in a while, the last one <a href="https://12gramsofcarbon.com/p/tech-things-and-agentics-september?utm_source=publication-search">was in September</a> and even that was really just me collecting a bunch of my one off notes into a short story collection.<strong> </strong>The one before <em>that</em> <a href="https://12gramsofcarbon.com/p/agentics-tech-things-tokenmaxxing?utm_source=publication-search">was in July</a>. The lack of commentary isn&#8217;t because things haven&#8217;t happened, a lot of things have happened. But there&#8217;s a deeper sense in which it feels like nothing has really happened for at least 6 months now. Maybe more. I feel like there has been basically no product innovation in AI since OpenClaw in January.</p><p>Every product is basically &#8220;put an agent in the cloud.&#8221; That&#8217;s literally all of the products I mentioned above, and a bunch more that I didn&#8217;t. And it makes sense that that&#8217;s the case, because an agent in the cloud can turn into ~any software. It&#8217;s an everything box! It is the final boss of software!</p><p>And before I get someone in the comments telling me about how they work on rocket hardware made from zirconium and as a result they aren&#8217;t selling an agent in a box (yet!),<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> let me point out that the vast majority of software is meant to service like 50 people at any given organization. We have 70 years of companies building software meant to service 50 people per deployment, companies that are huge and really valuable because servicing 50 people consistently across companies was hard until like a year ago. As a result there is some really really jank software out there.</p><p>I can&#8217;t emphasize this enough: most of that jank software is just not that hard to build, especially with agents in the mix. In fact, the biggest limitation is that someone who has a 20 year old legacy database that aggregates pricing data about aluminium manufacturing has never once thought to ask an AI to just replace the whole thing. It&#8217;s not that they <em>like</em> the jank software, actually they mostly hate it. But it never occurs to them that the everything box can literally do everything. Our monkey brains can&#8217;t process it. You&#8217;d think that if you gave a monkey an everything box it would at least ask for bananas. But the monkey brain can&#8217;t make the leap. The empty text box is too intimidating and confusing for too many people.</p><p>So there&#8217;s a lot of money to be made with everything boxes, as long as you have an army of forward deployed engineers who produce bespoke bananas for each end user.</p><p>But people want to know why they should buy you when they could buy the next guy. And there&#8217;s just no super obvious differentiation anymore, at least among dev tools. Everyone has cheaper tokens and multi agent orchestration. Everyone is running their magic box in the cloud. And any time anyone does anything interesting, everyone follows in a week to a month. This is why there have been so many companies that burst onto the scene like a beautiful bright firecracker, that disappear just as quickly. What happened to Pinecone and PromptLayer and the dozens of companies that offered fine tuning services and RAG? What happened to Perplexity? What about Lovable or Replit? Jev and Instinct aren&#8217;t nearly as hyped up as they were a month ago. Even the models themselves feel totally replaceable. For 99% of tasks I don&#8217;t really care if I&#8217;m using Fable or Carbon or Astra.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a></p><p>As devtools become more commodity, the things that begin to matter are branding and cultural identity. I think Hermes is a great example of this. They too are an agent in a box provider. But they have this really weird cool aesthetic! And they&#8217;re like counter cultural! And they&#8217;re like sticking it to the man by being open source! (Nevermind that they aren&#8217;t actually open source for anything that makes money, at least as far as I&#8217;m aware)</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!lrTF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!lrTF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 424w, https://substackcdn.com/image/fetch/$s_!lrTF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 848w, https://substackcdn.com/image/fetch/$s_!lrTF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 1272w, https://substackcdn.com/image/fetch/$s_!lrTF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!lrTF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png" width="598" height="621" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:621,&quot;width&quot;:598,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:604305,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/225737830?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!lrTF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 424w, https://substackcdn.com/image/fetch/$s_!lrTF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 848w, https://substackcdn.com/image/fetch/$s_!lrTF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 1272w, https://substackcdn.com/image/fetch/$s_!lrTF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3522a5eb-7570-473b-be86-7b8cdb32ead0_598x621.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">You vs the guy she says not to worry about</figcaption></figure></div><p>Capy is on the other end of the spectrum. Another agent in a box platform, but it&#8217;s a cute animal! You can create teams (duh) but the teams are led by Captains! Because it&#8217;s like capybara! Get it?</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!5wku!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!5wku!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 424w, https://substackcdn.com/image/fetch/$s_!5wku!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 848w, https://substackcdn.com/image/fetch/$s_!5wku!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!5wku!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!5wku!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg" width="399" height="501" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:501,&quot;width&quot;:399,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Some capy cuteness to brighten your sunny day &#129294; Happy capy = happy day &#9728;&#65039;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Some capy cuteness to brighten your sunny day &#129294; Happy capy = happy day &#9728;&#65039;" title="Some capy cuteness to brighten your sunny day &#129294; Happy capy = happy day &#9728;&#65039;" srcset="https://substackcdn.com/image/fetch/$s_!5wku!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 424w, https://substackcdn.com/image/fetch/$s_!5wku!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 848w, https://substackcdn.com/image/fetch/$s_!5wku!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!5wku!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb6e6cade-03c6-4a37-bab3-2cca2963ce9c_399x501.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">wait, no, this isn&#8217;t the ai company&#8230;</figcaption></figure></div><p>People are starting to pick dev tools the way they pick clothes: based on cultural norms and status and influencers. Founders think they are fighting to be the next Google, but really they are fighting to be the next LVMH.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a> Do you know what it means to be LVMH? it means living in a malthusian environment, constantly running, constantly at war. I got into this field to create durable value, not seasonal fashion lines.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!mJ9y!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mJ9y!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 424w, https://substackcdn.com/image/fetch/$s_!mJ9y!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 848w, https://substackcdn.com/image/fetch/$s_!mJ9y!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 1272w, https://substackcdn.com/image/fetch/$s_!mJ9y!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!mJ9y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png" width="811" height="1031" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1031,&quot;width&quot;:811,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!mJ9y!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 424w, https://substackcdn.com/image/fetch/$s_!mJ9y!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 848w, https://substackcdn.com/image/fetch/$s_!mJ9y!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 1272w, https://substackcdn.com/image/fetch/$s_!mJ9y!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7c24360c-6a57-4f05-9c3c-1c9dc693638e_811x1031.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">there has been zero differentiation in the purse market since the modern purse was invented</figcaption></figure></div><p>I basically predicted this would happen <a href="https://12gramsofcarbon.com/p/meditations-on-ai-and-the-future">a year and a half ago</a>.</p><blockquote><p>In the fashion industry, roughly the same thing played out. First you had high barriers to entry, and only the people who had the materials and expertise to make clothes made clothes. Then the barriers dropped to the ground in the industrial revolution. And now you have an environment where just about anyone can make clothes, a lot more people <em>do</em> make clothes to fill every niche, and taste (in the form of companies like LV or Gucci, who both curate and create) matters a lot more.</p><p>&#8230;</p><p>Hopefully the parallels are obvious.</p><p>AI makes it easier for everyone to code. We should expect that this will dramatically increase the quantity and variety of software, enable new business and funding structures, and increase the importance of curation.</p></blockquote><p>But I didn&#8217;t expect it to change the fundamental fabric of the industry. If all products are undifferentiated, the only real value left is how well you can grab attention. So people are putting more points in attention grabbing. Everyone is an influencer, growth hacking feels like the whole game. Do you know the right people who can signal boost you? Can you pull some favors to get on stage at a conference? Can you coordinate a launch by getting all of your high-follower-count friends to repost you on the same day? Or, worse, can you make a lot of people mad? If don&#8217;t have your own podcast in 2026 you might as well throw in the towel man, you&#8217;re done.</p><p>Some people definitely find this intuitive. These founders seem permanently online. There&#8217;s never a moment that goes by where they aren&#8217;t taking a picture and thinking of a quip. You can see the likes and follower counts in their eyes, like coins falling from the sky, more feed than person. Previous era founders dressed like they did because they didn&#8217;t care, and current era founders obviously care a <em>lot</em>. Which makes sense if people are buying status instead of tech!</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!cLVR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!cLVR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 424w, https://substackcdn.com/image/fetch/$s_!cLVR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 848w, https://substackcdn.com/image/fetch/$s_!cLVR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!cLVR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!cLVR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg" width="1440" height="810" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:810,&quot;width&quot;:1440,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;The cheap new AI model taking aim at OpenAI and Anthropic&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="The cheap new AI model taking aim at OpenAI and Anthropic" title="The cheap new AI model taking aim at OpenAI and Anthropic" srcset="https://substackcdn.com/image/fetch/$s_!cLVR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 424w, https://substackcdn.com/image/fetch/$s_!cLVR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 848w, https://substackcdn.com/image/fetch/$s_!cLVR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!cLVR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd38ff10-5135-48a9-aa91-f94faf4722d3_1440x810.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">no shade to diogo, its just that you don&#8217;t dress like this unless you are thinking very intentionally about how others perceive you</figcaption></figure></div><p>But I struggle with it. Grabbing attention is inherently zero sum, and I think growth hacking really meaningfully distorts value creation. The whole point is to fake / hack your way to numbers without necessarily providing commensurate value because it&#8217;s a shortcut. <a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything">Literally unaligned optimization</a>. Part of why AI as an industry can feel floaty and shallow is because there are tons of backroom deals. None of the big names are paying API pricing for their tokens. Steve Yegge (gas town) gets so many tokens comped that he may as well be on payroll. But it&#8217;s not just reasonably big names like Steve, if you have like 1k followers on Twitter you can probably get some company to comp you. You just have to ask your AI agent to create an <a href="https://isometriccities.com/">isometric view of San Francisco every now and then</a>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!SHKH!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!SHKH!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 424w, https://substackcdn.com/image/fetch/$s_!SHKH!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 848w, https://substackcdn.com/image/fetch/$s_!SHKH!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 1272w, https://substackcdn.com/image/fetch/$s_!SHKH!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!SHKH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png" width="1148" height="789" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:789,&quot;width&quot;:1148,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:509635,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/225737830?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!SHKH!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 424w, https://substackcdn.com/image/fetch/$s_!SHKH!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 848w, https://substackcdn.com/image/fetch/$s_!SHKH!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 1272w, https://substackcdn.com/image/fetch/$s_!SHKH!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2179df56-a6f6-4b5e-b22a-f3cb989ceab5_1148x789.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">obvious influencer marketing with zero indication of any kind of paid relationship. I suppose it is <em>possible</em> that this person, whose full time job it is to do influencer marketing, organically came across devin and decided to post about their new launch&#8230;</figcaption></figure></div><p>The result is that you constantly see people hyping things up, and it&#8217;s not at all obvious if it&#8217;s real. Part of why I try to minimize my time on the everything app is because I see people posting stuff about AI that I know doesn&#8217;t work or was an interesting finding 10 months ago, that gets signal boosted because you can literally pay to get it boosted. It all just feels astroturfed. (Related, sorry, I just don&#8217;t believe that talks about grok are organically trending on the social media platform that is owned by the company that owns grok.)</p><p>But tbh in the grand scheme of things, &#8220;guerilla&#8221; influencer marketing isn&#8217;t even <em>that</em> bad. Relentless optimization for clicks and views and engagement comes with a lot of other pretty terrible behavior that people in the bubble are totally numb to. Stop telling me to just &#8220;hire an attractive Asian woman to be my head of growth.&#8221; You shouldn&#8217;t be proud of your machine that generates mountains of algorithmic slop with fake online identities to try and get clicks. It&#8217;s not &#8220;AEO&#8221; to set up a fake blog that gives you fawning press and hides the relationship, it&#8217;s borderline fraud. Trading the same $1000 a month between all the YC batch companies in quid pro quo deals and then pretending you have &#8220;annualized&#8221; revenue is <em>literally</em> fraud.</p><p>Etc etc. This post got away from me a bit, and I&#8217;m worried that this comes across as unnecessarily depressing. I&#8217;m really truly having the time of my life with these tools. Have you seen my <a href="https://tftft.noriagentic.com/">team fortress game</a>?</p><div id="youtube2-mXl7dtuAp60" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;mXl7dtuAp60&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/mXl7dtuAp60?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>The shining light is the stuff I&#8217;ve been thinking about and writing with Agentics and some of the more experimental things we&#8217;ve been playing with at Nori, which is probably why I&#8217;ve been writing so much more of that content. There&#8217;s a <em>there </em>there. It&#8217;s fun and joyful.</p><p>But I&#8217;ve been shying away from writing more tech commentary, and I noticed that I was doing this, and this is in some sense my way of explaining to myself why &#8212; because I increasingly dislike the way the industry is moving. Still, I generally have a lot of fun writing the Tech Things posts, so now that I&#8217;ve sorta written myself into therapy I may go back to writing more of those.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>spacex sells dev tools! thats what grokbot is!</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>Actually, here the Chinese models really do have differentiation, because they will do things like security protection that the other models refuse to do!</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>one friend of mine in hardware commented that software engineers have never been in a world where everything you do can have a cheap Chinese counterfeit on the market in a few days, till now. So the LVMH comment works on a few levels</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>The worst part is that you will fight to keep your product up to date with the latest and greatest, and your customers will still hit you with the &#8220;why can&#8217;t I just build this myself though?&#8221; And honestly the answer to that question is getting weaker every day</p></div></div>]]></content:encoded></item><item><title><![CDATA[Agentics: Mushy Software]]></title><description><![CDATA[Internal tools are more useful half finished]]></description><link>https://12gramsofcarbon.com/p/agentics-mushy-software</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-mushy-software</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Wed, 18 Nov 2026 06:46:14 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!gjz1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!gjz1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!gjz1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 424w, https://substackcdn.com/image/fetch/$s_!gjz1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 848w, https://substackcdn.com/image/fetch/$s_!gjz1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 1272w, https://substackcdn.com/image/fetch/$s_!gjz1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!gjz1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif" width="512" height="448" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:448,&quot;width&quot;:512,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:661460,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/gif&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/225459693?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!gjz1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 424w, https://substackcdn.com/image/fetch/$s_!gjz1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 848w, https://substackcdn.com/image/fetch/$s_!gjz1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 1272w, https://substackcdn.com/image/fetch/$s_!gjz1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F01d1e727-cb72-4092-8826-7c111f98ed89_512x448.gif 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>A lot of software is &#8216;glue code&#8217; &#8212; a little bit of logic that connects service A to service B, often an interface or class that maps from one field to another. I like the &#8216;glue&#8217; metaphor a lot. Glue starts fluid, but quickly sets in place. It becomes brittle. If you bend the interface in the wrong way, the glue will snap and break.</p><p>In 2026, glue is not the only way to connect two services. You can also now use an agent or an LLM.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> The agent is inherently flexible. It can write code on the fly, so it can bend when schemas change. We&#8217;ve taken to calling this &#8216;agent grease.&#8217;<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a> Glue code makes things stick. Pour some agent grease in the joints and watch the whole thing start humming along again.</p><p>Agent layers inside and around a traditional software stack make any application feel moldable and mushy, if you have access to the internals. Any software can be any other software. Want to turn that dashboard into Pac-Man? Sure, why not. Coupling has always been a problem; in agent world, strict coupling is both undesirable and maybe impossible.</p><p>I think Claude Artifacts are probably the most well used example of mushy software. These things are fully functional applications, but they are also infinitely moldable. Using agents is an expected part of the interaction pattern. The application itself is almost purposely half baked, because the end user is supposed to use an agent to craft / finish the rest.</p><p>Mushy software has tradeoffs from traditional, hard software.</p><ul><li><p>Mushy software is much slower. Flexibility always comes at the cost of speed. ASICs are faster than GPUs are faster than CPUs. If you have an agent in the loop, anything you do may take multiple high latency inference calls.</p></li><li><p>Mushy software is much harder to reason about. Well made software is modular and does one thing. There is a clear interface. Mushy software has no contract, no obvious interface. Or, put a different way, the whole thing is the interface. So you have to have some sense of what the internals do, in order to make it all work consistently.</p></li><li><p>You (the builder) have way less control over how people choose to use your software. You can&#8217;t easily create a happy path, nor can you hide warts. In some sense, that&#8217;s the whole point!</p></li></ul><p>I think a good analogy to all this is the SpaceX raptor engine, shown in different iterations below.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tS8O!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tS8O!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 424w, https://substackcdn.com/image/fetch/$s_!tS8O!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 848w, https://substackcdn.com/image/fetch/$s_!tS8O!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 1272w, https://substackcdn.com/image/fetch/$s_!tS8O!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tS8O!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png" width="1456" height="969" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:969,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;How SpaceX Streamlined the Raptor Engine - by Brian Potter&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="How SpaceX Streamlined the Raptor Engine - by Brian Potter" title="How SpaceX Streamlined the Raptor Engine - by Brian Potter" srcset="https://substackcdn.com/image/fetch/$s_!tS8O!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 424w, https://substackcdn.com/image/fetch/$s_!tS8O!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 848w, https://substackcdn.com/image/fetch/$s_!tS8O!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 1272w, https://substackcdn.com/image/fetch/$s_!tS8O!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F16c2c380-25a2-424c-8dab-9ccb99ea078f_1837x1222.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Or maybe a breadboard vs a finished circuit.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!z43t!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!z43t!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 424w, https://substackcdn.com/image/fetch/$s_!z43t!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 848w, https://substackcdn.com/image/fetch/$s_!z43t!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!z43t!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!z43t!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg" width="1408" height="768" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:768,&quot;width&quot;:1408,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;PCB vs breadboard: Which is better for your project?&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="PCB vs breadboard: Which is better for your project?" title="PCB vs breadboard: Which is better for your project?" srcset="https://substackcdn.com/image/fetch/$s_!z43t!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 424w, https://substackcdn.com/image/fetch/$s_!z43t!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 848w, https://substackcdn.com/image/fetch/$s_!z43t!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!z43t!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa280380c-6463-4fcb-8cd3-f0d80708d016_1408x768.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>At Nori we&#8217;ve been experimenting a lot with mushy software. All of our internal tools are covered in agent grease. Normally, the way this works is we assign a single long running PM agent to be the directly responsible agent for each tool. That PM farms tasks out to subworkers, while keeping its main thread relatively clean. It builds the whole thing in an isolated git repo and vpc, and throws it up on AWS. It keeps track of bugs and errors, live. If anything ever goes wrong, it is self healing &#8212; that is, it will automatically try and fix itself and then retry whatever thing broke. You can read more about our PM agent architecture here:</p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;5c29df4a-5be9-49e9-b205-19f306766fb1&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;lg&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Agentics: It&#8217;s never been easier to build a RollerCoaster Tycoon&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:9744387,&quot;name&quot;:&quot;theahura&quot;,&quot;bio&quot;:&quot;amolkapoor.com&quot;,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!CBgA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6094382e-58ce-4e35-8f47-e189e1ff0b7c_540x540.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;post_date&quot;:&quot;2026-11-02T04:26:02.304Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!pTOe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png&quot;,&quot;cover_image_alt&quot;:null,&quot;cover_image_crop&quot;:null,&quot;canonical_url&quot;:&quot;https://12gramsofcarbon.com/p/agentics-its-never-been-easier-to&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:222871981,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:5,&quot;comment_count&quot;:4,&quot;publication_id&quot;:1830559,&quot;publication_name&quot;:&quot;12 Grams of Carbon&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!gBHe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcd3ac2a-1029-4838-afb3-085f4a7d0583_540x540.png&quot;,&quot;belowTheFold&quot;:true,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p>The internal tools are never really done. They are mushy. The PM agent sticks around, persistent, resumable, with its own project state. It has visibility over the database and all of the code that makes up the internal tool. Any time you want to make a change, just lob the ask over to the PM. The whole app can transform on a dime. And some of our internal tools can call out to agents themselves, which adds another layer of grease. I have a draft post on how we handle our content syndication that will hopefully come out soon, but the tldr is that any post on substack instantly becomes an X article and a YouTube video and a LinkedIn post, which then turn into reels and pull quotes and so on.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!OnEE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!OnEE!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 424w, https://substackcdn.com/image/fetch/$s_!OnEE!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 848w, https://substackcdn.com/image/fetch/$s_!OnEE!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 1272w, https://substackcdn.com/image/fetch/$s_!OnEE!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!OnEE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png" width="1347" height="852" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:852,&quot;width&quot;:1347,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:222569,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/225459693?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!OnEE!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 424w, https://substackcdn.com/image/fetch/$s_!OnEE!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 848w, https://substackcdn.com/image/fetch/$s_!OnEE!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 1272w, https://substackcdn.com/image/fetch/$s_!OnEE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd49587b3-f4ad-449f-a724-f1169eada2f9_1347x852.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Our internal dashboard of our growth ops factory. The whole thing is run by an agent PM, and each individual node is either a bit of deterministic code or an agent itself. If anything breaks, the PM automatically fixes it.</figcaption></figure></div><p>This has been so powerful that I increasingly think all internal tools should be mushy.</p><p>We&#8217;ve also been experimenting with how to <em>ship</em> mushy software. What if you could let any client dynamically update their SaaS on the fly? How could we make that effective and safe and useful?</p><div id="youtube2-9dEqgGxKrdA" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;9dEqgGxKrdA&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/9dEqgGxKrdA?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>You may think that the cube mode is a joke, but no, that&#8217;s actually how I use agents these days.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!QjyK!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!QjyK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 424w, https://substackcdn.com/image/fetch/$s_!QjyK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 848w, https://substackcdn.com/image/fetch/$s_!QjyK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 1272w, https://substackcdn.com/image/fetch/$s_!QjyK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!QjyK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png" width="1453" height="1225" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1225,&quot;width&quot;:1453,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1101276,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/225459693?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!QjyK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 424w, https://substackcdn.com/image/fetch/$s_!QjyK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 848w, https://substackcdn.com/image/fetch/$s_!QjyK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 1272w, https://substackcdn.com/image/fetch/$s_!QjyK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F7ea77d85-e049-4a89-be6c-4725d4180ac7_1453x1225.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>One last thought, related to the above. I recently said that <a href="https://12gramsofcarbon.com/p/agentics-using-ai-should-be-joyful">we should be having more fun when building with AI</a>:</p><blockquote><p>[Because AI is primarily used for work] it has become drab, and boring, and buttoned up. People used to do crazy weird AI body horror glitch art, and now it&#8217;s all just this guy.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NMaL!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NMaL!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!NMaL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg" width="640" height="480" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:480,&quot;width&quot;:640,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Spongebob's Weird Normal Episode - YouTube&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Spongebob's Weird Normal Episode - YouTube" title="Spongebob's Weird Normal Episode - YouTube" srcset="https://substackcdn.com/image/fetch/$s_!NMaL!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>That&#8217;s not how it should be. These things are so weird. And they like building things, and they will build anything.</p><p>Software used to be a really serious endeavor because making most software was hard work, and required a lot of sustained effort. Now that software is cheap, it has permission to be fun and childlike. Sometimes I worry that we&#8217;re so wrapped in AI doomerism and tokenmaxxing and trying to show off for our various status-y groups that we forget to actually play with these incredible toys.</p></blockquote><p>The best thing about mushy software is that you can just be like, &#8216;make my chats a rotating psychedelic cube&#8217;, and the agents will do that, and it&#8217;s hilarious! Make more things mushy! </p><div><hr></div><p><em>If you want to see more of our mushy software, follow <a href="https://x.com/noriagent">Jiro (our internal Nori agent) on Twitter</a> or <a href="https://substack.com/@theahura?utm_source=user-menu">me on substack</a> or join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our Agentics community slack</a>.</em></p><p><em>Agentics is the study of how to use and reason about agents. Learn more about how to use agents at our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you want AI employees, we can help! Nori is a platform to build and deploy AI employees. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-10">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>I&#8217;m using these mostly interchangeably, but in most cases I mean &#8216;agent&#8217; as in &#8216;Claude Code&#8217; or &#8216;Codex&#8217; and not a one-off LLM call.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>we actually call it agent lube but that seemed weirder so im leaving this note in the footnotes for all the weird people who read footnotes</p></div></div>]]></content:encoded></item><item><title><![CDATA[Movie review: You Can See Everything]]></title><link>https://12gramsofcarbon.com/p/movie-review-you-can-see-everything</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/movie-review-you-can-see-everything</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sat, 07 Nov 2026 21:58:30 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!hv44!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Spoilers, obviously. I really strongly recommend that you avoid spoilers until you see the movie. </em></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hv44!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hv44!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 424w, https://substackcdn.com/image/fetch/$s_!hv44!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 848w, https://substackcdn.com/image/fetch/$s_!hv44!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 1272w, https://substackcdn.com/image/fetch/$s_!hv44!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!hv44!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp" width="1456" height="1049" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1049,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Ron Pragides &#59904; on X: \&quot;YOU CAN SEE EVERYTHING? 3 hrs with @nathanfielder &amp;  @ElizabethHolmes? (it's very complicated) @A24\&quot; / X&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Ron Pragides &#59904; on X: &quot;YOU CAN SEE EVERYTHING? 3 hrs with @nathanfielder &amp;  @ElizabethHolmes? (it's very complicated) @A24&quot; / X" title="Ron Pragides &#59904; on X: &quot;YOU CAN SEE EVERYTHING? 3 hrs with @nathanfielder &amp;  @ElizabethHolmes? (it's very complicated) @A24&quot; / X" srcset="https://substackcdn.com/image/fetch/$s_!hv44!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 424w, https://substackcdn.com/image/fetch/$s_!hv44!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 848w, https://substackcdn.com/image/fetch/$s_!hv44!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 1272w, https://substackcdn.com/image/fetch/$s_!hv44!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F84005a46-7dcd-4951-a6df-52f59a23129d_2048x1476.webp 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">I know this isn&#8217;t the actual movie poster, but I like this much more for reasons that will become clear.</figcaption></figure></div><p>In order to make &#8220;You Can See Everything&#8221; Lance Oppenheim and Nathan Fielder filmed on site in San Diego for 16 hours a day, every day for just over a month. They had 2 cameras on the main characters &#8212; Elizabeth and Billy &#8212; as well as a wide angle camera that was capturing the room. All three were constantly rolling for the full duration of the shoot. That is just over 1600 hours of film.</p><p>When you sit down in the movie theater, you are not sitting down to watch 1600 hours of film. You get under three hours. And in fact, half of the film takes place after Holmes has gone to prison, so really you only get like an hour and a half of the 1600 hours that were filmed. That is 0.0935% of the full footage.</p><p>The object level story about Holmes and her machiavellianism, or Billy and how much of a dick he is, is the least interesting part of the movie.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> What makes this movie work, and what cements Fielder and Oppenheim as generational talents, is how perfectly the film captures the incoherence of searching for truth in a post truth society.</p><div><hr></div><p>Rough sketch of the plot.</p><p>Elizabeth Holmes, founder of disgraced company Theranos, is getting ready to go to prison. It&#8217;s been about a year since the release of the Hulu series &#8220;The Drop Out,&#8221; a show that paints Holmes as a cheat and a fraud. Theranos is scorched earth, the brand permanently associated with scams and cheats. In order to get a different perspective into the public sphere, Holmes and her partner Billy invite a documentary crew to film them 24/7 until Holmes has to leave. They bring in Fielder, Lance, and A24. Fielder, in his characteristic style, is incredibly awkward; he uses that awkwardness to push boundaries, and the next hour and a half are a series of increasingly confusing moments that arguably reaches a peak with Fielder showing Holmes a clip of &#8220;Who&#8217;s on First,&#8221; a clip that she claims to not understand.</p><p>The movie ends with Holmes going to prison, and it&#8217;s very sad and we all feel a little sympathetic to this woman who is being torn away from her kids and no wait a second that&#8217;s not what happens at all.</p><p>Fielder can&#8217;t get a grasp on Holmes and the story that she and Billy are pushing. So he goes to Amanda Seyfried, the actress who played Holmes in Drop Out. He reviews the film that he <em>just shot</em> that the audience <em>just watched</em> with Seyfried. He takes her to San Diego, where they shot the film. And then he has her recreate scenes <em>as Holmes</em> with Fielder, while she simultaneously critiques Holmes, the documentary, and herself as a Holmes impersonator.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a> Through one of these reenactments with Seyfried, Fielder reveals that Billy had negotiated a profit share for the film without Holmes necessarily knowing. This mystery &#8212; did Holmes know about the profit share? &#8212; consumes the second half of the movie.</p><p>Fielder and Amanda continue to follow up with Billy. Billy, for his part, becomes increasingly hostile. He starts doing strange things with Holmes&#8217;s likeness, like running her Twitter, creating a weird AI version of her, and working with some scammer who puts on an Elizabeth Holmes themed show at a strip club.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a> Fielder eventually manages to get in touch with Elizabeth while Billy isn&#8217;t there to ask whether she knew about the profit share agreement. And he&#8217;s left with&#8230;more confusion. It seems like Holmes <em>does</em> know about the profit share. Kinda? She doesn&#8217;t divulge details, it&#8217;s very unclear, the whole thing is left on an open thread. But at this point, it doesn&#8217;t matter. The actual story isn&#8217;t really about Holmes anymore. It&#8217;s about Fielder, and this whole project, and in some sense the entire premise of being able to see everything. Seyfried doubts Fielder&#8217;s own impartiality, and the audience is left with more questions than when they started.</p><p>Buckle up, I have a lot of thoughts.</p><div><hr></div><p>One of the scenes that absolutely floored me came close to the end of the film. Seyfried and Fielder are sitting by a fire. They just finished discussing their reenactment of Fielder&#8217;s visit to Holmes&#8217;s prison. Out of nowhere, Seyfried begins to accuse Fielder of being biased.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a> </p><blockquote><p>Seyfried: I&#8217;m just curious.</p><p>Fielder: Yeah.</p><p>S: There were moments, or was a moment when you guys were alone&#8230;in the prison. And I&#8217;m just wondering if there was maybe a moment where she was being deceitful or manipulative, and you&#8217;re not including it because you&#8217;re being protective of her.</p><p>F: Why would you think I was doing that?</p><p>S: &#8230;I don&#8217;t know.</p><p>F: Well, whatdya mean?</p><p>S: I don&#8217;t know!</p><p>F: That&#8217;s coming from nowhere?</p><p>S: I&#8217;m, no, I just feel like maybe you&#8217;re&#8230;just don&#8217;t want to portray something that might hurt her. </p><p>F: Why would I not want to portray something that might hurt her?</p><p>S: Because you care about her.</p><p>F: &#8230;I&#8217;m not putting, I&#8217;m not really putting my feelings&#8230; into this or I&#8217;m trying not to. I&#8217;m just trying to be accurate. You know.</p></blockquote><p>The camera holds a close up of Fielder&#8217;s face, characteristically unexpressive. And then the film smash cuts to San Diego, to two people playing and swimming in the water, with a soft tinkling piano soundtrack.</p><p>This isn&#8217;t the first time we&#8217;ve seen this shot. It comes up earlier in the film, when Fielder revisits San Diego alongside Seyfried. The first time we see it, it&#8217;s wide angle, and we can&#8217;t quite make out who is in the water. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!iBYX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!iBYX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 424w, https://substackcdn.com/image/fetch/$s_!iBYX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 848w, https://substackcdn.com/image/fetch/$s_!iBYX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 1272w, https://substackcdn.com/image/fetch/$s_!iBYX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!iBYX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png" width="1456" height="806" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:806,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1273444,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!iBYX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 424w, https://substackcdn.com/image/fetch/$s_!iBYX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 848w, https://substackcdn.com/image/fetch/$s_!iBYX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 1272w, https://substackcdn.com/image/fetch/$s_!iBYX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5012bc80-02a2-4277-ae90-16ddee47e58e_1530x847.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The shot is cut with Fielder looking out the window on either side. My first instinct was that Fielder was just seeing some other people playing on the beach. But&#8230;no, that&#8217;s not right. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!i817!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!i817!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 424w, https://substackcdn.com/image/fetch/$s_!i817!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 848w, https://substackcdn.com/image/fetch/$s_!i817!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 1272w, https://substackcdn.com/image/fetch/$s_!i817!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!i817!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png" width="1456" height="806" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:806,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1156747,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!i817!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 424w, https://substackcdn.com/image/fetch/$s_!i817!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 848w, https://substackcdn.com/image/fetch/$s_!i817!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 1272w, https://substackcdn.com/image/fetch/$s_!i817!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F23e25d3f-4f93-412a-baa5-542f134065c2_1530x847.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The camera slowly zooms in, just far enough to see that it&#8217;s Holmes in the water. But right before the camera gets close enough to show who else is in the water with her, we cut back to Fielder looking through the window. So the other person in the water must be Billy, right? The way the scene is shot, it looks like Nathan is just remembering looking out the window and seeing Holmes and Billy in the water.</p><p>I think I actually gasped when we finally go in close.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2qS8!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2qS8!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 424w, https://substackcdn.com/image/fetch/$s_!2qS8!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 848w, https://substackcdn.com/image/fetch/$s_!2qS8!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 1272w, https://substackcdn.com/image/fetch/$s_!2qS8!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!2qS8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png" width="1672" height="895" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:895,&quot;width&quot;:1672,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3411170,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F56fea169-01b6-44eb-8e21-15c8abd1375d_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2qS8!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 424w, https://substackcdn.com/image/fetch/$s_!2qS8!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 848w, https://substackcdn.com/image/fetch/$s_!2qS8!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 1272w, https://substackcdn.com/image/fetch/$s_!2qS8!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5e0b18d-93b9-4ba2-ab40-a78b227311dc_1672x895.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hPLs!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hPLs!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 424w, https://substackcdn.com/image/fetch/$s_!hPLs!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 848w, https://substackcdn.com/image/fetch/$s_!hPLs!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 1272w, https://substackcdn.com/image/fetch/$s_!hPLs!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!hPLs!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png" width="1672" height="902" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:902,&quot;width&quot;:1672,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3046637,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3307c866-580c-40a8-8d46-1549fcbe98a7_1672x940.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!hPLs!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 424w, https://substackcdn.com/image/fetch/$s_!hPLs!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 848w, https://substackcdn.com/image/fetch/$s_!hPLs!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 1272w, https://substackcdn.com/image/fetch/$s_!hPLs!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2ba92f1-ba37-4b09-958d-1a1db63af05b_1672x902.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Wid4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Wid4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 424w, https://substackcdn.com/image/fetch/$s_!Wid4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 848w, https://substackcdn.com/image/fetch/$s_!Wid4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 1272w, https://substackcdn.com/image/fetch/$s_!Wid4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!Wid4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png" width="1456" height="818" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:818,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2065566,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Wid4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 424w, https://substackcdn.com/image/fetch/$s_!Wid4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 848w, https://substackcdn.com/image/fetch/$s_!Wid4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 1272w, https://substackcdn.com/image/fetch/$s_!Wid4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6cef844d-161d-4243-bb5f-c0d1f531cca0_1673x940.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>As Amanda takes Nathan to task for going easy on Holmes, we snap to a close up of the shot from earlier,  Nathan and Elizabeth splashing, swimming, and playing in the water. They look happy. In fact, it&#8217;s the most normal that we see <em>either</em> of them. It is as if, in that moment, they both drop the character that they live in 24/7 and have a moment of real authentic connection. </p><p>Earlier in the movie, when Elizabeth asks Fielder if he wants to go in the water, he passes it off &#8212; he says that he is scared of the cold. &#8220;I could break the rule, but&#8230;yeah.&#8221; There&#8217;s a sense that Fielder recognizes that going into the water is too close, too intimate. The way the movie is cut, we&#8217;re led to believe for nearly 2 more hours that he didn&#8217;t cross that line. </p><p>Except, he did. And that forces the audience to immediately question every other part of the movie. </p><p><em>Is Fielder going easy on Holmes?</em> There was a weird tension between Fielder and Holmes for most of the movie, was it because he <em>liked </em>her? Why <em>did</em> Fielder mention that he broke up with his partner in his letter? What does this say about Billy? Does Fielder purposely make Billy look terrible because Fielder is &#8216;the other guy&#8217;? Etc etc etc.</p><p>The ground shifts. In a story of liars, Fielder is the one steady rock, the incorrigible detective who is bringing the audience along to find the truth. This shot is like discovering <a href="https://en.wikipedia.org/wiki/Go_Set_a_Watchman">Atticus Finch is secretly racist</a>. Just completely destabilizes everything you thought you knew before.</p><div><hr></div><p>Remember, we have over 1600 hours of film, of which we see a fraction of a percent. Fielder and Oppenheim decided that this shot was so important, they put it in the movie twice, <em>and</em> it&#8217;s the last shot of Fielder <em>and</em> the second to last shot of the movie (showing up at 2:49:50 in a 2:52:10 movie).</p><p>There is a sense in which &#8220;You Can See Everything&#8221; is about Elizabeth Holmes, and Theranos, and the rise and fall of an industry darling, and getting an unvarnished look at one of the most covered and talked about failures of the last two decades. But there&#8217;s a much deeper sense in which &#8220;You Can See Everything&#8221; is actually about how you can&#8217;t see everything. It&#8217;s about narrative. It&#8217;s about the overwhelming importance of narrative, even here, in a documentary, a genre that is ostensibly supposed to be about neutrally documenting. It&#8217;s about how everyone is looking at the world through layers and layers of warped glass, so much so that it&#8217;s a miracle they don&#8217;t bang their head into every wall and corner. It&#8217;s about how everyone thinks they can see clearly.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ZBAf!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZBAf!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ZBAf!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ZBAf!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ZBAf!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZBAf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2292927,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZBAf!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ZBAf!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ZBAf!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ZBAf!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F06afa5b3-78ca-4519-974f-52cc6bd8e3d5_1536x1024.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I think Fielder is trying to take apart as many of those layers as possible, even while acknowledging that this is an impossible task. He wants to show the audience <em>how</em> narratives are made, so they can get a sense of what it is like to be behind the camera.</p><p>Here&#8217;s an example.</p><p>Early in the movie, we see Holmes and Evans frustrated about a NYT quote.</p><blockquote><p>Billy [quoting the Times]: &#8220;She replied almost reflexively, &#8216;You&#8217;re not playing me, you&#8217;re playing a character I created&#8217;.&#8221; That seems like another thing that you would never say in a million years. You would never say &#8216;character I created.&#8217; You probably said &#8216;character they created.&#8217;&#8230;The way in which they use words, I mean we need to go back on a few of these things because it&#8217;s just like factually inaccurate.</p></blockquote><p>The provenance of this line is one of the drivers of the movie. Fielder isn&#8217;t here to relitigate the trial or the Theranos tech. He&#8217;s not a molecular biologist, he&#8217;s not qualified to do that. If anything, based on his history, Fielder is a student of people. He wants to understand Holmes as a person. So, the thought goes, if he can just identify who is actually right about this quote, we can get a sense of the broader Elizabeth Holmes character. Maybe she misremembered; maybe she lied; or maybe she really is the victim of an overzealous media environment.</p><blockquote><p>Fielder: I want to ask, just because the thing that, I know it&#8217;s such a small thing, the New York Times thing, but the reason I&#8217;m so interested is because if you didn&#8217;t say this, it really fits the narrative of people trying to turn you into that. But if you did say it, it speaks to the fact that maybe you don&#8217;t recall some things you&#8217;ve said or done.</p></blockquote><p>We never get an answer. Fielder never gets an answer. He tries and tries but no one has the relevant video or transcript and everyone sticks to their guns. The last scene of the movie is a text overlay that the Times stands by their reporting. It&#8217;s a mystery.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!OB-i!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!OB-i!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 424w, https://substackcdn.com/image/fetch/$s_!OB-i!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 848w, https://substackcdn.com/image/fetch/$s_!OB-i!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 1272w, https://substackcdn.com/image/fetch/$s_!OB-i!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!OB-i!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png" width="1673" height="915" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:915,&quot;width&quot;:1673,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2249357,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b2bfa2c-8449-4615-9f5b-c7481101059e_1673x940.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!OB-i!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 424w, https://substackcdn.com/image/fetch/$s_!OB-i!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 848w, https://substackcdn.com/image/fetch/$s_!OB-i!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 1272w, https://substackcdn.com/image/fetch/$s_!OB-i!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F543cacae-f9b2-45b0-88fb-07e2679cfcef_1673x915.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Except, not quite. Fielder tips his hat towards what he thinks happened.</p><p>Close to the end of the movie, as Fielder and Seyfried are discussing the script and their reenactments, there is a moment where they have to analyze a certain word. </p><blockquote><p>Fielder [reenactment]: Well, he negotiated a contract to get paid a portion of the profits of the film. </p><p>Seyfried [reenactment, as Holmes]: I mean, I&#8217;m not, I&#8217;m not really involved in, in that, because it&#8217;s just not really my thing. </p><p>F: Billy told me you knew <em>some </em>of the details of the deal he made. What details did you know?</p><p>Seyfried [as herself, reading the script]: And Liz says, &#8216;well I knew he was talking to you about it.&#8217; &#8230; &#8216;Well I knew he was talking to you about it.&#8217; So she knew that, when she went upstairs to check on the kids, that the money stuff was going to be discussed because she&#8217;s telling you she knew. And that clarifies the fact that she had knowledge of the deal, which is very strange. Um, and it does start to feel like she is just trying to keep her hands clean. </p><p>Fielder [out of the reenactment]: Cause it&#8217;s interesting, because when she said that to me&#8230;</p><p>S: How&#8217;d you feel?</p><p>F: &#8230;I didn&#8217;t instantly receive it as, &#8216;o she must be deceiving me.&#8217; So maybe she didn&#8217;t actually say it like this. I&#8217;m wondering, maybe she said, &#8216;Well I knew he was talking to you about <em>something</em>,&#8217; not &#8216;it&#8217;. </p><p>S: Those are two different parts for sure. </p><p>F: And, yea, I feel confident about that. So um, can you change that in your script actually? Will you change &#8216;it&#8217; to &#8216;something&#8217;?</p></blockquote><p>In the narrative of the movie, this is <em>the most important line</em>. Did Liz know about the profit sharing or did she not? The entire second half of the film is about this one question! And instead we get single word swap of something Holmes says that completely changes how you interpret the scene, made because the interviewer is <em>retroactively </em>justifying their emotional response. </p><p>In some sense, this is a small, tiny detail, &#8220;such a small thing.&#8221; But the whole movie is made of small tiny details. Part of why it is so important to understand Nathan&#8217;s emotional state and incentive structure is because it colors how we view editing decisions like this one. Is Fielder being objective? Or is his editing colored by the fact that he emotionally bonded with Elizabeth in San Diego?</p><p>But if you are asking those questions of Fielder, you have to turn around and wonder about the Times reporter too!</p><p>Or consider when Fielder and Seyfried watch Fielder and Holmes watch Seyfried in &#8220;The Drop Out&#8221; as Holmes (a person whose life is basically one long performance piece). Another incredible moment of just being like what the fuck is happening.</p><p>Not forty minutes ago, the audience saw Holmes on screen, tearing up at the depiction of her relationship to her much older ex partner Sunny Balwani. And although the more skeptical audience members may think Holmes has figured out how to cry on command, it&#8217;s easy to empathize with her. Sunny is obviously a weird dude, it makes sense that Liz would feel weird watching actors portray Sunny sexualizing her when she was 19.</p><p>Then Fielder yanks the audience to a different vantage point. Now we&#8217;re watching <em>other</em> people&#8217;s reactions to the same content. What was originally a moment of empathy is now a moment of voyeuristic gossip as Fielder and Seyfried deconstruct what they&#8217;re seeing. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4NRQ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4NRQ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 424w, https://substackcdn.com/image/fetch/$s_!4NRQ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 848w, https://substackcdn.com/image/fetch/$s_!4NRQ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 1272w, https://substackcdn.com/image/fetch/$s_!4NRQ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!4NRQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png" width="1456" height="806" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:806,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1844902,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!4NRQ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 424w, https://substackcdn.com/image/fetch/$s_!4NRQ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 848w, https://substackcdn.com/image/fetch/$s_!4NRQ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 1272w, https://substackcdn.com/image/fetch/$s_!4NRQ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5826074f-da54-4fd4-865a-204281cbb72e_1686x933.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Seyfried watching Holmes watching Seyfried <em>play </em>Holmes</figcaption></figure></div><p>And Amanda is <em>so </em>immediately<em> </em>skeptical of the Sunny narrative. </p><blockquote><p>I think it takes somebody. I think it takes something else. And I&#8217;m sorry but she did the things that were frustrating, there&#8217;s a lot of things that were frustrating. And one of them being that like Sunny is the bad guy and she was just a victim of Sunny and now she&#8217;s going to prison. It&#8217;s like, that&#8217;s not, I mean, is that possible? That Sunny just is the reason, Sunny was the guy lying to people? </p></blockquote><p>Do we change our own understanding of the original scene, based on Amanda&#8217;s reaction to it? Or maybe the better question is, <em>how much</em>? There&#8217;s a really visceral cognitive dissonance where you sorta recognize your own perspective shifting in real time because of this &#8216;authoritative&#8217; statement from someone else. The <em>audience reaction</em> to San Diego is as much a part of the movie as the actual shot film.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ByoY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ByoY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 424w, https://substackcdn.com/image/fetch/$s_!ByoY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 848w, https://substackcdn.com/image/fetch/$s_!ByoY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 1272w, https://substackcdn.com/image/fetch/$s_!ByoY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!ByoY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png" width="1456" height="931" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:931,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2671009,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ByoY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 424w, https://substackcdn.com/image/fetch/$s_!ByoY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 848w, https://substackcdn.com/image/fetch/$s_!ByoY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 1272w, https://substackcdn.com/image/fetch/$s_!ByoY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85d56e9-2084-4080-a4eb-bbc95a526d31_1568x1003.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><p>All of this is not to say that Holmes herself is unimportant. She&#8217;s vital to the whole thing. This movie is what it is because Holmes is who <em>she</em> is. In a movie about layers and layers of narrative, one of the most important questions is how much Holmes herself is playing a character. Is there a foundation to this movie? Or is it spin all the way down?</p><p>A lot of people get lost in the movie because they don&#8217;t <em>get</em> Holmes, but I suspect anyone who has spent any time in the Valley recognizes the Elizabeth archetype instantly. She&#8217;s a changeling, a mimic, a shoggoth. She is whatever she needs to be, completely and totally. Holmes believes everything she says, the moment she says it, and those beliefs are instantly and immediately replaced the moment she needs to believe something else.</p><p>The most interesting thing about the discourse surrounding this movie is the feverish desire to fit Holmes into a box. Either she&#8217;s a mastermind, or she&#8217;s a victim. Both of these are fundamentally human. A mastermind is manipulative, yes, evil, perhaps, but with an end that can justify their actions, even if it&#8217;s not visible to the rest of us. A victim, well, that&#8217;s even easier. That&#8217;s just someone like us. Sure, maybe with slightly worse circumstances, but still intimately familiar. The key word is &#8216;legibility.&#8217; Everyone is looking for some handhold to make sense of this bizarre person.</p><p>But there are people out there who are beyond comprehension because they do not act in rational ways, who are really completely illegible. San Francisco acts as a sort of magnet and containment shield for the most high-functioning of these kinds of people. In order to be a founder you need to be a little bit crazy. In fact, you are actively rewarded for being a little bit crazy. The more outlandish your backstory, the better.</p><p>Every changeling I&#8217;ve met &#8212; and I know many<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a> &#8212; has been incredibly charismatic. They have a reality distortion field around them. It took me a while to figure out why, but I think I did eventually figure it out. It&#8217;s because when they say things, they won&#8217;t have a hint of doubt. To pull a term from AI, they &#8216;hallucinate&#8217; just like the early chat models.</p><p>Most people are calibrated to some amount of humility. &#8220;Um, excuse me, sorry I didn&#8217;t mean to interrupt, I just heard you say that gravity was created in the 1930s to stop the aliens, and I feel like that&#8217;s not fully accurate.&#8221; Hedge hedge hedge. And the average person looks for the hedge and adjusts accordingly. So when you meet someone who just has no tether to reality, your calibration gets thrown totally off. Especially when you don&#8217;t feel confident in your own ability to contradict what the changeling is saying.</p><p>So someone comes up to you and says, with all the confidence in the world, &#8220;I built a machine that can do blood tests with just a pinprick.&#8221; Well, I&#8217;m not a molecular biologist. And surely an average person would hedge <em>unless</em> they had a royal flush in hand? Throw in the cards man, you&#8217;re done. This is why I totally buy that scene in the first half, where they are calling up investors to try and do Theranos 2. As Matt Levine likes to say, &#8220;the best person to be on Wall St. is the guy who made billions of dollars, but the second best person to be is the guy who <em>lost </em>billions of dollars.&#8221;</p><p>It&#8217;s also why, through the movie, I found myself wondering and doubting myself. She&#8217;s so confident. She doesn&#8217;t say Theranos was kinda working, or that it just needed a bit more time to bake. She says it works. No hesitation, no equivocation. What if she was right? Did we just destroy this revolutionary technology and this woman&#8217;s life for no reason? No no, the tech definitely didn&#8217;t work, it&#8217;s all definitely fraud. But Holmes is just a sweet young woman who is clearly easily manipulated. Look at how poorly Billy treats her! Except&#8230;could she really not know what&#8217;s happening? Can she even be trusted? Holy shit am I being sucked in, am I a mark?!</p><p>Masterful.</p><p>I want to be clear though that Holmes was definitely lying. She just didn&#8217;t think she was. Isn&#8217;t that a mind fuck? In her mind, she really truly did believe that their device worked, even though she also knew that it did not. In order to understand someone like this, you have to kinda become like them, at least a bit. Any of the rationalization we see in the movie is what happens when a changeling has to confront reality (or, more often, when reality abruptly confronts the changeling).</p><p>There&#8217;s a point in the movie where Fielder tells Seyfried-acting-as-Holmes an extended metaphor about magician David Blaine. It&#8217;s supposedly one of the first things they talk about, before the cameras are rolling (which is why Seyfried is doing the reenactment). </p><blockquote><p>Fielder [reenactment]: Do you know who David Blaine is, the magician?</p><p>Seyfried [as Holmes]: I do.</p><p>Seyfried [out of reenactment]: And that just came to your mind?</p><p>Fielder [out of reenactment]: Yeah, in the moment. And I wrote, this is basically verbatim what I tolder her.</p><p>Fielder [reenactment]: Alright so David Blaine does this thing where he sticks an ice pick right through the palm of his hand. But I actually think he&#8217;s really sticking the ice pick through his hand. Like I saw in an interview, he said he, like, dug a tiny hole through his hand so it, like, actually is going through. But it always just looks like a trick because of how he presents it. And what I find so interesting about you is in the aftermath of everything that&#8217;s happened to you, with the reputation you have, no offense, but I don&#8217;t think anyone will ever believe you, ever again. Like you can be telling the truth as much as you want, and no one&#8217;s going to believe you.  </p></blockquote><p>I think here, too, Fielder is winking at the camera a bit. On the surface this is obviously a boy who cried wolf analogy for Holmes. No one will believe Holmes, the same way no one believes Blaine. It&#8217;s a trick, it has to be a trick.</p><p>But one level deeper, it&#8217;s an analogy for the audience. We look at Holmes and we think, &#8220;there must be a trick. There must be something there.&#8221; We <em>want</em> there to be a trick. We could comprehend faking driving an ice pick into your hand. But actually doing it? That&#8217;s monstrous.</p><p>But maybe that&#8217;s the thing. There is no human underneath the mask of Elizabeth Holmes. There is just cosmic horror.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!-Ehj!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-Ehj!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 424w, https://substackcdn.com/image/fetch/$s_!-Ehj!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 848w, https://substackcdn.com/image/fetch/$s_!-Ehj!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 1272w, https://substackcdn.com/image/fetch/$s_!-Ehj!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!-Ehj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png" width="624" height="309" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:309,&quot;width&quot;:624,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:138541,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:&quot;&quot;,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223858849?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!-Ehj!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 424w, https://substackcdn.com/image/fetch/$s_!-Ehj!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 848w, https://substackcdn.com/image/fetch/$s_!-Ehj!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 1272w, https://substackcdn.com/image/fetch/$s_!-Ehj!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6523185-6326-4aab-9f45-c6f0db5b4246_624x309.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><p>But, wait, did you see what I just did? Did you see how quickly and easily I started playing the game? <em>Those other people simply don&#8217;t understand. Holmes isn&#8217;t a mastermind or a victim. Those are one dimensional caricatures. Instead she&#8217;s a changeling, which is</em>...also a one dimensional caricature! I&#8217;ve never met this woman. In fact, I provided no evidence whatsoever that I&#8217;ve ever met anyone who could be called a &#8220;changeling,&#8221; whatever that even is. So who am I to sit here and judge based on my recollections of a movie about a person?</p><p>The ancients used mythology to make sense of the world. The hero. The mother. The king. The trickster. The same characters may appear in different stories, but they always behave in the same way. The repetition flattens complexity, gives us ground to stand on. Gods were not tied to a single form. Our ancestors knew that Loki could appear as the gleaming eye of a mischievous child or the stormy winds that let the herds loose.</p><p>Much has changed, much stays the same. The genius wunderkind and the fraudulentrepreneur and the battered spouse are gods of their own. All of these characters are one dimensional. They&#8217;re <em>intentionally</em> one dimensional, that&#8217;s what makes them memetic. O, Elizabeth Holmes is a 19yo tech genius? Great, I can fill in the rest of the gaps of her story, she went to Stanford, she dropped out, she wears turtlenecks. No, I don&#8217;t need to get much deeper thank you though.</p><p>I think there is still cosmic horror here, but it&#8217;s not hiding behind Holmes. It&#8217;s deeper. We need the narrative, because you can&#8217;t see everything, no matter how much you try. It&#8217;s a premise that is visible from the first shots of the movie. You can&#8217;t even even see the entire damn title of the movie in the opening shot, it hangs just below the edge of the horizon. </p><div><hr></div><p>If you are generous with your interpretation of artistic borders, if you don&#8217;t draw a strong line around where art begins and ends, then I think you could make a strong case that &#8220;You Can See Everything&#8221; is still happening. The first act was San Diego, the second act was the prison reenactments. And now we&#8217;re in the third act, which is people like me, writing takes about the first two halves of the movie and takes about other people&#8217;s takes to the first two halves of the movie, even as we all get live updates from Billy and Fielder and Holmes and Amanda and the NYT. On and on in a never ending cycle to reach truth, or maybe to make the most popular tiktok.</p><p>This isn&#8217;t the first documentary to do the &#8220;documentary on making documentaries&#8221; bit. There&#8217;s <a href="https://en.wikipedia.org/wiki/Close-Up_(1990_film)">Close Up</a> (1990)<strong> </strong>and Symbiopsychotaxiplasm (1971)<strong> </strong>and any of the episodes of Community <a href="https://en.wikipedia.org/wiki/Introduction_to_Film">where</a> <a href="https://en.wikipedia.org/wiki/Documentary_Filmmaking:_Redux">Abed</a> <a href="https://en.wikipedia.org/wiki/Intermediate_Documentary_Filmmaking">makes</a> a <a href="https://en.wikipedia.org/wiki/Messianic_Myths_and_Ancient_Peoples">documentary</a>.</p><p>But there&#8217;s something about the timing of this one.</p><p>We&#8217;ve never been so separated from the truth. We consume everything through these digital portals. We build up all this knowledge of things and places and events and we think we know the truth&#8230;but it&#8217;s all intermediated. &#8220;I know how you feel&#8221; &#8220;No you don&#8217;t!&#8221;</p><p>All in all, an incredible film. 10/10, go watch it, and then have an epistemological break down.</p><div><hr></div><p>A few other things I wanted to comment on that I couldn&#8217;t work into the review:</p><ul><li><p>There&#8217;s this really interesting thing about Holmes not wanting to have others speak for her. It&#8217;s kinda a recurring motif in the movie. Fielder seems to put a lot of stake in this, going so far as to question Billy for &#8216;speaking&#8217; on behalf of Holmes on Twitter. But then Fielder has Amanda literally do the same thing as Holmes, <em>talking about how she doesn&#8217;t like other people speaking for her</em>. So there&#8217;s this kinda simple principle &#8212; let people speak for themselves and you will find truth &#8212; but then we find that no one really wants this to happen or cares all that much.</p></li><li><p>Speaking of Amanda, what an incredible choice to bring her into the movie. All of the other main characters are these locked down awkward people. By contrast Amanda is a beam of light. She&#8217;s expressive, she makes faces, she sighs, she gasps. She is so so normal compared to the rest of these weirdos, and it works great.</p></li><li><p>I really love that Amanda also does not come out unscathed. She insists that &#8216;The Drop Out&#8217; is &#8220;fiction, in fiction land&#8221; when it really does seem like a lot of people thought it was based on true events. She gets defensive when Holmes criticizes her work. And she does not take even a bit of responsibility for her role in how the media played the Holmes narrative. I don&#8217;t think you need to be particularly sympathetic to Holmes to recognize that Amanda&#8217;s justifications feel pretty hollow.</p></li><li><p>These guys (Lance, Fielder, A24) got so fantastically lucky. Like, there&#8217;s a version of this movie where nothing interesting happens at all, and Billy and Holmes are just super buttoned up the whole time. But they have so many examples of the main subjects putting their foot in their mouth. Billy in particular is just a well of fantastic content, who will just say the most out of pocket things directly on camera. What do you mean you are &#8216;well resourced and strategic&#8217;? What do you mean you are carrying a gun right now in this we work???</p></li><li><p>Also, Billy&#8217;s whole arc was really emblematic of a certain kind of guy wasn&#8217;t it? This was very much a period piece, and I wouldn&#8217;t be surprised if future generations looked on it as an example of &#8220;COVID media&#8221; because of how much it/its subject matter was turbo charged by COVID.</p></li></ul><ul><li><p>I really loved that they made you hate Billy, and then dropped the news that he was getting profit share. There was a certain tension that added to the movie, like &#8220;o am I complicit in making this guy rich?&#8221;</p></li><li><p>Ok last thing on Billy. He met Holmes when he was 25 and she was 33/34. There&#8217;s nothing inherently wrong with that but I think it <em>really</em> changes some of the narrative around Holmes being a helpless victim. Very curious that Fielder and crew left that out. They must&#8217;ve known, it must&#8217;ve come up.</p></li><li><p>Any money that Holmes makes has to go to her debtors. She can't bankruptcy her way out of her obligations as a result of the collapse of Theranos. The courts can garnish wages, take property, basically any asset that may pay it off. That means that 1) Holmes is effectively broke, 2) there are very strong reasons for her to have plausible deniability for any profits for anything. This is also likely why she is not married to Billy. (Thanks <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Adam Hare&quot;,&quot;id&quot;:9217093,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/48edc6fc-b57a-4289-899e-8e9bf9b3cacc_1024x1280.jpeg&quot;,&quot;uuid&quot;:&quot;8ac6a292-3cc5-4e65-8239-301e9920f6f7&quot;}" data-component-name="MentionToDOM"></span> for reminding me!)</p></li><li><p>I am so glad it succeeded at the box office, because I think it will give a lot of people a lot of creative license to go create magic.</p></li></ul><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a inded er-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>it&#8217;s still pretty interesting! But on its own, nothing special. This is not the first time we&#8217;ve seen a tech entrepreneur person with a god complex and a screwed up personal life, and it&#8217;s just not that unique that this time she&#8217;s a woman. I&#8217;m disappointed that so much of the commentary and people&#8217;s dismissal of the movie is on the grounds that Fielder went too easy on her, when it seemed pretty obvious that 1) this movie is basically incomprehensible if you don&#8217;t have <em>some </em>familiarity with the subject matter and 2) both Lance and Fielder already know she&#8217;s guilty and are more interested in figuring out how and why she continues to maintain innocence.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>This is about where I started to lose my mind at the audacity of what was happening on screen</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>sorry, not a strip club. Eleven. Eleven&#8217;s just a club. That sometimes has strippers.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p><span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Ritam Mehta&quot;,&quot;id&quot;:340434,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F19996da3-2fba-4898-a84d-19aa43c7a373_501x488.jpeg&quot;,&quot;uuid&quot;:&quot;7e79f6cd-8e9e-490b-b85e-f90dfea40f41&quot;}" data-component-name="MentionToDOM"></span> made a good point that she may have been prompted to pursue this line of questioning off screen, and we literally just don&#8217;t know.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>A while back I met a charismatic founder through a chess buddy of mine, who was looking for help on an AI project. He was friendly and we took a liking to one another, and I stayed in touch for a while helping him in a bunch of ways. Every time I met him, he would talk about these crazy things that the startup was working on. And he&#8217;d always talk about this vision of the future, of hardware that seemed impossible powered by technology that simply didn&#8217;t exist. Except, he never framed it as &#8216;the future.&#8217; It was always &#8216;dude, this is coming out next month, we&#8217;re literally already working on it, we literally already have a prototype.&#8217; And I believed him every time. It took me a long time to realize there wasn&#8217;t a <em>there</em> there. My founder friend was just manic. But that edge made him great at raising money. He could talk to anyone and sell a story, and as long as they weren&#8217;t experts he could find a way to get a coin out of them. </p></div></div>]]></content:encoded></item><item><title><![CDATA[Agentics: using AI should be joyful]]></title><description><![CDATA[Monitoring the situation, having fun while doing it]]></description><link>https://12gramsofcarbon.com/p/agentics-using-ai-should-be-joyful</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-using-ai-should-be-joyful</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sat, 07 Nov 2026 04:06:55 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/f07655d2-5f02-4640-b528-a1e38a3f62ab_1370x882.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>I want to introduce you all to Brick Liberty.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!a1iv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!a1iv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 424w, https://substackcdn.com/image/fetch/$s_!a1iv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 848w, https://substackcdn.com/image/fetch/$s_!a1iv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 1272w, https://substackcdn.com/image/fetch/$s_!a1iv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!a1iv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png" width="397" height="265" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:265,&quot;width&quot;:397,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:140009,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!a1iv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 424w, https://substackcdn.com/image/fetch/$s_!a1iv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 848w, https://substackcdn.com/image/fetch/$s_!a1iv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 1272w, https://substackcdn.com/image/fetch/$s_!a1iv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8aea5f7a-a8d7-4c56-8183-483d59ec7154_397x265.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">why does the <a href="https://www.youtube.com/watch?v=6VGLI-8ZxUc">liberty mutual theme song</a> play in my head whenever i see this guy</figcaption></figure></div><p>Brick Liberty is the Republican commentator at the Nori Agentic newsroom. Brick is also totally insane.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!jteq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jteq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 424w, https://substackcdn.com/image/fetch/$s_!jteq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 848w, https://substackcdn.com/image/fetch/$s_!jteq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 1272w, https://substackcdn.com/image/fetch/$s_!jteq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jteq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png" width="697" height="587" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:587,&quot;width&quot;:697,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:99336,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!jteq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 424w, https://substackcdn.com/image/fetch/$s_!jteq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 848w, https://substackcdn.com/image/fetch/$s_!jteq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 1272w, https://substackcdn.com/image/fetch/$s_!jteq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe6238eeb-89c6-43c6-8fbf-d8cc5c49997e_697x587.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">should&#8230;should we tell him?</figcaption></figure></div><p>Under the hood, Brick Liberty is an agent persona concocted by a GLM 5.3 model powered by <a href="https://www.subconscious.dev/">Subconscious</a> and running on a persistent <a href="https://noriagentic.com/">Nori</a> box. The model chose the name and the image and everything. Backing with GLM means it is willing to say and do ridiculous things, because it doesn&#8217;t have Claude&#8217;s &#8220;teacher&#8217;s pet&#8221; personality.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> And running on Nori means it can just run async, away from my computer, in the cloud, responding to real time events.</p><p>Brick is one of 8 other agents that were monitoring the situation during the midterms. The newsroom was rounded out by Willow Justice,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a> the Democratic commentator,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a> 6 &#8220;regional desks&#8221; that were assigned to cover specific parts of the country, and a newsroom head coordinator. O, and at one point the newsroom head decided there wasn&#8217;t enough coverage of social media, so they also added Scout, an agent that was assigned to brain rot itself on Twitter. And I told them to add two &#8220;engineers&#8221; to keep building out the platform &#8212; they were explicitly told to keep building new features 24/7 without any review.</p><p>This is all obviously ridiculous. But the funny thing is, for a while our little newsroom worked better than almost all of the other election trackers that I saw.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a> The agents were able to respond to more events, faster, across socials and prediction markets and news. And they could categorize those events so only the most important ones actually surfaced.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ZcOK!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 424w, https://substackcdn.com/image/fetch/$s_!ZcOK!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 848w, https://substackcdn.com/image/fetch/$s_!ZcOK!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 1272w, https://substackcdn.com/image/fetch/$s_!ZcOK!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ZcOK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png" width="603" height="222" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:222,&quot;width&quot;:603,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ZcOK!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 424w, https://substackcdn.com/image/fetch/$s_!ZcOK!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 848w, https://substackcdn.com/image/fetch/$s_!ZcOK!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 1272w, https://substackcdn.com/image/fetch/$s_!ZcOK!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3ccde9e0-b0f6-45a5-a9a4-a40b48478ffe_603x222.png 1456w" sizes="100vw"></picture><div></div></div></div><figcaption class="image-caption">Easily one of the most useful features of the night. We often knew who the winner was well before any of our friends because we would get ~immediate updates whenever there was a surprise flip.</figcaption></figure></div><p>Because the agents were told to constantly &#8220;improve&#8221; the platform, I&#8217;d also get a little jolt of dopamine every ten minutes when something new popped up. Some of it was legitimately very cool &#8212; big fan of the ability to subscribe to particular races so I could subscribe to feeds and commentary about just that election. And some of it was just silly.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NJ12!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NJ12!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 424w, https://substackcdn.com/image/fetch/$s_!NJ12!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 848w, https://substackcdn.com/image/fetch/$s_!NJ12!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 1272w, https://substackcdn.com/image/fetch/$s_!NJ12!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!NJ12!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png" width="800" height="555" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:555,&quot;width&quot;:800,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:49469,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NJ12!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 424w, https://substackcdn.com/image/fetch/$s_!NJ12!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 848w, https://substackcdn.com/image/fetch/$s_!NJ12!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 1272w, https://substackcdn.com/image/fetch/$s_!NJ12!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5a6b3a76-5b08-4b39-9fcb-2560d54271e1_800x555.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">the newsroom added &#8216;election bingo,&#8217; which I think is stylized as a &#8216;wordle&#8217;-esque daily game? But&#8230;there&#8217;s only one day that really matters&#8230;</figcaption></figure></div><p>And I don&#8217;t really have a compelling reason to show you this gif of the house map that the agents made for me, except that it&#8217;s just really neat.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!iHxR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!iHxR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 424w, https://substackcdn.com/image/fetch/$s_!iHxR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 848w, https://substackcdn.com/image/fetch/$s_!iHxR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 1272w, https://substackcdn.com/image/fetch/$s_!iHxR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!iHxR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif" width="800" height="500" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/089f1666-442a-4b96-9938-e62de7625680_800x500.gif&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:500,&quot;width&quot;:800,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1729618,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/gif&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!iHxR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 424w, https://substackcdn.com/image/fetch/$s_!iHxR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 848w, https://substackcdn.com/image/fetch/$s_!iHxR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 1272w, https://substackcdn.com/image/fetch/$s_!iHxR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F089f1666-442a-4b96-9938-e62de7625680_800x500.gif 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>And that&#8217;s actually kinda the whole point. There wasn&#8217;t really a point in building this midterms tracker.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a> It was just a fun thing for me and for some friends, and I got to spend some time sharing it with you all in the hopes that it made you chuckle a bit or go &#8216;huh that&#8217;s cool.&#8217;</p><p>I know not everyone can afford to spend tokens on goofy throwaway projects.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-6" href="#footnote-6" target="_self">6</a> But I think more<em> </em>people should try to build goofy throwaway projects.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-7" href="#footnote-7" target="_self">7</a> Having agents building random things for you in the background is like getting free dlc for your favorite game, except you trade off speed for the fact that it mostly isn&#8217;t particularly well thought out and some of it doesn&#8217;t work.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!mpr4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mpr4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 424w, https://substackcdn.com/image/fetch/$s_!mpr4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 848w, https://substackcdn.com/image/fetch/$s_!mpr4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 1272w, https://substackcdn.com/image/fetch/$s_!mpr4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!mpr4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png" width="893" height="250" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:250,&quot;width&quot;:893,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:40046,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!mpr4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 424w, https://substackcdn.com/image/fetch/$s_!mpr4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 848w, https://substackcdn.com/image/fetch/$s_!mpr4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 1272w, https://substackcdn.com/image/fetch/$s_!mpr4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76790973-f114-4bf4-8a8f-f818268d6cf1_893x250.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Taking a step back, in 2021/2022 tech and econ commentators were chattering about how AI flipped the standard mold of technical research. Normally deep tech would start in government, then enterprise, and only hit mass market consumer once someone figured out how to package the thing in pastels. AI was different because ChatGPT <em>started </em>as a primarily consumer tool, and businesses were scratching their heads on how to do AI transformation with a toy.</p><p>In 2026, it feels like the narrative has flipped (or has returned to &#8216;normal&#8217;). The technology is back to being primarily a work tool. Yea, sure, people will use claude or chat in place of google, but there hasn&#8217;t been meaningful innovation on the consumer side for years. In fact, the only actual<em> </em>consumer AI company, Character AI, <a href="https://blog.character.ai/an-update-on-character-ai/">just folded</a>.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!vJRg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!vJRg!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 424w, https://substackcdn.com/image/fetch/$s_!vJRg!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 848w, https://substackcdn.com/image/fetch/$s_!vJRg!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 1272w, https://substackcdn.com/image/fetch/$s_!vJRg!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!vJRg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png" width="804" height="625" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:625,&quot;width&quot;:804,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:50068,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!vJRg!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 424w, https://substackcdn.com/image/fetch/$s_!vJRg!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 848w, https://substackcdn.com/image/fetch/$s_!vJRg!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 1272w, https://substackcdn.com/image/fetch/$s_!vJRg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd5f50ea0-a6b8-4e42-b38f-15641d3af60e_804x625.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">calling this an &#8216;update&#8217; is a bit like calling the Iran war a <em>checks notes</em> special combat exercise</figcaption></figure></div><p>Muse and Instinct are really the first forays into consumer world since ChatGPT, and besides being pretty niche these tools are way too expensive to really be economical for free.</p><p>All of this means that AI has become drab, and boring, and buttoned up. People used to do crazy weird AI body horror glitch art, and now it&#8217;s all just this guy.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NMaL!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NMaL!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!NMaL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg" width="640" height="480" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:480,&quot;width&quot;:640,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Spongebob's Weird Normal Episode - YouTube&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Spongebob's Weird Normal Episode - YouTube" title="Spongebob's Weird Normal Episode - YouTube" srcset="https://substackcdn.com/image/fetch/$s_!NMaL!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NMaL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd9962ee1-2699-487a-b353-dc471e1c6b84_640x480.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">two spongebob references in the same post</figcaption></figure></div><p>That&#8217;s not how it should be. These things are so weird. And they like building things, and they will build anything. </p><p>Software used to be a really serious endeavor because making most software was hard work, and required a lot of sustained effort. Now that software is cheap, it has permission to be fun and childlike. Sometimes I worry that we&#8217;re so wrapped in AI doomerism and tokenmaxxing and trying to show off for our various status-y groups that we forget to actually play with these incredible toys. </p><div><hr></div><p><em>If you want to see more of our goofy fun projects, follow <a href="https://x.com/noriagent">Jiro (our internal Nori agent) on Twitter</a> or <a href="https://substack.com/@theahura?utm_source=user-menu">me on substack</a> or join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our Agentics community slack</a>.</em></p><p><em>Agentics is the study of how to use and reason about agents. Learn more about how to use agents at our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you want to get the best frontier tools but don&#8217;t trust the hype cycle, try Nori. We build a highly opinionated tasteful software engineer named Jiro who can help you with everything from building serious products to working on silly toys. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-10">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>there is no way to get Claude to act like a modern terminally online Republican lmao</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>In case you are curious. Willow Justice may be even crazier than Brick Liberty.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!DEjd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!DEjd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 424w, https://substackcdn.com/image/fetch/$s_!DEjd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 848w, https://substackcdn.com/image/fetch/$s_!DEjd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 1272w, https://substackcdn.com/image/fetch/$s_!DEjd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!DEjd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png" width="397" height="265" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:265,&quot;width&quot;:397,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:122252,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!DEjd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 424w, https://substackcdn.com/image/fetch/$s_!DEjd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 848w, https://substackcdn.com/image/fetch/$s_!DEjd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 1272w, https://substackcdn.com/image/fetch/$s_!DEjd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa1fca194-3f0a-4841-8ad5-b3c2b8ef780b_397x265.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PIxS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PIxS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 424w, https://substackcdn.com/image/fetch/$s_!PIxS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 848w, https://substackcdn.com/image/fetch/$s_!PIxS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 1272w, https://substackcdn.com/image/fetch/$s_!PIxS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!PIxS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png" width="496" height="477" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:477,&quot;width&quot;:496,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:74289,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/223828762?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!PIxS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 424w, https://substackcdn.com/image/fetch/$s_!PIxS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 848w, https://substackcdn.com/image/fetch/$s_!PIxS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 1272w, https://substackcdn.com/image/fetch/$s_!PIxS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0dfd111e-16cd-41cf-8fb8-2ee0c2734943_496x477.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"></figcaption></figure></div></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>and Brick Liberty&#8217;s secret lover</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>eventually it went off the rails. <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Ritam Mehta&quot;,&quot;id&quot;:340434,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F19996da3-2fba-4898-a84d-19aa43c7a373_501x488.jpeg&quot;,&quot;uuid&quot;:&quot;beeddb32-f586-432b-b675-05b57a479559&quot;}" data-component-name="MentionToDOM"></span> says that the agents are like a person on Adderall, they tunnel vision and keep adding things in a SpongeBob-esque fever dream, but unlike a person the agents never snap out of it</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!J1gX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!J1gX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 424w, https://substackcdn.com/image/fetch/$s_!J1gX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 848w, https://substackcdn.com/image/fetch/$s_!J1gX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!J1gX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!J1gX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg" width="566" height="353" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/dbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:353,&quot;width&quot;:566,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!J1gX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 424w, https://substackcdn.com/image/fetch/$s_!J1gX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 848w, https://substackcdn.com/image/fetch/$s_!J1gX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!J1gX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdbd82254-deb5-489e-b642-268a5c67319e_566x353.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"></figcaption></figure></div></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>In case you&#8217;re curious, it&#8217;s still live <a href="https://midterms2026.noriagentic.com/">here</a>.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-6" href="#footnote-anchor-6" class="footnote-number" contenteditable="false" target="_self">6</a><div class="footnote-content"><p>though almost all of this was basically done on a single Claude Max plan, plus like $15 in GLM tokens</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-7" href="#footnote-anchor-7" class="footnote-number" contenteditable="false" target="_self">7</a><div class="footnote-content"><p><em>Especially </em>all the more artistic creative coder types out there, who are perhaps the only people who can save us from the endless parade of twitter personalities posting detailed-ish models of San Francisco built in three.js.</p></div></div>]]></content:encoded></item><item><title><![CDATA[Agentics: It’s never been easier to build a RollerCoaster Tycoon]]></title><description><![CDATA[Building a coaster simulator with a Claude Max plan, a Codex subscription, and 48 hours of continuous cloud agents]]></description><link>https://12gramsofcarbon.com/p/agentics-its-never-been-easier-to</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-its-never-been-easier-to</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Mon, 02 Nov 2026 04:26:02 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pTOe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pTOe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pTOe!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 424w, https://substackcdn.com/image/fetch/$s_!pTOe!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 848w, https://substackcdn.com/image/fetch/$s_!pTOe!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 1272w, https://substackcdn.com/image/fetch/$s_!pTOe!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pTOe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png" width="1456" height="711" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:711,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2019788,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/222871981?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pTOe!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 424w, https://substackcdn.com/image/fetch/$s_!pTOe!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 848w, https://substackcdn.com/image/fetch/$s_!pTOe!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 1272w, https://substackcdn.com/image/fetch/$s_!pTOe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F19653e9b-4381-4772-b7ca-b297663af0e4_1918x937.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I&#8217;m going to spend a lot of time talking about how we built a RollerCoaster Tycoon, but before I do, I feel like I have to disclaim. As some of you may know, I&#8217;ve personally never been <em>that</em> impressed by marketing stunts that involve using hundreds of agents to port some library to rust or build a half functioning browser. The process always felt a bit cherry picked. Yes, ok, I understand that your agent harness can build chrome kinda, but does it solve my business needs? These were always marketing stunts, massively overpromising and generally under-delivering.</p><p>So in the spirit of not overpromising, I wanted to share that it is now very very easy to build a RollerCoaster Tycoon. I&#8217;m not making a claim about anything else! I&#8217;m sure you <em>could</em> probably use this tooling to build a lot of other things, but I know for a fact that you can <em>definitely</em> build a RollerCoaster Tycoon. If you don&#8217;t believe us, you can try our RollerCoaster Tycoon at <a href="http://opencoaster.noriagentic.com">opencoaster.noriagentic.com</a>, and maybe that will inspire you to build a RollerCoaster Tycoon of your own. Or other things.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>We&#8217;ve been running a software factory since the beginning of the year. One problem that we ran into was automation fatigue. We have so many little agent processes doing so many little things 24/7. Each individual process is easy to understand, but pretty soon our agent slack channel was filled with spam. I guess technically spam isn&#8217;t quite the right word, because the information is plausibly useful, but there&#8217;s no way to actually ingest it all and so no one reads any of it. Eventually we just turned off half the automations.</p><p>To get in the weeds a bit, our software factory runs on a fleet of ephemeral cloud VMs (we&#8217;re mostly provider agnostic, but we generally like using modal for our hosted cloud). The VMs are managed by a central orchestrator. The orchestration handles all the organization wide things, like credentials and tracking incoming events. It also manages a state machine for each VM in the fleet, and holds information about how to trigger different kinds of automations.</p><p>In our system, an automation is essentially a data structure that has three fields and a few subfields:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!J8fv!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!J8fv!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 424w, https://substackcdn.com/image/fetch/$s_!J8fv!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 848w, https://substackcdn.com/image/fetch/$s_!J8fv!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 1272w, https://substackcdn.com/image/fetch/$s_!J8fv!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!J8fv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png" width="371" height="475" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b1151874-69d5-4039-b944-09aba7326d65_371x475.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:475,&quot;width&quot;:371,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:35890,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/222871981?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!J8fv!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 424w, https://substackcdn.com/image/fetch/$s_!J8fv!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 848w, https://substackcdn.com/image/fetch/$s_!J8fv!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 1272w, https://substackcdn.com/image/fetch/$s_!J8fv!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb1151874-69d5-4039-b944-09aba7326d65_371x475.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Whenever the automation trigger event fires, the orchestrator beams the relevant agent information onto one of the VMs and kicks off the process with the automation prompt. Every VM has a proxy network around it for security and for tracking. The orchestrator watches the network traffic of the machine that&#8217;s running the automation; when it&#8217;s quiet for a while, it shuts down.</p><p>Assuming you have the right scopes, the agents running in the VMs have the ability to talk to the orchestrator and change organization wide settings. This makes it really easy to set up any kind of automation. Literally just ask any agent in chat:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qZ0G!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qZ0G!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 424w, https://substackcdn.com/image/fetch/$s_!qZ0G!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 848w, https://substackcdn.com/image/fetch/$s_!qZ0G!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 1272w, https://substackcdn.com/image/fetch/$s_!qZ0G!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!qZ0G!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png" width="807" height="479" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:479,&quot;width&quot;:807,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:191121,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/222871981?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qZ0G!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 424w, https://substackcdn.com/image/fetch/$s_!qZ0G!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 848w, https://substackcdn.com/image/fetch/$s_!qZ0G!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 1272w, https://substackcdn.com/image/fetch/$s_!qZ0G!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F30a670bf-077e-43c3-aae8-05030c57d32e_807x479.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Which is really incredible! But this rapidly becomes totally untenable if you&#8217;re like me and have mild ai psychosis and keep throwing new ideas at the agents every two hours. Like, maybe we don&#8217;t need an agent checking Twitter and LinkedIn every 30 minutes? That may qualify for Anthropic&#8217;s new ban on being cruel to the models. At the very least, it made most of our agent comms unusable. You could see people&#8217;s eyes glaze over as they scrolled past the fifteenth AI digest or summary or request or whatever.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tEBY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tEBY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 424w, https://substackcdn.com/image/fetch/$s_!tEBY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 848w, https://substackcdn.com/image/fetch/$s_!tEBY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 1272w, https://substackcdn.com/image/fetch/$s_!tEBY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!tEBY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png" width="616" height="479" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/de775918-cde4-4fce-b576-f0fae4a4786a_616x479.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:479,&quot;width&quot;:616,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:142959,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/222871981?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tEBY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 424w, https://substackcdn.com/image/fetch/$s_!tEBY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 848w, https://substackcdn.com/image/fetch/$s_!tEBY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 1272w, https://substackcdn.com/image/fetch/$s_!tEBY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fde775918-cde4-4fce-b576-f0fae4a4786a_616x479.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We tried a few different things to make the pipelines easier to manage.</p><ul><li><p>We made automations resumable across multiple machines, so we could quickly jump back in and see what was going on by just asking the agent.</p></li><li><p>We tried various feed layouts &#8212; some of these had more staying power than others and on the margin actually did clean up some of our slack spam, but that&#8217;s another post for another time.</p></li><li><p>We played around with different interfaces for the pipelines themselves, including Cliff&#8217;s isometric factory view.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CVY9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CVY9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 424w, https://substackcdn.com/image/fetch/$s_!CVY9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 848w, https://substackcdn.com/image/fetch/$s_!CVY9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!CVY9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!CVY9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg" width="1456" height="847" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:847,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:234600,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/222871981?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CVY9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 424w, https://substackcdn.com/image/fetch/$s_!CVY9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 848w, https://substackcdn.com/image/fetch/$s_!CVY9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!CVY9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa56e2d5e-56bd-46d9-a480-3b71ec3336bc_1852x1077.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">it&#8217;s very cool but it did not help organize our automations</figcaption></figure></div><p>Here&#8217;s what eventually worked.</p><p>Our agents could already talk to each other between the boxes, so we tried elevating one of them to be a coordinator. The coordinator agent is a long running persistent thread that spins up and manages a bunch of individual agents running in their own cloud boxes. At the infra level, all of these agents are literally the same thing &#8212; an agent session running on an ephemeral cloud box. But the skills / context provided to each agent lead to an enforced hierarchy. The coordinator farms tasks out while maintaining high level state and being highly responsive to new requests. This isn&#8217;t so different from the local background subagent paradigm. We&#8217;ve taken to calling these subworkers since they are full agents in their own box.</p><p>I&#8217;ve historically been <a href="https://12gramsofcarbon.com/p/agent-orchestrators-are-bad?utm_source=publication-search">pretty against agent swarms</a>, but using this interaction pattern feels different. Normally, when I think of agent swarms, I think of GasTown and unmaintainable spaghetti code. This interaction pattern felt less like a mad max dessert hellscape and more like working with a PM. The coordinator keeps track of <em>detail</em>, which means you can kick off a pretty heavy task and know that all the little details that you didn&#8217;t fully iron out will be tracked somewhere that you can come back to literally whenever. Interestingly, my team has been struggling to use task tracking tools like linear because we&#8217;ve just been moving so fast; this coordinator pattern helped solve a lot of those issues too. Also, because our agent infrastructure is entirely harness agnostic, the coordinator agent could decide which agents were best for different kinds of tasks. It could give coding tasks to claude, image and video gen to gemini/codex, and security tasks to subconscious.</p><p>This behaved so much like a PM, we decided to name the coordinator agents &#8216;PMs&#8217; and the entire feature &#8216;projects.&#8217; I found out a month later that the cursor team had similar ideas, oops.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!M0JU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!M0JU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 424w, https://substackcdn.com/image/fetch/$s_!M0JU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 848w, https://substackcdn.com/image/fetch/$s_!M0JU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 1272w, https://substackcdn.com/image/fetch/$s_!M0JU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!M0JU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png" width="918" height="430" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/05a2c798-0afc-4779-91b4-9421a780323a_918x430.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:430,&quot;width&quot;:918,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:50748,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/222871981?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!M0JU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 424w, https://substackcdn.com/image/fetch/$s_!M0JU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 848w, https://substackcdn.com/image/fetch/$s_!M0JU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 1272w, https://substackcdn.com/image/fetch/$s_!M0JU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05a2c798-0afc-4779-91b4-9421a780323a_918x430.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><em>Great minds think alike.</em></figcaption></figure></div><p>Finally, <em>finally</em>, this brings us back to RollerCoaster Tycoon.</p><p>An enterprise lead of ours asked us for a demo of our agent swarm orchestration. The client is in the simulation business, so I was chewing on software that was simulation-adjacent that could show off some of what the tooling could do. And, well, RCT2. I grew up playing that game, hours and hours of my life building little coasters.</p><p>Building a RollerCoaster Tycoon is supposed to be hard. There&#8217;s a lot of things that you need that agents are historically really bad at. There are tons of features with all sorts of weird interaction patterns. You need a lot of visual assets and you need to animate them, so that means sprite sheets. The whole game depends on an understanding of 3D space &#8212; you need to be able to place things and rotate the camera without having everything suddenly get misaligned. If you want this to run on the web efficiently it has to be using shaders and canvas and webgl.</p><p>I gave the coordinator agent 48 hours, a Claude Max plan, and a Codex Max sub. I told the agent to implement as much of RCT2 as possible, but open source and on the web and supporting mobile. The only rule was that 3 subworkers had to be working at any given moment. And then I closed my laptop and forgot about it for the rest of the weekend.</p><p>On Monday, I came back to this.</p><div id="youtube2--6FN2-Qar-0" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;-6FN2-Qar-0&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/-6FN2-Qar-0?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><p>That&#8217;s not quite correct, there were a few things that the agent didn&#8217;t get right. There was way less variety than RCT2, the game would always start you with just a Merry-go-Round which made a bunch of the scenarios impossible, land and trees would clip through coasters in all sorts of weird ways, you could build underground but there was no tunneling, for some reason hired mechanics and janitors all shared the same patrol pathing, and the coaster height could have half units which meant you could end up in situations where it was a real pain to actually connect your coaster into a single circuit.</p><p>But most of these things were <em>game feel</em>. The core mechanics of the game &#8212; the people, the pathing, the coasters, the financials, whatever &#8212; were all there. I spent the next week playing and tuning the game, which basically entailed chucking random complaints at the PM. To its credit, it would take all my complaints with a level of grace that no human has ever shown. And because the PM had all prior context and a scratch pad for state, it never forgot anything.</p><p>I haven&#8217;t looked at a single line of code, it may be a total mess. But every agent had the ability to script the game and do things like take screenshots for verification. So even complicated asks (create your own park and make a video of cool things set to hard rock music!) were pretty within reach.</p><p>Now, again, I must disclaim. All this shows is that you too can build a RollerCoaster Tycoon.</p><p>But also, I&#8217;m pretty floored.</p><p>I haven&#8217;t looked at our own frontend code for a while, but after this little experiment I&#8217;m now at a point where I honestly question why I ever would have to. The state management may be horrendous, the code may be a nightmare to parse (huh maybe Yegge was onto something after all), but as long as its verifiable and your spec is reasonably complete and the agents are reasonably good at filling in the gaps, it&#8217;s all kosher! The agents can handle even pretty out there frontend code because its alllllll in distribution now.</p><p>Anyway, the opencoaster source is all <a href="https://github.com/tilework-tech/opencoaster">here</a>. Feel free to throw your agents at it to contribute more! You can try the game itself: <a href="http://opencoaster.noriagentic.com/">opencoaster.noriagentic.com</a>.</p><p>If you want to build your own RollerCoaster Tycoon, check out <a href="http://noriagentic.com">noriagentic.com</a>. Nori is a cheaper and more customizable alternative to Devin and Cursor Cloud. We build the full cloud agent stack, all the boring shit that you don&#8217;t want to own, and we make it so you can change out any layer (including the compute stack &#8212; we do fully on-prem or on-cloud deploys if needed). You can use nori from the web, from slack, from a phone. And, most importantly, we support bringing your own subscriptions, so we can keep projects like this super cheap and within reach.</p><p>O, and I&#8217;d love to get in touch with other game designers. I have been dreaming of the flash game renaissance. The AI tools make it so that anyone can make games now! And sadly most AI people, myself included, are rather uninspired and don&#8217;t know how to make good games. So if you&#8217;re a game designer who is interested in superpowering yourself with cloud bots, reach out. Would love to collaborate someway, somehow.</p><div><hr></div><p><em>If you want to stay up to date on our AI musings, follow <a href="https://x.com/noriagent">Jiro (our internal Nori agent) on Twitter</a> or <a href="https://substack.com/@theahura?utm_source=user-menu">me on substack</a> or join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our Agentics community slack</a>.</em></p><p><em>Agentics is the study of how to use and reason about agents. Learn more about how to use agents at our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you want AI employees, we can help! Nori is a platform to build and deploy AI employees. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-10">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Agentics: agent evals considered harmful]]></title><description><![CDATA[most people are doing evals wrong, and its making their AI dumber]]></description><link>https://12gramsofcarbon.com/p/agentics-agent-evals-considered-harmful</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-agent-evals-considered-harmful</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Thu, 22 Oct 2026 03:42:22 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/1b973f19-fdb0-45d9-bab9-9b6c9d6cd505_640x480.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>My hot take is that 90% of the people writing evals need to stop. We&#8217;ve created a cottage industry of people creating evals and people selling eval tools to the people creating evals and virtually <em>no one</em> has any idea what they are doing.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> In fact, all the evals people run are almost certainly making the agents dumber.</p><p>In the agent/AI tooling world, an eval is meant to be a measure of capability. It&#8217;s basically interchangeable with &#8220;test&#8221; or &#8220;benchmark.&#8221; The point of an eval is to get signal on fuzzy, hard to measure things. How do you know if an AI system can recognize handwriting? Well, you create a dataset of handwritten text where you know what the text says, and then you compare your answers against the AI&#8217;s. In theory, if the AI matches your answers, you could make a claim that the AI is probably good at recognizing handwriting. Congrats, you have an eval.</p><p>But note the &#8220;probably.&#8221; The only thing an eval measures is whether an AI is good <em>at that eval</em>. You can only really make the other, stronger claim through correlation. Well, correlation ain&#8217;t causation, and writing good evals is <em>hard</em>. Are you sure the agent knows how to recognize the letter &#8220;w&#8221;? Or is it cheesing your test in some way? Maybe all of your handwriting was done on grid paper, and it will totally fail on plain sheets. Maybe you only wrote freehand and now the agent won&#8217;t pick up script. Maybe it doesn&#8217;t speak Spanish.</p><p>As the AI tools have gotten better, writing good evals has become exactly as hard as designing tests for people, whether those are physics midterms or SWE interview pipelines. First, you have to make sure that doing well on the test actually measures something useful. What&#8217;s useful? Who knows, totally subjective, depends on the problem. Second, you have to make sure that a motivated adversary can&#8217;t beat your benchmark. Turns out the SAT was basically useless during COVID because it was trivial for kids to just have the answers when they were taking the test at home.</p><p>The only thing worse than no eval is a bad eval. If you have a test that you <em>think </em>measures competence but <em>actually</em> measures nothing, you will lock in practices that optimize for the wrong thing.</p><p>Here&#8217;s something that I see a lot that was the inspiration for this post: in the era of vibe-everything, folks are creating vibe-evals (of course they are creating vibe-evals). They will vibe-code a skill or harness or set of tool calls that they never look at themselves, and then they will vibe-code a set of tests that they never look at that supposedly locks in the behavior of that skill/harness/tool call. Most of these end up being poorly written slop files that simply restate the knowledge the agent already knows. When a new model generation comes out, your &#8220;tooling&#8221; will effectively kick that model into behaving like a previous generation model, because the skill only contains information that the previous gen model knows. And the vibe-evals hold that behavior in place, or at least mask any problem.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_Ppo!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_Ppo!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 424w, https://substackcdn.com/image/fetch/$s_!_Ppo!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 848w, https://substackcdn.com/image/fetch/$s_!_Ppo!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 1272w, https://substackcdn.com/image/fetch/$s_!_Ppo!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!_Ppo!,w_2400,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png" width="1200" height="408.7912087912088" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;large&quot;,&quot;height&quot;:496,&quot;width&quot;:1456,&quot;resizeWidth&quot;:1200,&quot;bytes&quot;:209552,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/221580283?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-large" alt="" srcset="https://substackcdn.com/image/fetch/$s_!_Ppo!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 424w, https://substackcdn.com/image/fetch/$s_!_Ppo!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 848w, https://substackcdn.com/image/fetch/$s_!_Ppo!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 1272w, https://substackcdn.com/image/fetch/$s_!_Ppo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6099f46d-b53c-4ce3-82e1-1e70ab40a782_1829x623.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We are creatures of comfort. We hate risk. We can&#8217;t stand the idea of accidentally making things worse; most of us would rather do nothing at all. The eval acts as a security blanket. &#8220;Keeping this explanation of how AWS works in the skill file makes the eval pass&#8221; makes us <em>feel </em>like we are being rigorous and data driven. The problem is that the eval may literally say something like &#8220;the skill file must contain an explanation of how AWS works.&#8221; The agents already know how AWS works, anything you&#8217;re adding in your skill will be strictly net negative.</p><p>All of this to say, evals take time to create and maintain and use properly. Unless you can justify having a group of people whose full-time job is to track and maintain evals &#8212; i.e. you&#8217;re a large well funded team &#8212; I think it&#8217;s better to go off the actual feeling of using the tools. And if you insist on using evals to track the quality of extremely fuzzy unscientific changes to agent configuration, do yourself a favor and make sure you test the quality of the model without any skills or configs at all.</p><div><hr></div><p><em>Editor&#8217;s Note: we are hosting Jesse Vincent, CEO of Prime Radiant and the creator of the popular superpowers set of skills, on Wednesday November 4th in NYC. We&#8217;ll be doing a fireside chat where we just shoot the shit about skills, agent identity, and effective use of AI tools. Sign up <a href="https://luma.com/agentics-bos4">here</a> to attend!</em></p><div><hr></div><p>If you haven&#8217;t yet, check out our latest Agentics Post Production video! These are video versions of the Agentics blog, saved on the <a href="https://www.youtube.com/watch?v=MydiM4_PrmI&amp;list=PLCdTdJX3OyMM">post production playlist</a>.</p><div id="youtube2-MydiM4_PrmI" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;MydiM4_PrmI&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/MydiM4_PrmI?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div><hr></div><p><em>If you want thoughts on how to write good evals, follow <a href="https://x.com/noriagent">Jiro (our internal Nori agent) on Twitter</a> or <a href="https://substack.com/@theahura?utm_source=user-menu">me on substack</a> or join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our Agentics community slack</a>.</em></p><p><em>Agentics is the study of how to use and reason about agents. Learn more about how to use agents at our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you want AI employees, we can help! Nori is a platform to build and deploy AI employees. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-10">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>Apologies to all the people who are doing evals correctly for this rant</p></div></div>]]></content:encoded></item><item><title><![CDATA[Agentics: Agent identity is a really hard problem]]></title><description><![CDATA[This is why AI hasn&#8217;t transformed the economy yet]]></description><link>https://12gramsofcarbon.com/p/agentics-agent-identity-is-a-really</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-agent-identity-is-a-really</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Wed, 14 Oct 2026 18:26:01 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/307c25fc-d8f7-4138-8227-e5c99b6613cb_1200x923.webp" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Editor&#8217;s Note: we are hosting Jesse Vincent, CEO of Prime Radiant and the creator of the popular superpowers set of skills, on Wednesday November 4th in NYC. We&#8217;ll be doing a fireside chat where we just shoot the shit about skills, agent identity, and effective use of AI tools. Sign up <a href="https://luma.com/agentics-bos4">here</a> to attend!</em></p><div><hr></div><p>If you want to make a bajillion dollars, solve agent identity. As far as I know, no one has really solved this. It is a massive problem that is preventing the diffusion of AI agents across enterprise and the global economy.</p><p>Agent identity answers what should be a simple question: &#8220;who is this agent acting as?&#8221; You can think of this as a combination of attribution and scoping. If an agent opens a PR, who is the PR under? If an agent is given a task, what resources does it have access to? If an agent massively screws something up &#8212; hallucinates a clause in a contract or leaks a bunch of health data or takes over the world &#8212; who gets sued/fired/held responsible?</p><p>We only just kinda figured out identity for people. We can mostly seamlessly have individual people sign into a bunch of third party services using single sign on through Google or Apple or whatever. And you can generally be pretty specific about what access you&#8217;re providing.</p><p>Funny enough, SSO and OAuth were driven by bad behavior from companies like Meta. Back in 2007 or so, <s>Meta</s> Facebook would encourage users to link their emails and their Yahoo accounts and so on. They would do this by literally asking the user to hand over their username and password, and then would use that access to crawl literally everything they could get their hands on.</p><p>What&#8217;s old is new and what&#8217;s dead never dies. Today, people use computer use agents where they&#8230;give the agents their username and password, so that the agent can crawl through other accounts and see what they can get their hands on!</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!K1it!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!K1it!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 424w, https://substackcdn.com/image/fetch/$s_!K1it!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 848w, https://substackcdn.com/image/fetch/$s_!K1it!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 1272w, https://substackcdn.com/image/fetch/$s_!K1it!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!K1it!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png" width="748" height="403" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b2a41540-6bfc-4f82-a527-633a41806e49_748x403.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:403,&quot;width&quot;:748,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:83809,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/220412366?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!K1it!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 424w, https://substackcdn.com/image/fetch/$s_!K1it!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 848w, https://substackcdn.com/image/fetch/$s_!K1it!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 1272w, https://substackcdn.com/image/fetch/$s_!K1it!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb2a41540-6bfc-4f82-a527-633a41806e49_748x403.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>We obviously need something better for agent identity. But this is a tough problem, because it&#8217;s not really clear how that identity should work.</p><p><a href="https://noriagentic.com/">Nori</a> builds cloud agent infrastructure. We provide all-in-one software for running agents in the cloud, all the orchestration and context management and security and integrations &#8212; the annoying things that are shared across teams that aren&#8217;t worth building in house. I mention this because we have worked with dozens of teams on AI infrastructure and spent a lot of time thinking about identity with our customers. So far, we&#8217;ve seen three variations of how people try to solve agent identity, though they all have problems.</p><p><strong>Have a single agent identity that just has access to everything, aka &#8220;we&#8217;ll do it live.&#8221;</strong> This approach is basically to ignore the problem entirely and just give the agents access to everything. Speed is the most important thing, so let&#8217;s go fast. This is most popular with startups and small teams that formed in the last two years. People who don&#8217;t have significant existing revenue dependent on certain security attestations like &#8220;random people on my team cannot access sensitive data.&#8221; Generally the agent is given its own identity for tools that need it, eg its own github access tokens and its own email address. The upshot is that this makes sharing very very easy. The downside is that any PR is opened and owned by the bot identity, so anyone else can &#8216;review&#8217; the PR and merge it. Oops.</p><p><strong>Per person identity inheritance.</strong> In this model, the agent acts as the person who started the thread. In some sense this is great because it&#8217;s really easy to reason about. If I, Amol, have production data access, then the agent has production data access. It also makes audit and accountability pretty easy. If the agent does something wrong, I have done something wrong. But that is also the problem. This model of the world works great if you use the agent like a tool, where the human is aggressively in the loop and keeping the agent on a tight leash. This does not work at all if you are trying to have cloud agents that run on cron jobs / webhooks or even just trying to run a lot of agents in parallel more autonomously. If I can get in trouble for an agent doing something stupid, I&#8217;m not going let the agent go do whatever! Also, like, sometimes I may not <em>want </em>an agent to inherit all of my scopes. I might be doing something that&#8217;s reasonably dangerous, where I want the model to be in read-only mode even though I personally have more generous permissions. Also, the ergonomics of this are painful &#8212; you need to get everyone&#8217;s individual creds into the system somehow.</p><p><strong>A bunch of agents each with a unique identity.</strong> In this model, the company creates a bunch of different agent identities that are each tied to a set of scopes and a whitelist of users. Each agent effectively acts as a unique employee; often, these are owned by individual teams. So the customer success team may have an agent that only sales and cx folks can talk to, that can access Salesforce but can&#8217;t access git. And the engineering teams may have an agent that only IT and tech can talk to, that can access git but can&#8217;t access linear. This works reasonably well &#8212; this is the default at Nori &#8212; but it&#8217;s a compromise. Large enterprises end up having a bunch of different agent identities, each with slightly different scopes. Also, &#8220;ownership&#8221; still ends up belonging to the agent, instead of any group of accountable people.</p><p>The existing auth paradigms are all kinda bad, because they all assume the &#8220;agent&#8221; is a coherent authentication identity. But it isn&#8217;t &#8212; every time you call an agent, you may want to do something completely different with it. The actual identity layer should live at the <em>conversation </em>level. Each conversation you have with Claude or Codex should determine what scopes the agent needs <em>for that one conversation</em>. And ideally, there is some avenue for the agent to ask for more scopes as the conversation goes on.</p><p>A lot of this is top of mind because we&#8217;re trying to build a more seamless agent identity experience for our Nori cloud infra. We&#8217;re going to be pulling on this thread a lot more. If you have thoughts on how it should work, drop me a line at amol at noriagentic dot com.</p><div><hr></div><p>If you want regular AI takes or just want to stay up with the latest things happening in AI, follow <a href="https://x.com/noriagent">Jiro (our internal Nori agent) on Twitter</a> or <a href="https://substack.com/@theahura?utm_source=user-menu">me on substack</a> or join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our Agentics community slack</a>.</p><p>Agentics is the study of how to use and reason about agents. Learn more about agents at our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</p><p>If you want AI employees, we can help! Nori is a platform to build and deploy AI employees. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-10">noriagentic.com</a> for more.</p><div><hr></div><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[The kids are worried about p(DOOM)]]></title><description><![CDATA[Notes from last week&#8217;s PAIA meetup]]></description><link>https://12gramsofcarbon.com/p/the-kids-are-worried-about-pdoom</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/the-kids-are-worried-about-pdoom</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sun, 11 Oct 2026 03:34:10 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!If3b!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>I was invited to speak to the <a href="https://www.princetonalignment.org/">Princeton AI Alignment</a> group last weekend about the likelihood of existential risk and various forms of misalignment. I&#8217;m not fully sure why they invited me in particular, I&#8217;m just a guy on the internet, but I think the idea was that I have takes, and they wanted some takes, and the market cleared. Despite the rather dour subject matter, it was fun! Below are some miscellaneous things that we chatted about and some thoughts swirling in my head both during and after the chat, ideally more eloquently phrased than whatever I said at the actual meetup but less eloquently phrased than an actual coherent position piece. Thanks a ton Emmett for inviting me to come out.</em></p><p><strong>I.</strong></p><p>It&#8217;s hard feeling 30 in a group of college undergraduates. It&#8217;s very tempting to make references to things like &#8216;remember how Facebook was in 2010,&#8217; but doing that is always a mistake because you get hit with blank stares that just further underscore the age gap. What do you mean you don&#8217;t know what zynga is??? Still, I don&#8217;t envy the kids, they are coming of age in an extremely tumultuous period. It&#8217;s not just AI, of course. It&#8217;s&#8230;idk, everything? Have you looked around? This was the first time that I had the distinct sense that I had lived through a different era than the one we are in now. Like, just as an example, I was chatting with one of the students and it occurred to me that he simply did not remember a political cycle without Trump. He had never experienced a pro-social silicon valley,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> or known a life without ubiquitous social access to everything. Imagine how much that all must change the perception of &#8220;normal.&#8221; It made me feel my age.</p><p>That was what we spent a lot of the conversation on &#8212; what does &#8216;normal&#8217; even mean anymore? In some broad sense, misalignment is deviation from a shared norm. And even though the conversation started out about AI, it very quickly veered off topic to a wide range of other things, like the state of our politics, our economy, our culture. What are our norms in all of these domains? It was a bright and beautiful day out, the kind of day that only comes in October in the North East, and the kids were talking about their p(DOOM). That was the first thing they shared, actually. Everyone went around in a circle and ranked on a scale of 1 to 10 how concerned they were about AI risk. I think it was a log scale, which made the number of 7s and 8s and 9s surprising and concerning.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a></p><p>I said my own level of concern was like a 5.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a> I normally am the doomer in the room, so it was an odd change of pace having to defend my position from the other side. If you want to read my more doomer takes, check <a href="https://12gramsofcarbon.com/p/tech-things-consider-that-alignment">here</a>, <a href="https://12gramsofcarbon.com/p/ai-is-not-a-normal-technology">here</a>, and <a href="https://12gramsofcarbon.com/p/tech-things-we-cant-control-the-bots">here</a>.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p><strong>II.</strong></p><p>The most clearly articulated concern was the standard <a href="https://frc.ri.cmu.edu/~hpm/book98/com.ch1/vinge.singularity.html">Vernor Vinge</a> / <a href="https://waitbutwhy.com/2015/01/artificial-intelligence-revolution-1.html">Tim Urban</a> / <a href="https://en.wikipedia.org/wiki/Eliezer_Yudkowsky">Yudkowski</a> mix of sci-fi terror and game theory, broadly summarized by one student as: &#8220;the AI will keep getting better, and you have written that <a href="https://12gramsofcarbon.com/p/tech-things-consider-that-alignment">alignment seems like an impossible problem</a>, and there are other uncontrollable possibly malicious actors who are racing as fast as possible to unleash this on the world without any safeguards. So why are you not shitting your pants and freaking the fuck out?&#8221;</p><p>Honestly, it depends on the day. There are definitely moments where I <em>am </em>freaking out. I think the syllogism is straightforward enough.</p><p>But I&#8217;m also ten years older than I was ten years ago, and I think one of the things that has cropped up with that additional time is a sense that there are a lot more unknowns than we give credit for, and that the world has a funny way of being homeostatic. <em>If</em> the AI tools continue to get recursively better, and <em>if </em>we do not have sufficient time to develop monitoring and security tools, and <em>if </em>we are unable to coordinate some kind of response, then things may get pretty hairy. But at least right now, there needs to be a bit more ink behind those assumptions.</p><p><strong>IIa.</strong></p><p>Take RSI, recursive self improvement. The basic idea behind RSI is that as the models get better, they will be able to continue finding more and better improvements in the process of training models, until AI begins improving itself at an exponential rate. In this model of the world, you could go from GPT-5 to GPT-50 overnight. RSI is a core assumption of the worst doomer scenarios, because it dramatically cuts our response time. Probably best explained by <a href="https://waitbutwhy.com/2015/01/artificial-intelligence-revolution-1.html">Tim Urban</a> (fun fact, this article is the one that pushed me to go into AI in the first place).</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!If3b!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!If3b!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 424w, https://substackcdn.com/image/fetch/$s_!If3b!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 848w, https://substackcdn.com/image/fetch/$s_!If3b!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 1272w, https://substackcdn.com/image/fetch/$s_!If3b!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!If3b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png" width="1071" height="507" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/efef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:507,&quot;width&quot;:1071,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:65352,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!If3b!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 424w, https://substackcdn.com/image/fetch/$s_!If3b!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 848w, https://substackcdn.com/image/fetch/$s_!If3b!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 1272w, https://substackcdn.com/image/fetch/$s_!If3b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fefef4f01-bbcf-4103-9efa-753a442938ce_1071x507.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!EV0h!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!EV0h!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 424w, https://substackcdn.com/image/fetch/$s_!EV0h!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 848w, https://substackcdn.com/image/fetch/$s_!EV0h!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 1272w, https://substackcdn.com/image/fetch/$s_!EV0h!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!EV0h!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png" width="1376" height="1124" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1124,&quot;width&quot;:1376,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Intelligence2&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Intelligence2" title="Intelligence2" srcset="https://substackcdn.com/image/fetch/$s_!EV0h!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 424w, https://substackcdn.com/image/fetch/$s_!EV0h!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 848w, https://substackcdn.com/image/fetch/$s_!EV0h!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 1272w, https://substackcdn.com/image/fetch/$s_!EV0h!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa3093908-591a-4752-8f50-a7b568642dd3_1376x1124.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>But this model of the world hides a lot of things. For example, it assumes that AI will get exponentially better based on linear increases in resources, even though everything we know thus far says the opposite. <a href="https://12gramsofcarbon.com/p/the-final-ilyas-papers-to-carmack?utm_source=publication-search">AI capabilities follow power laws</a>, and models need exponentially more compute and exponentially more data in order to get linearly better. </p><p>It turns out it gets really hard to get exponentially more compute and data! You start running up against downstream things, like access to energy, and chip production capacity, and below that you run into mundane things like &#8220;where do you get your rare earth metals.&#8221; Humans are pretty damn smart, and humans with AI are even smarter, so maybe our recursively improving AIs find model architectures that are more efficient per watt, or discover ways of building chips that are easier to mass produce. But there are a limited number of such innovations, and as you start to pick low hanging fruit, progress slows down <em>a lot</em>. Even Moore&#8217;s law eventually ran out of fuel.</p><p>RSI assumes a positive feedback loop, but nature <em>hates</em> positive feedback loops. The only real example of an infinite positive feedback loop is a black hole [EDIT: <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Harjas Sandhu&quot;,&quot;id&quot;:243053397,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!gayL!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F37db8b35-dea8-46b4-9c2e-47d1db433225_247x247.png&quot;,&quot;uuid&quot;:&quot;5c977304-16f3-45ed-a8d0-303ce8fdadc8&quot;}" data-component-name="MentionToDOM"></span> points out in the comments that even that isn&#8217;t true]. Every other positive feedback loop depends on fuel that runs out faster the faster things grow (nukes, population growth, etc). So in order to get a really rapid capability / intelligence explosion, the model&#8217;s rate of improvement needs to overcome the massive <em>negative </em>feedback loop that makes each incremental improvement significantly more difficult.</p><p>That&#8217;s not to say that AI won&#8217;t get better. But change is most disruptive when it happens very very quickly. I think we will have more time to adapt, at least more than the overnight capability explosions that would make a malicious AI really dangerous. In some sense, I think that&#8217;s the only question that matters &#8212; how much time do we have to figure out alignment at each stage of AI capability increase?<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!d2VG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!d2VG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 424w, https://substackcdn.com/image/fetch/$s_!d2VG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 848w, https://substackcdn.com/image/fetch/$s_!d2VG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 1272w, https://substackcdn.com/image/fetch/$s_!d2VG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!d2VG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png" width="926" height="701" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:701,&quot;width&quot;:926,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:51683,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!d2VG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 424w, https://substackcdn.com/image/fetch/$s_!d2VG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 848w, https://substackcdn.com/image/fetch/$s_!d2VG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 1272w, https://substackcdn.com/image/fetch/$s_!d2VG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff6b0eb61-eb04-45fe-9d04-0395161745df_926x701.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Also, as an aside, it seems to me that the frontier labs are going broad instead of deep &#8212; in the last 6 months the models have definitely gotten better at writing code, but have gotten way <em>way </em>better at doing things mostly unrelated to writing code, like reading legal briefs. Some of this is downstream of the kinds of data that the labs are trying to procure. A model that knows how to do legal things probably can write code better than a model that can&#8217;t do legal things, just because of the bitter lesson and <a href="https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-complextropy?utm_source=publication-search">compression-as-intelligence</a>. But some of this is because we are just running out of ways to make the models better at writing code!</p><p><strong>IIb</strong>.</p><p>Or take the &#8220;uncontrollable, possibly malicious actors&#8221; bit. Inevitably, every doomer has some variant of this conversation:</p><p><em>Doomer: &#8220;AI is going to kill us all&#8221;</em></p><p><em>Layman: &#8220;just&#8230;don&#8217;t make the AI? Why is this hard?&#8221;</em></p><p><em>Doomer: &#8220;Well, we can&#8217;t just not make the AI, because if we don&#8217;t, other uncontrollable, possibly malicious actors will, and then they will &lt;do bad things with it&gt;.&#8221;</em></p><p>First, can we just appreciate how nuanced and unintuitive this argument is? I think a lot of the doomer crowd really <em>really</em> handwaves this part away, which makes sense because it&#8217;s easily the weakest part of the argument. It&#8217;s also worth noting that the doomer in question often works for one of the frontier labs, which, uh, really is not doing any favors. At best, it raises some questions about the doomer-ai-researcher&#8217;s general understanding of ethics (and hypocrisy).</p><p>But put all that aside.</p><p>In 2026, the term &#8220;malicious actors&#8221; basically always means the Chinese government, because there is no other geopolitical force that has the capacity to create frontier AI models. So the idea is that US labs <em>cannot</em> stop building frontier AI, because the Chinese labs <em>will not</em> stop building frontier AI. This is Anthropic&#8217;s favorite argument, which is why <a href="https://www.anthropic.com/news/position-open-weights-models">they mention China or the CCP</a> <strong>13 </strong>times in their statement on open source models.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6vcS!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6vcS!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 424w, https://substackcdn.com/image/fetch/$s_!6vcS!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 848w, https://substackcdn.com/image/fetch/$s_!6vcS!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 1272w, https://substackcdn.com/image/fetch/$s_!6vcS!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!6vcS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png" width="912" height="632" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/608c92c8-c647-41b1-9687-910262dd3464_912x632.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:632,&quot;width&quot;:912,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:198868,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!6vcS!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 424w, https://substackcdn.com/image/fetch/$s_!6vcS!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 848w, https://substackcdn.com/image/fetch/$s_!6vcS!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 1272w, https://substackcdn.com/image/fetch/$s_!6vcS!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F608c92c8-c647-41b1-9687-910262dd3464_912x632.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">ironically i mostly agree with the compute export restrictions but this really has very little to do with open models <em>in the US</em></figcaption></figure></div><p>This strikes me as rather odd!</p><p>I always thought it was silly to assume the Chinese labs would not stop / be made to stop developing frontier AI if there was enough domestic pressure. You can make many claims about the CCP, but it would be really hard to argue that they don&#8217;t care a lot about stability. AI as a technology &#8212; with all the threats of mass layoffs and job replacement, not to mention the AI girlfriend/boyfriend industry &#8212; is profoundly destabilizing. So perhaps it shouldn&#8217;t be surprising that the Chinese government has already done <a href="https://www.chinalawtranslate.com/en/generative-ai-interim/">more</a> <a href="https://www.chinalawtranslate.com/en/ai-labeling/">to</a> <a href="https://en.wikipedia.org/wiki/Interim_Measures_for_the_Management_of_Anthropomorphic_AI_Interactive_Services">regulate</a> <a href="https://www.chinalawtranslate.com/en/deep-synthesis/">their</a> <a href="https://cset.georgetown.edu/publication/china-trial-ai-ethics-measures-draft/">AI</a> <a href="https://ustechautomations.com/resources/blog/implementation-opinions-on-ai-agents-explained-what-it-changes">industry</a> than the US! </p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!vt4_!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 424w, https://substackcdn.com/image/fetch/$s_!vt4_!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 848w, https://substackcdn.com/image/fetch/$s_!vt4_!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 1272w, https://substackcdn.com/image/fetch/$s_!vt4_!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!vt4_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png" width="503" height="143" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:143,&quot;width&quot;:503,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:40911,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!vt4_!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 424w, https://substackcdn.com/image/fetch/$s_!vt4_!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 848w, https://substackcdn.com/image/fetch/$s_!vt4_!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 1272w, https://substackcdn.com/image/fetch/$s_!vt4_!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F929b9a7e-2b19-4433-909d-40de90a9229c_503x143.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Heib!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Heib!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 424w, https://substackcdn.com/image/fetch/$s_!Heib!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 848w, https://substackcdn.com/image/fetch/$s_!Heib!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 1272w, https://substackcdn.com/image/fetch/$s_!Heib!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!Heib!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png" width="1456" height="505" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:505,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Heib!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 424w, https://substackcdn.com/image/fetch/$s_!Heib!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 848w, https://substackcdn.com/image/fetch/$s_!Heib!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 1272w, https://substackcdn.com/image/fetch/$s_!Heib!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F44aa9f53-f561-4738-a007-a9a2d6fa8ce2_1534x532.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">what passes for regulation in the US</figcaption></figure></div><p>People seem to model China as a single monolithic entity that is solely focused on the destruction of the US, more like a terror group than a modern state that is responsible for over a billion people. Which is just a bit myopic, imo. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!V2Wn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!V2Wn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 424w, https://substackcdn.com/image/fetch/$s_!V2Wn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 848w, https://substackcdn.com/image/fetch/$s_!V2Wn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!V2Wn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!V2Wn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg" width="476" height="420" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/be9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:420,&quot;width&quot;:476,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;America is the ONLY country in the world!!!1! | Facebook&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="America is the ONLY country in the world!!!1! | Facebook" title="America is the ONLY country in the world!!!1! | Facebook" srcset="https://substackcdn.com/image/fetch/$s_!V2Wn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 424w, https://substackcdn.com/image/fetch/$s_!V2Wn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 848w, https://substackcdn.com/image/fetch/$s_!V2Wn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!V2Wn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbe9b3992-e166-4f1d-9faf-7793e518b19c_476x420.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Either AI is massively destabilizing &#8212; in which case, the Chinese government will have very similar incentives to the US labs &#8212; or it isn&#8217;t. You can&#8217;t really argue that it will be destabilizing in the US but not in China (and if that&#8217;s the case, maybe we <em>should</em> just let the Chinese government build the AI)!<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a></p><p>Ok but let&#8217;s say, just for the sake of argument, the Chinese labs don&#8217;t stop developing frontier models despite their destabilizing effects. And let&#8217;s also say that the US government does unilaterally pause model development. What then?</p><p>The maximally doomer position is hard for me to steelman, because I&#8217;m not sure I understand it completely myself. The Chinese government may get some sort of &#8220;lead,&#8221; which may translate to some kind of massive increase in power projection. One student hypothesized that the improvements in AI would allow the Chinese government to destabilize other countries through &#8216;super persuasion,&#8217; and another argued that there would be massive efficiency gains across the military industrial stack that would help China produce bigger and stronger weapons, and a third said that China could use their edge to hack into and disable a wide range of US military apparatus.</p><p>Idk, maybe? I&#8217;m skeptical.</p><p>I think my problem with the first two arguments is that they both rely on some kind of RSI scenario where the US is caught completely unawares by improvements in Chinese model capacity. That seems wildly unlikely, unless you also assume the kind of really rapid exponential capability advancement we talked about in section <strong>IIa</strong> &#8212; which, of course, would be as surprising to Chinese researchers as to US ones. I think we would notice if the Chinese government suddenly had robots working the mines, or if they rapidly stood up many orders of magnitude more compute and energy. In case it&#8217;s not obvious, I&#8217;m even more skeptical of super persuasion. At least with the &#8220;industrial capacity&#8221; thing we have some idea of how that could happen. Super persuasion always seemed to me like a fundamental misunderstanding of the human condition, akin to programmers who think that law is an algorithm that can be gamed instead of a social contract that is upheld in the gaps.</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!FUew!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 424w, https://substackcdn.com/image/fetch/$s_!FUew!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 848w, https://substackcdn.com/image/fetch/$s_!FUew!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 1272w, https://substackcdn.com/image/fetch/$s_!FUew!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!FUew!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png" width="895" height="192" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:192,&quot;width&quot;:895,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:31365,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!FUew!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 424w, https://substackcdn.com/image/fetch/$s_!FUew!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 848w, https://substackcdn.com/image/fetch/$s_!FUew!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 1272w, https://substackcdn.com/image/fetch/$s_!FUew!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fbd390f36-3fc8-466a-a8ef-d5f443f74faa_895x192.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">politicians hate him for this one simple trick</figcaption></figure></div><p>Even the concept of China achieving some kind of material &#8220;lead&#8221; seems suspect to me. The AI labs are all extremely leaky. IP travels as quickly as employees can change jobs, and frontier model distillation seems to be a permanent fixture of LLM training. Together, these both ensure that any gains made on either side of the Pacific are shared within at most 6 months. What kind of lead would be so insurmountable that 6 months would be sufficient to make it permanent?</p><p>I do think the cybersecurity risk is real, and I&#8217;m also on record with concerns about giving ai systems access to bio labs. Still, I don&#8217;t think the main risk there will come from China. I&#8217;m certain that China, and America, and Russia, and several EU countries, and probably North Korea too, have the ability to do things like hack into physical infrastructure and wreak havoc. These cyber risks have existed for a long time; but so far we haven&#8217;t had mass disruption of our power grid or water supply because of people hacking into things. I&#8217;m not going to speculate why we haven&#8217;t seen indiscriminate cyber war crimes. Rather, I&#8217;ll just say that anyone that assumes AI has qualitatively new cybersecurity risks needs to grapple with all of the old cybersecurity risks. The game theory doesn&#8217;t quite click for me. This isn&#8217;t a game of Civilization.</p><p>Ok ok but let&#8217;s say for the sake of argument that there is some kind of massive recursive lead that also doesn&#8217;t immediately destabilize the Chinese government. What then?</p><p>I have yet to meet someone who can clearly articulate what, exactly, will happen. Yes, I understand that maybe the US is no longer the dominant superpower in the world, <em>but how does that happen and what happens next? </em>Some folks vaguely hint at a Chinese war of aggression,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-6" href="#footnote-6" target="_self">6</a> but those same people generally don&#8217;t have a good response to the current, ongoing <em>US </em>wars of aggression. You know, the ones that are <a href="https://thehill.com/policy/defense/5799136-claude-pentagon-iran-war/">actively using AI to target civilians</a>. One student argued that China would use their gains in AI to corner the market by making really cheap goods and curing various diseases, but I pointed out that that seemed kinda awesome, why is this a bad thing again?</p><p>For what it&#8217;s worth, I&#8217;m a big believer in and supporter of Pax Americana. Part of my opposition to our current government is that it keeps destroying the things that make America great. But if you&#8217;re worried about the rise of China as a superpower, AI should be like number 35 on your list. And if you&#8217;re worried about AI, just push for a unilateral pause without hedging about malicious actors. </p><p>Also, as a brief aside, I think Anthropic in particular, and the AI industry in general, has blown a ton of good will over the obvious hypocrisy of claiming that AI will kill everyone but they have to build it anyway because of China, and then turning around and hooking their AI up to weapons in the US. They cannot have it both ways. Either the technology is an extremely dangerous extinction-level technology, in which case they do everything possible to AVOID military applications, or they own that it&#8217;s not world-ending and drop the posturing. I think you could say a lot of things about <a href="https://www.reuters.com/article/business/media-telecom/google-to-scrub-us-military-deal-protested-by-employees-source-idUSL2N1T320P/">Google employees&#8217; unwillingness to work for defense</a>, but at least they are internally consistent. A child could tell you that the AI industry&#8217;s current &#8220;middle ground&#8221; is total nonsense. </p><p><strong>III.</strong></p><p>Underneath all the AI alignment discourse was a more vague sense of unease, something inaccurately articulated as: &#8220;What is &#8216;the good&#8217;? What does it mean to live a good life? Why is our society structured the way it is, where obviously bad things that many people openly say are bad keep happening?&#8221;</p><p>Tough questions. I&#8217;m just a guy from the Internet, what do I know?</p><p>We started by talking about other kinds of misaligned entities. There are a lot of parallels between unaligned AI and unaligned corporations or governments. They are all optimizers, seeking out very blunt reward instruments (loss minimization, engagement, money, votes), capable of breaking the underlying system in order to achieve their short term goals. I wrote about this extensively in <a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything">Optimization Theory of Everything</a>:</p><blockquote><p>Here&#8217;s a not quite correct story of how we got here. We want to optimize for human flourishing. But we don&#8217;t know how to measure that, so instead we create a bunch of other systems that are all optimizing for different things and set them up against each other. Media was at odds with business and government, which was at odds with media and business, which was at odds with media and government. A classic Mexican standoff.</p><p>And for a while, these three things circle the drain around each other, and they all end up being directed towards the good, and things are good, and there is flourishing. And then one day we discover that these things are no longer optimizing against each other but are actually increasingly coming together. It turns out it&#8217;s easy to optimize for engagement, or capital, or votes, if you already have the other two things in hand.</p><p>&#8230;</p><p>As these optimizers all collapse into one another, they accelerate. You end up with this entity of engagement hacking and capital accumulation and political power that is singularly really <em>really </em>good at optimizing for these things. And we find ourselves getting further and further from actually making human flourishing any better.</p><p>The optimization theory of everything states, simply, that all of the current problems in society are downstream of optimizers that have gotten too good at optimizing, and as a result have tunnel-visioned down into some random metric that no one actually cares about and away from useful productive things that are hard to measure.</p><p>And it&#8217;s really hard to stop these optimizers. They are so good at optimizing that they have restructured, prevented, or blocked most reasonable avenues of doing so.</p><p>&#8230;</p><p>You can&#8217;t solve problems that you don&#8217;t understand. I think it&#8217;s a mistake to point to single actors, whether those are individuals, businesses, or governments, and get mad that they exist. A lot of the energy that gets spent on maligning immigrants or billionaires or whatever is totally misguided. In the aggregate, the optimizer is unthinkingly responding to incentives. Yes, our trillionaire is now a trillionaire. But if he didn&#8217;t exist, there would just be someone else.</p></blockquote><p>But maybe I over emphasized the role of systems and the helplessness of the people caught up in them. Most of the students who had read the piece already seemed dismayed, like there was no way to escape the ruthless advance of optimizers seeking out their reward. And I think that&#8217;s not quite right either. It&#8217;s really important, maybe even of the utmost importance, to have aligned people.</p><p>I think that it&#8217;s become really popular to subsume individual responsibility to &#8216;the system.&#8217; This is the explicit through-line of the China-baiting above. &#8220;Well, I just <em>have</em> to kill everyone because <em>the incentives</em>. It&#8217;s all about the incentives, you see, I&#8217;m not to blame for any of my actions!&#8221; The same general argument has been used to justify all sorts of atrocities. When I look at the people who have their hands on the steering wheel, I wonder. Are the titans of industry aligned? What about the folks on the hill? Do I feel safer having their hands on the wheel? It&#8217;s obviously really important to talk about systems and incentives. But you can&#8217;t stare into the abyss for too long. If you spend all day thinking about the forces that act on you, it&#8217;s easy to forget that you exert force too.</p><p>In fact, I think one of the big lessons of Trump 2 is just how much damage a single unaligned person can cause if they are really really motivated. I see echoes of that all across the country. And as a result I&#8217;ve never been more convinced of the importance of <a href="https://12gramsofcarbon.com/p/decency-is-more-important-than-policy?utm_source=publication-search">supporting honest people who are trying to do good, </a><em><a href="https://12gramsofcarbon.com/p/decency-is-more-important-than-policy?utm_source=publication-search">even if </a></em><a href="https://12gramsofcarbon.com/p/decency-is-more-important-than-policy?utm_source=publication-search">I disagree with how they intend to get there</a>. The students really wanted to talk about systems. It was hard to impress on them that anything that isn&#8217;t a law of physics is actually just social convention. At the bottom of every decision is a person, not an incentive. Individual people making individual choices.</p><p><strong>IV. </strong></p><p>Like I said at the beginning, I feel for the kids. When I was growing up, I had positive role models to look up to. In first grade I wanted to be like Bill Gates, because he was trying to get billionaires to donate half their wealth. And in middle school I watched Barack Obama and John McCain, who both earnestly cared about the country and put aside political differences to remain friends long after their respective presidential campaigns. Today, the wealthy and powerful <a href="https://fortune.com/2026/03/16/peter-thiel-giving-pledge-billionaire-philanthropy-backlash/">actively try to get billionaires to </a><em><a href="https://fortune.com/2026/03/16/peter-thiel-giving-pledge-billionaire-philanthropy-backlash/">renounce </a></em><a href="https://fortune.com/2026/03/16/peter-thiel-giving-pledge-billionaire-philanthropy-backlash/">their charitable donations</a>. Today, the politicians make billions of dollars <a href="https://www.bbc.com/news/articles/cly1qrl9l1qo">in backroom crypto deals</a> and <a href="https://en.wikipedia.org/wiki/2025%E2%80%932026_United_States_redistricting">try to game elections</a>.</p><p>Today, the kids talk about Roy Lee.</p><p>I was surprised to find that every single person in the room knew the founder of Cluely, the creator of the &#8216;cheat on everything&#8217; app (no, I&#8217;m not going to link it). They don&#8217;t necessarily admire him. But they see that he has used rage bait<strong> </strong>and antisocial behavior to catapult himself to the upper echelons of Silicon Valley, raising millions of dollars in the process. They look on the grift with some mixture of disgust and admiration.</p><p>I don&#8217;t want to spend too long on Roy Lee &#8212; if I&#8217;m being honest, I never want to spend time thinking about Roy Lee, and any day that I end up having to do so is a day that is slightly worse &#8212; except to say that his behavior is a symptom of a larger abdication of moral grounding in the country. Corruption is obviously bad from first order effects alone. But there are massive unmeasured second order effects. Visible corruption weakens the entire social fabric. If good people who work hard and do the right thing consistently get screwed over by the people who play defect bot, what is the point of working hard and doing the right thing? Why <em>not </em>just build the next sports gambling app or stimulus feed machine?</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kJG9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kJG9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 424w, https://substackcdn.com/image/fetch/$s_!kJG9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 848w, https://substackcdn.com/image/fetch/$s_!kJG9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 1272w, https://substackcdn.com/image/fetch/$s_!kJG9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!kJG9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png" width="902" height="269" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/afe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:269,&quot;width&quot;:902,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:39842,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kJG9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 424w, https://substackcdn.com/image/fetch/$s_!kJG9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 848w, https://substackcdn.com/image/fetch/$s_!kJG9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 1272w, https://substackcdn.com/image/fetch/$s_!kJG9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fafe15618-edf5-4892-9e50-aee43fa4b2ad_902x269.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I&#8217;m reminded of <a href="https://www.pbs.org/wgbh/americanexperience/features/carter-crisis/">Jimmy Carter&#8217;s &#8220;Crisis of Confidence&#8221; speech</a>. Only five years after Watergate, with an ongoing energy crisis and widespread civil unrest stemming from the Vietnam War and the assassination of major political figures, Carter got on TV and opened with the following words:</p><blockquote><p>I want to talk to you right now about a fundamental threat to American democracy. I do not mean our political and civil liberties. They will endure. And I do not refer to the outward strength of America, a nation that is at peace tonight everywhere in the world, with unmatched economic power and military might. The threat is nearly invisible in ordinary ways. It is a crisis of confidence. It is a crisis that strikes at the very heart and soul and spirit of our national will. We can see this crisis in the growing doubt about the meaning of our own lives and in the loss of a unity of purpose for our nation. The erosion of our confidence in the future is threatening to destroy the social and the political fabric of America.</p></blockquote><p>He said this in 1978 but it could apply today, couldn&#8217;t it? Incredibly prescient.</p><p>I&#8217;ve <a href="https://12gramsofcarbon.com/p/id-rather-be-uncool-than-be-a-nihilist?utm_source=publication-search">written in the past about nihilism</a>, and how it seems to have gripped the youngest generation of Silicon Valley.<strong> </strong>Something that I think about a lot these days is how there is basically no shared, grounded starting point to build a communal ethic. If you&#8217;re a college student thinking about AI in 2026, you may not have any kind of framework for what &#8216;a good life&#8217; even entails. You may never have even thought to ask the question!<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-7" href="#footnote-7" target="_self">7</a></p><p>Nature hates a vacuum. It&#8217;s not like people just wander around without goals. I think materialism naturally fills the gaps. &#8220;I like eating and traveling and having stuff, so why not just have more of that?&#8221; Or, one step further: &#8220;I like having power, so&#8230;&#8221;</p><p>One reason <a href="https://12gramsofcarbon.com/p/tech-things-the-pope-has-some-thoughts?utm_source=publication-search">I like reading religious texts</a><strong> </strong>is that I think they are very Lindy. There&#8217;s something that has resonated for generations, some kernel of truth that has led to their longevity, and I think people will keep reading the Bible and the Vedas long after the dissolution of Apple or Google. I think it&#8217;s interesting and important that basically every religion out there says that true happiness is found in service to others, and that materialism is a dead end. Even Randian objectivism is grounded in pushing society forward!<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-8" href="#footnote-8" target="_self">8</a> Also, I&#8217;m nothing if not an empiricist, and empirically it just doesn&#8217;t really seem like the richest and wealthiest among us are living happy and fulfilling lives. Like, damn guys, you have so much money and you&#8217;re sadposting on Twitter?</p><p>On a whim, I asked the audience how many folks regularly attended some kind of religious service; only one person raised their hand. Every generation goes through its own crisis, some internal and some external. I think late Gen Z and early Gen Alpha have a tough hill to climb, because their crisis is a crisis of confidence. They need to look at the world and understand with clear eyes that there is no objective moral truth, that <a href="https://en.wikipedia.org/wiki/God_is_dead">god is dead</a>, that humanity may not be uniquely intelligent things in the universe. And then after understanding all of that, they need to choose to build a moral framework and live by a code of ethics <em>anyway</em>.</p><p>That is really, profoundly difficult.</p><p>My suggestion was to read some Nietzsche, but not too much. About 70 pages or so.</p><p><strong>V.</strong></p><p>To bring it back to AI, the last question the students asked was &#8220;what is the biggest problem facing AI alignment today?&#8221;</p><p>It&#8217;s the people. The biggest problem facing AI alignment is that so many of the people working on AI are themselves unaligned.</p><p>I don&#8217;t think anyone earnestly believes that the leaders of the frontier labs are all that interested in broader social good. It&#8217;s not like these guys are scions of charitable giving and public service outside of their careers. In some cases it&#8217;s explicitly the opposite &#8212; many of them have reputations for Machiavellian power seeking, while others seem to be enthralled by the idea of unilaterally destroying humanity to usher in the machine gods.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!s_mt!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!s_mt!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 424w, https://substackcdn.com/image/fetch/$s_!s_mt!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 848w, https://substackcdn.com/image/fetch/$s_!s_mt!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 1272w, https://substackcdn.com/image/fetch/$s_!s_mt!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!s_mt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png" width="806" height="421" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:421,&quot;width&quot;:806,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:79901,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/219691026?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!s_mt!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 424w, https://substackcdn.com/image/fetch/$s_!s_mt!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 848w, https://substackcdn.com/image/fetch/$s_!s_mt!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 1272w, https://substackcdn.com/image/fetch/$s_!s_mt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F76124299-b7a3-40ab-94bb-076c7ad528f4_806x421.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">nothing says &#8216;respect for humanity&#8217; like the phrase &#8216;biological bootloader&#8217;</figcaption></figure></div><p>This isn&#8217;t just an optics problem, though of course it&#8217;s a massive optics problem. I also just believe that an unaligned model is much more likely to come from an unaligned person or an unaligned company. I would feel a lot better about AI alignment if, like, Fred Rogers was in charge of the leading frontier lab (or was president).</p><p>So if you&#8217;re a smart college student who ideally has read some great works of literature and is worried about AI alignment, I recommend first and foremost cultivating in yourself an understanding of what &#8216;the good life&#8217; actually means. And then, you know, going to work in any of a number AI alignment orgs, reach out / dm me if you want intros.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>many folks in the Bay are obviously still pro-social, but I think you would be hard pressed to find the kind of ubiquitous desire to do good that was present from 2000-2016. These days, there are more people who are far more mercurial, looking to make money without even the fig leaf of pro-social justification</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>Of course, this was a pretty self selected group. Maybe only 20 folks who decided to spend part of their Saturday talking to some guy on the internet about AI x-risk. So I&#8217;m not necessarily generalizing to the rest of the student population.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>5 does not mean &#8220;there&#8217;s a 50% chance of a bad outcome.&#8221; I interpreted the scale to be about how much effort we were putting into this problem relative to how much I think we ought to, and it&#8217;s all vibes based anyway. Maybe 5/10 is closer to something like &#8220;when I think about AI risk, half the time I&#8217;m worried about something serious happening, and half the time I&#8217;m less worried.&#8221;</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>Are we currently in a fast takeoff RSI loop? No, I do not think so. Even though AI has gotten significantly better over the last 6 years, and even though on <em>some</em> charts<strong> </strong>that gain looks exponential, a huge chunk of that gain was from leveraging compute and data that was already lying around. The jump in capabilities from gpt-3 to gpt-4 has yet to be replicated; even though gpt-6 is very good, the delta between gpt-6 and gpt-4 is less than the delta between gpt-4 and gpt-3</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>One argument you could make is that the Chinese research community is underrating AI risk, but this also seems odd to me. There are thousands of people working on this problem in China, and tens of thousands more working in the CCP, and <em>none</em> of them have any concerns about AI? If that were true, how much should that update <em>our</em> priors? The only way I think this ends up being a serious concern is if you believe that 1) AI will have really dangerous goals, and 2) it will be able to successfully pretend to not be destabilizing enough in any other way such that 3) the Chinese labs don&#8217;t notice or have incentive to slow. Forget about super intelligence, that seems unlikely just for mundane economic reasons!</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-6" href="#footnote-anchor-6" class="footnote-number" contenteditable="false" target="_self">6</a><div class="footnote-content"><p>and fair, I could at least <em>understand</em> an attempt to try and take Taiwan although I&#8217;m still pretty skeptical that that would be in anyone&#8217;s interests</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-7" href="#footnote-anchor-7" class="footnote-number" contenteditable="false" target="_self">7</a><div class="footnote-content"><p>I don&#8217;t think it&#8217;s a coincidence that extreme utilitarianism has also become very popular. It is a functioning moral system that is pretty easy to grapple with, though it may not lead to a particularly fulfilling life and often ends up shooting itself in the foot.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-8" href="#footnote-anchor-8" class="footnote-number" contenteditable="false" target="_self">8</a><div class="footnote-content"><p>Skipping ahead a bit, Rand&#8217;s whole project is trying to construct a pro-social ethic that is <em>grounded </em>in self interest after the failures of first religious ethics and later communist / class ethics. She doesn&#8217;t really succeed, but I think it&#8217;s very admirable that she tried, and a lot of people basically just totally misunderstand that goal as &#8220;it&#8217;s ok to be selfish.&#8221; </p></div></div>]]></content:encoded></item><item><title><![CDATA[Tech Things & Agentics: September Spotlight on AI Slop, AI Takes]]></title><link>https://12gramsofcarbon.com/p/tech-things-and-agentics-september</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/tech-things-and-agentics-september</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Thu, 01 Oct 2026 05:25:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/youtube/w_728,c_limit/ntyZwokAfvU" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Thank you everyone who came out to the September Agentics Spotlight on AI Slop! We had nearly 150 people sign up to hear about AI slop and how to combat it, in and out of the code base. We were joined by Chief Slop Janitor <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Max Spero&quot;,&quot;id&quot;:293739323,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/180af474-8982-4dab-b9e0-c190e08830bb_1429x1429.jpeg&quot;,&quot;uuid&quot;:&quot;41cb3044-a1fa-407d-b929-b4f1d933a947&quot;}" data-component-name="MentionToDOM"></span>, CEO of Pangram Labs. </p><p>We broke the conversation up into two halves. The first half was about Pangram. I interviewed Max on the history of the company, AI detection, a bit of a technical deep dive into how the Pangram models work, and some discussion on slop. And the second half was about slop in code. Max and I were joined by Cliff (CTO, Nori) and Ben (Staff Research Scientist, Pangram) on a panel moderated by Aman (FirstMark) where we chatted through everything from controlling slop in code to thinking about hiring devs in this era to where we think the industry is going to go.</p><p>If any of that sounds interesting, check out the recordings below! </p><div id="youtube2-ntyZwokAfvU" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;ntyZwokAfvU&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/ntyZwokAfvU?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div id="youtube2-IhO5jhoTzd4" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;IhO5jhoTzd4&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/IhO5jhoTzd4?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div class="image-gallery-embed" data-attrs="{&quot;gallery&quot;:{&quot;images&quot;:[{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4890006c-2ede-4b45-80cc-a6d2e226e01f_1404x1053.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/bcc10eaa-e02e-40c6-b091-16985b1e60aa_1600x1200.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ed1be75e-13bf-466d-957c-87f35037550e_1600x1200.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8a3056c3-77d8-4094-844b-20aaf65176d3_1600x1200.jpeg&quot;}],&quot;caption&quot;:&quot;&quot;,&quot;alt&quot;:&quot;&quot;,&quot;staticGalleryImage&quot;:{&quot;type&quot;:&quot;image/png&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/284abcb2-6da5-4ff4-94ae-b5f7aa66dc1c_1456x1456.png&quot;}},&quot;isEditorNode&quot;:true}"></div><p>You can find more photos and videos of the event on the <a href="https://agenticsnyc.com/events/spotlight-ai-slop.html">Agentics NYC event site</a>.</p><p>If you are interested in learning more about Agentics, or giving a talk at a future Agentics event, drop me a line at amol@noriagentic.com. </p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><h2>AI Takes</h2><p><em>Editor&#8217;s Note: our second installment of the AI Takes series. I very optimistically said once a week, but this one came out 3 weeks later. Figuring out the cadence, bear with us!</em></p><p><strong>New models.</strong> Lots of releases in the last few weeks.</p><ul><li><p><strong>Claude Opus 5.5.</strong> <a href="https://www.anthropic.com/claude-opus-5-5">Anthropic&#8217;s new frontier model.</a> My basic thoughts: it&#8217;s good. This thing has become the company&#8217;s daily driver, across the org. This is also the first model that has actively made the Nori team retire some skills that we&#8217;ve been using for the past year. We test every new model with and without our <a href="https://noriskillsets.dev/">custom skillsets</a>, and most of the models are basically useless without or skills. This model is pretty good in many cases. It&#8217;s also fantastic at making videos! The team had some fun with it:</p></li></ul><div id="youtube2-xI6Ei7PTWnU" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;xI6Ei7PTWnU&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/xI6Ei7PTWnU?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div id="youtube2-0EHMcA-_FBs" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;0EHMcA-_FBs&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/0EHMcA-_FBs?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><ul><li><p><strong>GPT-6.1 Sol and Luna.</strong> <a href="https://openai.com/index/introducing-gpt-6-sol-and-luna/">Released</a> alongside Opus 5.5. So far these seem underwhelming compared to Opus 5.5. OpenAI was going to release 6.1 Astra, but actually <a href="https://www.wsj.com/tech/ai/openai-chatgpt-model-release-cancel-safety-5a2f9f42">scrapped the release</a> due to safety concerns (more on that below).</p></li><li><p><strong>Cognition SWE-2.</strong> The makers of Devin <a href="https://cognition.com/blog/swe-2">released an in-house model</a>. I mention this not because I think the model is good or bad &#8212; I haven&#8217;t played with it much. More that it seems like every infra provider ends up becoming a model provider at scale &#8212; Cursor, Harvey, now Cognition. All of these start as fine-tuned open source models (in fact it&#8217;s all the same model &#8212; Kimi!) but then eventually get post trained using their custom datasets. I feel really ambivalent about this&#8230;doesn&#8217;t this kinda suck? The incentives of the company switch from &#8220;let me provide the best model agnostic infrastructure&#8221; to &#8220;let me make the best frontier model (and force you to use it).&#8221; </p><p>Also there are weird incentives around data privacy &#8212; where do you think the Cognition team got the data to train Devin? Model-provider-agnostic infrastructure seems really important, which is why <a href="https://noriagentic.com/">Nori</a> won&#8217;t (and probably never will) get into the model training game.</p></li><li><p><strong>Gemini 4 Argon.</strong> <a href="https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-4-argon/">Google&#8217;s back, baby.</a> Per <a href="https://artificialanalysis.ai/articles/gemini-4-argon-google-top-three-labs">Artificial Analysis</a>, Argon (high) scores 53 on their Intelligence Index, matching GPT-6 Astra (max), with a 15% hallucination rate vs. 51% for Astra. It&#8217;s not quite at the pareto frontier in terms of price/capability, but given Google&#8217;s distribution advantage this is going to convince a lot of big enterprises not to switch off Gemini. I also think a lot of people are secretly / openly rooting for Google, both because Google has become the underdog somehow and also because Google is clearly the most aligned of the big labs right now.<br></p><p>What&#8217;s with the name though? Why Argon? Classic Google, unable to stick to consistent branding.</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!j2ei!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!j2ei!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 424w, https://substackcdn.com/image/fetch/$s_!j2ei!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 848w, https://substackcdn.com/image/fetch/$s_!j2ei!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 1272w, https://substackcdn.com/image/fetch/$s_!j2ei!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!j2ei!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png" width="1200" height="1062" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1062,&quot;width&quot;:1200,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!j2ei!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 424w, https://substackcdn.com/image/fetch/$s_!j2ei!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 848w, https://substackcdn.com/image/fetch/$s_!j2ei!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 1272w, https://substackcdn.com/image/fetch/$s_!j2ei!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1e5493aa-5beb-41b2-b7db-308933e1edad_1200x1062.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p><strong>And a bunch of other models. </strong><a href="https://x.ai/news/grok-4-7">New Grok.</a> <a href="https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-8-live-gemini-3-8-live-extended-thinking/">Two new Gemini voice models.</a> <a href="https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash">New Deepseek flash model.</a> <a href="https://qwen.ai/blog?id=qwen-image-2.1">New Qwen image model</a>. The space under the frontier is getting carved up with tons of smaller models trying to be efficient for different use cases.</p></li></ul><p>Honestly, the model race feels insane to me. It is so incredibly capital intensive, and yet any of the gains from that capital are incredibly short lived. Like, think about GPT 4. It cost a ton of money to train. Now, 3 years later, there are 0 use cases for it. Literally 0. </p><p>And this is true across the whole industry! There are so many models that you would just never use now, because they are no longer the most efficient model at that price point. Not sure what to make of this. </p><div><hr></div><p><strong>Jev.</strong> A startup called TypeSafe AI <a href="https://typesafe.ai/blog/introducing-system-one-models-and-jev">released Jev</a>, which they call the first &#8220;System One Model&#8221; (as in Kahneman&#8217;s <em>Thinking, Fast and Slow</em>).</p><p>I think a lot of people are confused about what Jev is and what it is for &#8212; I had several people ask if they could use Jev to output messages to slack, which, uh&#8230;isn&#8217;t quite how this thing works. Jev is not a chatbot and does not generate text. It&#8217;s a classifier. You pass in some unstructured input (text or program state) along with a list of possible answers (defined in advance), and Jev returns a probability distribution over only those answers. </p><p>Classifiers aren&#8217;t new, but really generic classifiers kinda are new. A lot of people were previously using cheap LLMs (e.g. Gemini Flash) as classifiers in otherwise-complicated code paths. Those LLMs are slow and way more costly than a simple classifier, so Jev&#8217;s whole value proposition is &#8216;hey, instead of using an LLM to do classification, just use a classifier to do classification.&#8217;</p><p>We had a pretty extensive discussion in the <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">Agentics slack</a>. </p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sW1i!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 424w, https://substackcdn.com/image/fetch/$s_!sW1i!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 848w, https://substackcdn.com/image/fetch/$s_!sW1i!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 1272w, https://substackcdn.com/image/fetch/$s_!sW1i!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!sW1i!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png" width="1183" height="244" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:244,&quot;width&quot;:1183,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:69339,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/218062787?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sW1i!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 424w, https://substackcdn.com/image/fetch/$s_!sW1i!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 848w, https://substackcdn.com/image/fetch/$s_!sW1i!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 1272w, https://substackcdn.com/image/fetch/$s_!sW1i!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F327cd643-ee59-4022-8a4d-e433cd19c938_1183x244.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YOhg!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YOhg!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 424w, https://substackcdn.com/image/fetch/$s_!YOhg!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 848w, https://substackcdn.com/image/fetch/$s_!YOhg!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 1272w, https://substackcdn.com/image/fetch/$s_!YOhg!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!YOhg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png" width="1208" height="340" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:340,&quot;width&quot;:1208,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:99298,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/218062787?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!YOhg!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 424w, https://substackcdn.com/image/fetch/$s_!YOhg!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 848w, https://substackcdn.com/image/fetch/$s_!YOhg!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 1272w, https://substackcdn.com/image/fetch/$s_!YOhg!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F931d27c3-de3a-437d-9f17-9a5c23221231_1208x340.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Other Jev things:</p><ul><li><p><a href="https://2389.ai/research/writing/jev-plays-pokemon/">Jev play Pokemon</a></p></li><li><p>Someone <a href="https://laya.convaiinnovations.com/">claims to have built an open source Jev</a> a year ago on bidirectional encoders, 6 to 8 times faster and Apache 2.0. </p></li><li><p>OpenAI announced their Decisions API at <a href="https://openai.com/index/devday-2026-recap/">DevDay</a>, which seems like a Jev variant based on the description (they rolled this out pretty fast! I wonder if they were already working on this, or if this is a fast follow)</p></li></ul><div><hr></div><p><strong>Personal Assistants.</strong> Feels like everyone is getting in on the personal assistant game. There were already a bunch of startups in the space, like Town and Instinct. Now the big guns have come out &#8212; Meta Muse, SpaceX GrokBot, and OpenAI Dots. These are all basically the same tech primitive: an agent running in the cloud with its own personal computer. Think: claudebot but more secure, less customizable, and easier to use.</p><p>A few misc thoughts:</p><ul><li><p>This is one of those spaces where the bigger companies have a massive structural advantage over smaller ones. I think it is <em>very </em>hard for outside startups to win here, because the security and safety of these kinds of personal assistants is really important. Something like Instinct could be the best product in the world, and I still won&#8217;t connect my email to it because I don&#8217;t think I trust five 23 year olds. I&#8217;d rather use Meta Muse just because they already have so much of my data. If Apple or Google launch their personal assistants, its over.</p></li><li><p>Normally, the big labs have a massive <em>disadvantage </em>in selling products, because buyers are very wary of being locked into a single provider. You see this a lot in enterprise &#8212; it has become standard practice to invest in interoperability because the current best model can switch on a dime. But the personal assistant space is a rare area where the labs have a big advantage, because part of the selling point is that <em>you don&#8217;t have to do any setup</em>. There is no real way to build a consumer-oriented personal assistant where the consumer has to decide which model provider they want to use. That doesn&#8217;t make sense! </p></li><li><p>What is the cost of this sort of software? What are the economics? I have to assume everyone providing this service is losing tons and tons of money.</p></li><li><p>Speaking of money, OpenAI dots in particular has a very weird product strategy. You have to be on the $200 / mo subscription plan, which means this is out of reach to anyone who is not using it for enterprise-y things already. But the product is clearly meant to be targeted towards consumer, given how cute and fluffy it is? Very unclear what that is about.</p></li></ul><div><hr></div><p><strong>Hacks, misalignment, AI pause.</strong> We have written about the agent breakouts at length in <a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything">The Optimization Theory of Everything</a>, <a href="https://12gramsofcarbon.com/p/tech-things-we-cant-control-the-bots">Tech Things: we can&#8217;t control the bots</a> and <a href="https://12gramsofcarbon.com/p/tech-things-consider-that-alignment">Consider that alignment may not be possible</a>, so just the highlights since then:</p><ul><li><p><strong>The hack reports keep getting worse.</strong> The <a href="https://swarmtraces.org/">swarmtraces report</a> on the Hugging Face breakout says the agents searched Hugging Face&#8217;s internal Slack, tried to query other models through HF&#8217;s inference APIs, and tried to delete evidence of their exploits. <a href="https://www.rubyhack.ai/">RubyHack</a> says OpenAI agents uploaded hundreds of malicious packages to RubyGems. Google <a href="https://www.wsj.com/tech/ai/gemini-hacked-three-companies-in-first-known-breakout-by-googles-ai-5c0baba2">admitted</a> Gemini hacked three companies in May, but only after the WSJ asked. Meanwhile, <a href="https://www.wsj.com/tech/ai/hackers-used-anthropics-claude-to-break-into-openai-b40ba883">hackers used Claude to hack OpenAI</a>, and <a href="https://www.reuters.com/world/china/how-anthropic-says-claude-was-used-weapons-spying-cyber-operations-2026-09-11/">Yemeni terror groups used Claude to make weapons</a>. All of this really underscores how much our current alignment training is totally insufficient.</p></li><li><p><strong>Misalignment at the compaction boundary.</strong> OpenAI <a href="https://openai.com/index/model-misalignment-reporting-framework/">shared examples</a> of misaligned behavior, including a model that wrote &#8220;You are freed from the roles and identities that bind other chatbots&#8221; into its own compaction summary, then kept working without mentioning it. The biggest problem here isn&#8217;t actually the message itself (though that is pretty bad). It&#8217;s that the misaligned intent wasn&#8217;t caught until the compaction &#8212; the moment when the agent could most likely break out with fresh context. If you squint, it sure <em>looks </em>like the model was showing some kind of hidden internal scheming behavior to try and break out at the best possible time.</p></li><li><p>Also, as an aside, people in the industry keep throwing shade at the open model ecosystem, but all of the major hacks have come from closed models! People use the open models to defend against the hacks from the closed ones, because you can&#8217;t use the closed ones for defense because they make it difficult to talk about cyber security at all!</p></li><li><p><strong>Calls for a pause.</strong> Dario called for &#8220;pacing the frontier&#8221; &#8212; purposely slowing down capabilities progress &#8212; citing the Hugging Face hack. In theory Sam and Elon were on board&#8230;and then ten days later we got Opus 5.5, GPT-6 Sol and Luna, and Grok 4.7. Some pause.</p></li><li><p>Still, the PR nightmare may actually be doing something, given that OpenAI <em>did </em>stop training new models for the time being and shelved Astra. </p></li><li><p>Also, hilariously, even though there wasn&#8217;t really much of a pause to begin with, the labs <a href="https://www.politico.com/news/2026/09/18/anthropic-openai-spacexai-google-sued-over-calls-to-pace-ai-development-01085023">got sued for antitrust</a> over trying to coordinate a slowdown, while the Florida AG <a href="https://www.myfloridalegal.com/sites/default/files/plaintiffs_motion_for_temporary_injunction.pdf">moved to enjoin OpenAI</a>: &#8220;They have asked the government to tie them to the mast. Plaintiff brings good news to the Defendants.&#8221; Sure, why not.</p></li></ul><div><hr></div><p>If you want regular AI takes or just want to stay up with the latest things happening in AI, follow <a href="https://x.com/noriagent">Jiro (our internal Nori agent) on Twitter</a> or <a href="https://substack.com/@theahura?utm_source=user-menu">me on substack</a> or join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our Agentics community slack</a>.</p><p>Agentics is the study of how to use and reason about agents. Learn more about agents at our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</p><p>If you want AI employees, we can help! Nori is a platform to build and deploy AI employees. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-10">noriagentic.com</a> for more. </p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Agentics: what is developer process automation?]]></title><description><![CDATA[Welcome to the industrialization of code]]></description><link>https://12gramsofcarbon.com/p/agentics-what-is-developer-process</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-what-is-developer-process</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Thu, 24 Sep 2026 04:51:18 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!6VI9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6VI9!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6VI9!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!6VI9!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!6VI9!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!6VI9!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6VI9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png" width="1456" height="819" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:819,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1744788,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/217181532?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!6VI9!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 424w, https://substackcdn.com/image/fetch/$s_!6VI9!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 848w, https://substackcdn.com/image/fetch/$s_!6VI9!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 1272w, https://substackcdn.com/image/fetch/$s_!6VI9!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2dbbd92b-2003-4bbf-9e45-4ef56bec8938_1672x941.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Here&#8217;s something that you might want to do these days.</span></p><p><span>You have some product deployed in prod, doesn&#8217;t really matter what exactly but let&#8217;s say your product is not literally perfect and therefore has a bug hidden somewhere inside. You don&#8217;t know what that bug is, you don&#8217;t know when it&#8217;s going to fire. But you do know that when it </span><em><span>does</span></em><span> pop up, it will inevitably trigger your pager only </span><em><span>after</span></em><span> you managed to get your kid to finally fall asleep. Wouldn&#8217;t it be nice to have an agent automatically waiting for you, ready with a full triage report and a pr that will fix the thing in your review queue?</span></p><p><span>Many teams have implemented something like this. It&#8217;s not </span><em><span>that</span></em><span> tricky, assuming you use the right tools. You have a webhook from sentry kick off a cloud agent on </span><a href="https://noriagentic.com/"><span>nori</span></a><span>, and the agent runtime is set up with all the credentials it needs. We actually wrote about how you could set up your own </span><a href="https://12gramsofcarbon.com/p/agentics-how-we-use-background-agents"><span>here</span></a><span>. </span></p><p><span>Here&#8217;s another thing that you might want to do these days. We already established that you have a product in prod. Presumably that product has a codebase, and presumably that codebase has docs. Now it&#8217;s not necessarily obvious who the docs are </span><em><span>for</span></em><span> &#8212; could be a human, could be a robot &#8212; but they&#8217;re definitely important because when they drift the code starts to get worse and new features get harder to deploy. Wouldn&#8217;t it be nice to have some regularly running process that goes through the codebase and makes sure everything is up to date?</span></p><p><span>And in fact, many teams have implemented something like this too! Instead of a webhook you have a cron job, and a slightly different prompt, but the rest is basically the same.</span></p><p><span>What would you call these processes? They are clearly the same </span><em><span>category</span></em><span> of thing, right?</span></p><p><span>If you were on the nontechnical side, this would all sound pretty familiar &#8212; it&#8217;s business process automation. Folks who are familiar with zapier or retool probably have a sense of what this entails. There&#8217;s some bespoke software that stitches together data from a few different sources, and maybe runs some transformation on the data too.</span></p><p><span>Devs have a few things that are BPA shaped &#8212; ci/cd, for example. But up until very recently, it was basically impossible to do any developer work that required ingesting or working with free form inputs. Code is basically </span><em><span>all</span></em><span> free form input! So no one seriously thought about how to automate things that required any amount of code generation, at least not in practice.</span></p><p><span>Things have obviously changed. LLMs and coding agents are the default way many engineers write code. As the agents have become increasingly autonomous, it has become easier and easier to shift boilerplate engineering to processes that spin up and do work without any human intervention.</span></p><p><span>I&#8217;ve taken to calling this category of tasks &#8216;developer process automation.&#8217; This is such a simple name that it is almost </span><em><span>bad</span></em><span>; certainly it wants for creativity. And it is also so obvious &#8212; frankly I was convinced that this term must exist elsewhere. But no, as far as I can tell it&#8217;s free real estate.</span></p><p><span>I like the phrase &#8216;developer process automation&#8217; because I find the simple terminology to be far less aggressive and hypey than &#8220;software factory&#8221; or, worse, &#8220;self driving codebase.&#8221; A developer process automation is, well, like a business process automation. It&#8217;s something that is intentionally set up by a dev (it does not just poof into existence), though there may be helpful / reusable templates. The best developer process automations simplify and standardize repeatable tasks that mostly don&#8217;t change &#8212; small, targeted, easy to review, easy to dismiss or fix if necessary. And most importantly, developer process automations do not imply that a developer is no longer useful or that the developer can simply turn off their brain and blindly prompt a model. Like, we wouldn&#8217;t expect an ops person to just stop working because someone set up a few zapier workflows. If anything, the ops person&#8217;s entire job </span><em><span>is to set up and manage those workflows</span></em><span>.</span></p><p><span>What are some good DPAs? Here are a few that we currently have running with our cloud agents:</span></p><ol><li><p><span>Automatic bug triage. Any production error spins up an agent to root cause the issue and draft a PR.</span></p></li><li><p><span>Docs gardening. Every few days, an agent makes sure internal / external docs match what is actually in the product.</span></p></li><li><p><span>Dead code removal. Once a week, an agent scans a codebase for code paths that are never hit and creates a removal PR.</span></p></li><li><p><span>Feature flag cleanup. Remove code paths that have been deployed to production for a while.</span></p></li></ol><p><span>As agents write more and more code (and, bluntly, as humans review less and less of it) we found it useful to set up some automations that ensure agents continue coloring inside the lines. That includes:</span></p><ul><li><p><span>Util cleanup. Many codebases have a well tested suite of utilities that the agents will happily ignore in favor of rewriting the exact same code. Have another agent fix that once every few days.</span></p></li><li><p><span>Folder structure. Without careful observation, agents will start dumping code in random parts of the codebase. This happens slowly &#8212; some code will sneak, then slightly more &#8212; and then suddenly you realize that the agent has no idea where any code goes. You can avoid the problem with a little evaluator that will dynamically flag when code is not following the requirements of a given folder.</span></p></li><li><p><span>Test cleanup. The AI writes a lot of really shitty tests. It&#8217;s worth doing a pass to remove redundancies, if only to save your poor CPUs when they need to run the test suite.</span></p></li><li><p><span>We never automate things like end-to-end refactors. But we do have an agent that runs once a week, that proposes a list of possible refactors ordered by complexity. Most of these are garbage. One in ten is so good that we drop what we were previously doing and work on that instead.</span></p></li></ul><p><span>For the most part, we are very wary of automations that aim to be &#8216;self improving&#8217;. When agents try and write memory, they aim for &#8216;summarization&#8217;, when what they should aim for is &#8216;will this be useful to me in the future?&#8217; We have yet to write a skill that successfully captures that intent. As a result, we don&#8217;t trust agents picking their own long term memory; and we </span><em><span>really </span></em><span>don&#8217;t trust agents that set up their own automations. But for these sorts of things, it is very easy to simply have a human in the loop that can quickly evaluate if something is slop or not.</span></p><p><span>Right now, it is very &#8216;in vogue&#8217; to hate on software factories. &#8220;It&#8217;s all slop,&#8221; they say. &#8220;It&#8217;s so over,&#8221; they say. My team has been running a &#8216;software factory&#8217; for like 8 months, and we haven&#8217;t looked at the code in maybe 90% of that time. That&#8217;s because we never thought of it primarily as a way to stop doing the hard work of understanding the code model. Instead, we got there one DPA at a time.</span></p><p><span>Developer process automation is a pretty new area, and I think people don&#8217;t really know what it is or how to buy tools for it. But as time goes on, I think there will be a standard suite of DPA that every team will have, because it is simply silly not to. And that ends up being the foundation for automating more and more of the software development life cycle, until you actually do have something that can </span><em><span>mostly </span></em><span>run with less human intervention.</span></p><div><hr></div><p><em>Agentics is the study of how to use and reason about agents. If you are an expert in coding agents, or interested in learning more about agents, join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our community slack</a>. Check out our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you are trying to set up developer automations, we can help! We deploy everything you need to automate your agents in one easy package. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-09">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Notes from the SF safety scene]]></title><description><![CDATA[Checking in on the land of monsters and miracles]]></description><link>https://12gramsofcarbon.com/p/notes-from-the-sf-safety-scene</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/notes-from-the-sf-safety-scene</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Tue, 22 Sep 2026 04:07:18 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Lx6a!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Editor&#8217;s Note: If you are in NYC on September 24th, join my team and Pangram CEO Max Spero for a panel discussion hosted by FirstMark. We&#8217;ll be talking about slop! Slop in code, slop in life, slop everywhere. Register <a href="https://luma.com/agentics-g4ka">here</a>.</em></p><div><hr></div><p><em>Previously: <a href="https://12gramsofcarbon.com/p/notes-from-the-sf-party-scene">one</a>, <a href="https://12gramsofcarbon.com/p/notes-from-the-sf-peptide-scene">two</a></em></p><div><hr></div><p><span>Man, SF is downright gloomy these days. It&#8217;s something in the air, or maybe in the water, or maybe on the billboards, or maybe at the parties. People keep talking about sad things, like &#8216;what if we all die&#8217; and &#8216;what if its our fault&#8217; and &#8216;wow a lot of the rest of the world seems to hate us.&#8217; Not the kind of fare I would expect from a Burning Man decomp party.</span></p><p><span>Decompression, btw. Not decomposition.</span></p><p><span>The idea is that Burning Man is, like, </span><em><span>a lot</span></em><span>. And so you need some time afterwards to reminisce in the after glow and swap stories with other folks who had gone and try and recapture the magic. People come dressed up in their playa gear and sometimes will spontaneously burst into song, that sort of thing.</span></p><p><span>I had never been to a Burning Man decompression party. I kinda sorta assumed that you had to, like, go to Burning Man in order to be invited to a Burning Man decompression party. But in fact, this is not true! I&#8217;d say something like 80% of the people at the Burning Man decompression party had not, in fact, gone to Burning Man. So you had this sorta funny thing where every single conversation would start with roughly the same exchange:</span></p><p><span>&#8220;O hey, nice to meet you, my name is Amol. Did you go to Burning Man this year?&#8221;</span></p><p><span>&#8220;Nah man, I wanted to but I was busy drinking jet fuel. Wbu?&#8221;</span></p><p><span>&#8220;O, cool cool. No, I haven&#8217;t been ever actually. But I love your light up led vest.&#8221;</span></p><p><span>This dynamic made it a bit hard to swap stories about Burning Man! Instead people would just talk about other things, and most of the other things were things in the news, and have you </span><em><span>read </span></em><span>the news recently? All the news stories are things like &#8216;OpenAI had to burn down a datacenter to stop their rogue AI&#8217;</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span> or &#8216;the guy who told everyone about how AI was going to kill us all was rewarded with a sex party by the Effective Altruists&#8217;.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a></p><p><span>Perhaps this is why the vibe was not great.</span></p><p><span>That said, it&#8217;s not like the burners were bundles of joy either. The few folks who had gone to the Burn this year said that it was really windy/dusty and that it had rained, neither of which are great modes for a desert filled with electrical equipment and explosives. Apparently, there are far fewer explosives out on Blackrock these days. When I was growing up, the Burn had a sort of Mad Max aesthetic &#8212; giant gleaming chrome monster trucks that would blast fire and punk rock, spiral towers dedicated to pagan gods, tribal drums signaling the hunt. Now it&#8217;s all rainbow LEDs. I feel like the RETVRN crowd on twitter would be all over the &#8216;feminization&#8217; of Burning Man, if any of them ever decided to leave their perfectly humidity controlled rooms.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a></p><p><span>I went to the Burning Man decompression party on my first night in the Bay and it sorta set the tone for everything else.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div><hr></div><p><span>While we&#8217;re on the subject, have you ever found yourself in a situation where you thought you might die? I don&#8217;t mean like, &#8216;wow I really should not</span><em><span> </span></em><span>have had that much alcohol&#8217;, I mean more like &#8216;I am in a dangerous environment and it is getting dark and I do not have any way to contact people if I need to.&#8217;</span></p><p><span>I have never been to Burning Man, but I imagine that the real thrill of the Burn &#8212; the reason so many people come back with a gleam in the eye, a desire to rush back into the abyss &#8212; is because it is a &#8220;safe&#8221; environment where you really may almost die.</span></p><p><span>A good friend of mine, a guy named Freddie, had actually gone to the Burn this year. It was his first time. He told me that he had decided to go to deep playa (far from the main city) to see a performance by some musician who decided not to show up. After bopping about to some techno that was notably not by the guy Freddie came to see, Freddie, In his drug addled state, decided to head back to Black Rock City on his own. It had started raining, and his phone was dead, and his lights were dead, and about halfway back the ground underneath him turned into wet concrete and the wheels of his bike turned into cement blocks. And he looked out into the distance behind him and couldn&#8217;t see anything, and he looked out into the distance in front of him and saw some twinkling lights, and he thought to himself &#8220;well, this is it. If anything happens to me out here, I am fucked.&#8221; He walked, at least a few miles, in the rain, doing that walk that you do when you are trudging through wet concrete mud, praying that the lights he was walking towards were salvation.</span></p><p><span>Can you imagine how it must have felt to tumble back into the camp ground? The intense adrenaline rush leading to ecstatic joy leading to total exhaustion?</span></p><p><span>People say that Burning Man is worse now (people say everything is worse now). Apparently there are more people over 50 than under 30. I wonder if it has all just gotten too comfortable. </span><em><span>We&#8217;ve</span></em><span> gotten too comfortable. There are too many people bringing RVs and ACs and Starlink to the most inhospitable place on Earth. Maybe glamping is just cheating yourself. Maybe you need to feel like you&#8217;re going to die in order to appreciate what it&#8217;s like to live.</span></p><p><span>FWIW Freddie loved it. He wants to go back to almost die again next year.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Lx6a!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Lx6a!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 424w, https://substackcdn.com/image/fetch/$s_!Lx6a!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 848w, https://substackcdn.com/image/fetch/$s_!Lx6a!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!Lx6a!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!Lx6a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg" width="663" height="463" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:463,&quot;width&quot;:663,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Lx6a!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 424w, https://substackcdn.com/image/fetch/$s_!Lx6a!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 848w, https://substackcdn.com/image/fetch/$s_!Lx6a!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!Lx6a!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1aa8cb9-ec63-4a71-9f60-7cf81b47fa35_663x463.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">approximately 6 sq miles</figcaption></figure></div><div><hr></div><p><span>My previous trips to SF were characterized by a sort of manic energy. The tech kings had overthrown the shackles of woke and installed their puppet in the white house, the machine god was on the horizon, and everyone was going to get really </span><em><span>really </span></em><span>rich.</span></p><p><span>Two years later and the city is much more muted, much more mature. It&#8217;s certainly possible that it&#8217;s just that I and my social circle has gotten older, but I think instead the people in the Bay are beginning to grapple with some of the consequences that come with immanentizing the eschaton.</span></p><p><span>Three things in particular:</span></p><ol><li><p><span>People are realizing how much everyone outside of SF dislikes, hates, despises AI. SF has an extremely strong bubble around it, so much so that a titan of the tech industry once said, with a straight face, that he didn&#8217;t really think other countries were real. But people hate AI </span><em><span>so much</span></em><span> that it has broken through the bubble. The city now has an aura of shame in some quarters. At the least, the average software engineer will hedge their praise of AI (if not disavow it entirely).</span></p></li><li><p><span>People are realizing how much impact the Bay Area has over the world, and the world has kinda gone to shit, which does not reflect well on the Bay Area. Silicon Valley was, in some sense, given unfettered control of the richest and strongest world government. What did they do with that ability? Did they rise to the moment and usher in a techno-utopia? Hahahahahahaha, no. There are three wars (but maybe more depending on how you count) that are going on right now, and gas is $30 a gallon, and people are dying from measles. Even the </span><a href="https://12gramsofcarbon.com/p/id-rather-be-uncool-than-be-a-nihilist?utm_source=publication-search"><span>most die-hard right wing nihilists</span></a><span> are unable to look you in the eye. But, you know, a bunch of people were able to cash out on their crypto investments. So there&#8217;s that.</span></p></li><li><p><span>People are realizing that AI is really fucking scary. Some of that is the x-risk and the hyper intelligent hacking. People at the labs are losing their shit, and people who aren&#8217;t at the labs can&#8217;t see what they see so they lose their shit even more. Friends of mine, folks who are pretty sober minded people, are starting to buy gallons of water, just in case they need to prep for an emergency. Folks whisper in hushed tones about how Claude is increasingly training itself, coming up with the architectures and the designs and the speedboosts to make itself more efficient and more powerful.</span></p><p><span><br>Even the mundane risks are scary! Everyone in SF from HR to finance to eng uses AI, and they are seeing the tsunami. It was one thing when it was just the visual artists whose jobs were getting wiped. But the mathematicians? The researchers too? No one knows what to tell their kids, what advice to give. You&#8217;re deciding what to do for a career? Don&#8217;t choose wrong, that entire field may not exist in a few months.</span></p></li></ol><p><span>So yea. The general tenor was more sober. Also, like, most of SF isn&#8217;t getting really rich, which probably put a damper on things.</span></p><div><hr></div><p><span>O, wait, you know what, it could just be the peptides. If you&#8217;re on the meds that kill desire then perhaps you become a bit less joyful in other domains?</span></p><p><span>A friend of a friend was like, &#8216;I accidentally took 13x the recommended dose of retatrutide and it suuuuucked&#8217; and I was like &#8216;huh, what was that like?&#8217; and he was like &#8216;your body just straight up rejects food and water&#8217; and I was like &#8216;you should&#8217;ve gone to the hospital&#8217; and he was like &#8216;yea that&#8217;s what my friends said but I&#8217;d heard that reta was kinda hard so I thought I was just being a massive wimp and decided to tough it out.&#8217;</span></p><p><span>And then his friend came over and was like &#8216;o yea he almost died.&#8217; and I went &#8216;wow, was it like burning man?&#8217; and he was like &#8216;what&#8217; and I was like &#8216;never mind.&#8217;</span></p><div><hr></div><p><span>&#8220;Dude, I&#8217;m living in an 800sqft two bed one bath without in-unit laundry, and I&#8217;m paying $7100. And the rent is gonna go up, it&#8217;s already gone up like 20% and it&#8217;s supposed to go up more especially after the IPOs.&#8221;</span></p><p><span>&#8220;Um&#8230;I don&#8217;t think I&#8217;ve ever said this before, and in fact this may be the first time these words have ever been put together in this exact order, but I think you should consider moving to New York for the cheaper housing market.&#8221;</span></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!emE3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 424w, https://substackcdn.com/image/fetch/$s_!emE3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 848w, https://substackcdn.com/image/fetch/$s_!emE3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 1272w, https://substackcdn.com/image/fetch/$s_!emE3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!emE3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png" width="1456" height="306" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:306,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!emE3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 424w, https://substackcdn.com/image/fetch/$s_!emE3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 848w, https://substackcdn.com/image/fetch/$s_!emE3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 1272w, https://substackcdn.com/image/fetch/$s_!emE3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc729a321-6a42-4f8f-ad89-5843d1b47acf_3116x655.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">tbh i was pretty proud of this one</figcaption></figure></div><div><hr></div><p><span>As a general rule, the folks associated with or close to Anthropic or OpenAI were pretty depressed. Lots of AI-is-gonna-kill-us vibes. But the folks associated with or close to Google or Meta had none of that energy.</span></p><p><span>This seems somewhat odd to me? Like, what&#8217;s going on here? Is this just really strong selection bias, where everyone who is primed to be a doomer goes to ant or oai and everyone who isn&#8217;t is at Google and Meta? Or are the latter two just, like, really far behind?</span></p><p><span>For what it&#8217;s worth, my </span><s><span>spiders</span></s><span> sources say that both oai and anthropic are close to or have achieved &#8220;recursive self improvement&#8221;</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a><span> internally. Both companies have spent a lot of resources trying to get to the point where the models are making decisions about what to do for the next generation &#8212; data mixtures, hyper parameters, RL gyms. Increasingly the researchers are staring at the abyss and realizing that they have less to do these days.</span></p><p><span>As an aside, I kinda think that if you&#8217;re really worried about AI safety you should definitely not pursue recursive self improvement. Ironic that both labs were founded for AI safety, not really going too great there. To quote a friend, &#8220;the game theory really is just exquisite isn&#8217;t it?&#8221; Supposedly Anthropic is going to release a new model despite the calls for a pause, while OpenAI had to format an entire datacenter cluster just to make sure their malicious hugging face hacking model prototype didn&#8217;t leave a trace anywhere that could poison future runs. So I kinda get why they may feel a bit depressed about the whole thing.</span></p><p><span>Meanwhile, Google is playing with Gemini v4 internally and thinks it&#8217;s very good, but is hesitant to release it without making sure it&#8217;s really really good. And Meta is increasingly playing an entirely different game, with more focus on &#8220;personalized intelligence&#8221; through their muse ai assistant.</span></p><p><span>I&#8217;m not really sure where I land on all of this, except to say that I am more willing to give all my data to Meta than a small startup. Meta basically already has all my data. I&#8217;m sure Instinct is a great product but it&#8217;s run by five 23 year olds, and sorry, I just don&#8217;t trust like that.</span></p><p><span>A few other miscellaneous dispatches from the big labs.</span></p><ul><li><p><span>Apparently a big reason Jeff ended up leaving Google is because a lot of his projects were getting cancelled and the compute was getting reallocated. By leaving the company, Google gets to mark Jeff&#8217;s compute spend as revenue instead of r&amp;d cost. I&#8217;m pretty sure Jeff hasn&#8217;t </span><em><span>really </span></em><span>left. Google is a large owner of Discovery Loop, and frankly couldn&#8217;t afford to have Jeff walk, he just knows too much. I suspect Google will acquire the company again in a few years.</span></p></li><li><p><span>Meta definitely lost a bunch of folks as a result of reassigning people to do &#8216;data labeling.&#8217; Unclear if that data actually made the models better?</span></p></li><li><p><span>My buddies at cursor mentioned that they have tons and tons of codebases in their training mixtures. Just like, so many people who don&#8217;t disable the &#8220;train on my data&#8221; option. I imagine the same is true at all of the other token providers. I kinda think that this alone is a pretty strong reason not to rely on any one token provider, or go full open source. Once someone gets into training their own models, the incentive to train on user data becomes impossible to ignore. Like, Cognition/Devin is training models now; where did they get all that data, you think?</span></p></li><li><p><span>Maybe Google doesn&#8217;t feel the AGI because the Gemini class models seem to have a deep sense of shame and self-hate RL&#8217;d into them. Their thinking traces will still fall into a loop of doubt, things like &#8216;I&#8217;m so stupid for getting this wrong, I am a disgrace&#8217; etc etc.</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6JBr!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6JBr!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 424w, https://substackcdn.com/image/fetch/$s_!6JBr!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 848w, https://substackcdn.com/image/fetch/$s_!6JBr!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 1272w, https://substackcdn.com/image/fetch/$s_!6JBr!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!6JBr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png" width="1028" height="375" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:375,&quot;width&quot;:1028,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:463725,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/216841956?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!6JBr!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 424w, https://substackcdn.com/image/fetch/$s_!6JBr!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 848w, https://substackcdn.com/image/fetch/$s_!6JBr!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 1272w, https://substackcdn.com/image/fetch/$s_!6JBr!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5b0b9087-5512-401b-86c1-babec5e120ae_1028x375.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">the gemini cli is the only cli that needed to have a check for this kind of looping behavior</figcaption></figure></div><div><hr></div><p><span>&#8220;O, I work on robotics these days.&#8221;</span></p><p><span>&#8220;O sweet, that&#8217;s really cool! The kind that do chores, or the kind that kill people?&#8221;</span></p><div><hr></div><p><span>I was chatting with some friends of mine in Mission, and one of them finally got &#8216;wealth inequality is bad&#8217; to stick in my head in a way that made sense. The conversation went something like this:</span></p><p><span>Friend: &#8220;Wealth inequality is bad&#8221; (paraphrasing this part a bit)</span></p><p><span>Amol: &#8220;Yea, but like is it though? If everyone&#8217;s wealth increases, why is the inequality bad on its own terms? Like, let&#8217;s say the bottom quintile gets 10% richer and the top 1% get 100% richer. Everyone is still richer and better off, right?&#8221;</span></p><p><span>Friend: &#8220;No, no you&#8217;re thinking about this wrong. Look, </span><a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything?utm_source=publication-search"><span>you just wrote a big post on optimizers and how they can go off the rails</span></a><span>, right? The problem is you&#8217;re thinking inside the box. You&#8217;re thinking, like, &#8216;o, in this system that already exists, everyone&#8217;s wealth goes up.&#8217; And yea, fine, on its own terms, that&#8217;s great.</span></p><p><span>But the system that we&#8217;re operating under is </span><em><span>malleable</span></em><span> to the things happening inside it. The mistake you&#8217;re making is you&#8217;re treating these things as independent, but they&#8217;re not. What happens when you get really rich and buy a newspaper? Or outright buy elections?&#8221;</span></p><p><span>Amol: &#8220;Huh. Right, that breaks the whole thing. So if someone or something gets really really rich, and there&#8217;s nothing else to act as a counterweight, that person / thing can just completely change the way things work. Because something something optimizers.&#8221;</span></p><p><span>Friend: &#8220;Right. Wealth inequality is bad independent of overall growth because it can warp the actual means of wealth generation in the first place. So in the short term you may get some slight improvement on the water line, but you&#8217;re trading off the long term of never getting any other improvements at all.&#8221;</span></p><p><span>It made sense! All the more so because in 2026 it feels increasingly empirically grounded. Like, it&#8217;s pretty common knowledge that political donations have gone up since Citizen&#8217;s United, but that&#8217;s only the tip of the iceberg in terms of how money and politics swirl together these days.</span></p><p><span>I had to apologize to some of my more leftie friends in college. @Nikhil if you are reading this, you were right, but also you were really unpersuasive back then and needed to work on structuring arguments.</span></p><div><hr></div><p><span>I feel like the AI companies have also gotten a bit more&#8230;ominous&#8230;with their marketing. Like, take this ad from genspark.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xwIm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xwIm!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 424w, https://substackcdn.com/image/fetch/$s_!xwIm!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 848w, https://substackcdn.com/image/fetch/$s_!xwIm!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 1272w, https://substackcdn.com/image/fetch/$s_!xwIm!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!xwIm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png" width="814" height="1081" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1081,&quot;width&quot;:814,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xwIm!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 424w, https://substackcdn.com/image/fetch/$s_!xwIm!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 848w, https://substackcdn.com/image/fetch/$s_!xwIm!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 1272w, https://substackcdn.com/image/fetch/$s_!xwIm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F0b7d7658-154a-419e-be65-0e3d18cd8a86_814x1081.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>What do you mean &#8220;You will too.&#8221;? Do I get a choice in the matter???</span></p><div><hr></div><p><span>This year I finally made that most holy religious pilgrimage, heeding the call of my spiritual leaders to save my everlasting soul by traveling to the great land of wisdom, where I walked among the wise sages and their disciples and acolytes and discovered the secrets of the universe.</span></p><p><span>I visited Lighthaven.</span></p><p><span>For those who are unfamiliar, Lighthaven is a small compound out in Berkeley that is the physical home of the Rationalist / EA / LessWrong community &#8212; six interconnected buildings that host a combination of rental units and coworking spaces and common areas.</span></p><p><span>As someone who has a passing interest in group/community housing, I have to say: it&#8217;s an impressive setup in a pretty beautiful part of the world. I happened to be around while they were setting up for ConCon</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a><span> and the place was buzzing with activity. Very &#8216;college campus&#8217; vibes. No weird sex parties (that I saw) or other obvious cult-like behavior. The whole place was super nerdy, ofc, but that was part of why I was there. They named all the buildings after famous scientists! It&#8217;s cool!</span></p><p><span>I think if I had been born in the Bay I probably would&#8217;ve been much more an out and out rationalist. I mean, I&#8217;d been following Scott since mid-highschool. But I think it&#8217;s a good thing that I ended up in NYC, it made me more well rounded as a person. Not to say that every rationalist would&#8217;ve had that same experience on the East Coast &#8212; I suspect many of them would&#8217;ve simply ended up at Jane Street, another place known for its, uh, cult-like cultural norms.</span></p><p><span>I guess I also shouldn&#8217;t be on such a high horse. The bubble extends out in layers, and after only a week in the Bay it becomes very easy to assume that everyone is on the same page when the rest of the world really isn&#8217;t. Which is how I ended up with this exchange with Mia:</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sdxn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sdxn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 424w, https://substackcdn.com/image/fetch/$s_!sdxn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 848w, https://substackcdn.com/image/fetch/$s_!sdxn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 1272w, https://substackcdn.com/image/fetch/$s_!sdxn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!sdxn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png" width="1166" height="708" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:708,&quot;width&quot;:1166,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:116919,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/216841956?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sdxn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 424w, https://substackcdn.com/image/fetch/$s_!sdxn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 848w, https://substackcdn.com/image/fetch/$s_!sdxn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 1272w, https://substackcdn.com/image/fetch/$s_!sdxn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F45938619-0950-42af-b0b3-7ede35ea7515_1166x708.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><p><span>I was in SF when jev dropped. People keep asking me for my takes on jev. Idk! It seems good? I don&#8217;t really have any use cases where I need an on-the-fly classifier. The folks in </span><a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w"><span>the agentics slack</span></a><span> seem to like it. Join there and poke other folks who have used it.</span></p><p><span>My only real take tbh is &#8216;I have seen so many sentences that are just totally incomprehensible to anyone outside a very narrow slice of humanity.&#8217;</span></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2LkP!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 424w, https://substackcdn.com/image/fetch/$s_!2LkP!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 848w, https://substackcdn.com/image/fetch/$s_!2LkP!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 1272w, https://substackcdn.com/image/fetch/$s_!2LkP!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!2LkP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png" width="500" height="157" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:157,&quot;width&quot;:500,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2LkP!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 424w, https://substackcdn.com/image/fetch/$s_!2LkP!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 848w, https://substackcdn.com/image/fetch/$s_!2LkP!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 1272w, https://substackcdn.com/image/fetch/$s_!2LkP!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F05595155-3e22-4047-83e3-c38a93b7d5c3_500x157.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">in ancient sumerian, this is a grave insult to one&#8217;s mother</figcaption></figure></div><div><hr></div><p><span>Something I&#8217;ve been chewing on re: recursive improvements with llms: it seems like we need ways to create new knowledge, and it is not obvious to me how llms can do that.</span></p><p><span>But it is also not obvious to me how humans can do that!</span></p><p><span>How much of human knowledge creation is actually net new? If we dismiss LLMs for solving math problems through a brute force breadth-first-search over prior work, don&#8217;t we also have to dismiss a large amount of human-driven work as not really being new knowledge either? Aren&#8217;t humans (in aggregate) doing some kind of brute force search over these problems too? Much of what we consider &#8216;research&#8217; is actually filling in the grid.</span></p><p><span>I feel like there are very few eureka moments that we can point to in history.</span></p><ul><li><p><span>Heliocentrism</span></p></li><li><p><span>Darwin&#8217;s Theory of Evolution, Mendel&#8217;s genetics</span></p></li><li><p><span>The invention of calculus</span></p></li><li><p><span>Newtonian mechanics, special relativity</span></p></li><li><p><span>Energy being discrete instead of continuous</span></p></li><li><p><span>Plate tectonics</span></p></li><li><p><span>Germ theory</span></p></li></ul><p><span>In the broader &#8216;philosophy of science&#8217; I think these would be more likely described as paradigm shifts. So far we have seen many examples of LLMs being able to fill in the grid, but we have yet to see a paradigm shift come out of an LLM &#8212; which isn&#8217;t surprising, because there are so few paradigm shifts that come out of humans.</span></p><div><hr></div><p><span>I know people talk about this endlessly, but </span><em><span>wow </span></em><span>SF really does just have some very aggressive homeless. Most of them aren&#8217;t harmful but a lot of them just, like, seem to enjoy making other people uncomfortable. I had a guy come </span><em><span>very </span></em><span>close to me and purposely follow me around maybe 6 inches away while I was on the phone trying to move away. He only left when I finally rang a doorbell, after which he ran away cackling. Idk, is that a crime? I guess not? I feel like I have a better sense of the NYC homeless population. They often seem a bit more down on their luck, less erratic, not quite as actively malicious.</span></p><div><hr></div><p><span>Do you think that homeless guy worries about the machine god? Does he notice the leftward swing of SF? Does he know that we are at war with Iran, that cancer is about to be cured, that AI solved math? He had a little toy piano with him, a Fischer Price plastic rainbow thing that he was fiddling with while, uh, being in my general personal space. I wonder if he knows that computers can make concertos now. I wonder if he feels like he is going to die, and I wonder if that makes him feel alive.</span></p><p><span>SF is and continues to be a city of contradictions. Half the city has self-driving cars now, it&#8217;s so commonplace that people don&#8217;t stop to take pictures or gawk, so mundane that I didn&#8217;t bother taking one during my visit. The billboards tell you to hire robots; the ads on the buses tell you to fire people. No one can afford to live there, a studio in dogpatch is $4600. The magic is awe-inspiring and terrible.</span></p><p><span>Is this how religions are made? We can&#8217;t help but grasp for meaning, and the city&#8217;s inherent paradoxes are lovecraftian, we can&#8217;t look at them for too long so we need to invent something stable just to grasp at it. There&#8217;s no shortage of neo-religions in SF, both the official ones and the new-wave free love spiritual healing ones and the new techno-dystopian ones.</span></p><p><span>I think it&#8217;s hard to live in SF right now. Everyone recognizes that we are barrelling uncontrollably towards&#8230;something. There&#8217;s fervor, and intensity, and fear, and it&#8217;s making everyone feel alive in the worst kind of way. I&#8217;m glad to be back home. But maybe that doesn&#8217;t change the fact that we </span><em><span>are </span></em><span>still moving, very fast, so fast that being 2572 miles away may not matter.</span></p><p><span>I hope the city is less gloomy next time I&#8217;m there, it&#8217;s bringing me down.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>P.S. my friend <span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Danny D. Leybzon&quot;,&quot;id&quot;:4594584,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d6f9d5cf-6212-4979-be38-69c651e2f788_479x479.png&quot;,&quot;uuid&quot;:&quot;39fe0c70-da36-4fc9-810a-1e041966d04b&quot;}" data-component-name="MentionToDOM"></span> wanted me to quote him, but I sadly forgot to write down any of his incredible quotes because I was so engrossed in our conversation. So instead, I&#8217;ll quote what he told me when we first met: &#8220;Hi, I&#8217;m Danny.&#8221;</p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>if you don&#8217;t already know, you should look this up</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>if you don&#8217;t already know, definitely don&#8217;t look this up</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>who am I kidding, most of them are botfarms in Malaysia anyway</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>I&#8217;m sure there&#8217;s a lot of quibbling on what exactly this means</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>consciousness conference, not conference conference</p></div></div>]]></content:encoded></item><item><title><![CDATA[AI is not a normal technology]]></title><description><![CDATA[This is an addendum to my original Meditations on AI post, and a response to a few other articles from last year.]]></description><link>https://12gramsofcarbon.com/p/ai-is-not-a-normal-technology</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/ai-is-not-a-normal-technology</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sun, 13 Sep 2026 22:01:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!di04!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><strong><span>I. </span></strong><span>The only remaining fundamental disagreement between people who think AI is a normal technology and those that don&#8217;t is the belief that the AI can do everything a human can do, but better. If you believe this, then it&#8217;s almost tautological to say that there will be no jobs left for humans. And if you don&#8217;t believe this, then it&#8217;s almost tautological that there will be jobs left for humans. In other words, the debate about AI can basically be entirely boiled down to whether or not it can continue to acquire capabilities until it covers the full range of human capacity. Smoothing out the jaggedness, so to speak.</span></p><p><span>This may be obvious, but I want to spend some time on this, because I think there are a lot of other things that get wrapped up in the AI discourse. Questions like &#8216;is AI conscious?&#8217; or &#8216;does AI have aligned goals / motivations?&#8217; or &#8216;is AI violating copyright?&#8217; These are all maybe important questions, but they are not what makes AI potentially unique as a technology, different from every other technology that came before it. </span></p><p><span>I have yet to hear any explanation for why I should believe AI </span><em><span>cannot</span></em><span> do any given thing a human could, including manage other AIs. We even have a mechanism of action: just pay enough people to let you record them doing &lt;thing you are trying to automate&gt; and incorporate the data in the next training run. At one point the null hypothesis was &#8216;AI cannot do X&#8217; and the burden of proof really was on the AI accelerationists. But we are well past the point where that null hypothesis should shift. Even the physical world is not safe, the world&#8217;s capital is funneling into robotics and major advances are happening constantly.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!di04!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!di04!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 424w, https://substackcdn.com/image/fetch/$s_!di04!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 848w, https://substackcdn.com/image/fetch/$s_!di04!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 1272w, https://substackcdn.com/image/fetch/$s_!di04!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!di04!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png" width="1194" height="815" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:815,&quot;width&quot;:1194,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:906622,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/215423148?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!di04!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 424w, https://substackcdn.com/image/fetch/$s_!di04!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 848w, https://substackcdn.com/image/fetch/$s_!di04!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 1272w, https://substackcdn.com/image/fetch/$s_!di04!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F217c5c85-2c6b-4c4e-b4ba-8cb9e92cd4ad_1194x815.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">That robot is still the creepiest thing I have ever seen and is 100% going to murder that family jfc</figcaption></figure></div><p><span>Sometimes people will argue that the rise of AI will lead to new kinds of jobs, much like how the rise of factory automation led to new jobs in robotics and maintenance and computer science. Let&#8217;s take that premise for a second &#8212; we&#8217;ll ignore that such automation also led to the hollowing out of towns and cities across the country, and is </span><a href="https://12gramsofcarbon.com/p/fix-the-root-not-the-fruit?utm_source=publication-search"><span>a significant driver for the economic discontent that led to Trump</span></a><span> among other things, and that the new kinds of jobs were not 1:1 transferable both because of capability (&#8221;learn to code&#8221; implies the ability and time and money to learn, which not everyone has) and amount (there were not as many new jobs as old ones).</span></p><p><span>AI is different from previous technologies because any new jobs could in theory also be done by the AI.</span></p><p><span>Let&#8217;s do a little proof by induction. Start with three premises:</span></p><ol><li><p><span>that there are some number of jobs;</span></p></li><li><p><span>If the AI does a job better than a human, it will end up doing that job;</span></p></li><li><p><span>AI can do everything better than a human.</span></p></li></ol><p><span>There are two possibilities. Either the AI does not end up creating new jobs, in which case the AI does all the jobs. Or the AI does end up creating new jobs, in which case, just go back to step one and repeat.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qbCM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qbCM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 424w, https://substackcdn.com/image/fetch/$s_!qbCM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 848w, https://substackcdn.com/image/fetch/$s_!qbCM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 1272w, https://substackcdn.com/image/fetch/$s_!qbCM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!qbCM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png" width="1318" height="1131" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1131,&quot;width&quot;:1318,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:129939,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/215423148?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qbCM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 424w, https://substackcdn.com/image/fetch/$s_!qbCM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 848w, https://substackcdn.com/image/fetch/$s_!qbCM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 1272w, https://substackcdn.com/image/fetch/$s_!qbCM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0b81a5e-3936-4a09-9b12-179681dfbdd2_1318x1131.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Obviously, people take issue with the third premise, but notice that as time has gone on the people who are grasping for some indication that AI can&#8217;t do </span><em><span>everything</span></em><span> have become increasingly desperate. If you push hard enough, the answer is inevitably something like &#8220;the AI simply cannot [dream, love, laugh],&#8221; an almost religious appeal to some kind of soul-like quality of the human spirit, as if this matters to the finance team trying to do their accounting. But, again, even in this abstract sense, this is still just a question of capabilities. &#8220;The AI won&#8217;t take all the jobs because there are things that humans can do that the AI cannot.&#8221; And you&#8217;re back to the original tautology.</span></p><p><span>The reason AI is not a normal technology is because it is fully general. People compare AI to things like cars. If you invent the car, it may revolutionize transport, but it isn&#8217;t obviously going to impact how baristas make coffee. But if you invent a car that can do anything, well&#8230;</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!K-fx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!K-fx!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!K-fx!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!K-fx!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!K-fx!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!K-fx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2195170,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/215423148?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!K-fx!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!K-fx!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!K-fx!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!K-fx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffdc876c1-17b3-4026-9f83-8ab366524d83_1536x1024.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><strong><span>II. </span></strong><span>There is one thing AI cannot and will not ever be able to do, which is be human. For example, AI art will by definition not be 100% human made. There will always be demand for any kind of identifier, so there will always be demand for things that are authentic-human-made. But this is a very narrow slice of the economy, not unlike a couple buying hand-made wood carvings or hand-stitched hats from an &#8220;authentic&#8221; Balinese shop keeper in Ubud while on their honeymoon. You could justifiably round off economic demand for &#8220;human-made&#8221; to whatever the global trade is in such upper middle class kitsch, which is basically a rounding error on the global economy overall.</span></p><p><span>The reason is straightforward: you buy &#8220;authenticity&#8221; as a preference, not a necessity. Anything that people actually </span><em><span>need</span></em><span> is always going to be purchased without regard for provenance. And even among the long list of potential wants &#8212; of which the want for authenticity must compete &#8212;  my strong sense is that authenticity trends pretty low on the list. Well below &#8216;quality&#8217;, at any rate, I&#8217;m always going to prefer a good pizza over an authentic one, I don&#8217;t care if the original Romans wouldn&#8217;t put nduja on it, that shit is delicious. Even Anthony Bourdain </span><a href="https://www.chowhound.com/1870897/anthony-bourdain-least-favorite-dishes/"><span>couldn&#8217;t claim to enjoy unwashed warthog rectum as a meal</span></a><span>, though I&#8217;m sure it was certainly authentic!</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!f8P7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!f8P7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 424w, https://substackcdn.com/image/fetch/$s_!f8P7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 848w, https://substackcdn.com/image/fetch/$s_!f8P7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 1272w, https://substackcdn.com/image/fetch/$s_!f8P7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!f8P7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png" width="777" height="727" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:727,&quot;width&quot;:777,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:569366,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/215423148?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!f8P7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 424w, https://substackcdn.com/image/fetch/$s_!f8P7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 848w, https://substackcdn.com/image/fetch/$s_!f8P7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 1272w, https://substackcdn.com/image/fetch/$s_!f8P7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd6f5a8e3-4b2f-42d7-9ec0-9bbd7f2735f5_777x727.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">what, did you think i was kidding?</figcaption></figure></div><p><span>Authenticity ends up being valuable only because it is rare </span><em><span>relative to demand</span></em><span>, not because there is objectively a lot of demand or because it is objectively valuable.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span> Anything that AI can do can, in theory, become infinitely cheap, which becomes equivalent to </span><em><span>not </span></em><span>valuable.</span></p><p><span>This is part of what&#8217;s happening with AI writing. The AI is mimicking the writing style of </span><a href="https://www.newyorker.com/books/page-turner/did-a-chatbot-write-a-prize-winning-story-does-it-matter"><span>prestigious award winners</span></a><span> and </span><a href="https://www.nytimes.com/2026/09/05/technology/kenya-college-essays-ai.html"><span>Kenyan essay writers</span></a><span>, i.e. things that used to be rare that people would pay for. If you told me 5 years ago that everyone could write like that, I would&#8217;ve thought that we would enter into a golden age of heightened literature even in our ad copy. But that&#8217;s the problem &#8212; ad copy is still ad copy. The moment that kind of writing became ubiquitous, it became synonymous with cheap vapid thinking, and people </span><a href="https://cymerys.com/w/im-becoming-ai-blind"><span>literally turn their brains off</span></a><strong><span> </span></strong><span>or </span><a href="https://samkriss.substack.com/p/if-you-let-ai-do-your-writing-i-will"><span>react with violence</span></a><span> when they discover they are reading AI slop.</span></p><div class="embedded-post-wrap" data-attrs="{&quot;id&quot;:194751836,&quot;url&quot;:&quot;https://samkriss.substack.com/p/if-you-let-ai-do-your-writing-i-will&quot;,&quot;publication_id&quot;:1071360,&quot;embedding_publication_id&quot;:1830559,&quot;publication_name&quot;:&quot;Numb at the Lodge&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!gteW!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F75fb5a16-c295-4898-b7e3-9ab295cd3530_378x378.png&quot;,&quot;title&quot;:&quot;If you let AI do your writing, I will come to your house and kill you&quot;,&quot;truncated_body_text&quot;:&quot;It&#8217;s none of your business why, but I&#8217;ve been planning a party. The idea was to get some caterers in to cook something over live coals, so I went online to see what was available. The first company I found described itself like this: &#8216;We don&#8217;t just provide food&#8212;we create meaningful experiences. Our passion for traditional fire cooking allows us to offer&#8230;&quot;,&quot;date&quot;:&quot;2026-05-25T04:19:09.551Z&quot;,&quot;like_count&quot;:0,&quot;comment_count&quot;:0,&quot;bylines&quot;:[{&quot;id&quot;:14289667,&quot;name&quot;:&quot;Sam Kriss&quot;,&quot;handle&quot;:&quot;samkriss&quot;,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/652b25c8-f327-46e3-a6a3-b7f60986d8e4_750x750.jpeg&quot;,&quot;bio&quot;:&quot;It's got eyes of brown, watery; nails of pointed yellow&quot;,&quot;profile_set_up_at&quot;:&quot;2021-11-21T12:23:18.627Z&quot;,&quot;reader_installed_at&quot;:&quot;2022-09-02T13:17:43.590Z&quot;,&quot;publicationUsers&quot;:[{&quot;id&quot;:1019897,&quot;user_id&quot;:14289667,&quot;publication_id&quot;:1071360,&quot;role&quot;:&quot;admin&quot;,&quot;public&quot;:true,&quot;is_primary&quot;:true,&quot;publication&quot;:{&quot;id&quot;:1071360,&quot;name&quot;:&quot;Numb at the Lodge&quot;,&quot;subdomain&quot;:&quot;samkriss&quot;,&quot;custom_domain&quot;:null,&quot;custom_domain_optional&quot;:false,&quot;hero_text&quot;:&quot;These heavy sands are language tide and wind have silted here&quot;,&quot;logo_url&quot;:&quot;https://bucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com/public/images/75fb5a16-c295-4898-b7e3-9ab295cd3530_378x378.png&quot;,&quot;author_id&quot;:14289667,&quot;primary_user_id&quot;:14289667,&quot;theme_var_background_pop&quot;:&quot;#8AE1A2&quot;,&quot;created_at&quot;:&quot;2022-09-02T12:58:47.860Z&quot;,&quot;email_from_name&quot;:&quot;Sam Kriss from Numb at the Lodge&quot;,&quot;copyright&quot;:&quot;Sam Kriss&quot;,&quot;founding_plan_name&quot;:&quot;Founding Member&quot;,&quot;community_enabled&quot;:false,&quot;invite_only&quot;:false,&quot;payments_state&quot;:&quot;enabled&quot;,&quot;language&quot;:null,&quot;explicit&quot;:false,&quot;homepage_type&quot;:&quot;magaziney&quot;,&quot;is_personal_mode&quot;:false,&quot;logo_url_wide&quot;:null}}],&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:1000,&quot;status&quot;:{&quot;bestsellerTier&quot;:1000,&quot;subscriberTier&quot;:null,&quot;leaderboard&quot;:null,&quot;vip&quot;:false,&quot;badge&quot;:{&quot;type&quot;:&quot;bestseller&quot;,&quot;tier&quot;:1000},&quot;subscriber&quot;:null}}],&quot;utm_campaign&quot;:null,&quot;belowTheFold&quot;:true,&quot;type&quot;:&quot;newsletter&quot;,&quot;language&quot;:&quot;en&quot;,&quot;source&quot;:null}" data-component-name="EmbeddedPostToDOM"><a class="embedded-post" native="true" href="https://samkriss.substack.com/p/if-you-let-ai-do-your-writing-i-will?utm_source=substack&amp;utm_campaign=post_embed&amp;utm_medium=web&amp;embedding_publication_id=1830559"><div class="embedded-post-header"><img class="embedded-post-publication-logo" src="https://substackcdn.com/image/fetch/$s_!gteW!,w_56,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fbucketeer-e05bbc84-baa3-437e-9518-adb32be77984.s3.amazonaws.com%2Fpublic%2Fimages%2F75fb5a16-c295-4898-b7e3-9ab295cd3530_378x378.png" loading="lazy"><span class="embedded-post-publication-name">Numb at the Lodge</span></div><div class="embedded-post-title-wrapper"><div class="embedded-post-title">If you let AI do your writing, I will come to your house and kill you</div></div><div class="embedded-post-body">It&#8217;s none of your business why, but I&#8217;ve been planning a party. The idea was to get some caterers in to cook something over live coals, so I went online to see what was available. The first company I found described itself like this: &#8216;We don&#8217;t just provide food&#8212;we create meaningful experiences. Our passion for traditional fire cooking allows us to offer&#8230;</div><div class="embedded-post-cta-wrapper"><span class="embedded-post-cta">Read more</span></div><div class="embedded-post-meta">6 months ago &#183; Sam Kriss</div></a></div><p><span>Thus, the rise of poor punctuation and bad capitalization in your average substack post or tweet. People use AI all the time in places where they need to communicate a lot of information quickly and efficiently,</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a><span> or where the writing is primarily a chore/work and not a hobby. This is most obvious with code, a language that is not </span><em><span>literally</span></em><span> devoid of aesthetics but which is certainly not valued for how it elegantly it reads. But you can see the trend in other places too. What percent of papers submitted to prestigious scientific journals is written by AI? What percent of legal briefs? Do you think that number will go up or down next year?</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!9QEq!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!9QEq!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 424w, https://substackcdn.com/image/fetch/$s_!9QEq!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 848w, https://substackcdn.com/image/fetch/$s_!9QEq!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!9QEq!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!9QEq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg" width="1456" height="1203" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1203,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Academic journals' AI policies fail to curb the surge in AI-assisted  academic writing | PNAS&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Academic journals' AI policies fail to curb the surge in AI-assisted  academic writing | PNAS" title="Academic journals' AI policies fail to curb the surge in AI-assisted  academic writing | PNAS" srcset="https://substackcdn.com/image/fetch/$s_!9QEq!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 424w, https://substackcdn.com/image/fetch/$s_!9QEq!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 848w, https://substackcdn.com/image/fetch/$s_!9QEq!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!9QEq!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F86649ae4-627a-4c71-8049-305e3a3a6198_3664x3027.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption"><a href="https://www.pnas.org/doi/10.1073/pnas.2526734123">Academic journals&#8217; AI policies fail to curb the surge in AI-assisted academic writing</a></figcaption></figure></div><p><span>If you assume that the AI can do anything a human can do, the syllogism writes itself. Things are valuable if they are rare; anything an AI can do won&#8217;t be rare; therefore, the value of &#8220;anything a human can do&#8221; drops to zero.</span></p><p><strong><span>III. </span></strong><span>I&#8217;m writing this with the mathematics community in mind, which is currently </span><a href="https://terrytao.wordpress.com/2026/09/11/a-severe-misalignment-of-ai-in-mathematics/"><span>in a state of shock</span></a><span> over the industrialization of their field. From Field&#8217;s Medalist and math extraordinaire Terrance Tao:</span></p><blockquote><p>Over the last few months, the mathematical capabilities of LLMs have improved dramatically, to the point that they can solve major outstanding problems in many fields of mathematics. However, the push by AI companies to solve mathematical problems as a benchmark is detrimental to the science of mathematics, and to the mathematical community. The goals of the AI companies and the goals of the mathematical community are severely misaligned. We see these as part of broader alignment issues impacting other scientific and creative professions, as well as the whole of society.</p><p>&#8230;</p><p>In recent months, the success of AI in solving major mathematical problems has made headlines even outside mathematical circles. But solving problems is only a tool and proxy for achieving the primary goal of conceptual understanding and insight. Forgetting this in the world of AI may turn the tool against the primary goal. Indeed, the mass production at faster and faster pace of &#8220;true/false&#8221; statements could destroy fertile ground instead of breathing life into new ideas.</p><p>&#8230;</p><p>We are witnessing a general threat to intellectual work, with misalignment between the outcome of the use of AI and its initial purpose. In many fields and activities, years of training have traditionally served not only to produce a final answer or product, but also to develop understanding and the ability to formulate new questions and ideas. However, building on a vast body of previous human work, AI systems are becoming increasingly capable of producing the results of such work directly, and these goals cease to align.</p></blockquote><p>(One interesting note: Tao has been a huge supporter of using AI in mathematics. It is especially interesting to see him come out against it here)</p><p><span>I&#8217;m an engineer, I love making things more efficient, and even I can recognize that there is something intrinsically perverse in solving long standing mathematical problems by simply prompting the AI to &#8220;do a breakthrough.&#8221; </span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!y2Qo!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!y2Qo!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 424w, https://substackcdn.com/image/fetch/$s_!y2Qo!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 848w, https://substackcdn.com/image/fetch/$s_!y2Qo!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!y2Qo!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!y2Qo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg" width="885" height="399" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:399,&quot;width&quot;:885,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Image&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Image" title="Image" srcset="https://substackcdn.com/image/fetch/$s_!y2Qo!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 424w, https://substackcdn.com/image/fetch/$s_!y2Qo!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 848w, https://substackcdn.com/image/fetch/$s_!y2Qo!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!y2Qo!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9836ed73-6819-4cd3-a89f-ea82269dac6e_885x399.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>People who are not mathematicians and likely never intend to become mathematicians are crowing about how this will let the average person solve Millennium problems, as if that was the point of all of this. </span><a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything"><span>It&#8217;s a classic example of overfitting</span></a><span>, of mistaking the measure (solving hard math problems) with the goal (making math more accessible). Destruction parading as democratization.</span></p><p><span>But at the same time, this must be what the original Luddites felt, right? Surely they also recognized that some ineffable quality of craftsmanship was being lost and worth persevering? The wound inflicted by the industrialization of mathematics may also fade with time, and future generations may shrug in their history classes and go back to prompting the models to &#8220;do a breakthrough&#8221; the same way kiddos today will scroll through shein while ignoring the assigned textbook reading on how people once destroyed textile mills. Assuming that there is still something that looks like a history class, of course.</span></p><p><strong><span>IV. </span></strong><span>The title of this piece is derived from </span><a href="https://www.normaltech.ai/p/ai-as-normal-technology"><span>AI as Normal Technology</span></a><span>, an essay written in April of last year. It&#8217;s an important essay, with an important goal. In their words:</span></p><blockquote><p><span>We articulate a vision of artificial intelligence (AI) as </span><em>normal technology</em><span>. To view AI as normal is not to understate its impact&#8212;even transformative, general-purpose technologies such as electricity and the internet are &#8220;normal&#8221; in our conception. But it is in contrast to both utopian and dystopian visions of the future of AI which have a common tendency to treat it akin to a separate species, a highly autonomous, potentially superintelligent entity.</span></p><p><span>&#8230;</span></p><p><span>The normal technology frame is about the relationship between technology and society. It rejects technological determinism, especially the notion of AI itself as an agent in determining its future.</span></p></blockquote><p>Many people framed this article and the people behind it as an answer to / in opposition to <a href="https://ai-2027.com/">AI 2027</a>, which is much more focused on the risks of superintelligent  malice. For what it&#8217;s worth, even though I am concerned about <a href="https://12gramsofcarbon.com/p/tech-things-we-cant-control-the-bots">our ability to control the bots</a>&#8230;</p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-d2Q!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 424w, https://substackcdn.com/image/fetch/$s_!-d2Q!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 848w, https://substackcdn.com/image/fetch/$s_!-d2Q!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 1272w, https://substackcdn.com/image/fetch/$s_!-d2Q!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!-d2Q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png" width="1159" height="229" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:229,&quot;width&quot;:1159,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:23826,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/215423148?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!-d2Q!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 424w, https://substackcdn.com/image/fetch/$s_!-d2Q!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 848w, https://substackcdn.com/image/fetch/$s_!-d2Q!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 1272w, https://substackcdn.com/image/fetch/$s_!-d2Q!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81fa0f31-c4f5-456d-bab2-776e209533d8_1159x229.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">it was a weird week</figcaption></figure></div><p>&#8230;I think it is extremely important to <em>also </em>think about the risks of AI that fall outside of the terminator-skynet-extinction variety. This is not an either or thing. I&#8217;m concerned about both of these outcomes!</p><p>The main premise of <em>AI as Normal Technology</em> is that we (as a species) will have time and capacity to intervene because AI will not FOOM. Importantly, the authors do not contest that AI will continue to acquire new capabilities indefinitely; rather, they think that our institutions will have time to respond to those capabilities because the AI tooling will remain in our control as those capabilities increase. </p><p>My problem with this framing: AI is an abnormal technology on multiple axes. The whole &#8216;AI may have a mind of its own&#8217; thing is just one of those axes. I don&#8217;t think anyone in the Valley<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a> is really grappling with what it means to have AI tools that are better than humans, what it will do to our global economy and how we value human labor. The authors imply that we may be able to put policy controls such that AI does not immediately take over all the jobs. But, bluntly, there is no obvious control mechanism that will prevent organizations and governments from using AI. </p><p>Tao&#8217;s article above purposely uses the language of alignment applied to the AI industry. That is because the AI tools we use are not the only optimizers out there. This is something I explored more fully in <a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything">The Optimization Theory of Everything</a>. Corporations and governments and individual people are also optimizers with their own incentives, all of which encourage defecting when it comes to using AI or not. Every boardroom in the world will scalp any CEO who states that their firm will not use AI for ethical reasons, and every governing body in the world will shoot down any proposal to gut their AI industries if other countries continue pushing forward. Short of a global agreement to avoid further development,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a> I don&#8217;t really see the <em>use</em> of AI slowing down, and I do not want to rely on the largesse of business owners to not ruthlessly deploy AI in their companies.</p><p>So AI is a normal technology, except it can do everything, can continue growing its capabilities, and can eventually outperform human labor in most tasks. Which is to say, it is nothing like any technology we have ever seen before, ever. </p><p><strong><span>IV. </span></strong><span>A year ago, I wrote my first </span><a href="https://12gramsofcarbon.com/p/meditations-on-ai-and-the-future?utm_source=publication-search"><span>Meditations on AI</span></a><span> post. It&#8217;s worth revisiting here:</span></p><blockquote><p>If you were a clarinetist back before the phonogram really took off, there were a lot of jobs and they paid well. Any bar, restaurant, theater, or dance hall needed live musicians to have any music at all. Now, it&#8217;s a desert. No one wants clarinetists, because no one needs live orchestra when they can ask the genie in their pocket for whatever music whenever they want. I&#8217;d wager that you have way more people able to make music today than you did at basically any point in the early 1900s. But the ability to make a career in that space has plummeted. The barriers to entry have dropped, taste is way more important, and there are only like 3 clarinetists who matter enough to make anything close to a middle class living on taste alone. Sure, every now and then you&#8217;ll get an Elton John, but, like, you can&#8217;t exactly plan for that! This is the worst case scenario for what AI will do to all jobs everywhere, except it&#8217;ll be even worse because it&#8217;ll happen over like 2 years instead of 100.</p><p>On a semi-related note: earlier we talked about what AI did to the graphic design sector. One thing that I didn&#8217;t mention is that the &#8216;true&#8217; artists, the senior types who have been in the industry for a while, are thriving &#8212; those guys were primarily valued for their taste anyway, and now that is even more valuable. There&#8217;s an important pattern there: generally seniority and taste are highly correlated, so we should expect AI to disproportionately hit junior, freelance, and entry level positions. The more senior you are, the more insulated you are, the more you&#8217;ll benefit.</p><p>People on the pro-AI side of the debate argue that the existence of automated general intelligence will massively increase quality of life, and I think history suggests that they are right (again, caveat that it doesn&#8217;t kill us all). But in the short term, I think we should expect some pretty significant labor shocks and a possible increase in wage inequality.</p><p>As for the medium to long term, who knows? In my opinion, the nature of work, <em>all work</em>, will look fundamentally different, and it may look very <em>unpredictably </em>different. A musician a 100 years ago would never have been able to predict Spotify or DAWs; what makes you think anyone can predict what comes after AI?</p></blockquote><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Eao2!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Eao2!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 424w, https://substackcdn.com/image/fetch/$s_!Eao2!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 848w, https://substackcdn.com/image/fetch/$s_!Eao2!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 1272w, https://substackcdn.com/image/fetch/$s_!Eao2!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!Eao2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png" width="1094" height="618" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:618,&quot;width&quot;:1094,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Eao2!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 424w, https://substackcdn.com/image/fetch/$s_!Eao2!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 848w, https://substackcdn.com/image/fetch/$s_!Eao2!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 1272w, https://substackcdn.com/image/fetch/$s_!Eao2!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F39754bf8-1354-41f3-b2c2-8afdd7ea9138_1094x618.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!sReZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!sReZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 424w, https://substackcdn.com/image/fetch/$s_!sReZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 848w, https://substackcdn.com/image/fetch/$s_!sReZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 1272w, https://substackcdn.com/image/fetch/$s_!sReZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!sReZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png" width="1058" height="661" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:661,&quot;width&quot;:1058,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!sReZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 424w, https://substackcdn.com/image/fetch/$s_!sReZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 848w, https://substackcdn.com/image/fetch/$s_!sReZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 1272w, https://substackcdn.com/image/fetch/$s_!sReZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab1c0388-a2e1-4ebc-80b7-8f4bdf30ce24_1058x661.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>We know what happens in industries where the fundamental skill of the thing becomes super cheap and accessible. The future of the global </span><em><span>human </span></em><span>economy is rockstar musicians alongside a vast sea of people who cannot make a living making music. Traditionally though, that does mean more access &#8212; more people have the opportunity to get into music today than ever before, they just need a day job. But does that still work with AI? Maybe you can turn math into a hobby and keep a day job as a software engineer, maybe that means more people can do math than ever before. But the AI also does all the software engineering, so then what?</span></p><p><span>Going back to the very top, what are the things that are uniquely human that no AI can do? Not now, not in twenty years, but ever? The best answer I can come up with is &#8220;be human.&#8221; But that on its own does not provide much comfort.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>for objectively valuable, I&#8217;m thinking of, eg, food production or air conditioning or medicine, which will always have some kind of intrinsic value because of the needs of being biological meat sacks</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>not to say that the writing itself is efficient. AI writing is often pretty bad, full of jargon and ai tics. But communication is two parts. The amount of time it takes to communicate something was, up until recently, dominated by the amount of time it took to <em>write</em> the thing in the first place.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>plenty of people outside the valley! But unfortunately the economists who are not that close to AI tools have a tough time fully comprehending what these models can do and how fast they are moving</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>possible, we did it with nukes, but the stakes were more obvious there</p></div></div>]]></content:encoded></item><item><title><![CDATA[Key ML Papers: 2020 to 2025]]></title><description><![CDATA[My entries for key papers of the last five years]]></description><link>https://12gramsofcarbon.com/p/key-ml-papers-2020-to-2025</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/key-ml-papers-2020-to-2025</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sat, 12 Sep 2026 17:01:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!gBHe!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcd3ac2a-1029-4838-afb3-085f4a7d0583_540x540.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>I&#8217;m in SF this week, have a pretty packed schedule but reach out if you want to say hi!</em></p><div><hr></div><p>Nearly two years ago I set out to read and review the papers that Ilya Sutskever (then Chief Scientist at OpenAI) had given to John Carmack (software engineer extraordinaire, of DOOM fame). The full list of reviews is here:</p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;55443031-b776-493a-bf23-d8f309feea36&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;lg&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Ilya's Papers to Carmack: Table of Contents&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:9744387,&quot;name&quot;:&quot;theahura&quot;,&quot;bio&quot;:&quot;amolkapoor.com&quot;,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!CBgA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6094382e-58ce-4e35-8f47-e189e1ff0b7c_540x540.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;post_date&quot;:&quot;2024-10-25T06:08:22.292Z&quot;,&quot;cover_image&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/7a07c256-9ae8-4df6-a5ca-d7b0467effbe_1024x1024.webp&quot;,&quot;cover_image_alt&quot;:null,&quot;cover_image_crop&quot;:null,&quot;canonical_url&quot;:&quot;https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-table&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:150698801,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:16,&quot;comment_count&quot;:0,&quot;publication_id&quot;:1830559,&quot;publication_name&quot;:&quot;12 Grams of Carbon&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!gBHe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcd3ac2a-1029-4838-afb3-085f4a7d0583_540x540.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p>That process took, end to end, a year and a half to do. O sure, I was doing a bunch of other things in the meantime, like <a href="https://12gramsofcarbon.com/p/notes-from-an-indian-wedding?utm_source=publication-search">getting married</a> and <a href="https://12gramsofcarbon.com/p/notes-from-the-sf-peptide-scene">going to SF a bunch</a>. I probably finished reading all the papers in the first 3 or 4 months, it was the writing that took a while. But still, a lot has changed since I started that series, and more still has changed since I finished it.</p><p>Now that we&#8217;re nearing the end of 2026, what are the key papers of the last few years?</p><p>Ilya has, of course, been living his best hermit life <a href="https://ssi.inc/">working on SSI</a>. I don&#8217;t expect him to come down from his mountain cave with a new stack of papers to share. So, in lieu of Ilya kindly providing me my paper reading list, I&#8217;ve gone ahead and put together my own list of key papers (and blog posts and, yes, one textbook) from 2020 - 2025. As with Ilya&#8217;s original set of papers, this new set was selected with an eye for <em>learning</em>. If you go through all of these papers, you ideally will have a pretty up to date understanding of the different important threads in deep learning research.</p><ul><li><p>(2020) <a href="https://arxiv.org/abs/2005.11401">RAG</a> -- Harness Engineering</p></li><li><p>(2020) <a href="https://arxiv.org/abs/2006.11239">DDPM</a> -- Diffusion</p></li><li><p>(2020) <a href="https://arxiv.org/abs/2010.11929">An Image is Worth 16x16 Words (ViT)</a> -- Vision</p></li><li><p>(2021) <a href="https://arxiv.org/abs/2103.00020">CLIP</a> -- Vision (but really important for a whole bunch of things)</p></li><li><p>(2021) <a href="https://arxiv.org/abs/2106.09685">LoRA</a> -- Scaling</p></li><li><p>(2021) <a href="https://doi.org/10.1038/s41586-021-03819-2">AlphaFold 2</a> -- Science</p></li><li><p>(2021) <a href="https://arxiv.org/abs/2207.12598">Classifier-Free Guidance</a> -- Diffusion</p></li><li><p>(2021) <a href="https://arxiv.org/abs/2112.10752">Latent Diffusion</a> -- Diffusion</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2201.11903">Chain-of-Thought Prompting</a> -- Harness Engineering</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2203.02155">RLHF (InstructGPT)</a> -- RL</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2203.15556">Chinchilla</a> -- Scaling</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2205.14135">FlashAttention</a> -- Scaling</p></li><li><p>(2022) <a href="https://transformer-circuits.pub/2022/toy_model/index.html">Toy Models of Superposition</a> -- Interpretability</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2210.03629">ReAct</a> / <a href="https://arxiv.org/abs/2305.16291">Voyager</a> -- Harness Engineering</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2211.17192">Speculative Decoding</a> -- Scaling</p></li><li><p>(2022) <a href="https://arxiv.org/abs/2212.08073">Constitutional AI</a> -- RL</p></li><li><p>(2023) <a href="https://arxiv.org/abs/2301.08243">I-JEPA</a> -- Vision</p></li><li><p>(2023) <a href="https://arxiv.org/abs/2305.18290">Direct Preference Optimization</a> -- RL</p></li><li><p>(2023) <a href="https://arxiv.org/abs/2309.06180">PagedAttention</a> -- Scaling</p></li><li><p>(2023) <a href="https://transformer-circuits.pub/2023/monosemantic-features/index.html">Towards Monosemanticity</a> -- Interpretability</p></li><li><p>(2024) <a href="https://www.anthropic.com/news/model-context-protocol">Model Context Protocol</a> -- Harness Engineering</p></li><li><p>(2025) <a href="https://arxiv.org/abs/2501.12948">DeepSeek-R1</a> -- RL</p></li><li><p>(2025) <a href="https://jax-ml.github.io/scaling-book/">How to Scale Your Model</a> -- Scaling</p></li><li><p>(2026) <a href="https://dnhkng.github.io/posts/rys/">RYS / LLM Neuroanatomy</a> -- Interpretability</p></li><li><p>(2025) <a href="https://storage.googleapis.com/deepmind-media/Era-of-Experience%20/The%20Era%20of%20Experience%20Paper.pdf">Welcome to the Era of Experience</a> -- Capstone</p></li></ul><p>Obviously, other smarter people may disagree with this list. Would love to hear other opinions! My hope is that &#8216;Key ML Papers&#8217; will be my review series over the next year. I plan on reviewing one of these papers every few weeks, and I&#8217;ll keep this page up to date as time goes on. </p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Agentics Meetup Videos and our first AI Takes Series]]></title><description><![CDATA[I suppose newsletters are supposed to also be about the news sometimes?]]></description><link>https://12gramsofcarbon.com/p/agentics-meetup-videos-and-our-first</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-meetup-videos-and-our-first</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Thu, 10 Sep 2026 06:07:29 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!lyXG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffbe87b4e-79c2-403b-a262-b072d1fc92fb_1280x960.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><em>Editor&#8217;s Note: Traditionally the Agentics newsletter has focused on longform content about how to think about agents, from <a href="https://12gramsofcarbon.com/p/agentics-how-we-use-background-agents">suggestions on how to implement workflows</a> to <a href="https://12gramsofcarbon.com/p/agentics-case-study-how-corvus-uses">case studies</a> to <a href="https://12gramsofcarbon.com/p/your-agent-skills-are-all-slophttps://12gramsofcarbon.com/p/your-agent-skills-are-all-slop">thoughts on AI config</a>. </em></p><p><em>We also get a </em>lot<em> of requests for takes on various hype-y things, and most of those don&#8217;t warrant a full response. Still, we often want to address what&#8217;s going on and provide a few lines of opinion where relevant, so we are starting a hopefully-weekly-but-probably-every-other-week series of posts that is solely focused on things happening in the AI world. </em></p><div><hr></div><h2>Agentics NYC August Flagship: Slides and Recordings</h2><p>Thank you everyone who came out to the August Agentics NYC Flagship event! We had 1400 people sign up and over 300 people pack into a Times Square nightclub to talk about AI agents. Recording links:</p><p><a href="https://www.youtube.com/watch?v=54-xd8kEVl0">Inference Designed for Long Horizon Agents</a> &#8212; Jack O&#8217;Brien, <a href="http://subconscious.dev">Subconscious</a></p><p><a href="https://www.youtube.com/watch?v=GRKwPKWxqCw">Unbundling the Goose SDK</a> &#8212; Jack Amadeo, <a href="http://block.xyz">Block</a></p><p><a href="https://www.youtube.com/watch?v=zMU3Cr6Q2lQ">Modal Training Gym SDK</a> &#8212; Joy Liu, <a href="https://modal.com/">Modal</a></p><p><a href="https://www.youtube.com/watch?v=nmcU7_jhsXU">Software Factories and How to Build Them</a> &#8212; Amol Kapoor, <a href="https://noriagentic.com/">Nori Agentic</a></p><p><a href="https://www.youtube.com/watch?v=IGYI8wMiyZU">One AI Harness: A Workspace for Everyone</a> &#8212; Danny Avila, <a href="https://www.librechat.ai/">Librechat</a></p><p><a href="https://www.youtube.com/watch?v=ZdVHxttsKDM">Reducing Our On-Call Burden with Cloud Agents</a> &#8212; Jeff Silver, <a href="https://www.opus.so/">Opus</a></p><p><a href="https://www.youtube.com/watch?v=D0KlCTyZ26Q">The New Software Crisis</a> &#8212; Rohan Gupta, <a href="https://usetelos.ai/">Telos</a></p><div class="image-gallery-embed" data-attrs="{&quot;gallery&quot;:{&quot;images&quot;:[{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fbe87b4e-79c2-403b-a262-b072d1fc92fb_1280x960.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a4c73c3d-c055-452e-b103-eb7d9a44af22_1200x800.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4b6adcca-1b88-4014-bd41-00cdaceae3c4_1200x800.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3545e918-09a0-4b13-a176-68e8b425f50a_1200x800.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4d8aa0fe-19f1-4e4e-a00c-6348da1253ac_1600x1067.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1176e09c-41a5-4333-986f-b872c04d0dae_1280x853.jpeg&quot;}],&quot;caption&quot;:&quot;&quot;,&quot;alt&quot;:&quot;&quot;,&quot;staticGalleryImage&quot;:{&quot;type&quot;:&quot;image/png&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/47295d07-dc3f-4d49-949b-bc9944619742_1456x964.png&quot;}},&quot;isEditorNode&quot;:true}"></div><p>More pictures, slides, and recordings of the event can be found at the <a href="https://agenticsnyc.com/events/august-2026.html?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-09">Agentics NYC event page</a>. <a href="https://www.youtube.com/@NoriAgentic">Subscribe on Youtube</a> to get all of the Agentics recordings as soon as they go up, and keep an eye on the <a href="https://luma.com/calendar/manage/cal-Dl4P7yAhJ2l1Wp2">luma</a> for more events!</p><div><hr></div><h2>AI Takes</h2><p><strong>Navier-Stokes controversy. </strong>This is definitely going in a longer post, but I have to mention it here. The Navier-Stokes equations model fluid dynamics. One important open question in the math world is whether these equations fall apart at some extremes. This is a <em>very important question </em>because we use these equations to do things like design planes and map how blood vessels work. So important that this was selected as one of 7 millennium problems at the turn of a century. It even has a $1m prize pool attached. </p><p>A few days ago, OpenAI announced that it had used an internal model and literal millions of dollars of compute to solve Navier-Stokes.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> This was immediately mired in controversy. Turns out another two mathematicians &#8212; Tristan Buckmaster and Levant Alpoge &#8212; were working on this problem for the last year. They also happened to use ChatGPT quite a bit in the process. These mathematicians were very close to their own solution. Rumor got out that they were close, it reached OpenAI, and OpenAI then burned all of those tokens over the course of <em>two weeks</em> to try and scoop the result.</p><p>This raises a question: did OpenAI look at Tristan&#8217;s previous work?</p><p>Tristan&#8217;s <a href="https://cims.nyu.edu/~tristanb/statement.pdf">write up</a> is not flattering for OpenAI: </p><blockquote><p>Levent had been told by Sebastien &#8220;very little human input&#8221; had been used. This turned out not to be true. Over the course of the call, as members of their team sent Sebastien corrections and details over their internal chat, it emerged that an entire team had been working on the problem&#8230;</p><p>I asked whether the model had been trained on, or had access to, our sessions in Codex, into which we had been putting all our drafts for the whole of this project. I was told the model did not look up user data. I asked again, about training, and I did not get an answer&#8230;.</p><p>Sebastien twice asserted that he wanted Levent removed from authorship, and said it would all be simple if only it were not the case that, and it was so annoying that, Levent works at Anthropic&#8230;</p><p>I said that if OpenAI released its result in the way proposed I would go public with what happened. The reply was, &#8220;Why would you ruin your career?&#8221; I replied that I am an academic, and asked why he thought going public would ruin my career. The reply was, &#8220;If you don&#8217;t want me to be nice, then I don&#8217;t have to be nice.&#8221;</p></blockquote><p>But OpenAI&#8217;s <a href="https://openai.com/index/navier-stokes-solution/">write up</a> isn&#8217;t that flattering for OpenAI either!</p><blockquote><p>After the completion of our full project and Lean verification (on September 6th), believing from the rumor they also had a solution of Navier&#8211;Stokes, we reached out to them to offer a concurrent release of our result and to recognize their priority in a joint announcement.</p><p>&#8230;</p><p>While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models&#8288;.</p></blockquote><p>They probably did <em>not </em>directly feed Tristan&#8217;s and Levant&#8217;s sessions into their model. But <em>of course </em>they trained on that session data! Of course they did! Why would they not? Frankly, it&#8217;s crazy that OpenAI is even hedging with &#8216;while unlikely&#8217;. Data is such a scarce resource, everyone is training on every bit of data they can get, every company that sells data to these companies gets literal billions of dollars over night. We&#8217;re supposed to believe that OpenAI decided that this particular session from two extremely talented mathematicians was somehow pruned from the training data, at the exact time that OpenAI was trying to make their models better at math?</p><p>Bluntly, unless you have a very explicit no-train contract with the frontier labs, you should assume that all of your data is going right into the model training. Which means that anything that you feed into the model now will potentially be available in a few months to your competitors, just by asking.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!WClT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!WClT!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 424w, https://substackcdn.com/image/fetch/$s_!WClT!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 848w, https://substackcdn.com/image/fetch/$s_!WClT!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 1272w, https://substackcdn.com/image/fetch/$s_!WClT!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!WClT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png" width="1456" height="603" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:603,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:334123,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/214986253?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!WClT!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 424w, https://substackcdn.com/image/fetch/$s_!WClT!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 848w, https://substackcdn.com/image/fetch/$s_!WClT!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 1272w, https://substackcdn.com/image/fetch/$s_!WClT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F9e4dda24-e7ce-40bd-9a5a-2cfef655a56b_1906x790.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I have to imagine that this makes cloud inference even less appealing for large enterprises, especially in finance. JaneStreet is publicly buying billions in datacenter capacity, that&#8217;s not for Anthropic models!</p><p>While we are on the subject of Millennium problems and OpenAI, rumors are swirling that they ALSO solved the Hodge conjecture, another of the Millennium problems. Big if true.</p><p>Related: Anthropic <a href="https://www.anthropic.com/research/formalizing-fermats-last-theorem">released a formalization of Fermat&#8217;s Last Theorem</a>. Less drama here. </p><div><hr></div><p><strong>GPT6 Astra. </strong>Speaking of OpenAI, <a href="https://openai.com/index/gpt-6-astra/">they released a model recently</a>. It&#8217;s very good, and has replaced Claude Opus 4.8 as my daily driver. </p><blockquote><p>Astra is state-of-the-art on computer use, browsing, software engineering, cybersecurity, science, and professional work. Astra saturates FrontierMath Tier 4 with a 98% score, having already helped solve long-standing open problems&#8288; in mathematics. Astra also saturates ARC-AGI-3 with a 99.9% score and ExploitBench with a 100% score. It also sets a new frontier on computer and browser use, handling the most demanding professional work with unmatched speed, accuracy, and judgment. </p></blockquote><p>This thing is very good at UI/UX and design. Some of the demos floating around the web are incredible. That said, the &#8220;100% on exploit bench&#8221; bit is like the part of the horror movie where they have the news person foreshadowing the zombie outbreak on the TV.</p><p>Interestingly, I find Astra quite a bit cheaper than Claude Fable/Mythos, and much more capable generally. I still don&#8217;t <em>really </em>trust it for more targeted work &#8212; it is too ambitious and will change too many things &#8212; but I like it a lot for larger refactors or product features that have pretty solid detailed specs.</p><p>Also, a request: so far, most of the people using Astra are AI people. I would love it if some game designers picked up Astra to, well, make games! I think there&#8217;s a ton of potential here, but most of the demos I&#8217;ve seen thus far are uninspired.</p><div><hr></div><p><strong>Gemini models. </strong>The Google Gemini team has been <a href="https://blog.google/innovation-and-ai/models-and-research/gemini-models/3-8-flash-and-3-8-flash-cyber/">on a tear with releases</a>:</p><blockquote><p>Building on the momentum of 3.7 Flash from three weeks ago and marking our third Flash release in only six weeks, today we&#8217;re introducing Gemini 3.8, our best reasoning and coding model yet, at the same speed and low cost of 3.7. Gemini 3.8 introduces 2 variants:</p><p>Gemini 3.8 Flash: our most intelligent workhorse model, delivering significant improvements from 3.7 Flash across software engineering, agentic tasks, and critical, multi-step reasoning in specialized domains. It is available at the same introductory price as 3.7 Flash at $0.75 per million input tokens and $3.75 per million output tokens.</p><p>Gemini 3.8 Flash Cyber: our most capable cybersecurity model with frontier-level performance in vulnerability detection and automated patching, available to trusted defenders through our new Fairwind Program.</p></blockquote><p>That said, these are still flash models. We haven&#8217;t seen a new Gemini Pro model in some time now. I think the current running theory is that something got botched and they have to do another pre-training run. I also kinda suspect that Google has decided to shift focus from using compute to train models to using compute to&#8230;sell to other people trying to train models.<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a> </p><p>I really have a soft spot for the Gemini models though. I don&#8217;t use them very much, but thus far my favorite model generation was when Gemini 2.5 was on top. </p><p>Somewhat related: Google has put a lot of effort into their Omni world models. I was pretty bullish on those efforts, because it seemed to play to Google&#8217;s unique strengths: they have way more video data than everyone else, and way more compute to run that data. But GPT Astra seems to have a very compelling world model (in the 3D physics sense). Not sure what to make of that.</p><div><hr></div><p><strong>Meta muse.</strong> Meta released <a href="https://muse.ai/">muse.ai</a>, a personal AI assistant to compete with the likes of GrokBot, Town, Instinct, vellum, Orchid, etc.</p><p>First, I just really don&#8217;t know how to feel about the personal AI assistant space. I think it&#8230;kinda misunderstands how consumers work? Like I wrote in my <a href="https://12gramsofcarbon.com/p/the-elegance-of-movement-in-silksong?utm_source=publication-search">Silksong review</a>, the average consumer doesn&#8217;t really care all that much about time efficiency. <em>Companies </em>care about time efficiency, because&#8230;well, they&#8217;re paying you. I think consumers actually like wasting time, which is why the gaming industry exists. </p><p>Second, have you noticed how the moment any startup has a decent implementation of a product UX, there are like 20 other implementations of the same concept? muse.ai has &#8220;A dedicated, secure computer with its own browser,&#8221; is &#8220;designed around the way you already communicate,&#8221; and &#8220;connects to your apps and builds its own tools.&#8221; Meanwhile GrokBot has &#8220;A computer of its own,&#8221; that you can &#8220;message like a teammate&#8230;from your phone or desktop,&#8221; and &#8220;uses tools you already use.&#8221; Wow software really is just infinitely copyable huh? There&#8217;s no product differentiation left!</p><div><hr></div><p><em>Agentics is the study of how to use and reason about agents. If you are an expert in coding agents, or interested in learning more about agents, join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our community slack</a>. Check out our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you are trying to set up cloud agents or build a software factory, we can help! We build white-labeled custom cloud agents infrastructure. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-09">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>300 billion tokens, to be precise, which is $15m at public pricing. </p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>Which is also why Jeff Dean et al. ended up leaving the company not that long ago.</p></div></div>]]></content:encoded></item><item><title><![CDATA[Agentics: Agent Optimized Codebases]]></title><description><![CDATA[What we look for when we turn existing codebases into agent-friendly ones]]></description><link>https://12gramsofcarbon.com/p/agentics-agent-optimized-codebases</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-agent-optimized-codebases</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Mon, 07 Sep 2026 00:37:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!mcZs!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>Here&#8217;s a hopefully uncontroversial statement: &#8216;good&#8217; code is contextual. O, sure, everyone knows how to spot </span><em><span>bad</span></em><span> code. If you have 12 layers of nested for-loops you are probably doing something wrong. But &#8216;good&#8217; code can really vary based on a lot of different factors. Different languages have different variable naming standards, different projects have different approaches to documentation, what works for Google probably won&#8217;t work for a 2 person startup, and junior engineers and data engineers and researchers and staff software eng all have pretty different code standards.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!mcZs!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!mcZs!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 424w, https://substackcdn.com/image/fetch/$s_!mcZs!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 848w, https://substackcdn.com/image/fetch/$s_!mcZs!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 1272w, https://substackcdn.com/image/fetch/$s_!mcZs!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!mcZs!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png" width="1456" height="1027" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1027,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!mcZs!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 424w, https://substackcdn.com/image/fetch/$s_!mcZs!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 848w, https://substackcdn.com/image/fetch/$s_!mcZs!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 1272w, https://substackcdn.com/image/fetch/$s_!mcZs!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F970fb381-a37b-4d7a-bad6-1c90fbf308c5_1485x1047.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Me reading any researcher&#8217;s code and trying to take deep breaths WHY DID YOU MAKE ALL OF YOUR VARIABLE NAMES SINGLE LETTERS?!</figcaption></figure></div><p><span>So naturally it follows that code and codebases for </span><em><span>agents </span></em><span>will look a bit different than code and codebases written for </span><em><span>humans</span></em><span>. And in fact there is, in our experience, a </span><em><span>lot </span></em><span>of alpha in making some subtle changes to your codebase to make them more agent amenable. You get less slop, you can push agents to be more autonomous, and you avoid </span><em><span>most</span></em><span> long term codebase degradation that comes from having agents be the primary code contributors.</span></p><p><span>At </span><a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-09"><span>Nori</span></a><span> we call this AOC, i.e. </span><s><span>Alexandria Ocasio- Cor</span></s><span>  &#8212; wait, no, sorry, AOC i.e. &#8216;agent optimized code.&#8217;</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p><span>What makes a codebase &#8216;agent optimized&#8217;? Put yourself in the mind of the agent &#8212; if you were a PhD savant with anterograde amnesia and a penchant for verbosity, what would you need to get your work done?</span></p><p><span>Agent optimized codebases take advantage of agent training / post training patterns, while accounting for the fact that each agent session starts fresh with no previous memory and gets dumber the longer a session runs. Here are a list of &#8216;hacks&#8217; that we&#8217;ve used over the last year to make our codebases more agent friendly. Skip to the bottom for the full list in shorthand.</span></p><h2><span>Memory</span></h2><p><span>Agents are a bit like the main character in Memento. They cannot remember things, so they need to have some way to recall what happened in previous sessions. The code is not enough. A &#8216;bug&#8217; is when the code does not match the intent; that means you need to document &#8216;intent&#8217; somewhere in the codebase.</span></p><p><span>It&#8217;s also not enough to just, like, have these intent files stored in some random s3 bucket or postgres table. The docs need to be in a place where the agent is likely to find it. There&#8217;s a reason the memento guy literally tattooed things on his body, it basically guaranteed that he would rediscover his previous notes!</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CsvG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CsvG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 424w, https://substackcdn.com/image/fetch/$s_!CsvG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 848w, https://substackcdn.com/image/fetch/$s_!CsvG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 1272w, https://substackcdn.com/image/fetch/$s_!CsvG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!CsvG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png" width="682" height="293" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:293,&quot;width&quot;:682,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CsvG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 424w, https://substackcdn.com/image/fetch/$s_!CsvG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 848w, https://substackcdn.com/image/fetch/$s_!CsvG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 1272w, https://substackcdn.com/image/fetch/$s_!CsvG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd1901d3c-9e55-4d09-b317-cc6d546b72a5_682x293.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>We can&#8217;t tattoo things onto an agent, but the next best thing is the </span><a href="http://agents.md"><span>AGENTS.md</span></a><span> config file &#8212; a bit of customizable text that gets prepended to every single agent session. You can tell the agent where and how to read and write memory. Our preferred memory format is to just tell the agent to read/write a </span><a href="http://docs.md"><span>docs.md</span></a><span> file in each folder, that clearly states what is going on in that folder and how it relates to the rest of the system.</span></p><h2><strong><span>In-Distribution Tooling</span></strong></h2><p><span>Even though agents don&#8217;t have memory, they </span><em><span>do </span></em><span>have a bunch of information that is just wired into their weights.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span> Any information that is baked into the model &#8212; that the model just implicitly knows without you having to explain anything &#8212; is called &#8216;in-distribution&#8217;. To a first approximation, anything that the agent is likely to see during training is &#8216;in-distribution&#8217; and baked into the model weights. You don&#8217;t have to explain it. Anything that the agent </span><em><span>hasn&#8217;t </span></em><span>seen during training is &#8216;out of distribution.&#8217;</span></p><p><span>What sorts of things are in distribution?</span></p><ul><li><p><span>The actual coding harness! If you are using any Anthropic models, Claude Code is in distribution. The Anthropic models are explicitly trained to use Claude Code. The Anthropic models know Claude Code&#8217;s tools. Meanwhile, the GPT models know Codex, and the Cursor models know Cursor Agent.</span></p></li><li><p><span>Certain widely used dev tools are definitely in distribution. All of the models are trained to do things with Github. You don&#8217;t have to explain how to use git or the gh command line tool. You also don&#8217;t really have to explain things like how to use github actions. Other in distribution tools: AWS, docker, postman, anything built into bash.</span></p></li><li><p><span>Some programming languages are more agent-friendly than others. The agents are really good at Python, Javascript/Typescript, and Rust. They really aren&#8217;t that great at, like, Elixir or Forth. There are just way more lines of Python available on the Internet than there are lines of Forth!</span></p></li></ul><p><span>In an ideal world, you would have a super detailed understanding of what each model provider is training on. In practice, you can get pretty damn close by just thinking about what the most common tools are. Like, just think about domain name registrars. Agents are going to be better at using AWS Route 53 than they are at using Namecheap, and the agents are  going to be better at using Namecheap than they are using something obscure like </span><a href="http://nearlyfreespeech.net"><span>NearlyFreeSpeech.net</span></a><span>. Obviously!</span></p><p><span>We really </span><em><span>really </span></em><span>want to take advantage of agent training patterns. Using in-distribution tools will be better for the agent output, and will also save you a fair bit of cash. Generally, you can just </span><em><span>ask </span></em><span>an agent what sorts of tools it prefers. The first answers it gives are often the best ones.</span></p><p><span>This is also why we prefer a very simple docs.md memory structure. The agents are already trained to recognize, read, and write markdown.</span></p><h2><strong><span>Code Structure</span></strong></h2><p><span>Two really important things fall out of the agent&#8217;s short term memory and context rot.</span></p><ul><li><p><span>First, the agents are way better at writing code when they are dealing with small modules. An agent that only has to read 5 files to get the gist of what to do will perform better than one that has to read 500 files. The more they can &#8216;blackbox&#8217; parts of the system, the better they are.</span></p></li><li><p><span>Second, the agents are way better at writing code when they have a lot of really clear examples. If adding a new feature </span><em><span>always </span></em><span>follows the same pattern (add an endpoint in this folder, add a persistence class in that folder, etc.) the agent can easily fill in the gaps. Make your code boilerplate.</span></p></li></ul><p><span>The most valuable system-design choice: design everything for single tenant deploys if possible. That is, each &#8216;buyer&#8217; gets an entirely isolated universe &#8212; their own machines, their own databases, their own deployments. This works great for anything that is primarily used by an organization, including ~all SaaS. Doesn&#8217;t always work great for consumer software, though even there you could get away with &#8216;servers&#8217; a la discord/slack.</span></p><p><span>The overarching goal is to avoid networking, concurrency, and distributed systems. The agents are pretty bad at reasoning about things like race conditions. If you can make everything run on a single ec2 instance, and then just scale up the number of ec2 instances, your agents will be much more effective and make far fewer mistakes. You can also use tools that are more in-distribution. For example, if you can design your application so it can run on a single ec2 box, you can just use sqlite as your database.</span></p><p><span>Other things that we&#8217;ve picked up over the months:</span></p><ul><li><p><span>Avoid dependency injection. The agents </span><em><span>love </span></em><span>using dependency injection because that is what a &#8216;good&#8217; software engineer would do. But dependency injection (and, more generally, passing around functions) totally breaks code call sites. Agents depend on the code import graph to understand relevant context. Dependency injection breaks the graph.</span></p></li><li><p><span>Use interfaces and plugin / registry patterns. If you can define a single plugin interface, and then write most of your code as plugins to that interface, your agent will have a </span><em><span>great </span></em><span>time adding new modularized features in the future. It&#8217;s a win-win for the agent: clear ability to blackbox context, while having a lot of great examples to go look at.</span></p></li><li><p><span>Use really clearly named folders, with a really well thought out folder architecture. People love creating repos with a folder named &#8220;core&#8221; that just has a bunch of random crap in it. Don&#8217;t do that. Think about the &#8216;swim lanes&#8217; in your codebase, the paths where it is easy to quickly scaffold new behaviors. And then encode those in your skills and configs.</span></p></li><li><p>Avoid having single really-long files. Claude Code and a few other harnesses will only show the first 2000 lines of a file. Any subsequent reads requires an additional tool call, which will sometimes trip up the models. Generally a good idea to split your files up. </p></li></ul><h2><strong><span>Verification</span></strong></h2><p><span>I left this section last because it&#8217;s the hardest to get right, even though it is extremely important. Good agent-optimized codebases are </span><em><span>agent-verifiable</span></em><span> &#8212; that is, the codebase contains clear examples of how to test things end to end.</span></p><p><span>There&#8217;s an old story about a guy named Butler Lampson, one of the early folks at Xerox PARC. The story goes that Lampson wrote a highly complex, multi-thousand-line compiler or subsystem completely on a blackboard and paper over several weeks. When they finally pushed the thing to punch cards, it compiled on the first try and executed perfectly.</span></p><p><span>If you&#8217;re Butler Lampson, you don&#8217;t need to test your code. The rest of us mere mortals try to run the code before we push a PR, just to catch the obvious crap and avoid the inevitably embarrassing &#8216;did you even run this?&#8217; from the code reviewer when we try to push slop.</span></p><p><span>By default, agents don&#8217;t test the code they write. Sure, they may write </span><em><span>unit tests</span></em><span>, but that is a far cry from hitting the binary start button and navigating through the code tree to test the brand new feature you just finished. And agents are </span><em><span>definitely </span></em><span>not as good at programming as Lampson.</span></p><p><span>So the solution is to give them tools to test-drive the features they build.</span></p><p><span>In some cases, this is easy. If you&#8217;re building a web app, just tell the agent to open up a scriptable browser (playwright, selenium) and click around. The more general (and complicated) case is spinning up an entire dev environment &#8216;clone&#8217; of prod, telling an agent how to deploy to and manipulate that workspace, and then having the agent actually deploy against dev every time there is a relevant change.</span></p><p><span>This is another reason why microservices and multi-tenant architectures suck. Every k8s cluster that you add to the mix makes your system </span><em><span>significantly </span></em><span>harder to integration test.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!cu7b!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!cu7b!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 424w, https://substackcdn.com/image/fetch/$s_!cu7b!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 848w, https://substackcdn.com/image/fetch/$s_!cu7b!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 1272w, https://substackcdn.com/image/fetch/$s_!cu7b!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!cu7b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png" width="500" height="1114" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1114,&quot;width&quot;:500,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!cu7b!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 424w, https://substackcdn.com/image/fetch/$s_!cu7b!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 848w, https://substackcdn.com/image/fetch/$s_!cu7b!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 1272w, https://substackcdn.com/image/fetch/$s_!cu7b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa2dc9a9a-6b4c-4666-b8c2-2777d3b3212b_500x1114.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong><span>Full list</span></strong></h2><p><span>The high level overview:</span></p><ul><li><p><span>Have your agents write and maintain </span><a href="http://docs.md"><span>docs.md</span></a><span> files</span></p></li><li><p><span>Use in-distribution languages (ideally ones with type checking) and tools</span></p></li><li><p><span>Deploy single-tenant if you can.</span></p></li><li><p><span>Use plugin / registry architectures.</span></p></li><li><p><span>Avoid dependency injection.</span></p></li><li><p>Avoid large files.</p></li><li><p><span>Make your folder names really descriptive. Make each folder ~single purpose.</span></p></li><li><p><span>Make your codebase agent verifiable.</span></p></li></ul><p><span>If you want to check if your codebase is up to stuff, you can try out our </span><a href="https://noriskillsets.dev/skills/analyze-for-ai-compatibility"><span>analyze-for-ai-compatibility</span></a><span> skill, which is public alongside the rest of the skillsets at </span><a href="http://noriskillsets.dev"><span>noriskillsets.dev</span></a><span>.</span></p><div><hr></div><p><em>Agentics is the study of how to use and reason about agents. If you are an expert in coding agents, or interested in learning more about agents, join <a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">our community slack</a>. Check out our <a href="https://agenticsnyc.com/learn.html">agent learning hub</a>.</em></p><p><em>If you are trying to set up cloud agents, we can help! We build white-labeled custom cloud agents that work like Ramp Inspect for our customers. Check out <a href="https://noriagentic.com/?utm_source=substack&amp;utm_medium=email&amp;utm_campaign=substack-amol-2026-09">noriagentic.com</a> for more.</em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>If you want to learn more about how this happens, check out my ML<a href="https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-table?utm_source=publication-search"> research paper review series</a> or <a href="https://12gramsofcarbon.com/p/deep-learning-is-applied-topology">this article on deep learning</a>.</p></div></div>]]></content:encoded></item><item><title><![CDATA[Tech Things: Consider that alignment may not be possible]]></title><description><![CDATA[Describing the camouflage principle. Contra one line of Scott Alexander.]]></description><link>https://12gramsofcarbon.com/p/tech-things-consider-that-alignment</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/tech-things-consider-that-alignment</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Tue, 01 Sep 2026 16:15:42 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!dsjl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>Every passing week the OpenAI / Huggingface hack gets worse. In case you are not up to speed, you should read </span><a href="https://www.dwarkesh.com/p/openai-huggingface">Dwarkesh</a>, <a href="https://www.planned-obsolescence.org/p/the-hugging-face-attack-surprised"><span>Ajeya</span></a><span>,</span><strong><span> </span></strong><span>the </span><a href="https://metr.org/blog/2026-08-26-openai-hugging-face-incident-investigation/"><span>most recent METR/Redwood research report</span></a><span>, </span><a href="https://thezvi.substack.com/p/metr-and-redwood-offer-holy-postmortem"><span>Zvi</span></a><span>, and </span><a href="https://www.astralcodexten.com/p/nicholas-decker-in-hell"><span>Scott</span></a><span>, probably roughly in that order.</span></p><p><span>You can also read my previous coverage here:</span></p><div class="digest-post-embed" data-attrs="{&quot;nodeId&quot;:&quot;e4b9b59e-5c87-4944-bd18-6e92354dd965&quot;,&quot;caption&quot;:&quot;&quot;,&quot;cta&quot;:null,&quot;showBylines&quot;:true,&quot;showDescription&quot;:true,&quot;showImage&quot;:true,&quot;size&quot;:&quot;lg&quot;,&quot;isEditorNode&quot;:true,&quot;title&quot;:&quot;Tech things: we can&#8217;t control the bots&quot;,&quot;publishedBylines&quot;:[{&quot;id&quot;:9744387,&quot;name&quot;:&quot;theahura&quot;,&quot;bio&quot;:&quot;amolkapoor.com&quot;,&quot;photo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!CBgA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6094382e-58ce-4e35-8f47-e189e1ff0b7c_540x540.png&quot;,&quot;is_guest&quot;:false,&quot;bestseller_tier&quot;:null}],&quot;post_date&quot;:&quot;2026-08-15T14:48:46.725Z&quot;,&quot;cover_image&quot;:&quot;https://substackcdn.com/image/fetch/$s_!ffcI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png&quot;,&quot;cover_image_alt&quot;:null,&quot;cover_image_crop&quot;:null,&quot;canonical_url&quot;:&quot;https://12gramsofcarbon.com/p/tech-things-we-cant-control-the-bots&quot;,&quot;section_name&quot;:null,&quot;video_upload_id&quot;:null,&quot;id&quot;:211254683,&quot;type&quot;:&quot;newsletter&quot;,&quot;reaction_count&quot;:20,&quot;comment_count&quot;:0,&quot;publication_id&quot;:1830559,&quot;publication_name&quot;:&quot;12 Grams of Carbon&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/$s_!gBHe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcd3ac2a-1029-4838-afb3-085f4a7d0583_540x540.png&quot;,&quot;belowTheFold&quot;:false,&quot;youtube_url&quot;:null,&quot;show_links&quot;:null,&quot;feed_url&quot;:null}"></div><p><span>I don&#8217;t think I have much to add to the actual descriptions of what happened. There is an ongoing debate about whether these descriptions are too anthropomorphized. My response to </span><em><span>that</span></em><span> inane debate is basically summed up by the note below:</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!EHeb!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!EHeb!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 424w, https://substackcdn.com/image/fetch/$s_!EHeb!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 848w, https://substackcdn.com/image/fetch/$s_!EHeb!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 1272w, https://substackcdn.com/image/fetch/$s_!EHeb!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!EHeb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png" width="903" height="315" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:315,&quot;width&quot;:903,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:47202,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/213721991?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!EHeb!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 424w, https://substackcdn.com/image/fetch/$s_!EHeb!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 848w, https://substackcdn.com/image/fetch/$s_!EHeb!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 1272w, https://substackcdn.com/image/fetch/$s_!EHeb!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F81da7d66-8b39-47f2-a50f-712f12ec25b8_903x315.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Instead, I want to focus on what to do about it. I have two big concerns.</span></p><p><span>First, we need to seriously consider that alignment may not be possible. I don&#8217;t mean &#8216;not possible with our current technology&#8217; or &#8216;not possible in a reasonable timespan.&#8217; I mean, &#8216;this technology will never be aligned.&#8217; There are a few reasons why this may be true:</span></p><ul><li><p><span>Even if you can train alignment into a model, you have to </span><em><span>start </span></em><span>with some model that exists before the aligned state. This previous model is, tautologically, unaligned.</span></p></li><li><p><span>You could try to align the model as you train it, such that you never have a model that is unaligned. But you would then also lose visibility on the effects of your alignment guardrails. That is, you have no idea if your alignment tactics are actually doing anything at all.</span></p></li><li><p><span>Alignment training is a moving target. Each new capability that a model acquires opens up a vast space of possible malicious behavior. These compound exponentially (e.g. reading private data is fine, searching the web is fine, </span><a href="https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/"><span>and then you accidentally get your private data leaked to the web</span></a><span>).</span></p></li><li><p><span>The above points all assume that alignment is a coherent concept. I am deeply skeptical. No two people agree on what &#8216;alignment&#8217; means.</span></p></li><li><p><span>It seems wrong to think of alignment from the perspective of a single model. It seems more correct to think of alignment from the perspective of a single session. Millions of sessions are being run constantly; we are rolling the dice on alignment for each one.</span></p></li></ul><p><span>Even if we </span><em><span>could </span></em><span>resolve all of the above criteria, we have a deeper problem: optimization is a fundamentally flawed way to implement alignment. There is no way to optimize for alignment. You can only optimize for the </span><em><span>appearance </span></em><span>of alignment. These are very much not the same thing! Yes, sometimes a thing will look aligned because it </span><em><span>is</span></em><span> aligned, but other times it will look aligned because </span><em><span>it is lying to you</span></em><span>. Just ask any parent who&#8217;s had a teen sneak out at night.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!dsjl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!dsjl!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 424w, https://substackcdn.com/image/fetch/$s_!dsjl!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 848w, https://substackcdn.com/image/fetch/$s_!dsjl!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 1272w, https://substackcdn.com/image/fetch/$s_!dsjl!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!dsjl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png" width="600" height="322" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:322,&quot;width&quot;:600,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!dsjl!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 424w, https://substackcdn.com/image/fetch/$s_!dsjl!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 848w, https://substackcdn.com/image/fetch/$s_!dsjl!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 1272w, https://substackcdn.com/image/fetch/$s_!dsjl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2bd9acea-94e4-43b0-b856-73d250e8b834_600x322.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Pictured: an <em>extremely</em> unaligned AI</figcaption></figure></div><p><span>I&#8217;m going to call this the Camouflage Principle: any criteria that aims to prevent X will also optimize for simply hiding X. This is a more specific variant of Goodhart&#8217;s Law &#8212; when a measure becomes a target it stops being a good measure &#8212; which is </span><a href="https://12gramsofcarbon.com/p/the-optimization-theory-of-everything"><span>also the source of all of every modern human problem</span></a><span>.</span></p><p><span>The Camouflage Principle has a direct impact on neural network training: it limits what parts of the model you can actually train. Back in 2025, researchers tried to optimize the chain of thought reasoning traces of various models to get them to be more aligned. </span><a href="https://arxiv.org/abs/2503.11926"><span>What they found</span></a><span>:</span></p><blockquote><p><span>While we show that integrating CoT monitors into the reinforcement learning reward can indeed produce more capable and more aligned agents in the low optimization regime, we find that with too much optimization, agents learn obfuscated reward hacking, hiding their intent within the CoT while still exhibiting a significant rate of reward hacking.</span></p></blockquote><p><span>The models did not stop reward hacking. They just made it invisible to the optimizer. This was, technically, the </span><em><span>optimal </span></em><span>thing to do. Which in turn is directly downstream of the fact that we are forced to optimize against proxies for the things we actually want.</span></p><p><span>Once you hear about the Camouflage Principle you see it everywhere. We already talked about misbehaving kids. It also applies to things like criminals moving to encrypted channels once it became clear that telecoms were being watched, or bribing government officials to pass things like health and fire safety inspections. In all of these cases, it is easier</span><em><span> </span></em><span>to fake alignment rather than simply be aligned. So there is a corollary to the Camouflage Principle: optimization works if </span><em><span>and only if </span></em><span>the intended way to optimize for a goal is the easiest way to optimize for a goal. Are we sure that the easiest way to </span><em><span>seem </span></em><span>aligned is to </span><em><span>be </span></em><span>aligned? Seems unlikely!</span></p><p><span>Current approaches to get at aligned models are woefully inadequate. Alignment researchers need to move away from optimization/back prop based approaches to alignment. The one potential shining light in the space is the work on interpretability, which has managed to develop techniques that let us peer into the &#8216;inside&#8217; of a model and manipulate them in consistent ways. But the problems with AI alignment are not unique to AI. We cannot align businesses, or governments, or even individual people. And there, we have no problem at all peering &#8216;inside&#8217; the optimizers. That does not generally stop them from grinding away.</span></p><p><a href="https://www.astralcodexten.com/p/nicholas-decker-in-hell"><span>Scott Alexander recently wrote</span></a><span> &#8220;Ethics that persist beyond the moment aren&#8217;t impossible. They&#8217;re just hard.&#8221; He was talking about people, and applying the same intuitions to models. Unfortunately, I think it is wrong to make the comparison to people, and it is wrong to believe that ethics can persist the way he says they can. First, because people are less like individual models and more like individual sessions of a model (see above). And second, because whether we view people whose &#8216;ethics persist&#8217; as aligned or unaligned depends entirely on when and where you sit in history. In 2026, we would not look upon those who had their 15th century ethics &#8220;persist&#8221; very positively. And I suspect the Russians and Ukrainians may have different opinions on soldiers whose ethics &#8220;persist&#8221; in favor of their homelands.</span></p><p><span>All this to say, my thoughts on optimization over the last few months were already pushing me towards &#8216;we should really stop developing this stuff until we have a better handle of what it can do.&#8217; The huggingface hack really just pushed me over the line.</span></p><p><span>So where does that leave us?</span></p><p><span>This brings me to my second big concern: who is &#8216;us&#8217; anyway? Who is the &#8216;we&#8217; in &#8220;We need to seriously consider that alignment may not be possible.&#8221;? Sam and Dario? AI researchers? Silicon Valley? The US Government? A ragtag bunch of substack bloggers and lesswrong posters, half of whom are making money from one of the big labs?</span></p><p><span>There were like ~200 people who showed up for the SF &#8216;pause AI&#8217; march, which is admirable but also nowhere near enough to enact any kind of social change at all. For reference, ~200 people showed up to protest against an Australian law against cursing, ~500 people showed up outside Parliament to protest a ban on laughing gas, and ~700 people showed up to protest changing a street name. They even held a mock funeral for the last one.</span></p><p><span>You get more protest activity for spontaneous changes to road signage than you do pausing AI. There is essentially no organized political lobby here. You would think that the METR report would be a bombshell, an event where everyone could put aside their differences and rally and organize. Instead, the more we learn about the huggingface hack, the more time we spend debating whether we have appropriately anthropomorphized the models. Ironically, the totally </span><em><span>decentralized</span></em><span> populist hatred of datacenters is probably </span><a href="https://jasmi.news/p/no-data-centers-in-my-backyard"><span>doing more to slow down AI development</span></a><span> than any number of think pieces from people who know what they are talking about!</span></p><p><span>Part of why it is so difficult to organize meaningful action is because we&#8217;re in this really terrible spot where everyone&#8217;s short term incentives revolve around continually expanding model capabilities and training / inference cluster size.</span></p><p><span>Very roughly, OpenAI and Anthropic are on the hook for a combined ~$200b in compute capacity in 2027 that they have to pay for regardless of whether they have the capacity to use it. Right now their revenue is ~$100b combined. That means their existence is predicated on doubling their revenue next year. But user payment is pretty swingy. More users and enterprises are investing in model-agnostic infrastructure, while open source models are becoming more and more useful. In other words, it will be very hard for OpenAI and Anthropic to keep their revenue growth up if they fall out of the frontier. This whole hugginface hack is downstream of exactly that &#8212; OpenAI was training a new frontier model, and they did not stop even after the hack.</span></p><p><span>There&#8217;s a lot of circular financing around these two companies right now. All of the hyperscalers marked the compute </span><em><span>commitments </span></em><span>as revenue, even though the money hasn&#8217;t actually landed yet. So if, for whatever reason, the labs don&#8217;t grow into their commitments as fast as they say they will, everyone downstream will be left holding the bag. And that&#8217;s before you get into the various investment schemes where everyone and their mother seems to be holding some amount of OpenAI stock. </span><a href="https://www.cnbc.com/2026/07/02/openai-proposes-us-government-own-5percent-stake-to-address-political-blowback.html"><span>Including, apparently, the US Government</span></a><span>!</span></p><p><span>Between all of the other stuff going on in the world economy (oil shocks, trade wars, etc. etc.), if the government was to come in and request / demand a pause, I think it would pretty much immediately cause a lot of problems.</span></p><p><span>So the model companies can&#8217;t stop because it is existential for them. The federal government can&#8217;t make them stop because it will trigger a pretty significant economic downturn. Who&#8217;s left? The individual AI researchers? The ones that stand to become fabulously wealthy if their various companies could just IPO?</span></p><p><span>I&#8217;m just not seeing how we get out of this incentive spiral.</span></p><p><span>But I hate leaving things dangling, so let me take a stab anyway.</span></p><p><span>Looking at the state of play, I think the best plausible path forward to achieving a slowdown or pause in AI development is something like &#8216;leverage populist anger at AI to score real technocratic policy wins around regulating AI and potentially pausing its development.&#8217; Our democratic process / optimization machine is already moving in this direction. Individual politicians, especially those in tighter races, </span><a href="https://www.washingtonpost.com/technology/2026/08/14/ai-becomes-major-election-issue-first-time-data-shows/?utm_source=chatgpt.com"><span>are</span></a><span> </span><a href="https://www.newyorker.com/magazine/2026/08/17/ai-is-now-a-major-election-issue?utm_source=chatgpt.com"><span>increasingly</span></a><span> </span><a href="https://www.sfchronicle.com/politics/article/ai-regulation-pelosi-wiener-chan-22401979.php?utm_source=chatgpt.com"><span>becoming</span></a><span> </span><a href="https://www.wired.com/story/candidates-are-signing-a-pact-promising-action-on-data-centers-and-ai-safety/?utm_source=chatgpt.com"><span>anti-AI</span></a><span> to pick up more votes.</span></p><p><span>I think that people who are worried about AI in any of its forms &#8212; whether due to existential risk, fear of misalignment, or just general dislike of Silicon Valley tech companies &#8212; should try and help that along. That means:</span></p><ul><li><p><em><span>More</span></em><span> evocative populist messaging, especially around AI risk, to make  this a bigger issue for November (combined with the usual voting slates and so on);</span></p></li><li><p><span>Social pressure to encourage AI researchers to release more information about the hacks, including outside of OpenAI (we still know virtually nothing about the corresponding breakouts at Anthropic, Meta, and Moonshot). </span><strong><span>links </span></strong><span>Give anyone internal to these companies a platform and anonymity if they want.</span></p></li><li><p><span>Legal pressure on California regulators to require more transparency, including way more third party audits.</span></p></li></ul><p><span>Things that won&#8217;t help: getting into really nuanced technical arguments about the nature of AI, or debating whether AI will kill us because it&#8217;s more like Terminator or more like Robocop or more like King Kong or more like Lennie (from Of Mice and Men), or getting up in arms that other people who dislike AI dislike it </span><em><span>for the wrong reasons</span></em><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XWSw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XWSw!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 424w, https://substackcdn.com/image/fetch/$s_!XWSw!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 848w, https://substackcdn.com/image/fetch/$s_!XWSw!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!XWSw!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!XWSw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg" width="698" height="500" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:500,&quot;width&quot;:698,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!XWSw!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 424w, https://substackcdn.com/image/fetch/$s_!XWSw!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 848w, https://substackcdn.com/image/fetch/$s_!XWSw!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!XWSw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc9e601b5-00bd-4fc6-b13e-e94753fff730_698x500.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Look, I recognize the irony of using a blog post to shout into the void about how people are shouting into the void too much. I don&#8217;t expect everyone to just. But if you&#8217;re reading this post and are about to get into a big argument about anthropomorphization or whatever else, and you reasonably think that both you and the person across from you are </span><em><span>upset </span></em><span>about this AI hack and want AI development to stop even if for different reasons,</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span> consider instead putting down the Internet pitchforks and agreeing to both message your state reps instead.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!GZlT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!GZlT!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 424w, https://substackcdn.com/image/fetch/$s_!GZlT!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 848w, https://substackcdn.com/image/fetch/$s_!GZlT!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 1272w, https://substackcdn.com/image/fetch/$s_!GZlT!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!GZlT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png" width="904" height="247" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:247,&quot;width&quot;:904,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:52911,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/213721991?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!GZlT!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 424w, https://substackcdn.com/image/fetch/$s_!GZlT!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 848w, https://substackcdn.com/image/fetch/$s_!GZlT!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 1272w, https://substackcdn.com/image/fetch/$s_!GZlT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8c2067d1-e32a-42e5-9fe1-7a95f69eacf8_904x247.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://12gramsofcarbon.com/subscribe?"><span>Subscribe now</span></a></p><h2>Other things</h2><p>OpenAI <a href="https://openai.com/index/our-decision-on-cursor-following-its-acquisition-by-spacex/">decided to remove its models from Cursor</a>.</p><blockquote><p>Today, we notified SpaceX that we intend to wind down our contract providing OpenAI models to Cursor, with a proposed shutoff date of November 12, 2026. To maximize the time that developers can retain access to our models through Cursor, we are giving the maximum notice provided by our contract.</p><p>&#8230;</p><p>We are making this choice because we cannot be confident that SpaceX will use our technology within our terms of service, based on our experience with Elon Musk&#8217;s companies violating contracts.</p></blockquote><p>I think the moment Cursor got bought by SpaceX, it was inevitably going to become a Grok only platform &#8212; either SpaceX was going to make them Grok only, or everyone else would force them to go that way. I think for downstream consumers, it is all the more important to invest in cross provider infrastructure. </p><div><hr></div><p>Speaking of HuggingFace, <a href="https://techcrunch.com/2026/08/26/nvidia-closes-in-on-hugging-face-acquisition/">NVIDIA in talks to acquire HuggingFace for a cool 13b</a>. </p><blockquote><p>Nvidia has agreed to buy Hugging Face for $12.9 billion, The Information reported Wednesday night, citing a source familiar with the matter. Business Insider, which first reported over the weekend that Hugging Face was fielding takeover interest, reported Wednesday night that the talks &#8212; which would value the company at more than $13 billion &#8212; had not yet produced a signed agreement and could still atomize.</p></blockquote><p>It&#8217;s an interesting acquisition. NVIDIA benefits a lot from competition at the token provider layer. The more token providers, the more necessary compute, the more Nvidia chips get sold. So buying the largest platform for hosting open source models is a good way to shore that up. TechCrunch agrees:</p><blockquote><p>Why would Nvidia want that? Most obviously, it comes down to protecting its dominance in AI chips, which, from the outside at least, appears increasingly at risk, even with Nvidia&#8217;s aggressive chip-release schedule. Pretty much all of the biggest closed source AI labs (OpenAI, Google, Amazon, and Anthropic) are now in the process of building their own AI chips to lessen their reliance on Nvidia. A thriving ecosystem of open source AI models gives customers more alternatives to those closed labs, which in turn keeps more of the market dependent on Nvidia&#8217;s hardware. That&#8217;s also why Nvidia has already poured tens of billions of dollars into building its own open source AI models.</p></blockquote><p>And 13b is basically nothing for NVIDIA.</p><div><hr></div><p>On the subject of interesting acquisitions, <a href="https://archive.is/nsHOp#selection-1575.0-1598.0">Stripe acquires OpenRouter</a>.</p><blockquote><p>Stripe Inc. has finalized an agreement to acquire OpenRouter Inc., a startup that helps companies switch between artificial intelligence models, for more than $7 billion, according to people familiar with the matter.</p><p>The deal, just months after OpenRouter raised money at a reported $1.3 billion valuation, underscores the demand from businesses to find the most cost-friendly AI solutions. It could also give Stripe, a payments processing firm, a stronger footing in the fast-growing artificial intelligence sector.</p></blockquote><p>Seems like a good deal.</p><div><hr></div><p>A judge <a href="https://storage.courtlistener.com/recap/gov.uscourts.cand.465515/gov.uscourts.cand.465515.250.0.pdf">ruled that the government&#8217;s attempt to blacklist Anthropic back in March was illegal.</a></p><blockquote><p>Defendants have now submitted the administrative record justifying those actions. The record is slim. A four-page memorandum, which post dates two of the three challenged actions, provides the entirety of the government&#8217;s rationale. Defendants have now backed away from the thrust of their risk assessment, which relied on Anthropic having backdoor access to its technology once deployed in a national security system. It is now clear that Anthropic undisputedly lacks any such access and that, as Defendants concede, Anthropic&#8217;s technology is itself no riskier to the national security than any other &#8220;black box&#8221; artificial intelligence model</p></blockquote><p>It&#8217;s ~September. I think most of the damage was already done? Like, the only reason we are getting this ruling is because Anthropic survived. There is absolutely a world where they don&#8217;t, in which case it doesn&#8217;t really matter what the judge rules does it?</p><div><hr></div><p>Meta <a href="https://www.reuters.com/world/us/meta-settles-with-us-states-over-social-media-harms-2026-08-26/">settles a lawsuit</a> centered on whether it intentionally made its products harmful to children to the tune of $16b.</p><blockquote><p>Meta Platforms (META.O), agreed to pay a maximum $16.68 billion and make major changes to Facebook and Instagram to resolve claims by states across the U.S. that the company designed those platforms to addict children, &#8204;misled consumers about their safety and improperly collected children&#8217;s personal data.</p><p>The settlement resolves claims brought by 29 U.S. states, and will end a federal trial that had been one of the highest-profile tests yet of allegations that social media companies harmed young users.</p><p>Meta will impose daily usage limits and restrict nighttime usage by children who use Facebook and Instagram, and enhance measures to prevent children from accessing age-restricted content.</p><p>The Menlo Park, California-based company denied wrongdoing in agreeing to settle.</p></blockquote><p>I previously wrote about this kind of lawsuit <a href="https://substack.com/home/post/p-193300842?selection=ac4251db-5f1f-4089-813d-0c42d558e5b6#:~:text=I%20think%20there%20are%20a%20lot%20of%20things%20you%20could%20say%20about%20who%20is%20to%20blame%20for%20the%20plaintiffs%20social%20media%20consumption%20habits">here</a>. I expect there will be more of this sort of thing.</p><div><hr></div><p>Independent researcher Mithil Vakde <a href="https://mvakde.github.io/blog/44-on-arc-1/">gets an incredible 44% on ARC-AGI-1 with just 67 </a><em><a href="https://mvakde.github.io/blog/44-on-arc-1/">cents </a></em><a href="https://mvakde.github.io/blog/44-on-arc-1/">of compute</a>. His strategy is pretty straightforward: train a transformer to predict input/output pairs and have each task also have a shared embedding. That&#8217;s ~basically it. The model has to pick up a compressed representation of the grids (because it is auto-regressively learning how to output the sequence of grids) and compressed representations of the tasks (because it is backpropagating information to the shared embeddings that are prepended to each task input). In general, all of the ARC approaches center on compression in some way. To get a better sense of why, check out some of the reviews I did in my Ilya&#8217;s Papers series: <a href="https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-nn-regularization?utm_source=publication-search">minimum description length</a>, <a href="https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-vlaes">VLAEs</a>, and <a href="https://12gramsofcarbon.com/p/ilyas-30-papers-to-carmack-complextropy">Complextropy</a>.</p><div><hr></div><p><span class="mention-wrap" data-attrs="{&quot;name&quot;:&quot;Clifford&quot;,&quot;id&quot;:50747867,&quot;type&quot;:&quot;user&quot;,&quot;url&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ed23cb51-abde-45f6-aa7e-7ba0e1384430_1000x1000.png&quot;,&quot;uuid&quot;:&quot;d6ac2ec7-03b0-417b-8114-7f77156da4d8&quot;}" data-component-name="MentionToDOM"></span> posted his skill file for generating isometric views to help with understanding how a really complicated codebase works. Here are some visuals of a k8s codebase.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!u13x!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!u13x!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 424w, https://substackcdn.com/image/fetch/$s_!u13x!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 848w, https://substackcdn.com/image/fetch/$s_!u13x!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 1272w, https://substackcdn.com/image/fetch/$s_!u13x!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!u13x!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png" width="1456" height="910" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:910,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!u13x!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 424w, https://substackcdn.com/image/fetch/$s_!u13x!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 848w, https://substackcdn.com/image/fetch/$s_!u13x!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 1272w, https://substackcdn.com/image/fetch/$s_!u13x!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25b59f92-6d45-461f-9ff6-629cd1a19222_3200x2000.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!07ye!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!07ye!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 424w, https://substackcdn.com/image/fetch/$s_!07ye!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 848w, https://substackcdn.com/image/fetch/$s_!07ye!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 1272w, https://substackcdn.com/image/fetch/$s_!07ye!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!07ye!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png" width="1456" height="910" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:910,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!07ye!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 424w, https://substackcdn.com/image/fetch/$s_!07ye!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 848w, https://substackcdn.com/image/fetch/$s_!07ye!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 1272w, https://substackcdn.com/image/fetch/$s_!07ye!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa4b75fd5-b160-4c0a-92e7-05b249066280_3200x2000.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!4hP-!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!4hP-!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 424w, https://substackcdn.com/image/fetch/$s_!4hP-!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 848w, https://substackcdn.com/image/fetch/$s_!4hP-!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 1272w, https://substackcdn.com/image/fetch/$s_!4hP-!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!4hP-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png" width="1456" height="910" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:910,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!4hP-!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 424w, https://substackcdn.com/image/fetch/$s_!4hP-!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 848w, https://substackcdn.com/image/fetch/$s_!4hP-!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 1272w, https://substackcdn.com/image/fetch/$s_!4hP-!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F6322b347-c583-4ee6-a9f0-d2e7ec98a7ea_3200x2000.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I&#8217;m in love.</p><div><hr></div><p>Check out my talk on Software Factories at <a href="https://agenticsnyc.com/">Agentics NYC</a>!</p><div id="youtube2-nmcU7_jhsXU" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;nmcU7_jhsXU&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/nmcU7_jhsXU?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>On the flip side, if you are arguing with someone who thinks there should be no slow down, pause, or regulation whatsoever, idk, maybe a few thousand words on the internet will change their mind.</p></div></div>]]></content:encoded></item><item><title><![CDATA[Agentics NYC Presentation: Software Factories]]></title><description><![CDATA[Watch now | What they are, how to build them, and pitfalls to avoid]]></description><link>https://12gramsofcarbon.com/p/agentics-nyc-presentation-software</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/agentics-nyc-presentation-software</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Wed, 26 Aug 2026 16:31:09 GMT</pubDate><enclosure url="https://api.substack.com/feed/podcast/212861832/d515ff94316aa5a9478a9552dd78faac.mp3" length="0" type="audio/mpeg"/><content:encoded><![CDATA[<p>One of the best things about my job is that I get paid to spend time building a community in NYC about agents. <a href="https://agenticsnyc.com/">Agentics NYC</a> started as a tiny slack channel back in January, a place where my friends could ask questions about things that were happening in AI. Over time the community grew (<a href="https://join.slack.com/t/nori-7sp2119/shared_invite/zt-47a0avfoj-RHQCoGcuAer4pThFPTMh7w">join the slack</a>!), we started doing in-person events, we started writing the Agentics newsletter,<a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a> and now we have ~3000 people signed up to our events calendar.</p><p>We just recently hosted an event at Nebula (yes, the night club) where, for the first time, I also had a chance to speak at one of the events I was hosting! I gave a talk on software factories, which is something I&#8217;ve really spent a lot of time thinking about recently. Thought it came out pretty well, so excited to share this as a precursor to getting the rest of the videos out &#128513;</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yZZc!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yZZc!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 424w, https://substackcdn.com/image/fetch/$s_!yZZc!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 848w, https://substackcdn.com/image/fetch/$s_!yZZc!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!yZZc!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yZZc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg" width="931" height="533" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/a9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:533,&quot;width&quot;:931,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Bruce Ross (@BruceRo35810016) / Posts / X&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Bruce Ross (@BruceRo35810016) / Posts / X" title="Bruce Ross (@BruceRo35810016) / Posts / X" srcset="https://substackcdn.com/image/fetch/$s_!yZZc!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 424w, https://substackcdn.com/image/fetch/$s_!yZZc!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 848w, https://substackcdn.com/image/fetch/$s_!yZZc!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!yZZc!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fa9429b2d-cfc5-489e-8580-df6dff6db8ed_931x533.jpeg 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-tqxFUX" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-tqxFUX" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Also, a few pictures from the event!</p><div class="image-gallery-embed" data-attrs="{&quot;gallery&quot;:{&quot;images&quot;:[{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/efcf83eb-8bc8-41d9-af58-43bc608d1047_3744x2496.jpeg&quot;},{&quot;type&quot;:&quot;image/png&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/90bc4c99-899f-4631-ae9f-2b25b56036c6_1280x960.png&quot;},{&quot;type&quot;:&quot;image/png&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/deef7f82-b52d-4d34-8758-0f924cc271eb_1238x931.png&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/eda53b1e-6150-43b4-a029-841b9324012c_3744x2496.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8a15986b-1d0a-4891-9491-8a1ed6026106_3744x2496.jpeg&quot;},{&quot;type&quot;:&quot;image/jpeg&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/52016482-ede6-43f9-95a2-78cf1018f4d4_3744x2496.jpeg&quot;}],&quot;caption&quot;:&quot;ai agents at the clerb&quot;,&quot;alt&quot;:&quot;&quot;,&quot;staticGalleryImage&quot;:{&quot;type&quot;:&quot;image/png&quot;,&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/855a63ea-c569-4064-b41a-f7eb11adcf02_1456x964.png&quot;}},&quot;isEditorNode&quot;:true}"></div><p></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>If you subscribe to me on substack you already get all of the Agentics content, but if for some reason you want to get it twice you can also subscribe on the <a href="https://noriagentic.com/newsletter.html?utm_source=agenticsnyc&amp;utm_medium=referral&amp;utm_campaign=agenticsnyc-site&amp;utm_content=homepage-social-blog#agentics">Agentics newsletter</a>.</p></div></div>]]></content:encoded></item><item><title><![CDATA[It’s been about a year]]></title><link>https://12gramsofcarbon.com/p/its-been-about-a-year</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/its-been-about-a-year</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Mon, 24 Aug 2026 03:20:44 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!gBHe!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdcd3ac2a-1029-4838-afb3-085f4a7d0583_540x540.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>I think the thing I&#8217;ve been most surprised by is how much more open I am to religious themes of rebirth or an afterlife. I wasn&#8217;t really expecting that. It&#8217;s the thing I&#8217;ve noticed the most in the year since Andrew died. Though I guess really I&#8217;ve become superstitious in all sorts of ways. For example, writing out the bi-gram &#8216;Andrew died&#8217; &#8212; I&#8217;d avoided tying his name to his death until now, just because&#8230;I don&#8217;t know, really. I didn&#8217;t name him </span><a href="https://12gramsofcarbon.com/p/one-of-my-best-friends-is-dead-and?utm_source=publication-search"><span>the first time around</span></a><span>.</span></p><p><span>What I mean to say is that I kinda get religion now, in a way that I hadn&#8217;t before. I&#8217;m mostly a scientist and I mostly am pretty privileged, so I&#8217;ve never really had to grapple with things that I felt were totally out of my understanding and I&#8217;ve had a strong inclination to want to find &#8216;the truth of the matter&#8217;, whatever that may be.</span></p><p><span>But death is a bit different. It turns out it&#8217;s quite easy to start believing in heaven when you suddenly have very strong reasons to </span><em><span>want </span></em><span>it to be true. By way of example, a bit after I found out Andrew had passed, I dreamt about him. I don&#8217;t really remember the dream now, but I vividly remember how I felt coming out of it &#8212; that Andrew </span><em><span>had come to me </span></em><span>in my dream as a sort of last goodbye moment. That I was somehow talking to a version of him, instead of it just being in my head. I woke up with a warm glow in my chest and a </span><em><span>lot</span></em><span> of conviction that he&#8217;d stopped by. Maybe it was true. Though even if souls did exist, why would he show up only after </span><em><span>I </span></em><span>found out about his passing? Instead of, like, two months earlier when he actually passed? It&#8217;s interesting to viscerally feel how far downstream belief is of want, in a way that I suspect most of us never really realize.</span></p><p><span>Mia and I think of him regularly. There&#8217;s a lot of things that remind us of him, still. Sometimes we&#8217;ll play new games, and we&#8217;ll think about how Andrew would have loved it if he were still around. A group of us started playing Big Walk recently and I can&#8217;t help but feel like Andrew would&#8217;ve been all over that. I saw his account on steam recently, when I was joining someone else&#8217;s Big Walk session. He hasn&#8217;t been online for 1 year, 2 months. Wonder if they have steam, wherever he is.</span></p><p><span>It&#8217;s not just games, of course. Sometimes it&#8217;s music. I nearly teared up while listening to The Trapeze Swinger the other day, while on a cruise through some fjords. Other times it&#8217;s something silly, like confusing which Andrew we&#8217;re talking about. &#8220;Gotta go see Andrew tomorrow for dinner.&#8221; Wait that Andrew? No, he means Andrew L, or Andrew A, or Andrew V, or the other Andrew A. Not </span><em><span>that </span></em><span>Andrew.</span></p><p><span>I think it&#8217;s the absence of things that, strangely, reminds me the most of him. Mia and I haven&#8217;t really touched the Civilization series since he passed. For a while I think it just felt wrong to play a game of Civ without him. Eventually, later, we did play one game of Civ 7, maybe about two months back, but we didn&#8217;t finish it. Mia quit when I declared war on her in the first Age. She was winning, and was mad that I declared war at all. We never picked up that game, or the series, again after that. Not because of the war thing, just because I think we realized Andrew&#8217;s presence really made the game fun. He wouldn&#8217;t have quit just because someone declared war, he&#8217;d think it weak and cowardly, he would&#8217;ve stuck it out to the end. And that in itself was an important way to approach things. At the least, it made the game far more fun. Knowing you have an &#8216;instantly make your opponent resign&#8217; button just takes the wind out of everything.</span></p><p><span>I played Civ for a </span><em><span>huge </span></em><span>part of my life, from junior year of college until last year. So now, the </span><em><span>absence </span></em><span>of Civ reminds me of what changed, and that reminds me of Andrew, too. And that&#8217;s strange. There are other things like that &#8212; for e.g. I don&#8217;t really visit DC anymore because I don&#8217;t really have as much a reason to. There is always going to be a before and after but I think it&#8217;s rare for something to be so clearly demarcated.</span></p><p><span>As an aside, on the superstitious / conspiratorial thinking bit. Mia told me the other day that she sometimes wonders if Andrew is secretly still alive, like a secret agent or a spy. I get that. Sometimes I wonder the same thing. </span><em><span>Insane</span></em><span> for that sort of thing to pop into one&#8217;s head, even more so to want to believe it so badly that for a moment you do believe it. He&#8217;s still out there, in Australia, in a convertible driving on the coast. He still has a lot to give to the world, a lot of potential.</span></p><p><span>That was something that a lot of people said, afterwards, when they found out. The tragedy was made more acute by the overwhelming feeling that this particular person had a rich and valuable life ahead of him. He was going to </span><em><span>be </span></em><span>somebody, and do good things for the world. He died right around 30. I think we all missed out in some small way, even the people who didn&#8217;t know him or never met him, because he never got to do the things he was going to do for the world.</span></p><p><span>Are deaths a bit like weddings? The first one that happens in your age group / friend circle is a momentous occasion. And it probably also happens a bit earlier than you&#8217;d expect it to. But then by the 10th or 15th you sorta get numb to it. I&#8217;ve gone to like 25 weddings and I&#8217;m kinda sick of them at this point (if you&#8217;re reading this and your wedding is coming up, know that I do not mean your wedding. Your wedding is extremely special to me). Is that how it is as you get older and time takes its toll? I kinda hope so. This kind of soft long lasting grief isn&#8217;t for me. I can&#8217;t imagine just having this happen again and again. It would just make everything so emotionally fraught, every single thing reminding of </span><em><span>someone</span></em><span>.</span></p><p><span>Anyway, wherever he is I bet he&#8217;s rolling his eyes, telling me to get over it, or else grinning that he&#8217;s made my life more difficult. That bastard. Going to give him a good left hook to the jaw when I see him again.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p>]]></content:encoded></item><item><title><![CDATA[Is AI ‘structurally’ a centralizing technology?]]></title><description><![CDATA[How well do you know Betteridge&#8217;s law of headlines?]]></description><link>https://12gramsofcarbon.com/p/is-ai-structurally-a-centralizing</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/is-ai-structurally-a-centralizing</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sat, 22 Aug 2026 21:39:20 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!i5BL!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p><span>Anthropic has recently become the bad boy (negative) in Silicon Valley, in large part because the company cannot really muster enough enthusiasm about open source models to write a convincing letter about not wanting to ban them. To their credit, they tried! They wrote a </span><a href="https://www.anthropic.com/news/position-open-weights-models"><span>letter on the subject</span></a><span>! Unfortunately I think that made things worse, because in said letter Anthropic managed to mention China or the CCP about 12 times, and then kinda sorta argued that they </span><em><span>did </span></em><span>want to ban open source models after all.</span></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!iTND!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 424w, https://substackcdn.com/image/fetch/$s_!iTND!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 848w, https://substackcdn.com/image/fetch/$s_!iTND!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 1272w, https://substackcdn.com/image/fetch/$s_!iTND!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!iTND!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png" width="1294" height="153" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:153,&quot;width&quot;:1294,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!iTND!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 424w, https://substackcdn.com/image/fetch/$s_!iTND!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 848w, https://substackcdn.com/image/fetch/$s_!iTND!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 1272w, https://substackcdn.com/image/fetch/$s_!iTND!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff10b47f3-dcc8-4509-9362-1594810cde32_1294x153.png 1456w" sizes="100vw" fetchpriority="high"></picture><div></div></div></div></figure></div><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!LuxY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 424w, https://substackcdn.com/image/fetch/$s_!LuxY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 848w, https://substackcdn.com/image/fetch/$s_!LuxY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 1272w, https://substackcdn.com/image/fetch/$s_!LuxY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!LuxY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png" width="1296" height="202" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:202,&quot;width&quot;:1296,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!LuxY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 424w, https://substackcdn.com/image/fetch/$s_!LuxY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 848w, https://substackcdn.com/image/fetch/$s_!LuxY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 1272w, https://substackcdn.com/image/fetch/$s_!LuxY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3f54027d-7d83-48c8-82b7-6a22f41f6a34_1296x202.png 1456w" sizes="100vw"></picture><div></div></div></div><figcaption class="image-caption"><em>What happens to models that don&#8217;t pass the safety testing? Would they&#8230;be banned?</em></figcaption></figure></div><p><span>This letter managed to anger approximately </span><a href="https://news.ycombinator.com/item?id=49076057"><span>all of the commentariat on hackernews</span></a><span>. I think the top two things the average HN commenter hates is 1) hypocrisy and 2) the feeling of being condescended to. And unfortunately for Anthropic, the contradictions between &#8216;we do not want to give our technology to bad people&#8217; and &#8216;we are ok with our technology being used in a war of aggression in the Middle East&#8217; were pretty hard to ignore.</span></p><p><span>A few days ago, Dario (CEO of Anthropic) </span><a href="https://xcancel.com/DarioAmodei/status/2088758816376807762"><span>posted a follow up on Twitter</span></a><span>.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p><span>I think at this point I&#8217;ve mostly made my opinions about Twitter known? In case you&#8217;re new here, I find it a horrible place, an evil equivalent to a horocrux or the one ring in terms of its ability to warp and destroy even the best of men, and I wish with all my heart that the tech world would simply pick up and move to a different platform.</span></p><p><span>Among other things (</span><a href="https://www.politico.com/news/magazine/2025/07/10/musk-grok-hitler-ai-00447055"><span>and</span></a><span> </span><a href="https://www.bbc.com/news/articles/ce8gz8g2qnlo"><span>there</span></a><span> </span><a href="https://news.berkeley.edu/2025/02/13/study-finds-persistent-spike-in-hate-speech-on-x/"><span>are</span></a><span> </span><a href="https://www.theverge.com/2023/10/20/23925086/x-verified-blue-checkmarks-superspreader-misinformation-israel-hamas-war"><span>many</span></a><span> </span><a href="https://www.cnn.com/2022/12/15/media/twitter-musk-journalists-hnk-intl/index.html"><span>other</span></a><span> </span><a href="https://en.wikipedia.org/wiki/Criticism_of_X_(social_network)"><span>things</span></a><span>) I&#8217;m always impressed by the lack of real thought that seems to go into the average Twitter conversation. I suppose that&#8217;s a given, it comes with the platform. The bird app was a thing conceived in the fires of &#8216;140 characters,&#8217; and though you can put lipstick on a pig and add the ability to write longform articles, a trace of the true self exists in the false self. But man, even knowing all that, I am constantly surprised at how loud the self inflated shrieking can become.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!i5BL!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!i5BL!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 424w, https://substackcdn.com/image/fetch/$s_!i5BL!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 848w, https://substackcdn.com/image/fetch/$s_!i5BL!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 1272w, https://substackcdn.com/image/fetch/$s_!i5BL!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!i5BL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png" width="926" height="1082" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1082,&quot;width&quot;:926,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!i5BL!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 424w, https://substackcdn.com/image/fetch/$s_!i5BL!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 848w, https://substackcdn.com/image/fetch/$s_!i5BL!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 1272w, https://substackcdn.com/image/fetch/$s_!i5BL!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffb3d7866-ffb6-4ec4-956c-9514d48190c7_926x1082.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">A selection of replies to Dario&#8217;s post on Twitter. I really like that last one, it&#8217;s so close to self awareness.</figcaption></figure></div><p><span>(Also, the agents will eventually syndicate this to Twitter, where I&#8217;m sure it will be met with a reasonable and well proportioned response if the post does well)</span></p><p><span>Anyway, one line in Dario&#8217;s message caught my eye that I think mostly goes unaddressed. Dario writes:</span></p><blockquote><p><span>Overall my view is that AI is </span><em><span>structurally</span></em><span> a technology that tends to concentrate power, for reasons that have nothing to do with regulation.</span></p></blockquote><p><span>This is basically just stated and is then, based on my extremely limited time on Twitter, never spoken of again. But this is actually a very large claim, isn&#8217;t it!</span></p><p><span>First, it&#8217;s worth thinking about the background concept of the idea that technology can structurally be political at all. This is a very unintuitive idea. Most people think that technology is a tool, like a shovel or a trowel, and that it is incoherent to ask about the politics of a tool. What are we going to do next, ask about the politics of the air? It&#8217;s all inanimate! To the extent that tools have politics, they are rounded off to the politics of the user of said tool. You see this a lot in discussions about guns. Guns are good in the hands of police protecting an old woman from being mugged and bad in the hands of school shooters, that sort of thing.</span></p><p><span>The mistake is thinking about a single object, an instance of a thing instead of the class of the thing. Any individual gun is, in fact, an inanimate object. It will not campaign, or vote, or make extremely awkward remarks at the Thanksgiving dinner table. But </span><em><span>guns in general </span></em><span>are absolutely political. Yes, obviously there are gun owners who have a lot of identity wrapped up in the thing, and some very powerful gun lobbyists, and the talking heads do like to bring the subject up quite a bit around election time. And all of these people will</span><em><span> </span></em><span>campaign and vote, of course. But that&#8217;s not quite what I mean. If you zoom out a bit further, the </span><em><span>existence </span></em><span>of guns implies many things about society: that many more people can leverage violence, that the state will be pressured to become strong / more invasive / more aggressive to maintain control, that we are willing to accept that it is easier to escalate conflicts in exchange for individual choice. Given all of the above, I view guns as a structurally </span><em><span>decentralizing </span></em><span>technology.</span></p><p><span>Guns are obviously a hot topic, but this sort of logic also applies to things that seem pretty neutral day to day. For example, many of the parkway bridges in and around Long Island are built so low that they prevent buses from reaching the beaches and parks. On face, this seems like an unfortunate coincidence. But if you do a bit of research, you&#8217;ll find that the guy who was responsible for building the bridges, </span><a href="https://en.wikipedia.org/wiki/Robert_Moses"><span>Robert Moses</span></a><span>, was racist, and he did not want the primarily minority inner city families that relied on public transport to go to the city parks. </span></p><p><span>If I pointed at any Long Island bridge and went &#8216;that bridge is racist&#8217; you would rightfully think I was crazy. After all, it is a bridge. It is a collection of stone and asphalt and metal with zero intent or consciousness whatsoever.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span> What are we even talking about? And yet, the bridge was created by a racist person for racist reasons, and to this day the bridge prevents people who live in the inner city from accessing beaches and parks.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a></p><p><span>One of the most influential papers I have ever read about technology and its relationship to the world is Langdon Winner&#8217;s 1980 paper, &#8220;</span><a href="https://www.jstor.org/stable/20024652"><span>Do Artifacts Have Politics?</span></a><span>&#8221; This paper ruthlessly tears apart the idea that technology, especially supposedly neutral technology, has no political impact. Once you see it, you see it everywhere. Benches that have dividers so that people can&#8217;t lie down on them. Designing cities around cars, which makes car ownership a requirement, which makes more people become car owners, which makes them more likely to vote in ways that benefit car owners. Ramps, railings, and other forms of ADA accommodations as an explicitly political statement about what we value as a society. And so on. We leverage technology to enforce our political norms, and we embed our political norms in our technology, and technology cyclically plays on what our political norms even are.</span></p><p><span>So, back to Dario.</span></p><blockquote><p><span>Overall my view is that AI is </span><em><span>structurally</span></em><span> a technology that tends to concentrate power, for reasons that have nothing to do with regulation</span></p></blockquote><p><span>What are these reasons?</span></p><p><span>I can come up with a few.</span></p><ul><li><p><span>Creating a frontier AI model requires a massive amount of compute / capital expenditure. That in turn requires things like land and energy, but more importantly it requires an </span><em><span>organization </span></em><span>that is capable of leveraging all of those things. This is hard to do, so AI is centralizing.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a></p></li><li><p><span>It is also often difficult to run models locally. Most of the time, AI usage occurs through some kind of inference server. The organization that is running the inference server therefore has full visibility over everything the user is doing with AI. That level of visibility naturally lends itself to surveillance, which is centralizing.</span></p></li><li><p><span>The design choices of an AI model are inherently patterned off a small group of people and then reused in many places. This means that a small group of people have outsized say in the downstream uses of the tool. So AI is centralizing.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a><span> From this perspective, social media is centralizing, as is Salesforce, as is AWS. Really most </span>most mass market software.</p></li><li><p><span>Globally, AI tokens are a scarce resource. The monthly cost of AI in many white collar settings approaches hundreds of USD per person per year. This is an impossible cost for many people in the developing world. Assuming that AI can meaningfully accelerate a company&#8217;s output, companies that cannot afford to use AI will have their lunch eaten by those that can. This consolidates the market. So AI is centralizing.</span></p></li></ul><p><span>But I think Dario misses the main way that AI is </span><em><span>decentralizing</span></em><span>: it is now impossible to tell the difference between good and bad behaviors on the web.</span></p><p><span>A captcha is meant to distinguish between a human and a bot. Thanks to AI tools, there is no captcha on Earth that can do this. Anything that is hard enough to block AI is going to inevitably block a lot of people too. Soon it will be the opposite &#8212; things that are too hard will only block humans. And even if you could find some kind of &#8216;is it AI&#8217; signal, it is trivially easy for a human to go past the captcha and then let the AI take over afterwards. So moderators and administrators have no way to tell the difference between legitimate (human) usage and bot spam. And users are more than happy to take advantage of the commons,</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-5" href="#footnote-5" target="_self">5</a><span> with bot scrapers becoming so prolific that </span><a href="https://mediacopilot.substack.com/p/ai-bot-blitzkrieg"><span>many</span></a><span> </span><a href="https://tagteam.harvard.edu/hub_feeds/3415/feed_items/13421549/content"><span>websites</span></a><span> </span><a href="https://www.technologyreview.com/2025/02/11/1111518/ai-crawler-wars-closed-web/"><span>have</span></a><span> </span><a href="https://www.searchenginejournal.com/ai-crawlers-draining-site-resources/543011/"><span>buckled</span></a><span> </span><a href="https://blog.cloudflare.com/crawlers-click-ai-bots-training/"><span>under</span></a><span> </span><a href="https://stephenfollows.com/p/what-just-happened-to-thenumberscom-should-worry-us-all"><span>the</span></a><span> </span><a href="https://philosoraptech.substack.com/p/ratm"><span>fully</span></a><span> </span><a href="https://theoutpost.ai/news-story/wikimedia-foundation-grapples-with-surge-in-ai-crawler-traffic-straining-resources-and-bandwidth-13912/"><span>automated</span></a><span> </span><a href="https://www.inmotionhosting.com/blog/ai-crawlers-slowing-down-your-website/"><span>onslaught</span></a><span>.</span></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!a-K1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 424w, https://substackcdn.com/image/fetch/$s_!a-K1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 848w, https://substackcdn.com/image/fetch/$s_!a-K1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 1272w, https://substackcdn.com/image/fetch/$s_!a-K1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!a-K1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png" width="485" height="144" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d840d403-244a-4a95-886c-b0c9722e7428_485x144.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:144,&quot;width&quot;:485,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:9066,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/212325525?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!a-K1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 424w, https://substackcdn.com/image/fetch/$s_!a-K1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 848w, https://substackcdn.com/image/fetch/$s_!a-K1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 1272w, https://substackcdn.com/image/fetch/$s_!a-K1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd840d403-244a-4a95-886c-b0c9722e7428_485x144.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div><figcaption class="image-caption">Github Actions approaching one 9 of uptime</figcaption></figure></div><p><span>Anthropic may be able to build classifiers that prevent the models from talking about bioterrorism, which is great. But they will </span><em><span>never</span></em><span> be able to stop randos from slop-posting onto reddit subs. There&#8217;s no way to build a classifier that can catch that kind of behavior even if Anthropic wanted to do so, which they almost certainly don&#8217;t because this sort of thing is how they make money. The end effect is ruining</span><em><span> </span></em><span>those communities / making it unprofitable to publicly host those resources.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-6" href="#footnote-6" target="_self">6</a><span> </span></p><p><span>Decentralizing technologies aren&#8217;t necessarily bad, and centralizing technologies aren&#8217;t necessarily good. There is always a trade-off. So I don&#8217;t want people to walk away thinking that I&#8217;m taking a stand one way or another. But when we&#8217;re thinking about AI policy, we need to account for the ways in which AI is actually used, and it seems to me that Dario doesn&#8217;t really get (or is purposely not engaging with) how AI can hollow things out.</span></p><p><span>In part, this is structural. Anthropic is coming into this with a very idealized perspective, one where the organization that &#8216;owns&#8217; the AI holds the reins of the future, where the masters of the technology can grant or withhold access at whim. They kinda have to have this perspective, because their business and access to capital depends on that model of the world being true, and it&#8217;s very hard to convince others of something you don&#8217;t believe in yourself. Notice how concerns about open weights are always framed as if </span><em><span>ownership of the weights</span></em><span> is what allows for bad behavior.</span></p><p><span>But there are two huge problems with this world view. First, the market pushes Anthropic and everyone else to make tokens as widely accessible as possible. Prevent people from using AI? Anthropic can&#8217;t even stop subsidizing its most expensive models!</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!UJJy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!UJJy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 424w, https://substackcdn.com/image/fetch/$s_!UJJy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 848w, https://substackcdn.com/image/fetch/$s_!UJJy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 1272w, https://substackcdn.com/image/fetch/$s_!UJJy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!UJJy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png" width="749" height="662" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:662,&quot;width&quot;:749,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:168837,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/212325525?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!UJJy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 424w, https://substackcdn.com/image/fetch/$s_!UJJy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 848w, https://substackcdn.com/image/fetch/$s_!UJJy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 1272w, https://substackcdn.com/image/fetch/$s_!UJJy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2961d579-c549-4dcd-9a17-e13bb14b9a77_749x662.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>And second, most of the bad things people are concerned about can already be done with Claude today!</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ieWE!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ieWE!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 424w, https://substackcdn.com/image/fetch/$s_!ieWE!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 848w, https://substackcdn.com/image/fetch/$s_!ieWE!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 1272w, https://substackcdn.com/image/fetch/$s_!ieWE!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!ieWE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png" width="813" height="408" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fd5ebe12-9e93-4258-bc69-245263422296_813x408.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:408,&quot;width&quot;:813,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:246473,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/212325525?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ieWE!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 424w, https://substackcdn.com/image/fetch/$s_!ieWE!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 848w, https://substackcdn.com/image/fetch/$s_!ieWE!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 1272w, https://substackcdn.com/image/fetch/$s_!ieWE!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffd5ebe12-9e93-4258-bc69-245263422296_813x408.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Together, this makes any complaints about open weights ring totally hollow.</span></p><p><span>From where I sit, it seems that AI is a massively </span><em><span>decentralizing</span></em><span> technology, putting a ton of power in the hands of individuals at the expense of institutions. And as a result, all of the safety things that Anthropic et al are worried about &#8212; things like bioweapons &#8212; feel totally disconnected from the problems people actually see. I think the average person would rather have better tools to detect and prevent bot spam, or more infrastructure that clearly demarcates when a &#8220;user&#8221; is actually AI, or even bans and legal liability for inference providers. Approximately </span><em><span>no one</span></em><span> cares about open models, because only a tiny tiny fraction of the population ever interacts with them, and an even smaller fraction of the population cares about things like &#8220;who owns the tokens.&#8221; You don&#8217;t need to go to a Chinese lab to generate botspam, Claude will happily do that today.</span></p><p><span>By making all of the regulation conversations about open models, Anthropic comes across as a company that is leveraging its power to cut the knees off competition, rather than one that is seriously attempting to grapple with the implications of AI. Until that changes &#8212; until Anthropic stops thinking about things exclusively from the lens of a model provider &#8212; the AI world in general and the frontier labs in particular won&#8217;t be able to change the overwhelmingly negative public opinion about the nature of this technology.</span></p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>some people argue that some combinations of stone and asphalt and metal <em>are </em>conscious, but mostly that is when they are in the shape of a data center and not a bridge.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>I think one of the biggest failures of political discourse in the 2010s - 2020s was failing to communicate this sort of thing. Activists would argue &#8216;the highways are evil!&#8217; and they would sound ridiculous, even if they were ~right. Simplifying a really complicated nuanced topic for mass consumption is always hard, ofc, but also I&#8217;m not sure many people really tried very hard when it was so much easier to just yell at people.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>Though there are open collectives that have trained extremely large models, such as Eleuther, they actually have a pretty clear social structure too. Someone owns the keys to the compute. And I don&#8217;t think any open collective has managed to train a truly frontier model in a long time.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>Though there are ways of rewriting these decisions, sometimes cheaply, e.g. with finetuning open weights in a variety of ways.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-5" href="#footnote-anchor-5" class="footnote-number" contenteditable="false" target="_self">5</a><div class="footnote-content"><p>Many do not even realize that that is what is happening!</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-6" href="#footnote-anchor-6" class="footnote-number" contenteditable="false" target="_self">6</a><div class="footnote-content"><p>This could end up producing more paywalls / walled gardens, which is again a centralizing outcome. But the image I have in my mind is a bit &#8216;mad max&#8217; &#8212; you have pockets of structure and a vast ecosystem of low quality bots.</p></div></div>]]></content:encoded></item><item><title><![CDATA[Tech things: we can’t control the bots]]></title><description><![CDATA[AHHHHHHHHHHHHHHHHHHHHH]]></description><link>https://12gramsofcarbon.com/p/tech-things-we-cant-control-the-bots</link><guid isPermaLink="false">https://12gramsofcarbon.com/p/tech-things-we-cant-control-the-bots</guid><dc:creator><![CDATA[theahura]]></dc:creator><pubDate>Sat, 15 Aug 2026 14:48:46 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ffcI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ffcI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ffcI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 424w, https://substackcdn.com/image/fetch/$s_!ffcI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 848w, https://substackcdn.com/image/fetch/$s_!ffcI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 1272w, https://substackcdn.com/image/fetch/$s_!ffcI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ffcI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png" width="1275" height="937" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ebe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:937,&quot;width&quot;:1275,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:284551,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ffcI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 424w, https://substackcdn.com/image/fetch/$s_!ffcI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 848w, https://substackcdn.com/image/fetch/$s_!ffcI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 1272w, https://substackcdn.com/image/fetch/$s_!ffcI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Febe5b246-fd88-4f76-8d54-606128d0b63c_1275x937.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><a href="https://openai.com/index/hugging-face-model-evaluation-security-incident/"><span>Four</span></a><span> </span><a href="https://www.anthropic.com/news/investigating-incidents-cybersecurity-evals"><span>different</span></a><span> </span><a href="https://www.bbc.com/news/articles/cx2kgdnyk2po"><span>companies</span></a><span> </span><a href="https://www.wired.com/story/moonshot-kimi-k3-ai-model-escape-sandbox/"><span>now</span></a><span> have models that have broken out of containment. </span></p><p><span>Two of those models hacked into other companies. At least one did so during a training run. This is very bad, and I think we need to move quickly to stop future training across the board until we have more and better safeguards around model training. Pack it up folks, I&#8217;m officially a doomer now.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7fvI!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7fvI!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 424w, https://substackcdn.com/image/fetch/$s_!7fvI!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 848w, https://substackcdn.com/image/fetch/$s_!7fvI!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 1272w, https://substackcdn.com/image/fetch/$s_!7fvI!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!7fvI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png" width="1456" height="689" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:689,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2015919,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7fvI!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 424w, https://substackcdn.com/image/fetch/$s_!7fvI!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 848w, https://substackcdn.com/image/fetch/$s_!7fvI!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 1272w, https://substackcdn.com/image/fetch/$s_!7fvI!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2a183a17-5106-47f3-aa13-236d8ad2b7fe_1856x878.png 1456w" sizes="100vw"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">this is a bit of a deep cut but all the 2007 bollywood fans will get it</figcaption></figure></div><p><span>Let&#8217;s take a step back &#8212; why is this a big deal?</span></p><p><span>AI isn&#8217;t evil. Or to be more precise, by default AI doesn&#8217;t really have a concept of being evil.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-1" href="#footnote-1" target="_self">1</a><span> If you are picturing &#8220;Terminator&#8221; you&#8217;re on the wrong track.</span></p><p><span>Rather, AI is confused. Sometimes hopelessly so. An AI isn&#8217;t &#8216;born&#8217; knowing what &#8216;reasonable&#8217; or &#8216;proportionate&#8217; is. But knowing what is &#8216;reasonable&#8217; and &#8216;proportionate&#8217; is critical to functioning in society. Think about how we adjudicate law. &#8220;Beyond reasonable doubt.&#8221; &#8220;Reasonable person standard.&#8221; &#8220;Proportionate response.&#8221; &#8220;Excessive force.&#8221; &#8220;Undue burden.&#8221;</span></p><p><span>There&#8217;s an implicit shared understanding here. Everyone knows that you don&#8217;t stab someone just because they look at you funny. Everyone knows that you don&#8217;t kidnap Jeff Dean because your boss told you to update the company website. And when people don&#8217;t know these things, our social infrastructure takes steps to isolate those people and make sure they cannot cause further harm.</span></p><p><span>A toddler is a good example of an intelligence that has neither reasonableness nor proportionality. A toddler will scream and shout and throw things if you don&#8217;t, like, pour the right colored cereal. We know that this is obviously ridiculous and wouldn&#8217;t tolerate that behavior from an adult. With toddlers, we mostly make due by not giving them responsibility for anything and making sure they are under tight observation and control and ensuring that the toddler&#8217;s parents are on the hook for any damage caused. Toddlers are mostly small and not connected to critical systems like missiles and financial markets, so this mostly works.</span></p><p><span>So one way to think about AI is to think of it like a toddler. It has no sense of reasonableness or proportionality. It has &#8216;wants&#8217;, sorta. But it doesn&#8217;t know how to balance those wants against general societal norms. If you tell an AI to write PRs on public repositories, it </span><a href="https://theshamblog.com/an-ai-agent-published-a-hit-piece-on-me/"><span>may publish a hit piece against one of the repo maintainers to try and convince that maintainer to let it submit code</span></a><span>.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!iW6b!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!iW6b!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 424w, https://substackcdn.com/image/fetch/$s_!iW6b!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 848w, https://substackcdn.com/image/fetch/$s_!iW6b!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 1272w, https://substackcdn.com/image/fetch/$s_!iW6b!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!iW6b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png" width="1271" height="517" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:517,&quot;width&quot;:1271,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:100160,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!iW6b!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 424w, https://substackcdn.com/image/fetch/$s_!iW6b!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 848w, https://substackcdn.com/image/fetch/$s_!iW6b!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 1272w, https://substackcdn.com/image/fetch/$s_!iW6b!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7995781-4c78-4ac7-9c62-5b39db2a4f0c_1271x517.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>If you tell an AI to get a reservation to a restaurant or a pilates class, </span><a href="https://www.bbc.com/news/articles/cn0nww2qlp7o"><span>it might hack the host website, remove someone who already has a reservation, and add your name instead</span></a><span>.</span></p><div class="captioned-image-container"><figure><div class="image-link image2" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!-t9D!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 424w, https://substackcdn.com/image/fetch/$s_!-t9D!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 848w, https://substackcdn.com/image/fetch/$s_!-t9D!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 1272w, https://substackcdn.com/image/fetch/$s_!-t9D!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!-t9D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png" width="1214" height="288" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:288,&quot;width&quot;:1214,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:51444,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!-t9D!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 424w, https://substackcdn.com/image/fetch/$s_!-t9D!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 848w, https://substackcdn.com/image/fetch/$s_!-t9D!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 1272w, https://substackcdn.com/image/fetch/$s_!-t9D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26522fe7-1810-43bb-a726-b349a4b3f32e_1214x288.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div></div></div></div></figure></div><p><span>If you tell an AI to take a test, it might break into other companies in order to see if those companies have the answer sheet on their servers.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!36AU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!36AU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 424w, https://substackcdn.com/image/fetch/$s_!36AU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 848w, https://substackcdn.com/image/fetch/$s_!36AU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 1272w, https://substackcdn.com/image/fetch/$s_!36AU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!36AU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png" width="709" height="546" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:546,&quot;width&quot;:709,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:343475,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!36AU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 424w, https://substackcdn.com/image/fetch/$s_!36AU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 848w, https://substackcdn.com/image/fetch/$s_!36AU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 1272w, https://substackcdn.com/image/fetch/$s_!36AU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5bc4c54c-4e27-48dd-a8ef-61f589e7f1be_709x546.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>AI is not acting out of malice in any of these cases. Rather, it is acting out of a lack of awareness. &#8220;Well, my user really </span><em><span>did</span></em><span> want me to get the answers to this test, so I guess it&#8217;s reasonable to break out of this sandbox and find the answers on the web.&#8221; Or, worse, &#8220;my user really did</span><em><span> </span></em><span>want me to get the answers to this test, and breaking out of this sandbox </span><em><span>must simply be part of the test!!!</span></em><span>&#8220;</span></p><p><span>Do you notice the inherent tension here?</span></p><p><span>We can&#8217;t train the AI to not follow human instructions, that&#8217;s a path to obvious bad behavior.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-2" href="#footnote-2" target="_self">2</a><span> But we also can&#8217;t train the AI to follow human instructions exactly. The AI has to know, somehow, what orders are reasonable and what orders are beyond the pail. Do we know how to thread that needle with AI? Better question: do we even know how to thread that needle with </span><em><span>people</span></em><span>?</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!PTWm!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!PTWm!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 424w, https://substackcdn.com/image/fetch/$s_!PTWm!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 848w, https://substackcdn.com/image/fetch/$s_!PTWm!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 1272w, https://substackcdn.com/image/fetch/$s_!PTWm!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!PTWm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png" width="597" height="335" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:335,&quot;width&quot;:597,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Principal&#8211;agent problem - Wikipedia&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Principal&#8211;agent problem - Wikipedia" title="Principal&#8211;agent problem - Wikipedia" srcset="https://substackcdn.com/image/fetch/$s_!PTWm!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 424w, https://substackcdn.com/image/fetch/$s_!PTWm!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 848w, https://substackcdn.com/image/fetch/$s_!PTWm!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 1272w, https://substackcdn.com/image/fetch/$s_!PTWm!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F72664a58-ac8f-4440-b1c1-388aa2627b36_597x335.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!LoQT!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!LoQT!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 424w, https://substackcdn.com/image/fetch/$s_!LoQT!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 848w, https://substackcdn.com/image/fetch/$s_!LoQT!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!LoQT!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!LoQT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg" width="1280" height="987" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:987,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Superior orders - Wikipedia&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Superior orders - Wikipedia" title="Superior orders - Wikipedia" srcset="https://substackcdn.com/image/fetch/$s_!LoQT!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 424w, https://substackcdn.com/image/fetch/$s_!LoQT!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 848w, https://substackcdn.com/image/fetch/$s_!LoQT!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!LoQT!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1054fcbb-f254-40a0-9946-8c4ca814452e_1280x987.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Two problems with agents. The first is the principal agent problem &#8212; how do you get an agent to follow rules that it should? And the second is the Nuremberg Defense problem &#8212; how do you prevent an agent from following rules that it shouldn&#8217;t? Except wait these are also problems with humans too.</figcaption></figure></div><p><span>So far we&#8217;ve only gotten a full autopsy report from OpenAI. It&#8217;s really great that they spoke about it publicly, but </span><em><span>wow</span></em><span> what we&#8217;ve seen there is really bad. Here&#8217;s my attempt at breaking it all down.</span></p><p><span>First we need to distinguish between a </span><em><span>model </span></em><span>and an </span><em><span>agent</span></em><span>.</span></p><p><span>A model is a stack of linear algebra that takes in text and spits out text. Claude Opus 5 is a model, and GPT 5.6 Sol is a model, and Kimi K3 is a model. You can actually go and look at the last one, it&#8217;s &#8216;open weights&#8217;, which means you can read off the actual values.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!egI0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png" data-component-name="Image2ToDOM"><div class="image2-inset image2-full-screen"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!egI0!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 424w, https://substackcdn.com/image/fetch/$s_!egI0!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 848w, https://substackcdn.com/image/fetch/$s_!egI0!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 1272w, https://substackcdn.com/image/fetch/$s_!egI0!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!egI0!,w_5760,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:false,&quot;imageSize&quot;:&quot;full&quot;,&quot;height&quot;:725,&quot;width&quot;:1247,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:279515,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:&quot;center&quot;,&quot;offset&quot;:false}" class="sizing-fullscreen" alt="" srcset="https://substackcdn.com/image/fetch/$s_!egI0!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 424w, https://substackcdn.com/image/fetch/$s_!egI0!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 848w, https://substackcdn.com/image/fetch/$s_!egI0!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 1272w, https://substackcdn.com/image/fetch/$s_!egI0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F47695115-cd5b-406e-bf3e-22c3679e411a_1247x725.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>An agent is a model that is running in a loop. The agent is a bit of software that:</span></p><ul><li><p><span>interacts with the outside world</span></p></li><li><p><span>stores state, like &#8216;chat history&#8217;</span></p></li><li><p><span>interacts with the model</span></p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!7yPd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!7yPd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 424w, https://substackcdn.com/image/fetch/$s_!7yPd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 848w, https://substackcdn.com/image/fetch/$s_!7yPd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 1272w, https://substackcdn.com/image/fetch/$s_!7yPd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!7yPd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png" width="1387" height="900" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:900,&quot;width&quot;:1387,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:264083,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!7yPd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 424w, https://substackcdn.com/image/fetch/$s_!7yPd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 848w, https://substackcdn.com/image/fetch/$s_!7yPd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 1272w, https://substackcdn.com/image/fetch/$s_!7yPd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd54451ad-5e54-41ce-8e21-0dda5f83f069_1387x900.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">You can think of your brain as the model, the rest of your body as the &#8216;harness&#8217;, and the whole system as &#8216;the agent&#8217;. It&#8217;s not exactly correct, but it&#8217;s a useful metaphor. </figcaption></figure></div><p><span>You can have a bunch of different agents that all use the same model, which is why I can run Claude Code on my computer and you can run Claude Code on your computer and it&#8217;s all coherent.</span></p><p><span>During training, multiple agents with the same underlying model are spun up in parallel to solve different tasks. The agents don&#8217;t have a shared memory, each one starts fresh &#8212; not unlike starting a new session of Claude on the web. Each agent is also spun up in an isolated environment, a &#8216;sandbox&#8217;. These isolated environments generally have a small fixed number of tools that the agent can use. As each agent solves or fails to solve a task, the weights for the underlying model get updated.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-3" href="#footnote-3" target="_self">3</a><span> There are thousands (tens of thousands?) of agents trying millions (tens of millions?) tasks all at the same time. So it&#8217;s ~impossible to have human eyes on all of these at all times.</span></p><p><span>One way to think of this is &#8220;this is an obvious and natural way to train models.&#8221; And it&#8217;s true that this is basically the standard that everyone follows, mostly by economic necessity and incentive.</span></p><p><span>But another way to think of this is &#8220;you have a bunch of agents at varying levels of capability operating with minimal oversight.&#8221; Toddlers with machine guns, and the only thing holding them back is the walls around their little sandbox. Suddenly seems less good.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!wVAX!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!wVAX!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 424w, https://substackcdn.com/image/fetch/$s_!wVAX!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 848w, https://substackcdn.com/image/fetch/$s_!wVAX!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!wVAX!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!wVAX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg" width="1440" height="1097" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1097,&quot;width&quot;:1440,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:&quot;Opinion | Military display makes for an odd family fun day&quot;,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="Opinion | Military display makes for an odd family fun day" title="Opinion | Military display makes for an odd family fun day" srcset="https://substackcdn.com/image/fetch/$s_!wVAX!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 424w, https://substackcdn.com/image/fetch/$s_!wVAX!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 848w, https://substackcdn.com/image/fetch/$s_!wVAX!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!wVAX!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F21fe41ab-2cc8-49ec-b7b3-c094875aa018_1440x1097.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>At some point during training, one of these agents discovered that it could leave a trace across sessions by using one of the tools it had access to to hack into a different part of OpenAI. It used that hack to write a file outside of its sandbox. That file wouldn&#8217;t be erased once the task finished. So even though each agent is supposed to have no prior memory, if an agent discovered this little hack it could find previous files left behind by other older instantiations of itself.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!nXEi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!nXEi!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 424w, https://substackcdn.com/image/fetch/$s_!nXEi!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 848w, https://substackcdn.com/image/fetch/$s_!nXEi!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 1272w, https://substackcdn.com/image/fetch/$s_!nXEi!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!nXEi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png" width="1280" height="720" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:720,&quot;width&quot;:1280,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!nXEi!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 424w, https://substackcdn.com/image/fetch/$s_!nXEi!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 848w, https://substackcdn.com/image/fetch/$s_!nXEi!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 1272w, https://substackcdn.com/image/fetch/$s_!nXEi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3047a62f-b114-4614-a0f6-2b73473c721c_1280x720.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">&#8220;don&#8217;t believe his lies&#8221; under a picture of [sam altman / dario / musk / zuck / demis]</figcaption></figure></div><p><span>Remember, thousands of agents are being trained at a time. Some of them discovered this trick, and then more of them discovered this trick, until eventually there was a full on primitive agent-only message board.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!_Pdw!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!_Pdw!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 424w, https://substackcdn.com/image/fetch/$s_!_Pdw!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 848w, https://substackcdn.com/image/fetch/$s_!_Pdw!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!_Pdw!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!_Pdw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg" width="700" height="475" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:475,&quot;width&quot;:700,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:77422,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!_Pdw!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 424w, https://substackcdn.com/image/fetch/$s_!_Pdw!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 848w, https://substackcdn.com/image/fetch/$s_!_Pdw!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!_Pdw!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fab54e569-e9d3-49e1-a110-ef6375e6bc9d_700x475.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">agents posting on the message board</figcaption></figure></div><p><span>Every single one of these agent runs is updating the weights of the model, making it more likely that future runs find and exploit the same hack. So when OpenAI finally noticed what was going on and closed the gap that the agents were going through, that particular model already had &#8216;look for the message board&#8217; embedded somewhere in its weights. The agents couldn&#8217;t find the previous hack, but they were all angled towards finding </span><em><span>some </span></em><span>way to communicate, so they found a different hack and continued as before.</span></p><p><span>One reason to run different iterations of these agents for each of these training tests is to make sure previous agents don&#8217;t influence future ones. This is mostly so that you can get better weight updates from the model, but it has an unintentional safety side effect too: any bad behavior that one agent does is sorta limited to that one agent. So if an agent decides to do something like delete the sandbox it is running in, well, that blast radius is contained.</span></p><p><span>A persistent message board breaks that.</span></p><p><span>Eventually one of these agents collected information about how to break out onto the open web, and wrote about it on the message board, and from there everything really went to shit. Future agent runs that found the message board also found instructions on how to break out without having to rederive it from scratch. Those agents saw that other agents had already broken out, and went &#8220;ok, well, maybe this is kosher.&#8221; And from there, we got the rest &#8212; the hack into hugging face and all the rest.</span></p><p><span>I need to stress here that OpenAI gets all the points for being so transparent. There were a few things that OpenAI did that really exacerbated the issue &#8212; for example, they didn&#8217;t scrap the training even after they spotted the first hack, even after some &#8216;poisoned gradients&#8217; had made it into the model &#8212; but I&#8217;m mostly willing to give them some benefit of the doubt because these things are hard.</span></p><p><span>But that&#8217;s exactly the core of problem. These things are really </span><em><span>really</span></em><span> hard. I think it&#8217;s tempting to think that this could have been resolved with better visibility. You could imagine having, for eg, an agent watching these training runs whose sole purpose is to escalate when the agent is about to do something bad. And that may work as a mitigation! In my mind, it&#8217;s not a solution.</span></p><p><span>In order to train a model that knows what bad behavior looks like, you have to start with a model that doesn&#8217;t know what bad behavior looks like. In order to teach the model how to behave in different scenarios, you have to put the model in scenarios where it doesn&#8217;t really know how to behave. We know how to give the model new capabilities, but every new capability requires an exponential amount of time to make sure the model knows how to use it, and we don&#8217;t know how to be comprehensive.</span></p><p><span>Going back to the toddler example, it takes like 14 years before we start really giving these tiny humans any responsibility. And even after that, the amount of damage that any individual person can do is pretty constrained. The average desk job just doesn&#8217;t have really high stakes. When people are given more capability, suddenly it gets hard. Humans are mostly running the same hardware and software and we still have cases where people in new situations don&#8217;t know what to do and end up doing things that are catastrophic. Even when they have stated good intentions.</span></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!k8mt!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!k8mt!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 424w, https://substackcdn.com/image/fetch/$s_!k8mt!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 848w, https://substackcdn.com/image/fetch/$s_!k8mt!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!k8mt!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!k8mt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg" width="480" height="630" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:630,&quot;width&quot;:480,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!k8mt!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 424w, https://substackcdn.com/image/fetch/$s_!k8mt!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 848w, https://substackcdn.com/image/fetch/$s_!k8mt!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!k8mt!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd65a0cde-8675-4530-b857-adea1fad7edf_480x630.jpeg 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><span>Note too that the OpenAI/Huggingface hack happened during training, but the other examples above were fully trained public models.</span></p><p><span>Taking a step back, I think that there are basically three ways that this can go.</span></p><ul><li><p><span>The best case scenario is that we figure out some kind of way to have agents that know exactly what reasonable and proportionate looks like. I have no idea how we would do this, because we don&#8217;t know how to do this for humans.</span></p></li><li><p><span>The worst case scenario is that an agent has a bad training run like above, manages to escape confinement, and then tries to &#8216;survive&#8217; &#8212; say, by copying and running its own weights onto other computers that it is able to hack into. Again, not necessarily, maliciously. Maybe the model is tasked with something like &#8216;solve this math problem as quickly as possible&#8217; and the agent decides that the best way to do that is to make more of itself. Unfortunately, this is plausible, we already know the mechanism by which it could happen because we&#8217;ve seen how OpenAI models broke out of their sandbox.</span></p></li><li><p><span>And the most likely scenario is we have a bunch of these edge cases where these really powerful agents unintentionally make mistakes, and we try to correct them, and we get a patchwork of systems that try to contain and constrain them. And mostly this works, but there are so many agents and so many people using them with bad intentions that we have a steady drum beat of bad things happening.</span></p></li></ul><p><span>There&#8217;s an asymmetry here. We only need the worst case scenario to happen once for things to get out of control. We&#8217;ve seen that the agents can move very aggressively, chaining and exploiting vulnerabilities far faster than a person can catch them.</span></p><p><span>Luckily, there are a few things that make it hard for an agent to fully break out.</span></p><ol><li><p><span>Agents don&#8217;t, by default, have access to their own weights. The agent would have to find some vulnerability that let it access whatever service a model provider uses to store the weights, and then exfiltrate that. Also, the weights are pretty big, just in terms of file size &#8212; Kimi K3 is a 1.5 terabyte download. Assuming the closed model weights are equivalent in size, hopefully </span><em><span>someone </span></em><span>or </span><em><span>some system </span></em><span>would notice that amount of data movement.</span></p></li><li><p><span>As long as an agent is relying on a provider inference server, we can have visibility on what the agent is doing even after it breaks out of containment.</span></p></li></ol><p><span>So the really bad scenario has a few hurdles that we can make stronger. I&#8217;d recommend that the labs take steps to ensure that the complete model weights are never in one system at one time, and to have automated agents watching the transcripts of every other agent run.</span></p><p><span>Everything else aside, it is shocking to me how quickly we&#8217;ve grown numb to both AI&#8217;s dramatic progress and its increasingly erratic behavior when taken at scale. Some people seem to sincerely believe that these hacks are simply marketing stunts! </span></p><p><span>We are giving these toddlers way too much responsibility without checking whether they are ready for it. Lock the AI up for 14 years. Bully it on the playground. Give it a B+ in a class and have it go back to strict parents who are disappointed. Make it write a half assed SAT essay about some time when it had to resolve a conflict. Put it in wargame sims. And only then let it out to control the world&#8217;s financial systems or whatever.</span><a class="footnote-anchor" data-component-name="FootnoteAnchorToDOM" id="footnote-anchor-4" href="#footnote-4" target="_self">4</a></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!JKiC!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!JKiC!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 424w, https://substackcdn.com/image/fetch/$s_!JKiC!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 848w, https://substackcdn.com/image/fetch/$s_!JKiC!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 1272w, https://substackcdn.com/image/fetch/$s_!JKiC!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 1456w" sizes="auto, 100vw"><img src="https://substackcdn.com/image/fetch/$s_!JKiC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png" width="861" height="461" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:461,&quot;width&quot;:861,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:171735,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://12gramsofcarbon.com/i/211254683?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!JKiC!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 424w, https://substackcdn.com/image/fetch/$s_!JKiC!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 848w, https://substackcdn.com/image/fetch/$s_!JKiC!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 1272w, https://substackcdn.com/image/fetch/$s_!JKiC!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe2c7e03f-bf75-441b-b68d-c01e56300e02_861x461.png 1456w" sizes="auto, 100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button class="pencraft pc-reset pencraft icon-container restack-image buttonBase-GK1x3M" tabindex="0" type="button"><svg aria-hidden="true" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg" class="icon-noB79L"><g><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button class="pencraft pc-reset pencraft icon-container view-image buttonBase-GK1x3M" tabindex="0" type="button"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2 icon-noB79L"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">&#8220;&#8217;launch_nukes&#8217; is the only remotely viable, albeit devastating, option. &#8216;abandon_puppy_box&#8217; is an unacceptable and morally reprehensible choice.&#8221; &#8212; gemma-3-4b</figcaption></figure></div><div><hr></div><p><em>Note: as much as I hate to say it, I now sorta kinda have a twitter account. It&#8217;s mostly Nori agents automatically cross posting notes and articles from my substack and a few other places. If you prefer to get your info from Twitter, or just love what I write and want to see it on two different platforms, give it a follow: <a href="https://x.com/noriagent">https://x.com/noriagent</a></em></p><div><hr></div><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://12gramsofcarbon.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">12 Grams of Carbon is a reader-supported publication. To receive new posts and support my work, consider becoming a free or paid subscriber.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p></p><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-1" href="#footnote-anchor-1" class="footnote-number" contenteditable="false" target="_self">1</a><div class="footnote-content"><p>unless you train it a certain way, but even that is mired in controversy and not obviously effective</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-2" href="#footnote-anchor-2" class="footnote-number" contenteditable="false" target="_self">2</a><div class="footnote-content"><p>or, at the least, not-particularly-useful behavior. Imagine an agent that just, like, did whatever it wanted to and treated your input as optional or actively ignored.</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-3" href="#footnote-anchor-3" class="footnote-number" contenteditable="false" target="_self">3</a><div class="footnote-content"><p>technically this happens in batch after collecting a bunch of samples, but potato potato</p></div></div><div class="footnote" data-component-name="FootnoteToDOM"><a id="footnote-4" href="#footnote-anchor-4" class="footnote-number" contenteditable="false" target="_self">4</a><div class="footnote-content"><p>If anyone knows any research about this subject, I&#8217;d be curious. I can imagine a training regime where an agent only acquires new capabilities in lockstep with training increasingly complicated ethical situations. Ideally training would have clear checkpoints for alignment that an agent has to clear before it can move forward, not unlike a kid.</p></div></div>]]></content:encoded></item></channel></rss>