{"id":135237,"date":"2024-12-09T22:56:52","date_gmt":"2024-12-09T15:56:52","guid":{"rendered":"https:\/\/hotvideos24.online\/?p=135237"},"modified":"2024-12-09T22:56:52","modified_gmt":"2024-12-09T15:56:52","slug":"microsofts-mustafa-suleyman-on-what-the-industry-is-getting-wrong-about-agi","status":"publish","type":"post","link":"https:\/\/hotvideos24.online\/?p=135237","title":{"rendered":"Microsoft\u2019s Mustafa Suleyman on what the industry is getting wrong about AGI"},"content":{"rendered":"<p> <script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script><br \/>\n<\/p>\n<div id=\"content\">\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Today, I\u2019m talking with Mustafa Suleyman, the CEO of Microsoft AI.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Mustafa is a fascinating character in the world of AI \u2014 he\u2019s been in and out of some pivotal companies. He was one of the cofounders of DeepMind, which got acquired by Google in 2014, then became a Google VP for several years before leaving in 2022 to found another AI startup, Inflection. Then, earlier this year, Inflection cut a deal with Microsoft to license its core technology in a <a href=\"https:\/\/www.theverge.com\/2024\/7\/1\/24190060\/amazon-adept-ai-acquisition-playbook-microsoft-inflection\">weird and kind of controversial<\/a> not-quite-acquisition situation, one that sent Mustafa, his cofounder, and a majority of their employees into Microsoft.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">As CEO of Microsoft AI, Mustafa now oversees all of its consumer AI products, including the Copilot app, Bing, and even the Edge browser and MSN \u2014 two core components of the web experience that feel like they\u2019re radically changing in a world of AI. That\u2019s a lot \u2014 and a lot of <em>Decoder<\/em> bait, since I\u2019m always fascinated by Microsoft\u2019s org chart and all the little CEOs that report to Satya Nadella, and of course, I\u2019m obsessed with what AI might do to the web at large. I also asked Mustafa to compare and contrast working at Microsoft and Google since he has direct experience at both, and his answer was pretty revealing.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component clear-both block md:float-left md:mr-30 md:w-[320px] lg:-ml-100\">\n<div class=\"duet--article--sidebar bg-gray-200 mb-20 w-full rounded-sm bg-[#F8F5FF] p-20 [&amp;&gt;*:last-child&gt;*:last-child]:mb-0\">\n<div class=\"[&amp;_p]:font-polysans [&amp;_p]:text-16 [&amp;_p]:font-light [&amp;_p]:leading-130\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Listen to <em>Decoder<\/em>, a show hosted by <em>The Verge<\/em>\u2019s Nilay Patel about big ideas \u2014 and other problems.\u00a0Subscribe\u00a0<a href=\"https:\/\/podcasts.apple.com\/us\/podcast\/welcome-to-decoder\/id1011668648?i=1000496212371&amp;itsct=podcast_box&amp;itscg=30200&amp;ls=1&amp;at=1001l7uV&amp;ct=verge091322\">here<\/a>!<\/p>\n<\/div>\n<\/div>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I also wanted to ask Mustafa about AI training and the data it requires. He\u2019s caught some heat for <a href=\"https:\/\/www.theverge.com\/2024\/6\/28\/24188391\/microsoft-ai-suleyman-social-contract-freeware\">describing content on the web as \u201cfreeware\u201d<\/a> before, and Microsoft and OpenAI are in the middle of <a href=\"https:\/\/www.theverge.com\/2023\/12\/27\/24016212\/new-york-times-openai-microsoft-lawsuit-copyright-infringement\">major copyright lawsuits<\/a> about training data. I\u2019m curious how AI companies are thinking about the risky and seemingly uncertain legal foundations of their work, and I wanted to know how Mustafa was thinking about it now.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">But before we got into all that, I needed to ask about AGI, or artificial general intelligence. That\u2019s the idea that these AI systems will be able to handle tasks as well as a human \u2014 or even better, in some cases. Sam Altman at OpenAI \u2014 which, again, is a huge partner with Microsoft for this stuff \u2014 has said he thinks AGI is achievable on our current computing hardware. In his most recent comments, he <a href=\"https:\/\/www.theverge.com\/2024\/12\/4\/24313130\/sam-altman-openai-agi-lower-the-bar\">seemed to lower the bar<\/a> for how he defines AGI entirely \u2014 which makes it easier to argue that it will arrive sooner than most think. On top of <em>that<\/em>, there\u2019s <a href=\"https:\/\/www.nytimes.com\/2024\/10\/17\/technology\/microsoft-openai-partnership-deal.html\">a lot of reporting<\/a> that says OpenAI can get out of its Microsoft deal when it achieves AGI, so he\u2019s got a lot of incentives to say it\u2019s happening.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I asked Mustafa straight out if he agrees with Altman and if AGI is achievable on current hardware \u2014 because if the answer is yes, then maybe a bunch of org chart questions are a little secondary. You\u2019ll hear him be optimistic but on a much longer timeframe \u2014 and you\u2019ll also hear him pull away from the idea of AGI being a superintelligence, which feels like another kind of redefinition.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">There\u2019s a lot here \u2014 including a discussion of what I\u2019ve started calling the DoorDash problem. You\u2019ll see what I mean.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Okay, Microsoft AI CEO Mustafa Suleyman. Here we go.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><em>This transcript has been lightly edited for length and clarity.<\/em><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Mustafa Suleyman, you are the CEO of Microsoft AI. Welcome to Decoder.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>I\u2019m very excited to talk to you. I have a lot of questions for you about how Microsoft AI is structured within Microsoft, what it means to be the CEO of Microsoft AI (at a company that appears to be all about AI lately), how you make decisions \u2014 all the Decoder stuff. I\u2019m going to start hot out of the gate. I hope you\u2019re ready for this because I realize that if you answer one way, this whole interview goes in a different direction. So, very recently, Sam Altman <\/strong><a href=\"https:\/\/mashable.com\/article\/openai-sam-altman-ama-reddit\"><strong>said in a Reddit AMA<\/strong><\/a><strong> that he thinks we can achieve artificial general intelligence (AGI) on current hardware. Do you think that\u2019s possible?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">What does current hardware mean?<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Within one or two generations of what we have now, I would say.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I don\u2019t think it can be done on <a href=\"https:\/\/www.theverge.com\/2024\/3\/18\/24105157\/nvidia-blackwell-gpu-b200-ai\">[Nvidia] GB200s<\/a>. I do think it is going to be plausible at some point in the next two to five generations. I don\u2019t want to say I think it\u2019s a high probability that it\u2019s two years away, but I think within the next five to seven years since each generation takes 18 to 24 months now. So, five generations could be up to 10 years away depending on how things go. We really are facing increasingly tough challenges with these chips. I don\u2019t think it\u2019s going to be as linear in terms of its progress or cost per dollar as we\u2019ve seen in the past. But things are accelerating very fast. So, I agree with that sentiment.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>So, between two and 10 years, you think?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The uncertainty around this is so high that any categorical declarations just feel sort of ungrounded to me and over the top.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>You and I have spoken several times in the past about a lot of things, and I want to follow up on all of those ideas. It just occurs to me that if we think AGI is between two and 10 years away, very much in the span of our lifetimes, maybe we shouldn\u2019t be working on anything else. That seems like it will be a paradigm shift, right? We\u2019re through the singularity now, there is AGI. Everything will be different on the other end of it. How do you approach that and then also think about, \u201cWell, I need to launch the Copilot app on the iPhone\u201d?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It depends on your definition of AGI, right? AGI isn\u2019t the singularity. The singularity is an exponentially recursive self-improving system that very rapidly accelerates far beyond anything that might look like human intelligence.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">To me, AGI is a general-purpose learning system that can perform well across all human-level training environments. So, knowledge work, by the way, that includes physical labor. A lot of my skepticism has to do with the progress and the complexity of getting things done in robotics. But yes, I can well imagine that we have a system that can learn \u2014 without a great deal of handcrafted prior prompting \u2014 to perform well in a very wide range of environments. I think that is not necessarily going to be AGI, nor does that lead to the singularity, but it means that most human knowledge work in the next five to 10 years could likely be performed by one of the AI systems that we develop. And I think the reason why I shy away from the language around singularity or artificial superintelligence is because I think they\u2019re very different things.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The challenge with AGI is that it\u2019s become so dramatized that we sort of end up not focusing on the specific capabilities of what the system can do. And that\u2019s what I care about with respect to building AI companions, getting them to be useful to you as a human, work <em>for you<\/em> as a human, be on your side, in your corner, and on your team. That\u2019s my motivation and that\u2019s what I have control and influence over to try and create systems that are accountable and useful to humans rather than pursuing the theoretical super intelligence quest.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>One of the reasons I\u2019m particularly curious about this is the notion that all human knowledge work can be performed either with the assistance of a very capable general AI or by the AI itself. It sort of implies that we will build a new kind of AI system, right? One that will be able to be as creative as a human knowledge worker at the 99th percentile. And I don\u2019t see that in our systems now. The way an LLM works, they don\u2019t necessarily come up with a bunch of individually creative thoughts. You can prompt them to do surprising things, but that turning [into something more] \u2014 I have not experienced. Do you think that the way that the current LLMs are built, trained, and deployed is a linear path to the kind of AGI you\u2019re describing, or is there another kind of thing we need to build?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It\u2019s funny because two or three years ago, people would often say, \u201cWell, these systems are destined to regurgitate the training data that they were trained on.\u201d And that there is some one-to-one mapping between query training data and output. It\u2019s pretty clear today that they\u2019re actually not doing that. The interpolation of the space between multiple N-dimensional elements of their training data is in itself the creative process, right? It\u2019s picking some point in this massively complex space to produce or generate a novel form of the response to the question that it has never seen before. We\u2019ve never seen that specific answer produced in that specific way. To me, that is the beginning of creativity. It\u2019s the kind of glimmer of a truly novel invention, which is obviously what we\u2019re trying to produce here.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Intelligence is the very sort of thing that has driven all of our progress in the world throughout history. It\u2019s the power to synthesize vast amounts of information, aggregate it into conceptual representations that help us reason more efficiently in complex spaces, make predictions about how the world is likely to unfold, and then take action on the basis of those predictions. Whether you are making a table or you are playing baseball with your friend, every single one of those environments that you experience has those characteristics.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So if we can distill those moments, if you like, into an algorithmic construct, then of course there is huge value there. What I think we see in this mini moment in the last three or four years are the glimmers that they (LLMs) really can be creative, exert real judgment, and produce novel ideas. Your point about whether they can do that proactively is a good one. Like can LLMs do that unprompted? Can they do it independently? Can they do it with very subtle, nuanced, or lightweight guidance? I think that\u2019s kind of an open question. I feel very optimistic about that myself.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Much of the infrastructure to ensure that LLMs can do that is kind of an engineering issue now. Stateful memory and meta-reasoning about the current context of a model are things that we know how to do in software today. We know how to introduce a second or a third system to observe the working state of an LLM in its activity and use that to steer or re-steer a prompt that it is operating to. And if you can do asynchronous meta-reasoning, which is what the initial \u201cchain of thought\u201d methods seem to show in the last six to 12 months, then you can imagine how it could string together actions in these continuous environments.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It could then orchestrate and coordinate with other parts of its working memory, other parts of its system \u2014 some of which are designed to do more short-term things, some to draw from long-term memory, some to be a bit more creative, and some to be more adherent to the behavior policy or the safety policy that you\u2019re designing to.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So, it\u2019s obviously not done and dusted, but there are very, very clear signs that we\u2019re on the right path, I think.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Those orchestration systems are fascinating to me because the models themselves are not deterministic. They\u2019re never going to produce the same output twice. A lot of the things we want computers to do are insanely deterministic. We definitely want them to do the same thing over and over again. In a variety of situations where an AI might be really helpful, like if you want to do tax preparation, you want the AI to be very helpful and understand all the inputs. You also want it to follow the rules 100% of the time.\u00a0<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>It seems like connecting our logical computer systems to control the non-deterministic AI systems is a big pathway here, more so than making the AI more capable. And that feels like a new way of talking about it that I\u2019ve only recently seen. Does that feel like the kinds of products you need to build or are you still focused on the capability of the model itself?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It\u2019s a good framing, but let\u2019s tease apart what you mean by determinism. So, determinism operates at layers of abstraction. At the very lowest layer, each token is being generated non-deterministically. As those outputs become more recognizable with respect to a behavior policy, a heuristic, or a known objective \u2014 like filling out a tax form \u2014 then that knowledge can be stored in representations that are more stable and deterministic.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">And this is exactly how humans operate today. No matter how well you might memorize something, if I ask you to do it 100 times over, you\u2019re most likely going to have some variation in the output. We don\u2019t really store things deterministically. We have co-occurring conceptual representations, which are quite fluid and abstract. We then reproduce and fit them into a schema of words and language in order for us to be able to communicate with one another.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">These models are actually very similar to that architecture. They can store stable information that can be retrieved in quite deterministic ways, and like you said, integrate with existing computer systems and knowledge bases. But it\u2019s not true to say that one approach is going to trump another. The models are going to get way more capable, and the methods for retrieval, information access, the use of existing databases, or making function calls to third-party APIs to integrate that information, are going to advance simultaneously.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">By the way, we\u2019re going to open up a third front, which is that these LLMs can speak natural language now. They\u2019re going to be able to go and query other humans and other AIs in real-time. So, that\u2019s like a third paradigm for \u201cretrieving\u201d or verifying that information, accessing new knowledge, or checking state on something. That in itself is going to drive huge gains in addition to straight-up model capabilities and integration with existing systems.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>I want to talk about the agent component of that at length because that seems to be where so many companies are focused, including to some extent, Microsoft. It raises a million questions about how our computer systems and our networks should work. We think we\u2019re headed towards AGI between two and 10 years from now, we think we can do it with an increase in model capability, but also some novel approaches to how we use those models.\u00a0<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>I want to talk about how you\u2019re actually doing it at Microsoft. It occurred to me from the jump, that if we didn\u2019t agree on what the goals were, the structure conversation would be ungrounded from reality. So, those are the goals. Those are huge goals. At Microsoft AI, how are you structured to accomplish those goals?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">That\u2019s a great tee-up. First and foremost, my organization is focused on the consumer AI part. So, it is about Bing, Edge, MSN, and Copilot \u2014 so consumer-facing products that have hundreds of millions of daily active users, lots of user data, and lots of direct commercial surfaces where we can deploy into production, get feedback, and drive large-scale experimentation. For me, that\u2019s mission-critical, because five years ago, we were in a state with LLMs and AI where we were still relying on the benchmarks to drive progress. Evaluation was taking place in basically academic environments, albeit in commercial engineering labs. The models weren\u2019t good enough to actually put them into production and collect feedback from the real world. That has completely shifted now where all of the innovation is happening by optimization and hill climbing in production. So, I think that\u2019s the first thing to say.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The second thing to say is that our Azure business and the immense number of customers that we have using M365 Copilot every day provide another huge experimentation framework, which is very different from the consumer experimentation framework. It\u2019s actually a great opportunity for me because I\u2019m learning a lot from how many businesses are integrating true AI agents in their workflow today. Since they have more visibility and control of their internal data, and in many cases, they have tens or even hundreds of thousands of employees, they\u2019re able to introduce novel Copilot into their workflows, be it for training sales agents, up-skilling underperforming sales agents, and providing marketing feedback. I\u2019ve seen HR Copilots, there\u2019s all kinds of customer service Copilots happening. That gives me a sort of window into all the different flavors of testing and pushing the limits of these AI models in third-party production environments in the enterprise context.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The third arena, of course, is our collaboration with OpenAI, our great partners. I think this is going to turn out to be one of the most successful partnerships in computer history. That partnership is five years old now and has many years to run. We get models from them, we get intellectual property (IP), and they get compute and funding. It\u2019s obviously a huge source of support for us.\u00a0<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">And then the fourth area is that we\u2019ve just spawned \u2014 since I arrived eight or nine months ago now \u2014 our own core effort to develop these models at scale inside of Microsoft AI. We have some of the best AI researchers and scientists who are pushing the frontier of post-training and pre-training for our weight class. We are choosing a floating point operations per second (FLOPS) match target that really suits the kind of use cases that we care about and making sure we have absolutely world-class frontier models that can do that.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Let me just unpack some of the vocabulary there. You said \u201cweight class.\u201d Does that just mean a giant corporation, or do you mean something more specific by \u201cweight class\u201d?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Weight class is the way that we refer to comparing frontier models with one another. Your FLOPS need to be matched to your competitor model that you\u2019re evaluating yourself against. So, size is really significant. It\u2019s by far the overriding predictor of capability performance in these models. You sort of can\u2019t compare yourself to something that\u2019s 10X larger by FLOPS. You have to treat them as weight classes or FLOPS classes if you like.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>That makes sense to me. And then you said you want to target it towards the applications you\u2019re using, right? So, you\u2019re making many models that are geared toward specific Microsoft products?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">That\u2019s right. So, if you think about it, Copilot under the hood is a whole collection of different models, of different sizes that adapt to different contexts. If you\u2019re in a speech setting, it\u2019s a different type of model. If you\u2019re on a desktop, if you\u2019re actually in the native apps on Mac or on Windows, they\u2019re all slightly different models. And then there are different models for search, reasoning, and safety, and I think that that is going to get even more heterogeneous as we go.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>And then I just want to be very clear about this. It sounds like you\u2019re developing a frontier model that can compete with Gemini, GPT-4, or GPT-5, whatever it is. Are you working on that as well?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">For the current weight class, yes. So, at the GPT-4, GPT-4o scale. But it depends on how things turn out over the next few years because each order of magnitude increase is a phenomenal piece of physical infrastructure. You\u2019re talking about hundreds of megawatts, and soon gigawatts, of capacity. There will really only be three or four labs in the world that have the resources to be able to train at that scale by the time that we get to 10 to the 27 FLOPS (floating point operations per second) for a single training run. We won\u2019t duplicate that between us and OpenAI. OpenAI is our pre-training frontier model partner for those things, and hopefully, that continues for a long time to come.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>So, you\u2019re not going to compete with the next-generation model\u2019s size, right? You\u2019re going to let OpenAI do that. The reason I ask is because Microsoft runs the data centers, right? That as a partnership is ongoing, but Amazon runs its own data centers and Google runs its own data centers, and it seems like there is just a core tension here regardless of how good the partnership is. It\u2019s between, \u201cWe are going to build these data centers and restart nuclear power plants in the United States to supply power to some of these data centers,\u201d and, \u201cMaybe it\u2019s better to sell that to someone else versus build the models ourselves.\u201d Do you feel that tension?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Every partnership has tension. It\u2019s healthy and natural. I mean, they\u2019re a completely different business to us. They operate independently and partnerships evolve over time. Back in 2019 when [Microsoft CEO] Satya [Nadella] put a billion dollars into OpenAI, I mean it seemed pretty crazy. I didn\u2019t think it was crazy, but I think a lot of people thought it was crazy. Now that has paid off and both companies have massively benefited from the partnership. And so, partnerships evolve and they have to adapt to what works at the time, so we\u2019ll see how that changes over the next few years.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Do you have a backup plan if OpenAI declares AGI and walks away from the Microsoft deal? There\u2019s some credible reporting that\u2019s as if they declare AGI they could walk away from the deal.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">No. Look, it\u2019s very unclear what the definition of AGI is. We have, inside of Microsoft AI, one of the strongest AI research teams in the world. If you look at the pedigree of our crew, my own co-founder, Kar\u00e9n Simonyan, led the deep learning scaling team at DeepMind for eight years and was behind many of the major breakthroughs. Nando de Freitas has just joined us; he previously ran audio\/video generation at DeepMind for 10 years. So, we have an exceptional team and we\u2019ll make sure that whatever happens, we\u2019ll be in a position to train the best models in the world.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>It does seem like you have some uncertainty there. You\u2019ve said whatever happens several times now in the context of the OpenAI deal. Does that feel like something that you can rely on over the course of the next two to 10 years? Because that seems like a very important timeframe.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It definitely does. Look, they\u2019re an exceptional company. They\u2019re on a tear. There aren\u2019t many companies in the world that have grown as fast as they have. During that kind of meteoric rise, things are going to be brittle and some of the bits and pieces are going to fall off occasionally. That\u2019s what we\u2019ve seen in the last 12 months. So, that doesn\u2019t really change their trajectory. They\u2019re going to be incredibly successful, and we\u2019re going to do everything we can to help them be successful because they\u2019ve helped make us successful. That\u2019s genuinely what\u2019s going on here. Naturally, in any partnership, there are little tensions here and there, but fundamentally we will win together.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>I want to come back to the cooperation-competition dynamic there when we actually talk about products, but I want to stay focused on Microsoft AI inside of Microsoft for one more turn. You obviously started Inflection, Microsoft sort of reverse, acqui-hired all of Inflection. They brought over all the people and they issued you all shares. Why do the deal that way? Why join Microsoft and why structure that deal in that way?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So, I\u2019ve known Satya for a very long time. He\u2019s been sort of trying to get me to come and be part of the Microsoft crew for a while, as far back as 2017 when we first started hanging out. I\u2019ve always been particularly inspired by his leadership, and I think the company is actually in an incredibly strong position: the investments that we\u2019re making in compute, the distribution that we have with so many enterprise partners now deploying M365 Copilot, and what you can learn from that is a real game changer. A lot of people are talking about these actions, right? Clearly, you want your consumer Copilot experience to have these seamless interactions with brands, businesses, opportunities for getting stuff done, buying things, booking, planning, and so on. And so, having that kind of protocol built in-house and available to the consumer side, is super important.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The thing I realized about where we were at with Pi and Inflection \u2014 we had an unbelievable engagement with Pi, very high-intensity DAO. The average session of voice interaction lasted 33 minutes a day. It was pretty remarkable. But I think the challenge is that the competition is going to invest for years and years, and keep it free, if not reduce it to nothing. Basically make it widely available to hundreds of millions of people. And so, from a consumer perspective, it is a very, very competitive landscape. And look, when Satya made me the offer to come and run all the consumer stuff here, it was just an offer that we couldn\u2019t refuse. It sort of enabled us to pursue our long-term vision of actually creating a true AI companion that has a lasting relationship with hundreds of millions of consumers that is really useful to you. And to me, that\u2019s going to shape the future. That is really the thing that is going to shape our long-term trajectory. So, I couldn\u2019t turn that down.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>You are the CEO of Microsoft AI. Microsoft is an interesting company in that it has <\/strong><a href=\"https:\/\/www.theverge.com\/23589994\/microsoft-ceo-satya-nadella-bing-chatgpt-google-search-ai\"><strong>a CEO<\/strong><\/a><strong> and then several other CEOs. <\/strong><a href=\"https:\/\/www.theverge.com\/21611412\/microsoft-phil-spencer-interview-xbox-series-x-launch-decoder-podcast\"><strong>Phil Spencer<\/strong><\/a><strong> is the CEO of Microsoft Gaming. Ryan Roslansky is the CEO of LinkedIn. We just had <\/strong><a href=\"https:\/\/www.theverge.com\/24221978\/github-thomas-dohmke-ai-copilot-microsoft-openai-open-source\"><strong>Thomas Dohmke from GitHub<\/strong><\/a><strong> on, he\u2019s the CEO of GitHub. What does it mean to you to be the CEO of Microsoft AI?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Microsoft is an enormous organization, with a quarter of a trillion dollars in revenue, and about 280,000 employees. The logic of making single individuals accountable for our own P&amp;L is very rational. There are about 10,000 or so people in my org. We have full integration from training the models, building the infrastructure, running the ads platform, managing all the sales leaders, making sure that our content is high quality, and getting that integrated across four platforms. So, it just creates accountability. That\u2019s the logic here, and that\u2019s very much how Satya runs it. Extreme accountability.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>One thing that strikes me here is that GitHub is a product. LinkedIn is a product, as a beginning and an end, it\u2019s very tangible. People can understand it.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Microsoft AI is the company. There\u2019s just a lot of AI at Microsoft that is infusing into all of these products. I think Satya has agreed that AI feels like a platform change. There\u2019s enormous opportunity inside of a platform change. You\u2019ve obviously got your core products in Bing and Edge and MSN and all that, but when you think about the relationship to the rest of the AI efforts at Microsoft, where does the line begin and end for you?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">That\u2019s a good question. Right now, the company is so focused on winning on Azure. OpenAI, for example. Getting our models into production and getting them into the hands of hundreds of thousands or millions of businesses. I\u2019m involved in a lot of the reviews on the enterprise side but also play a role as an advisor and support. Our Microsoft AI (MAI) internal models haven\u2019t really been focused on those enterprise use cases. My logic is that we have to create something that works extremely well for the consumer and really optimize for our use case. So, we have vast amounts of very predictive and very useful data on the ad side, on consumer telemetry, and so on. My focus is on building models that really work for the consumer companion.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>That\u2019s a product-focused structure it sounds like. Have you reorganized Microsoft AI to be a more product-driven team?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I think the business was focused on the product before. What we\u2019ve done is bring the kind of AI sensibility into the heart of each one of our products. We have a lot of rankings. We have increasingly conversational and interactive surfaces. We\u2019re trying to bring the voice of Copilot to Bing and MSN. We want to make it a core part of the search experience so that your first thought is: let me just ask my AI. \u201cWhat does my AI think about that?\u201d and \u201cMy AI can remember that for me, save it, and organize it.\u201d And so, making sure that it shows up in deeply integrated ways that really support the surface, rather than an adjacent add-on or an afterthought. That\u2019s the craft that we\u2019re kind of working towards.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>You are a unique person to have on the show because you also co-founded DeepMind and you worked at Google. We\u2019ve had Demis, the CEO of DeepMind on the show before. Google is a challenging place to work at. He is a CEO of Google DeepMind. Google doesn\u2019t have CEOs the way that Microsoft has CEOs.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Can you compare and contrast these two companies? You worked at one huge company, you were at a startup for a minute. Now you work at another huge company. They are very different culturally and structurally. Do you think Microsoft has advantages over Google\u2019s approach?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I do. I think that at Microsoft there is a lot of discipline around revenue and P&amp;L. I think that is a very healthy attitude because it really focuses the mind on what a consumer is going to find truly valuable and be prepared to pay for. Second, there\u2019s long-term thinking about \u201cWhere does this platform shift take us and what does the five to 10-year horizon look like?\u201d So, there\u2019s a kind of planning attitude, which, during my time at Google, felt more instinctive. I mean, their instincts are really good. It\u2019s an incredibly creative company and many times they\u2019ve made long-term bets, but they were kind of instinctively reactive. Whereas I think there\u2019s a lot more thought in the scenario planning and thorough deliberation [at Microsoft]. Then the third thing I guess I would say is that Friday\u2019s senior leadership team meeting with Satya is a phenomenal experience. It runs from 8:30AM until 2:30PM PT in the office in Redmond, and everyone\u2019s there, all the leaders.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">We review all the big businesses or all the big strategic initiatives in detail, and the senior leadership team is cross-functionally in the weeds. And that is pretty remarkable because they\u2019re sort of reviewing these things week after week, like security \u2014 huge priority, genuinely like a number one focus for the company \u2014 AI, and infrastructure. Then reviewing all of the businesses. It\u2019s very cool to see that other leaders ask the questions and I kind of see the world through their eyes, which is slightly different. So, although there are lots of CEOs, everyone\u2019s looking at everyone else\u2019s businesses and giving advice and feedback. It\u2019s quite an intellectually diverse group.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">And then the other thing I would say is that because there\u2019s obviously an enterprise-style DNA to the company, there\u2019s a real focus on, \u201cwhat does the customer want?\u201d But Google is like, \u201cWhat would be a cool technology for us to build?\u201d Whereas Microsoft\u2019s like, \u201cHow would this actually help the customer and what are they asking for?\u201d And I think both of those strategies have their own benefits, but if you swing one way or the other to an extreme, there are real problems. And so, I\u2019ve certainly enjoyed learning from the fact that Microsoft is very much like, \u201cWhat does the consumer want?\u201d and \u201cWhat does the customer need?\u201d<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>You mentioned security at Microsoft. The renewed focus on security is because there were a <\/strong><a href=\"https:\/\/www.theverge.com\/2024\/4\/25\/24139914\/microsoft-cyber-security-incidents-trust-report\"><strong>bunch of lapses earlier this year<\/strong><\/a><strong>, right? This has been an issue. You have an outsider perspective; you\u2019re building a lot of products that might go out into the world and do things for people. You\u2019re building a lot of products that require a lot of customer data to be maximally useful. As you go into these meetings and you talk about Microsoft\u2019s renewed effort on security because there were some problems in the past, how has that affected your approach to building these products?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I definitely think that the company culture is security-first and \u2014<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>But that\u2019s <em>now<\/em>, I just want to be very clear to the audience. Satya has started saying that now, but it\u2019s because there were these enormous security lapses in the past year.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">That\u2019s true. That is very true. I\u2019m just saying since I\u2019ve started there, I sit in a weekly security meeting where literally all the heads of the companies and various different divisions are singularly focused on what we can do and it is the number one priority. There\u2019s nothing that can override that. No customer demand, no amount of revenue. It is the first thing that everybody asks. So, culturally, as far as I\u2019ve known, it is the central priority, which has been good for me too. I mean, for my businesses it is also mission-critical that we preserve consumer trust and trust means that people expect us to be able to store, manage, and use their data in ways that singularly benefit them and are in their interests. I do think that that is a central part of the culture. And you\u2019re right, maybe that\u2019s a refocusing of late, but it certainly is the case now.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>You also mentioned you have P&amp;Ls as CEOs. I sort of understand how LinkedIn has a P&amp;L, right? They have a product, they have some engineers, they make some money, and people pay for Premium. Microsoft AI, feels like a lot of losses and not so many profits. How are you thinking about balancing that out?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Oh, we\u2019re very profitable. We are very profitable!<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Well, I\u2019m just saying there\u2019s a lot of investment in AI. That stuff hasn\u2019t paid off yet.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">That\u2019s true, that\u2019s true. The AI stuff hasn\u2019t paid off yet. I think it\u2019s fair to say. But remember, I spend over half my time focused on the Bing business, and the Bing business is doing incredibly well. I mean, we grew 18% last quarter and we actually took gains from Google, which means we are growing faster than Google, and that makes everybody feel happy. And that\u2019s kind of the main goal. So, the product is deeply integrated AI. There are generative search results in the context of your search experience. There are increasing conversational experiences there. The general quality that we\u2019ve been able to level up with LLMs has been very impressive, and I think that\u2019s translating into revenue improvements as well.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So, in that sense, AI itself is actually in production across the company. It\u2019s not like we\u2019re just waiting for chatbots to suddenly and miraculously generate a new business model. LLMs are being used at all sizes across the existing business for all kinds of things, like even in Edge, for example, for transcription and summarization built into the browser. There are so many different ways that AI is showing up. You\u2019ve got to think of it more as a new high bar in terms of the table stakes of the features that we offer.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>The part where the LLMs are integrated into a bunch of products like Bing or Edge, are they driving more revenue from those products or are they just taking share away from Google?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So, the way I think about it is that it\u2019s improving the quality of ads that we show, improving the relevance of those ads, and so it\u2019s making the experience more useful for the consumer. And that is\u2026 I mean, obviously, the overall pie is growing, and that\u2019s the nature of the growth. Obviously, Google\u2019s growing too, so the entire market is continuing to grow. The point is that we\u2019re growing faster than Google for this quarter, and I think that\u2019s a huge achievement. The team\u2019s done an amazing job and it\u2019s not about me by the way. That\u2019s a product of many years of them investing in quality and relevance and just generally doing a great job.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Famously, when Bing with Copilot was introduced and I <\/strong><a href=\"https:\/\/www.theverge.com\/23589994\/microsoft-ceo-satya-nadella-bing-chatgpt-google-search-ai\"><strong>sat down with Satya<\/strong><\/a><strong>, he said, \u201cI want to make Google dance.\u201d And then I went and <\/strong><a href=\"https:\/\/www.theverge.com\/2023\/5\/12\/23720731\/google-io-2023-exclusive-sundar-pichai-search-generative-experience-ai-microsoft-bing-chatgpt\"><strong>asked [Google CEO] Sundar [Pichai] about that<\/strong><\/a><strong>. He said, \u201cHe just gave you that quote so that people would run that quote.\u201d And that was kind of his response. Sundar is very calm in that way. You came into it after that whole situation and now you run the products that are <\/strong><a href=\"https:\/\/www.theverge.com\/2024\/12\/5\/24314245\/sundar-pichai-google-search-change-profoundly-2025\"><strong>directly competitive with Google<\/strong><\/a><strong>. Do you think that you are\u2026 you know, you\u2019re growing faster than Google in some places.\u00a0 Do you think that you are actually posing a competitive threat to Google in either Bing with Search or Edge with Chrome?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">One of the things that I\u2019ve realized as I\u2019ve become a bit more experienced and mature over the years is that you have to be very humble about how the landscape changes. I mean, on the one hand, this is an opportunity to relitigate some of the battles of the past. The chips are going to fall into a completely different configuration in the next two or three years. At the same time, that\u2019s a very challenging thing to do. Habits die hard and so on. But our goal with this completely new interface is to make it 10 times easier for people to access information, advice, and support in a truly conversational way, and to do things that our competitors won\u2019t do \u2014 things that are truly useful to everyday consumers. And I think that\u2019s actually going to be one of the differentiators. It\u2019s like what is the personality, the tone, and the emotional intelligence of an AI companion?<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Remember, most people do love information and they like getting accurate and reliable information, but that\u2019s going to be commoditized. All of these models are going to have that. And despite what we like to think in Silicon Valley, surrounded as we are by nerds and information obsessives who read all the content that you can get access to, most people really connect to brands and really connect to ideas in a social way. They connect to it because it is sort of friendly, kind, supportive, and emotionally reassuring, and I think that\u2019s going to form a big part of the way these models actually turn out to be successful in a few year\u2019s time.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>I need to ask you the core <em>Decoder <\/em>question, but then I want to come back to the idea that the information will be commoditized. You\u2019ve described a lot of change. You were at one company, you were at a startup, you\u2019re at Microsoft, you\u2019re learning how Microsoft works. You have big decisions to make about how to deploy these products. What is your framework for making decisions? How do you make them?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The way that I like to operate is in a six-week rhythm. So, I have a six-week cycle, and then we have a one-week meetup for reflection, retrospectives, planning, brainstorming, and being in person. The reality post-COVID is that people work from all kinds of places and they like that flexibility. So, my rhythm is to keep people in person two to three days a week and then really come together for that seventh week of retrospectives. My general framework is to try to be as in the weeds as possible. Okay? Really spend a lot of time in our tools, tracking telemetry, hearing feedback from people, and then creating this very tight operating rhythm where in the context of a cycle, six to seven-week process, we have a very falsifiable mission. Every single team can express in a sentence exactly what it is they\u2019re going to deliver, and it\u2019ll be very falsifiable at the end of that, so we\u2019ll know.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">And then when we observe whether or not that happened, that\u2019s a moment for retrospective and reflection. I really like to write. I\u2019m a writer, I think by writing, and I like to broadcast my writing. So, every week, I write a newsletter to the team that is just like a reflection on what I\u2019ve seen, what I\u2019ve learned, what\u2019s changing, what\u2019s important, and then I document that over time and use that to track and steer where we are going. That\u2019s kind of the basics of how I practically implement my process for reflection and stuff like that. But in terms of the framework, one thing is to really tune in to the fact that no matter what product you invent, no matter how clever your business model is, we are all surfing these exponential waves. And the goal is to predict which capabilities fall out of the next large training model.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">If you overthink that and assume that there\u2019s some genius new ecosystem incentive, new business model, or new UI style, all that is super important. But if you think that it\u2019s only going to be that or that it\u2019s going to be the overwhelming driver, I think that\u2019s a mistake. Maybe this comes from my 15 years of experience in trying to build these models. Remember at DeepMind, 2014 to 2020, I was banging my head against the table trying to ship machine learning models, ship convolutional neural networks (CNNs) in the early days, find classifiers, do re-ranking, try to predict what to watch next on YouTube, trying to do activity classification on your wearables, trying to crash detection algorithms inside of Waymo. Every single applied practical machine learning objective, I explored there. And now, we have the tools to be able to do those things and do them really, really well. They\u2019re really working.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So, we are basically surfing those tides. The goal is to really nail those waves because we already have models that are giving us more than we can extract and apply into products. That\u2019s quite a profound state that we\u2019re in. We haven\u2019t completely extracted all the gains from the current class of frontier language models. Every week, there\u2019s still some new capability, some new trick, or people have crafted or sculpted them in post-training in a new way. And I think that that is going to continue for the next few years to come, many years to come, in fact. So, in terms of the decision-making framework, the goal is to be very focused on model development and scaling those models, getting them to be practical and useful, really aligning them, and getting them to behave in the way that you need for your product.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Let me ask you about that because model development\u2026 and we need to get more of the models we have now. There\u2019s a little bit of tension there. There\u2019s a notion that the scaling laws are going to run out, that the next class of models is not significantly outperforming the models we have now, and I think you can track that in just the way we\u2019re talking about the products.\u00a0<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>A couple of years ago, it was, \u201cAI\u2019s an existential risk, we have to stop it so we can make sure it\u2019s aligned before we kill everyone.\u201d And now, we\u2019re kind of like, \u201cWell, we got to get more out of the models we have now. Actually ship some products, make some money, hopefully, and figure out what it\u2019s all good for and how to best use it because it doesn\u2019t seem like the next generation of models are actually running away as fast as we think they might.\u201d Is that your view that the frontier models are not getting better as fast as we thought they might and so we have to get more out of what we have?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">No, I don\u2019t think that\u2019s true. I think that they\u2019re going to continue to deliver the same seismic gains that we\u2019ve seen in the previous generations. Remember that they\u2019re more costly and more fragile, and they\u2019ll take longer to train this time around. So, we\u2019re not going to see them happen in the same sort of 12 to 18-month timeframe. It\u2019s going to shift to 18 to 24 months and then a bit longer. But I don\u2019t see any sign that there\u2019s a structural slowdown. I kind of see the opposite. There are huge gains to extract from where we are today, but it\u2019s very clear to me that there are also huge gains to extract from the next two orders of magnitude of training as well.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>I want to make sure we talk about the thing you mentioned, the commodification of information, and then I definitely want to make sure we talk about agents real quick to bring this all around to the products to come. The commodification of information is, I think, the big story of the internet that we have today, the platform internet, for lack of a better word. You go to Google, you ask it a question, and now it might spit out an AI-generated answer. You go to MSN, you ask it for the news, and it might algorithmically or with AI sort a bunch of news and summarize that news for you.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Everyone\u2019s headed in this way. We\u2019ve been talking about this for a long time. To train the next-generation models, we need even more information. You\u2019ve gotten yourself into some trouble, I would say, saying that the information on the internet is \u201cfreeware,\u201d and the expectations that you can use it to train. There are a lot of lawsuits, including several pointed at Microsoft. Where do you think that next body of information comes from before we sort out the copyright implications of using all this stuff to train?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">One way of thinking about it is that the more computation you have, the more time these models can spend attending to the various relational components of all that training data. Think of FLOPS as a way to spend understanding time, learning the relationship between all these various training inputs. So, first of all, you can still gain more from just having more computation to learn over all the existing data. The second thing is that we learn a vast amount from interaction data. Users tell us implicitly and explicitly how they feel about an output. Is it high quality? Is it used? Is it ignored? Third, we\u2019re generating vast amounts of synthetic data. That synthetic data is increasingly high quality. When you ask an AI teacher or a rater to compare two or three different examples of the synthetically generated output and the human written output, it\u2019s extremely difficult to detect those precise nuances.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So, the synthetic data is increasingly high quality and used in a whole bunch of different settings. Fourth, I can imagine AIs talking to other AIs, asking for feedback \u2014 AIs that have been primed for different areas of expertise or different styles and prompted in different ways. You can imagine those interactions producing valuable new knowledge, either because they\u2019re grounded in different sources or just because of their stylistic output, they\u2019re producing novel interactions. So, I don\u2019t necessarily see data being the limitation anytime soon. I think that there are still huge benefits to come from scale for the foreseeable future.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>So, that\u2019s all new data, right? You\u2019re going to get a bunch of interaction data. Maybe the synthetic data will be a high enough quality to train the next generation models, but the original data sets were the web. It was a bunch of web content. It was the entire internet, maybe it was to video platforms to some extent from some of the model providers.\u00a0<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>The quote I have from you in June, I think you were speaking to Andrew Ross Sorkin. Here\u2019s a quote, you said, \u201cI think that with respect to content that\u2019s already on the open web, the social contract of that content since the 90s is that it\u2019s fair use, anyone can copy it, recreate with it, reproduce with it. That has been \u2018freeware,\u2019 if you like, that\u2019s been the understanding.\u201d I\u2019m curious\u2026 You said that. That was the understanding for search and there was a lot of litigation around search, Google Image Search, and Google Books that led there. Do you think that that is still stable enough for you in the age of AI with all of the lawsuits outstanding?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">What I was describing in that setting was the way that the world had perceived things up to that point. My take is that just as anyone can read the news and content on the web to increase their knowledge under fair use, so can an AI, because an AI is basically a tool that will help humans to learn from publicly available material. All the material that has been used for generating or training our models has been scraped from publicly available material. Where we \u2014<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>But publicly available and copyrighted are very different things on the internet, right? Publicly available does not mean free of copyright restrictions.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Oh, yeah. I mean, look, obviously, we respect the content providers, so that\u2019s an important distinction. But I guess what I\u2019m trying to say is that from our perspective, there are certain types of content, for example, in our Copilot Daily or MSN Daily that are paywall publisher content that we pay for directly. And what MSN has been doing since the beginning of time. It\u2019s what we\u2019ve decided to do with Copilot Daily for high-quality content because we want those publishers to create an information ecosystem that really works for everybody. And I just think this is one of those situations where things will play themselves out in the courts. At any time when there\u2019s a new piece of technology, it changes the social contract as it is at the moment. There\u2019s clearly a gray area in terms of what constitutes fair use and whether an AI can have the same fair use as a human, and we will just have to play it out over the next few years. I think we\u2019ll have some perspective over that in the next few years as things land.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>One of the reasons that I ask that \u2014 as directly as I\u2019m asking it \u2014 is the cost of training the next generation models is very, very high. But that cost is built on a foundation of, well, the training data is free, and if a couple of court decisions go a couple of ways, the cost of the training data might skyrocket, right? If a court says it\u2019s not fair use to use the New York Times\u2019 content, or it\u2019s not fair use to use these books from these authors. Suddenly you may have to pay a lot of money for that data as well. Do you think that that is something \u2014<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">We already <a href=\"https:\/\/www.theverge.com\/2024\/11\/19\/24300893\/microsoft-ai-training-deal-harpercollins-report\">pay for books on a huge scale<\/a>. So, if it is a copyrighted book, we\u2019re not hoovering that up from the internet. Copyright books and licensed \u2014<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Well, Microsoft might not be, but there\u2019s a very big lawsuit from a bunch of publishers who say that, for example, OpenAI is, right? And that\u2019s the model that you are reliant on. So, it just seems like there\u2019s a&#8230; Maybe legally we\u2019ll see what the answer is, but economically, there\u2019s also a lot of uncertainty here because of the cost of the underlying data.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Yeah, that\u2019s true. And I think our focus has been to make sure that we pay for the really high-quality copyrighted material from publishers \u2014 news publishers, book publishers, and others, and I think that\u2019s going to continue. That\u2019s definitely what we\u2019re committed to.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Who decides what\u2019s high quality?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">That\u2019s actually an interesting question. Quality is actually something that we can measure. We want to make sure that the content, especially from a non-fiction perspective, so we\u2019re particularly interested in academic journals and academic textbooks\u2026\u00a0 We can verify the source and citations for that knowledge, and that is one of the big measures that we consider to be high quality.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>But the <\/strong><a href=\"https:\/\/apnews.com\/article\/artists-ai-image-generators-stable-diffusion-midjourney-7ebcb6e6ddca3f165a3065c70ce85904\"><strong>visual artists<\/strong><\/a><strong>, the non-fiction artists, visual effects artists, the <\/strong><a href=\"https:\/\/www.nbcnews.com\/tech\/tech-news\/hollywood-actor-sag-aftra-ai-artificial-intelligence-strike-rcna94191\"><strong>movie industry<\/strong><\/a><strong>, <\/strong><a href=\"https:\/\/www.theverge.com\/2024\/8\/5\/24213808\/video-game-voice-actor-strike-sag-aftra\"><strong>they\u2019re saying<\/strong><\/a><strong>, \u201cHey, we\u2019re going to get pushed out of work because we are not compensated for any of the work that\u2019s going into these models.\u201d How do you think this plays out for that? Because again, I agree that the law here is deeply uncertain, these cases are going to play out, but I\u2019m looking back at what you\u2019re describing as the social contract of the web. And what I see is, \u201cOh, Google litigated a million of these lawsuits.\u201d That social contract was not&#8230; We didn\u2019t just all wake up one day and decide this is how it\u2019s going to work. Google went to court 15 times and they were a bunch of kids who had slides in the office and they had just made Google. They were very positioned as a company in a moment, and they had a product that was so obviously useful in so many different ways that they kind of got away with it.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>And I don\u2019t know that the tech industry is in that position anymore. I don\u2019t know that the products are so obviously useful the way that putting Google on the internet for the first time ever was so obviously useful, and I certainly don\u2019t know that the feelings from particularly one set of creators are as mixed or too positive as they were for Google back in the 90s and early 2000s. And that to me feels like you\u2019re on the board of The Economist. That to me feels like the people that make the work are having the most mixed emotions of all. Because yes, I think a lot of us can see the value of the products, but we also see the value transfer to the big tech companies, not the upstarts, not the cute kids with the slides in the office.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I think that this is going to be more useful and valuable than search. I think search is completely broken, and I think it\u2019s a total pain in the butt, and we\u2019ve just kind of become used to using a terrible experience. Typing a query&#8230; Just think about what a query is. We had to invent the word \u201cquery\u201d to describe this really weird, restricted way that you express a sentence or a question into a search engine because of the weakness of the search engine. And then you get 10 blue links, and then those things are vaguely related to what you\u2019re looking for. You click on one and then you have to go and refine your query. I mean, it is a painful and slow experience.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I think that if we can get this right, if we can really reduce hallucinations to de minimis amount\u2026 I think we\u2019ve already demonstrated that they don\u2019t have to be toxic, biased, offensive, and all the rest of it. It\u2019s pretty good. It\u2019s not perfect, but it\u2019s getting much much better, and I think it\u2019s only going to get better with more stylistic control. Then these conversational interactions are going to become the future of the web. It\u2019s quite simple. This is the next browser; this is the next search engine.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It is going to be 100 times easier for me to just turn, by voice, to my Copilot and say, \u201cHey, Copilot, what\u2019s the answer to this?\u201d I already do it five times a day. It is my go-to. It\u2019s my bottom right-hand app on my iPhone. My thumb instantly goes to it. I use the power button to open it. My favorite app, like I did with Pi. I mean, it is clearly the future, that conversation interaction. So, to me, the utility is phenomenal, and I think that is going to weigh into the cases as they make their way through the court.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>So, that leads us, I think, directly to agents, where you are going to ask some app on your phone or some part of the operating system on your computer to do something and it will go off and do it. It will bring you the information back or it\u2019ll accomplish some task on your behalf and bring you the result. You and I have talked about this before in various ways. That commodifies a lot of the service providers themselves, right? You say, \u201cI want a sandwich,\u201d and now I don\u2019t know if it\u2019s DoorDash, Uber Eats, Seamless, or whoever is going to bring me the sandwich. My AI is going to go out and talk to them. That implies that they will allow that to happen \u2014 they will allow the agents to use their services.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>In the best case, they would provide APIs for you to do it. In the worst case, they let people click around on their websites, which is a thing that we\u2019ve seen other companies do. And sort of in the medium case, they develop some sort of AI-to-AI conversation. Not quite an API, not quite we\u2019re just literally clicking around on a website and pretending to be human, but our AIs are going to have some conversation. What is the incentive for those companies to build all of those systems or allow that to happen to become disintermediated in that way?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I mean, people often ask when there\u2019s a new technological or scientific revolution and it\u2019s causing a massive amount of disruption, and people are curious. It\u2019s like, \u201cWell, why would someone do that in 10 years?\u201d And then if you look back for centuries, it\u2019s always the case that if it is useful, it gets cheaper and easier to use. It proliferates; it becomes the default. And then the next revolution comes along and completely turns everything on its head. My bet is that every browser, search engine, and app is going to get represented by some kind of conversational interface, some kind of generative interface. The UI that you experience is going to be automagically produced by an LLM in three or five years, and that is going to be the default. And they\u2019ll be representing the brands, businesses, influencers, celebrities, academics, activists, and organizations, just as each one of those stakeholders in society ended up getting a podcast, getting a website, writing a blog, maybe building an app, or using the telephone back in the day.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">The technological revolution produces a new interface, which completely shuffles the way that things are distributed. And some organizations adapt really fast and they jump on board and it kind of transforms their businesses and their organizations, and some don\u2019t. There will be an adjustment. We\u2019ll look back by 2030 and be like, \u201cOh, that really was the kind of moment when there was this true inflection point because these conversational AIs really are the primary way that we have these interactions.\u201d And so, you\u2019re absolutely right. A brand and a business are going to use that AI to talk to your personal companion AI because I don\u2019t really like doing that kind of shopping. And some people do, and they\u2019ll do that kind of direct-to-consumer browsing experience. Many people don\u2019t like it, and it\u2019s actually super frustrating, hard, and slow.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">And so, increasingly you\u2019ll come to work with your personal AI companion to go and be that interface, to go and negotiate, find great opportunities, and adapt them to your specific context. That\u2019ll just be a much more efficient protocol because AIs can talk to AIs in super real-time. And by the way, let\u2019s not fool ourselves. We already have this on the open web today. We have behind-the-scenes, real-time negotiation between buyers and sellers of ad space, or between search ranking algorithms. So, there\u2019s already that kind of marketplace of AIs. It\u2019s just not explicitly manifested in language. It\u2019s operating in vector space.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Well, that\u2019s the part I\u2019m really curious about. The idea that natural language is the paradigm shift. I think it\u2019s very powerful. I don\u2019t think it has been expressed very clearly, but the notion that actually the next form of computing is inherently based in natural language, that I\u2019m just going to talk to the computer and it\u2019s going to go off and do some stuff because it understands me, is very powerful. I buy it.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>How that actually plays out on the back end is the part that, to me, still feels up in the air, right? I\u2019m going to ask for a sandwich, that necessitates there to be companies that are in the business of bringing me a sandwich, and how they talk to my AI and how they stay in business seems very challenging. Right now, those companies, they\u2019re in business because they can sell ad space on my phone to the other companies that actually make the sandwiches. They have upsells. There are a million different ways that these companies make money. If they abstract themselves down to their AI talks to my AI and says, \u201cOkay, here\u2019s a sandwich,\u201d and I take away all of their other revenue opportunities, I\u2019m not sure that that ecosystem can stay relevant or even alive.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I\u2019m not sure about that. I mean, your sandwich-making AI is still going to want to sell itself, be persuasive, be entertaining, and produce content for the consumer, right? It\u2019s not that it kind of completely disintermediates and disconnects. Brand and display advertising is still super relevant, and there will be ways that that sandwich-making AI shows up in the context of your personal AI context in (maybe) a sponsored way too. So, there\u2019ll still be that core framework of keyword bidding, paying for presence, and paying for awareness. There\u2019s still going to be ranking \u2014 that is still going to be relevant to some extent. It\u2019s just that you are going to be represented by a personal AI companion that is going to be that interlocutor or negotiator, and those two AIs are going to have an exchange in natural language, which is what we would want. We\u2019d want to be able to go back and audit that negotiation and check where the error came from,\u00a0 see if it really was a good price in hindsight and all the rest of it.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>As you start to build these products in Copilot, have you had these negotiations with these other providers? Have they started to say what they would want?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">We\u2019ve talked; I wouldn\u2019t describe them as negotiations. I mean, I think lots of brands and businesses are building their own AIs. Today, they\u2019re characterized as customer support AIs that pop up on your website. But tomorrow, in two or three years\u2019 time, they\u2019re going to be fully animated, conversational rich, clever, smart, digital Copilots that live in social media. They\u2019re going to appear on TikTok. They\u2019re going to be part of the cultural space. So I think that there\u2019s not so much negotiation to happen there. I think it\u2019s just this inevitable tide of the arrival of these Copilot agents.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>You run MSN, you obviously have peers at Microsoft who run other kinds of social networks, and other kinds of information products. I see a flood of AI slop choking out some of these networks. I\u2019ve searched Facebook for Spaghetti Jesus and I have seen the other side of the singularity, my friend. We already had one conversation about determining high quality, and the answer is sort of, \u201cI know it when I see it.\u201d But if you run these networks and you\u2019re faced with a bunch of agent AIs who are talking or AI influencers on TikTok, can you label that stuff effectively? Can you make it so that users can only see things from other people?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">You certainly can. It would require a shift in the identity management system of the platform, which has a lot of pros and cons. You can certainly tell which accounts come from a human and which are AI-generated. To some extent, I think there can be digital watermarking and signing for verified human content or verified AI content from a specific source. And then to some extent, there can be detection of synthetically generated content, because that does have a specific signature. Long term, I don\u2019t think that\u2019s a defense. I think it is going to be perfectly photorealistic, very high quality, and it is going to be a game of cat-and-mouse just as it has been in security, privacy, and information for decades and centuries actually. So, I expect that to continue. It is going to get harder and more nuanced, but this is the natural trajectory of things.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Do the people who run LinkedIn or do your folks at MSN say, \u201cThis is a problem that we can\u2019t stop\u201d? We need to make sure we don\u2019t have too much AI content here because right now it\u2019s not good enough. I can see it a mile away. I see those bullet points. I think someone made this with ChatGPT. I don\u2019t even want to read it. Is that a problem that you\u2019re facing right now, or is it a problem to come?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I think it\u2019s a problem to come, but the thing I would say is we humans are behaviorists, right? We observe the output of other humans and we evaluate and decipher trust, based on the quality of information with respect to our own assessment. Is it accurate? Is it reliable? Is that person consistently doing what they said they would do? And so we can observe their actions. Rather than sort of introspecting, why did this happen? Why did this neural network generate this output? Why did this person come to this conclusion? And that\u2019s actually an important distinction because I think a lot of purists are kind of fixated on the causal explanation for why an output has been produced rather than the more observational assessment of, \u201cWas it useful? Does it do the same thing over and over again?\u201d That\u2019s what drives trust.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I do think poor-quality content will be detectable in that sense, or AI content that is deliberately misrepresentative or misinforming will be detectable because I think we\u2019ll have better models. We are getting them all the time for ranking down and deprioritizing certain types of content.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>One of the things that I\u2019ve been thinking about a lot throughout this conversation\u2026 You\u2019re in charge of Microsoft\u2019s consumer business. Microsoft\u2019s consumer business, I think famously right now in 2024, is built around not making the iPhone, right? That\u2019s the thing that Microsoft famously missed in consumer. It has nothing to do with you, but the iPhone happened.\u00a0<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Microsoft pivoted to being an enterprise business, and it\u2019s not slowly coming back because I think the company rightfully sees a platform shift, a paradigm shift, in computing. Apple still exists, and the iPhone still exists. You said, \u201cI\u2019ve got this icon on my iPhone, it made it onto the home screen and it\u2019s in this preferred position,\u201d the position everybody wants in the bottom corner. Apple has a pretty big distribution advantage here. They have a deal with OpenAI to use ChatGPT. Can you make products so good that you overcome the iPhone\u2019s distribution advantage? That they\u2019re bundling into the operating system?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">It is a great question. I mean, distribution and defaults really matter. And so, from our perspective, obviously we\u2019re focused on distribution deals, but fundamentally we are also focused on building something that\u2019s truly differentiated. To me, that AI companion really is going to be differentiated. The tone and the style of that interaction matter. The fact that it will be able to remember you and what you\u2019ve said over time, it will reach out at that opportune moment just before a difficult moment in your life when you\u2019re starting a new job or your kid is having their birthday party, or something \u2014 you\u2019re in a moment where having your companion reach out and be supportive is a differentiator. And that\u2019s how a lot of people make their decisions, and it\u2019s how a lot of people seek support.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">So I think that\u2019s a really big opportunity to spread a good vibe and spread kindness. And I think most apps and most product thinking in Silicon Valley doesn\u2019t really engage with that kind of emotional plane in the way that the advertising industry in New York just thinks of that as second nature, for example. I think that\u2019s a big shift that we\u2019re making as an industry and it\u2019s certainly one of the areas that we are going to be focused on in Copilot. We have to build something that is really beautiful and differentiated. It is going to be a real challenge. It\u2019s not easy.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Do you think this is an opportunity to build consumer hardware again? Not a phone, but whatever comes after the phone?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I am open-minded about that. I think that the voice-first experiences are going to be transformational and they do represent a new platform. I think we\u2019re increasingly tired of our screens. I\u2019m frankly sick of looking at a grid of multicolored icons on my iPhone. I think many people are. You sort of feel trapped down this structured, fixed unit of tapping these things. And I don\u2019t know, I think people are looking for more opportunities to go hands-free and to be away from keyboards and screens, and leave your phone at home. So, I think there\u2019s a lot of opportunity there. I\u2019m very, very interested in that space.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Have you played with the products that are out now? Humane\u2019s? The Rabbit\u2019s?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">I have. I played with all of them, yeah. And I\u2019ve actually just come back from an extended trip to China where I visited all the big manufacturing companies, and got to know those guys. Very impressive what they\u2019re doing out there, moving at light speeds. Very, very interesting to see.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Should we expect hardware from you?<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">Not anytime soon, but I think we are a huge company. We\u2019re keeping an open mind about lots of things and we will see how things go.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\"><strong>Very good. Well, Mustafa, we\u2019re going to have to have you back very soon. I have a million questions here I didn\u2019t get a chance to ask you. This was great. Thank you so much for being on the show.<\/strong><\/p>\n<\/div>\n<div class=\"duet--article--article-body-component\">\n<p class=\"duet--article--dangerously-set-cms-markup duet--article--standard-paragraph mb-20 font-fkroman text-18 leading-160 -tracking-1 selection:bg-franklin-20 dark:text-white dark:selection:bg-blurple [&amp;_a:hover]:shadow-highlight-franklin dark:[&amp;_a:hover]:shadow-highlight-blurple [&amp;_a]:shadow-underline-black dark:[&amp;_a]:shadow-underline-white\">This has been a lot of fun. Thanks, Nilay. I really appreciate it. Talk to you soon.<\/p>\n<\/div>\n<div class=\"duet--article--article-body-component clear-both block\">\n<div class=\"duet--article--action-box action-box mb-20 border-t border-blurple px-12 pt-16 font-polysans-mono text-14 leading-130 -tracking-2 text-blurple md:text-15 md:flex md:flex-row md:items-start md:justify-between\">\n<div class=\"mb-14 md:mb-0\">\n<h2 class=\"inline font-medium\">Decoder with Nilay Patel<!-- --> <!-- --> \/ <\/h2>\n<p class=\"duet--article--dangerously-set-cms-markup text-sm md:text-base inline font-light\">A podcast from The Verge about big ideas and other problems.<\/p>\n<\/div>\n<p><a class=\"duet--article--dangerously-set-cms-markup inline-block whitespace-nowrap rounded-sm border border-blurple px-18 py-12 text-12 font-medium uppercase tracking-12 no-underline hover:bg-blurple hover:text-white md:ml-28\" href=\"https:\/\/pod.link\/decoder\">SUBSCRIBE NOW!<\/a><\/div>\n<\/div>\n<\/div>\n<p><script async src=\"https:\/\/pagead2.googlesyndication.com\/pagead\/js\/adsbygoogle.js?client=ca-pub-3711241968723425\"\r\n     crossorigin=\"anonymous\"><\/script>\r\n<ins class=\"adsbygoogle\"\r\n     style=\"display:block\"\r\n     data-ad-format=\"fluid\"\r\n     data-ad-layout-key=\"-fb+5w+4e-db+86\"\r\n     data-ad-client=\"ca-pub-3711241968723425\"\r\n     data-ad-slot=\"7910942971\"><\/ins>\r\n<script>\r\n     (adsbygoogle = window.adsbygoogle || []).push({});\r\n<\/script><br \/>\n<br \/><div data-type=\"_mgwidget\" data-widget-id=\"1660802\">\r\n<\/div>\r\n<script>(function(w,q){w[q]=w[q]||[];w[q].push([\"_mgc.load\"])})(window,\"_mgq\");\r\n<\/script>\r\n<br \/>\n<br \/><a href=\"https:\/\/www.theverge.com\/24314821\/microsoft-ai-ceo-mustafa-suleyman-google-deepmind-openai-inflection-agi-decoder-podcast\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Today, I\u2019m talking with Mustafa Suleyman, the CEO of Microsoft AI.\u00a0 Mustafa is a fascinating character in the world of AI \u2014 he\u2019s been in and out of some pivotal &hellip; <a href=\"https:\/\/hotvideos24.online\/?p=135237\" class=\"more-link\">Read More<\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8630],"tags":[],"class_list":["post-135237","post","type-post","status-publish","format-standard","hentry","category-technology","entry"],"_links":{"self":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/135237","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=135237"}],"version-history":[{"count":0,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=\/wp\/v2\/posts\/135237\/revisions"}],"wp:attachment":[{"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=135237"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=135237"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/hotvideos24.online\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=135237"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}