Nvidia CEO Jensen Huang delivers keynote at Computex 2026 in Taiwan (full speech)

[00:00:00] So good to see all of you. [00:00:05] Very good to be home. [00:00:07] I brought my parents home. [00:00:08] Where are my parents? [00:00:09] Everyone give a round of applause to my mom and dad. [00:00:19] And a round of applause for our pre-game show, Superstars, ladies and gentlemen. [00:00:30] Look how adorable they are. [00:00:35] The superstars of Taiwan. [00:00:38] There are so many of you here today. [00:00:39] We are broadcasting this right now to 70 other watch parties across Taiwan. [00:00:48] 70 different conferences are going at the same time. [00:00:52] Everybody is watching this to you. [00:00:54] We have so much to tell you, and I have so many partners to thank. [00:00:58] It is incredible how large our ecosystem in Taiwan has become. [00:01:03] Most of the time, when people think about an ecosystem, they think about our software staff. [00:01:09] They think about the developer ecosystem above the computing systems that NVIDIA builds. [00:01:15] But NVIDIA's ecosystem spans all the way upstream to all of our supply chain, here in Taiwan, where it all begins, and downstream all the way to data centers and eventually to end users. [00:01:30] Today, we're going to talk about almost all of the ecosystem. [00:01:34] There are so many people to thank. [00:01:36] I love my ecosystem here. [00:01:39] I mean, there are so many companies here, and some of my favorite ecosystem partners. [00:01:44] First. [00:02:14] So many. [00:02:19] Taiwan's rich ecosystem. [00:02:24] The richest ecosystem. [00:02:26] The world's best supply chain ecosystem. [00:02:29] Unbelievable. [00:02:30] Well, thank you all for being here. [00:02:32] And this year, our businesses together are growing incredibly. [00:02:37] In fact, somebody told me last night that the annual GDP of Taiwan [00:02:43] is going to grow almost 10%. [00:02:53] Unbelievable. [00:02:54] Well, we have a lot to talk about. [00:02:56] Let's get going. [00:02:57] Two years ago when I was here, I started to talk to you about [00:03:01] how AI has moved from Gentic AI and the other waves of AIs that are coming. [00:03:06] The next wave of AI was agentic AI. [00:03:09] And today, we can say that agentic AI has arrived, that useful AI has arrived. [00:03:16] Now, what does this mean? [00:03:18] This is GitHub. [00:03:20] Of course, one of the first applications of agentic AI is software coding. [00:03:25] One of the most valuable professions. [00:03:28] An incredibly large ecosystem. [00:03:30] 30 million, 40 million professional software developers. [00:03:35] Probably another couple of hundred who are students and enthusiasts and so on and so forth. [00:03:41] But say, 30, 40 million software developers in the world code for a living. [00:03:48] And this represents most of them. [00:03:50] This is GitHub. [00:03:51] The pull request is when they download software, they modify it, and commit is when they push it back up. [00:03:58] Okay? [00:03:59] And so, if you could look at this, in 2023, the number of commits was 300 million. [00:04:09] 2024, 400 million. [00:04:10] 2024, 400 million. [00:04:12] 2025, 500 million commits. [00:04:16] In the first few months, in the first few months of 2026, it has nearly tripled. [00:04:26] Now, what does that mean? [00:04:28] 30 million software developers representing about $3 trillion worth of GDP. [00:04:37] Producing three, that's what they're paid. [00:04:40] $3 trillion worth of salaries per year, which is generating economic growth for the rest of the industries. [00:04:49] Say $100 trillion of the world's industries is impacted, is generated by $3 billion worth of salary. [00:04:58] That $3 trillion, excuse me, $3 trillion. [00:05:00] That $3 trillion worth of salary is now producing nearly three times as much output. [00:05:08] It's effectively a $9 trillion productivity from $3 trillion of sellers. [00:05:18] Does that make any sense? [00:05:20] The difference is absolutely extraordinary. [00:05:23] This is the potential. [00:05:24] This is the promise of AI. [00:05:26] The number of engineers, software engineers, is actually increasing. [00:05:29] People talk about AI reducing jobs. [00:05:32] Complete nonsense. [00:05:33] It's causing more software engineers to be higher than the reason for that. [00:05:38] It's very simple. [00:05:39] If you can hire a software engineer, and you can generate $9 trillion worth of productive work, [00:05:47] why would you want to hire more software engineers? [00:05:51] If that line was flat, then obviously people will hire fewer software engineers. [00:05:57] But because the output is so incredible, people want to hire more software engineers. [00:06:01] This is going to show up in our economy somehow soon. [00:06:04] And so the first thing is useful AI has arrived. [00:06:08] Now what does that mean from the industry's perspective? [00:06:11] From the industry's perspective, that means that tokens are now in extraordinary demand. [00:06:17] Because if you could do this, you're going to want to produce more of it. [00:06:20] And because tokens are now profitable units. [00:06:23] Tokens are now profitable units of revenues. [00:06:28] Because it is now profitable, the AI companies want to build a lot more tokens, generate a lot more tokens, build more AI factories. [00:06:37] Which is the reason why compute demand here in Taiwan has skyrocketed. [00:06:43] It is precisely the reason why all of you are so busy and your businesses are doing so well. [00:06:49] In fact, that looks like some of your stock price. [00:07:01] The compute pattern has changed. [00:07:03] Everything has changed. [00:07:04] So the first idea is that useful AI has arrived. [00:07:09] AI is now a profit generator. [00:07:12] AI is now a GDP generator. [00:07:15] Behind it is a whole new kind of computing pattern. [00:07:19] Not just a large language model, but an agent. [00:07:22] Today, almost everything we're going to talk about is going to be based on this. [00:07:27] So let me take a quick moment and show you what I'm talking about. [00:07:30] Inside, this is an agent. [00:07:33] It's an agent application. [00:07:36] In the old days, this would be application. [00:07:40] This would be code. [00:07:42] And this would be operating system. [00:07:45] Application, code, running inside an application, inside an operating system. [00:07:52] Today, it is agent which consists of a large language model, or many, sitting inside a harness. [00:08:01] And that harness helps it orchestrate it to do productive work. [00:08:06] This is the input. [00:08:08] When that input comes, it has to understand, observe, reason, act, use tools. [00:08:16] Use tools. [00:08:17] That tool could be a spreadsheet, web browser, a data processing engine, database engine, for example. [00:08:25] This is orchestrated. [00:08:26] This is orchestrated. [00:08:27] This is hard to orchestrate this routing of information. [00:08:32] Every single time it touches either processing the context, understanding what is happening, reasoning about what to do, coming up with a plan that it acts on, that orchestration path is orchestrated by some software. [00:08:50] And so this is fundamentally an agent. [00:08:55] It deals with short-term memory, called working memory, long-term memory, just like we do. [00:09:00] We have long-term memory. [00:09:01] And so the memory management system is incredibly important. [00:09:05] This entire system is called an agent. [00:09:09] The large language model is used to do the thinking, and the harness connects everything together, just like an operating system. [00:09:20] Okay? [00:09:21] And so this is the new computing model, and this is what an agent. [00:09:24] It could do incredible things. [00:09:26] This is the big breakthrough. [00:09:28] The simultaneous, the convergence of large language models that are now able to do a really good job thinking, reasoning, planning, using tools, and the fact that we have now these harnesses that manages memory, the orchestration, uses tools. [00:09:46] We can now do amazing things. [00:09:47] Let me give you some examples. [00:09:50] This is a prompt. [00:09:51] This is the prompt. [00:09:52] This is the code that is generated, and this comes out. [00:09:59] This is the input. [00:10:02] And that's the output. [00:10:05] What do you guys think? [00:10:06] It's pretty amazing, right? [00:10:07] We use Cloud Code here, but Codex does an incredible job as well. [00:10:17] Here's another example. [00:10:18] This is the input. [00:10:19] Create a GIF, NVIDIA green dots on black scatter, form Taiwan 101 building, morph to GTC Taipei 2026, morph to NVIDIA i logo, then scatter and repeat. [00:10:36] Right? [00:10:37] So you saw that. [00:10:38] That was the prompt. [00:10:39] Here's the next one. [00:10:40] I lost my remote control battery clip. [00:10:42] It looks like this. [00:10:44] Create a CAD file. [00:10:46] It uses a tool. [00:10:47] Create a CAD file. [00:10:48] Ready for 3D printing to create a new one. [00:10:52] Make sense? [00:10:53] This is now the new computing pattern. [00:10:57] Whereas we used to launch an application, click and type. [00:11:03] We now replace that with explaining to the AI what we want, our intent, and the AI generates the code or uses tools and produce the necessary output. [00:11:17] This is how computers are going to work in the future. [00:11:21] This is agentic AI. [00:11:24] For two years, we've been building towards this. [00:11:26] And now it has arrived. [00:11:28] Now, one of the big breakthroughs, of course, is tool use. [00:11:32] A lot of people have said, you know, Jensen AI is coming. [00:11:36] Agentic AI is coming. [00:11:37] Therefore, all of the software companies are going to go out of business. [00:11:40] I said, it's exactly the opposite. [00:11:42] Because there are going to be so many agents, the world is no longer limited by the number of people. [00:11:49] Therefore, those agents are going to use more tools than ever. [00:11:54] This is actually an incredible time to be a software company. [00:11:58] But the software has to be presented to the agent in a way that the agent can use it. [00:12:05] This is a big breakthrough. [00:12:07] And in fact, what we have done, as you know, what NVIDIA's treasure is, is all of our CUDA libraries. [00:12:15] I call them CUDAX libraries. [00:12:17] This is NVIDIA's treasure. [00:12:18] Today, we're able to now present these CUDAX libraries to agents who can use it much more effectively than even humans. [00:12:30] And so, this is a wonderful time for CUDAX libraries. [00:12:33] Let's take a look. [00:12:38] Twenty years ago, we built CUDA, a single architecture for accelerated computing. [00:12:43] We reinvented computing. [00:12:45] A thousand CUDAX libraries help developers make breakthroughs in every field of science and engineering. [00:12:52] CUDAX libraries are tools for agents. [00:12:57] CULitho for computational lithography. [00:13:01] CUOpt for decision optimization. [00:13:06] CUDSS for direct sparse solvers. [00:13:11] AIQ for deep research across structured and unstructured documents. [00:13:16] Arial for AI-RAN. [00:13:21] Warp for differentiable physics. [00:13:24] Parabricks for genomics. [00:13:27] At their foundation are algorithms. [00:13:30] And they are beautiful. [00:13:32] At their foundation, they are beautiful. [00:13:35] At their foundation, they are beautiful. [00:13:37] At their foundation, they are beautiful. [00:13:39] At their foundation, they are beautiful. [00:13:40] At their foundation, they are beautiful. [00:13:41] At their foundation, they are beautiful. [00:13:42] At their foundation, they are beautiful. [00:13:43] At their foundation, they are beautiful. [00:13:44] At their foundation, they are beautiful. [00:13:45] At their foundation, they are beautiful. [00:13:46] At their foundation, they are beautiful. [00:13:47] At their foundation, they are beautiful. [00:13:48] At their foundation, they are beautiful. [00:13:49] At their foundation, they are beautiful. [00:13:50] At their foundation, they are beautiful. [00:13:51] At their foundation, they are beautiful. [00:13:52] At their foundation, they are beautiful. [00:13:53] At their foundation, they are beautiful. [00:13:54] At their foundation, they are beautiful. [00:13:55] At their foundation, they are beautiful. [00:13:56] At their foundation, they are beautiful. [00:13:57] At their foundation, they are beautiful. [00:13:58] At their foundation, they are beautiful. [00:13:59] At their foundation, they are beautiful. [00:14:07] At their foundation, they are beautiful. [00:14:08] At their foundation, they are beautiful. [00:14:09] At their foundation, they are beautiful. [00:14:10] At their foundation, they are beautiful. [00:14:11] At their foundation, they are beautiful. [00:14:12] At their foundation, they are beautiful. [00:14:13] At their foundation, they are beautiful. [00:14:14] At their foundation, they are beautiful. [00:14:15] At their foundation, they are beautiful. [00:14:16] At their foundation, they are beautiful. [00:14:17] At their foundation, they are beautiful. [00:14:18] At their foundation, they are beautiful. [00:14:19] At their foundation, they are beautiful. [00:14:20] At their foundation, they are beautiful. [00:14:21] At their foundation, they are beautiful. [00:14:22] At their foundation, they are beautiful. [00:14:23] At their foundation, they are beautiful. [00:14:24] At their foundation, they are beautiful. [00:14:25] At their foundation, they are beautiful. [00:14:26] At their foundation, they are beautiful. [00:14:27] At their foundation, they are beautiful. [00:14:28] At their foundation, they are beautiful. [00:14:37] At their foundation, they are beautiful. [00:14:38] At their foundation, they are beautiful. [00:14:39] At their foundation, they are beautiful. [00:14:40] At their foundation, they are beautiful. [00:14:41] At their foundation, they are beautiful. [00:14:42] At their foundation, they are beautiful. [00:14:43] At their foundation, they are beautiful. [00:14:44] At their foundation, they are beautiful. [00:14:45] At their foundation, they are beautiful. [00:14:46] At their foundation, they are beautiful. [00:14:47] At their foundation, they are beautiful. [00:14:48] At their foundation, they are beautiful. [00:14:49] At their foundation, they are beautiful. [00:14:50] At their foundation, they are beautiful. [00:14:51] At their foundation, they are beautiful. [00:14:52] At their foundation, they are beautiful. [00:14:53] At their foundation, they are beautiful. [00:14:54] At their foundation, they are beautiful. [00:14:55] At their foundation, they are beautiful. [00:14:56] At their foundation, they are beautiful. [00:14:57] At their foundation, they are beautiful. [00:14:58] At their foundation, they are beautiful. [00:15:07] At their foundation, they are beautiful. [00:15:08] At their foundation, they are beautiful. [00:15:09] At their foundation, they are beautiful. [00:15:10] At their foundation, they are beautiful. [00:15:11] At their foundation, they are beautiful. [00:15:12] At their foundation, they are beautiful. [00:15:13] At their foundation, they are beautiful. [00:15:14] At their foundation, they are beautiful. [00:15:15] At their foundation, they are beautiful. [00:15:16] At their foundation, they are beautiful. [00:15:17] At their foundation, they are beautiful. [00:15:18] At their foundation, they are beautiful. [00:15:19] At their foundation, they are beautiful. [00:15:20] At their foundation, they are beautiful. [00:15:21] At their foundation, they are beautiful. [00:15:22] At their foundation, they are beautiful. [00:15:23] At their foundation, they are beautiful. [00:15:24] At their foundation, they are beautiful. [00:15:25] At their foundation, they are beautiful. [00:15:26] At their foundation, they are beautiful. [00:15:27] At their foundation, they are beautiful. [00:15:28] At their foundation, they are beautiful. [00:15:37] At their foundation, they are beautiful. [00:15:38] At their foundation, they are beautiful. [00:15:39] At their foundation, they are beautiful. [00:15:40] At their foundation, they are beautiful. [00:15:41] At their foundation, they are beautiful. [00:15:42] At their foundation, they are beautiful. [00:15:43] At their foundation, they are beautiful. [00:15:44] At their foundation, they are beautiful. [00:15:45] At their foundation, they are beautiful. [00:15:46] At their foundation, they are beautiful. [00:15:47] At their foundation, they are beautiful. [00:15:48] At their foundation, they are beautiful. [00:15:49] At their foundation, they are beautiful. [00:15:50] At their foundation, they are beautiful. [00:15:51] At their foundation, they are beautiful. [00:15:52] At their foundation, they are beautiful. [00:15:53] At their foundation, they are beautiful. [00:15:54] At their foundation, they are beautiful. [00:15:55] At their foundation, they are beautiful. [00:15:56] At their foundation, they are beautiful. [00:15:57] At their foundation, they are beautiful. [00:15:58] At their foundation, they are beautiful. [00:16:07] At their foundation, they are beautiful. [00:16:09] At their foundation, they are beautiful. [00:16:10] At their foundation, they are beautiful. [00:16:11] At their foundation, they are beautiful. [00:16:12] At their foundation, they are beautiful. [00:16:13] At their foundation, they are beautiful. [00:16:14] At their foundation, they are beautiful. [00:16:15] At their foundation, they are beautiful. [00:16:16] At their foundation, they are beautiful. [00:16:17] At their foundation, they are beautiful. [00:16:18] At their foundation, they are beautiful. [00:16:19] At their foundation, they are beautiful. [00:16:20] At their foundation, they are beautiful. [00:16:21] At their foundation, they are beautiful. [00:16:22] At their foundation, they are beautiful. [00:16:23] At their foundation, they are beautiful. [00:16:24] At their foundation, they are beautiful. [00:16:25] They are beautiful. [00:16:26] At their foundation, they are beautiful. [00:16:27] At their foundation, they are beautiful. [00:16:28] At their foundation, they are beautiful. [00:16:29] At their foundation, they are beautiful. [00:16:30] The computing pattern of software is going to change. [00:16:40] In fact, let's come back to this. [00:16:42] This is the agent. [00:16:43] It is the ultimate disaggregated and distributed computing model. [00:16:53] So many different computers are going to be activated in order to process this agent. [00:16:58] The agent consists of model, harness, tools and skills, and a runtime. [00:17:10] All of that is running at different places in a data center. [00:17:15] You can think of the model as the brain. [00:17:19] The harness as the body. [00:17:22] The tools that it uses working in a runtime. [00:17:27] Think of it as a workshop. [00:17:29] So this is a person, a worker working with tools in a workshop. [00:17:35] Of course, this is being done at extraordinarily large scales. [00:17:39] And each one of those steps are running in a different part of the computer. [00:17:44] And you could see the large language model is thinking, context processing, observing, understanding the environment, reasoning, coming up with a plan, and acting on the plan. [00:17:58] Every single time that happens, an entire rack of Grace Blackwell NVLink 72 is activated. [00:18:05] It's thinking with the large language model. [00:18:08] Whenever it uses a tool, a CPU is used. [00:18:13] That tool could be a C compiler. [00:18:16] It could be Python. [00:18:17] It could be JavaScript. [00:18:18] Or it could be accelerated computing. [00:18:21] Today's agents are relatively simple users of tools. [00:18:26] Tomorrow, they're going to be very sophisticated users of tools, which is the reason why the CUDAX libraries that I showed you are going to be incredibly popular with agents. [00:18:36] They solve some of the most important problems the world knows. [00:18:40] And all of our CUDAX libraries are now going to come with skills that the AI could learn how to use. [00:18:49] So the CUDAX library, some skills, basically a manual, the AI reads it and go, "Aha, that's how you use it." [00:18:59] The ability to use these libraries by agents are going to be incredible. [00:19:04] And so the tools run on CPUs and GPUs and large language models. [00:19:09] The security harness runs on CPUs and a security processor called the DPU, NVIDIA's Bluefield. [00:19:18] The orchestration of all this runs on a CPU. [00:19:21] This is the entire harness, and the CPU is orchestrating all of the work. [00:19:26] One of the hardest parts is memory. [00:19:29] You could just imagine. [00:19:30] The working memory is called KV caching. [00:19:33] What to remember, compaction, not just compression, but how to retrieve. [00:19:39] Do you retrieve structured data? [00:19:41] Do you retrieve unstructured data? [00:19:43] What is the ontology, the relationship of all of these different data to itself? [00:19:49] That entire processing is incredibly complicated. [00:19:52] The memory system, the memory system of AIs is going to cause the storage system to be completely revolutionized. [00:20:01] As you can see, every aspect of this computing model, this computing pattern, this new application called an agent is fundamentally different than the way that applications used to run. [00:20:16] A whole bunch of software sitting inside a binary, sitting inside an operating system. [00:20:21] This is the reason this disaggregated, this distributed, this heterogeneous computing problem is precisely the reason we built our next generation. [00:20:34] Verirubin. [00:20:35] Verirubin. [00:20:36] Verirubin is not one chip. [00:20:39] Verirubin is not a GPU only. [00:20:42] It starts with the GPU. [00:20:44] But Verirubin is incredible. [00:20:47] This entire thing is Verirubin. [00:20:52] From end to end. [00:20:54] It has GPUs. [00:20:56] Verirubin, NVLink 72. [00:20:59] It is orchestrated by Verirubin CPUs that I'm going to tell you more about. [00:21:03] The storage systems. [00:21:05] Revolutionary. [00:21:06] Verirubin. [00:21:07] Verirubin. [00:21:08] Along with CX-9. [00:21:09] Our software stack called Doka. [00:21:12] The security processor that's inside so that everything is encrypted at rest, in motion, as well as in use. [00:21:23] Everything across this is secure because the AI model is so precious. [00:21:28] This is the reason why this entire system obeys confidential computing. [00:21:34] Each one of these systems would be a complete revolution in itself. [00:21:39] Verirubin is the most ambitious endeavor in the history of our company. [00:21:45] The whole company worked on Verirubin across all 40,000 engineers. [00:21:51] Not to mention all of you. [00:21:53] All of you participated in the creation of this entire system. [00:21:57] Verirubin is really a miracle. [00:22:00] And it's not just one chip. [00:22:01] It is so many. [00:22:02] Well, it's even beyond that. [00:22:05] A long time ago, NVIDIA used to be a GPU company. [00:22:09] But over the years we've evolved to become a systems company. [00:22:15] You're looking here now for the most complex systems, most complex and ground up system ever designed. [00:22:23] But ultimately, our customers, our partners don't want to buy computers. [00:22:30] They want to build AI factories, which is the reason why NVIDIA has really started to transform ourselves yet again. [00:22:37] You could see so much of our technology is now at the entire infrastructure scale. [00:22:44] Our partners are at infrastructure scale. [00:22:47] Power generators, cooling systems, the grid providers. [00:22:52] So many industrial companies are now part of our ecosystem. [00:22:57] Because ultimately, we're trying to build an entire stack just like GPUs. [00:23:02] Just like when we were building Grace Blackwell NVLink 72. [00:23:06] Just like now, we are building a full stack system so that our customers could build amazing AI infrastructure. [00:23:15] Let's take a look. [00:23:19] The world is racing to build AI factories. [00:23:22] The largest infrastructure build out in human history. [00:23:25] AI factories are incredibly complex. [00:23:28] Every layer, chip, rack, network, power, cooling, grid, must be designed together from end to end. [00:23:36] Because compute is revenues. [00:23:41] NVIDIA DSX is the blueprint. [00:23:44] A reference design for building and operating AI factories at maximum efficiency and profitability. [00:23:50] It starts with DSX-SIM. [00:23:53] With the DSX-SIM Omniverse blueprint. [00:23:55] Partners design and validate an NVIDIA Vera Rubin AI factory before a single rack lance. [00:24:01] They plan the layout. [00:24:06] Simulate the power and cooling. [00:24:11] Design the network. [00:24:12] Validate every integration. [00:24:14] Test every change in the digital twin. [00:24:17] The factory powers on. [00:24:18] DSX-OS takes over and provisions, operates, monitors, and remediates the infrastructure. [00:24:26] Turning the installed systems into trusted, multi-tenant, resilient, AI-ready capacity. [00:24:35] Today's AI factories over provision power by up to 40%. [00:24:39] DSX-MAX LPS lets operators safely deploy more GPUs inside the same power budget. [00:24:46] Adding billions in annual revenue. [00:24:52] Breakthrough hot liquid cooling at 45 degrees Celsius uses less water and energy. [00:24:58] More power going to revenue generating compute. [00:25:01] Incredible. [00:25:03] Dynamic power allocation steers power from rack to rack. [00:25:07] Recovering stranded watts, sending them where work is happening. [00:25:11] In-rack power smoothing flattens peak current spikes and power surges. [00:25:19] Throughout the factory, teams of AI agents work with DSX-MAX LPS, continuously coordinating to balance cooling and power to meet workload demand. [00:25:30] DSX-ai factories are flexible energy assets that operate cooperatively with the grid. [00:25:36] DSX-Flex reads real-time grid signals and dynamically adjusts factory power when the grid needs relief. [00:25:44] A hundred gigawatts of AI factories will come online before the end of the decade. [00:25:50] NVIDIA DSX-AI factories run at highest efficiency, produce the lowest cost tokens, and make the grid stronger. [00:25:59] NVIDIA DSX-AI factories run at highest efficiency, the lowest cost tokens. [00:26:02] NVIDIA DSX-AI factories run at highest efficiency. [00:26:04] NVIDIA DSX-AI factories run at highest efficiency. [00:26:05] NVIDIA DSX-AI factories run at highest efficiency. [00:26:06] NVIDIA DSX-AI factories run at highest efficiency. [00:26:07] NVIDIA DSX-AI factories run at highest efficiency. [00:26:08] I've shown you ecosystem slides of the past where NVIDIA's computing layers and software and software and computing stacks are integrated into other people's platforms, third-party platforms and libraries that serve end markets. [00:26:25] That was a computing ecosystem. [00:26:28] This is an AI factory ecosystem. [00:26:31] This is way downstream of all of you. [00:26:34] downstream of me is all of you, and downstream of us is this ecosystem. [00:26:39] Because NVIDIA ultimately is not just building a GPU, not just building a system. [00:26:46] We're helping customers build these AI factories, these AI infrastructure that is so immensely complex. [00:26:53] Each one of these at one gigawatt level started at 30, 20, 30 billion dollars. [00:27:01] It is at 50, 60 billion dollars, and soon it will be 80, 100 billion dollars per gigawatt. [00:27:09] 100 billion dollars into an AI factory. [00:27:13] It must work the first time, and it must work right away. [00:27:18] The cost of capital is incredible. [00:27:20] The complexity is incredible. [00:27:22] So as you see, we used to design a chip inside a computer. [00:27:27] And then we simulated a system inside a computer. [00:27:32] Today, you saw just now, everything was built in Omniverse. [00:27:38] I've been working with Omniverse with all of you for a long time. [00:27:42] This was the dream come true. [00:27:44] So that we can build these gigantic systems as large as the world wants to build. [00:27:50] Inside a digital framework, inside a digital simulator, in a digital world. [00:27:55] Long before we build the first break ground and put our money to work. [00:28:01] So this is our ecosystem. [00:28:03] We call it DSX. [00:28:05] RTX is for our GPU, DGX is for our systems, and now DSX, basically infrastructure. [00:28:13] Because of the work that we do here, across this entire stack, including our systems and software, [00:28:19] it's the reason why we can work with small companies and enable them to be world-class AI clouds. [00:28:25] Every one of these I'm about to show you are small companies just recently. [00:28:30] And now CoreWeave is worth $50, $60, $70 billion and growing incredibly fast. [00:28:36] Recently, we worked with Nebius, and again, they're growing incredibly fast. [00:28:41] Each one of these clouds have incredible customers. [00:28:45] Cursor, the software coding company, Black Mountain Labs, Image Generation, World Labs, [00:28:52] World Foundation Model, Revolut, the leading financial services AI company, and Shopify. [00:28:59] Here's another one. [00:29:01] This is Nscale, and their customers are British Telecom, Google. [00:29:06] Google is using one of our AI clouds. [00:29:10] Thinking machines, a Frontier Labs company, which is super exciting. [00:29:14] Here's Naver Cloud in Korea, Bank of Korea, Hyundai, so many incredible companies. [00:29:22] And in India, Yoda, incredible companies. [00:29:27] Here's one based in Singapore, building in Australia, Together AI, AI Singapore. [00:29:34] This is one in Indonesia. [00:29:36] Each one of these companies, each one of these companies are serving regional as well as global customers. [00:29:44] AI is going to run everywhere. [00:29:46] Every company will be powered by it. [00:29:49] Every region will build it. [00:29:53] Endostat here in Indonesia. [00:29:55] Here in Taiwan, GMI. [00:29:59] Here in Taiwan, GMI. [00:30:01] It's okay to clap. [00:30:08] So, incredible, incredible, incredible companies, incredible opportunity. [00:30:14] But all of them need several things. [00:30:16] Of course, they need the computing stack. [00:30:18] This entire stack underneath. [00:30:20] This is what made NVIDIA famous. [00:30:22] All of our hardware and software and libraries. [00:30:26] Our connection into the world's ecosystem of third-party developers makes it possible for anyone to stand up an AI cloud. [00:30:35] However, the AI cloud is so complex now. [00:30:39] This is the software version. [00:30:41] This is the computer science version. [00:30:42] This is the computer science version. [00:30:44] The money version. [00:30:46] The asset version is what I showed you earlier. [00:30:50] It's a giant factory. [00:30:52] Having this ability alone is not enough, which is the reason why NVIDIA has become an AI infrastructure company. [00:31:00] Now, doing this well and becoming incredibly good at helping customers build AI factories and deploying AI factories [00:31:10] is incredibly important. [00:31:12] And the reason for that is this. [00:31:14] Compute is revenue now. [00:31:16] Compute is profit. [00:31:18] The absence of revenues and profit is loss. [00:31:22] And so, it's really important to realize that this is an example of an AI infrastructure coming online. [00:31:33] It could be coming online quickly. [00:31:37] It could take a while. [00:31:39] Its throughput could be high. [00:31:40] It could be low. [00:31:42] Its resilience and reliability could be good or bad. [00:31:46] And its lifetime of usefulness could be long or short. [00:31:50] Because this represents 50, 60, going to $100 billion. [00:31:58] This curve matters greatly. [00:32:01] Which is the reason why NVIDIA is such a great partner working with us because of our fully integrated capability. [00:32:10] We didn't just come up with a PowerPoint slide. [00:32:13] We created the entire infrastructure. [00:32:16] We connected everything together. [00:32:17] We built out billions and billions of it ourselves to make sure that everything works well. [00:32:24] As a result of that, our time, our time to first token, our time to first token, our time to first inference, our time to training turned on is much faster. [00:32:40] For a second, because our throughput per watt, our tokens per watt, is utterly world class. [00:32:50] And the reason for that is because we integrate everything. [00:32:52] We design everything from the ground up, we simulate the entire system, and we use extreme co-design. [00:32:58] Just like I showed you just now with the Vera Rubin rack, everything was designed in order to deliver on this incredible throughput. [00:33:06] But if your data center, if your factory has one gigawatt, it will not have more. [00:33:16] One gigawatt means one gigawatt. [00:33:19] That's all the power generation you could do. [00:33:22] If you have one gigawatt of power, then throughput per watt is revenues because every token is profitable. [00:33:32] Every token is revenues. [00:33:35] This is the future. [00:33:37] Compute is revenues. [00:33:39] Performance per watt is your revenues. [00:33:41] Choosing the wrong architecture, just because the chips are cheaper, doesn't translate, doesn't make sense. [00:33:51] You need to make sure that your revenues per watt, the more you buy, the more you make. [00:33:57] And so tokens per watt. [00:34:00] And then lastly, very light. [00:34:03] Oh, second. [00:34:04] Third is reliability. [00:34:06] If you ever get a chance to see these data centers, there are so many moving parts, millions of cables. [00:34:12] The ability for all of those computers to work harmoniously, reliability is extremely low. [00:34:21] It is just extremely difficult. [00:34:23] We have now been operating very large scale for a very long time. [00:34:27] That experience matters. [00:34:29] That difference, mean time between interrupts, extremely important. [00:34:35] And then lastly, this is very hard. [00:34:38] The lifetime of these systems, the lifetime of these systems, the software is changing all the time. [00:34:46] Four years ago, which is in the time of Hopper, AI has completely changed. [00:34:53] Six years ago, this is the timeframe of Ampere, AI has completely changed. [00:34:59] We started out talking about CNNs. [00:35:03] Here we are, then we talked about transformers. [00:35:06] And then we talked about mixture of experts. [00:35:08] Now we're talking about agentic systems. [00:35:11] Every single generation, every single few months, the software industry is coming up with new technology. [00:35:20] If your architecture is not flexible, if your ecosystem is not rich, then this curve cannot be long. [00:35:30] You cannot predict how long your system can last. [00:35:34] I can. [00:35:36] NVIDIA systems is all over the world. [00:35:39] Software developers start with NVIDIA CUDA. [00:35:42] And by definition, therefore, the life, the ecosystem, the useful asset is going to be much longer. [00:35:50] The difference is essentially cost. [00:35:53] You could think of it as revenues, but the other side of revenues is cost. [00:35:57] If the life of the asset is long, the TCO is low. [00:36:02] This is the difference. [00:36:04] This is what it looks like when compute. [00:36:08] The more you buy, the more you make. [00:36:18] Now, all of you are experiencing this with me. [00:36:26] Isn't that right? [00:36:28] All of your demand, your factories are working so hard. [00:36:32] Your people are working so hard all across Taiwan because everybody wants to make money. [00:36:39] They realize that AI, useful AI is here. [00:36:44] Profitable AI is here. [00:36:47] Compute demand is incredibly high and compute demand is the constraint. [00:36:54] And so let's go work super, super hard and help the world stand up AI factories everywhere. [00:37:00] And this is why it's so important. [00:37:02] I'm so happy. [00:37:04] Here I am standing in front of you. [00:37:06] Vera Rubin is in full production. [00:37:10] Vera Rubin is in full production. [00:37:15] Vera Rubin is in full production. [00:37:17] It, the supply chain we created for Vera Rubin is twice as large as Grace Blackwell. [00:37:27] Not, yeah, it's incredible. [00:37:31] And, and what used to take two hours to assemble one Grace Blackwell rack now only takes five minutes. [00:37:40] So not only is the capacity higher, the throughput is a lot faster and we need it all to support the demand. [00:37:48] This ecosystem is extraordinary. [00:37:52] Millions of square feet has been put online to support Grace Blackwell and preparing now, ramping up now, Vera Rubin. [00:38:00] I want to thank all of you. [00:38:02] Vera Rubin is now in full production. [00:38:04] Thank you. [00:38:05] Thank you. [00:38:09] Let's take a look. [00:38:13] Large language models generate answers. [00:38:16] Now AI agents can do work. [00:38:19] But processing agentic AI is a whole different kind of problem. [00:38:24] Agents observe, reason, plan, use tools. [00:38:28] They manage massive context, juggling working memory and long-term memory. [00:38:32] They spin up sub-agents, specialists on demand. [00:38:36] NVIDIA Vera Rubin is a multi-rack pod scale system built to process agentic AI and is now in full production. [00:38:44] The manufacturing, automation and orchestration across the supply chain, a miracle to witness. [00:38:50] Our journey started when we launched the first AI supercomputer, NVIDIA DGX1. [00:38:56] Over the next decade, we pushed every chip and system to the limit. [00:39:00] From Pascal, and the first NVLink, to Grace Blackwell, the first rack scale AI supercomputer. [00:39:07] And now, Vera Rubin, the first multi-rack pod scale supercomputer, built for the agentic age. [00:39:14] It starts at TSMC. [00:39:16] The seven new chips that make up Vera Rubin take shape through hundreds of processing steps. [00:39:21] Three nanometer process. [00:39:23] CoWAS-R and CoWAS-L packaging. [00:39:26] HBM4 memory, from Micron, SK Hynix, and Samsung. [00:39:30] The Vera Rubin Compute Board. [00:39:33] Six trillion transistors, with over 18,000 components on one board. [00:39:38] Vera Rubin NVL72 does the thinking. [00:39:41] Prompt and context understanding, reasoning, and planning. [00:39:45] Next, a new modular compute trim. [00:39:48] Streamlined with a new PCB mid-plane design. [00:39:51] Superchips. [00:39:52] Connect X9 Super Nix, and Bluefield 4 DPUs, all made in place. [00:39:58] With no cables, for resiliency at AI factory scale. [00:40:02] 18 compute trays. [00:40:04] 9 hot, swappable NVLink switch trays. [00:40:07] New, high-efficiency manifolds. [00:40:09] Liquid-cooled bus bars, carrying over 5,000 amps. [00:40:13] The equivalent of 20 electric cars at full acceleration. [00:40:17] Together, 1.3 million components form this third-generation MGX rack design. [00:40:23] Congratulations to Microsoft for their operational Vera Rubin NVL72 engineering rack. [00:40:29] Congratulations to Dell and CoreWeave as well, for standing up their Vera Rubin NVL72 engineering rack. [00:40:35] Then, the Vera CPU rack. [00:40:38] 256 CPUs in a single liquid-cooled rack. [00:40:42] Orchestrating the models. [00:40:44] Shuffling memory. [00:40:46] Launching tools. [00:40:48] And with Foxconn and Quanta, Grok3 LPX takes shape. [00:40:52] 256 Grok3 LPUs across 16 trays. [00:40:57] 40 petabytes per second of SRAM bandwidth for ultra-low latency. [00:41:01] While NVL72 generates tokens at the highest throughput, Grok LPX generates them at the lowest latency. [00:41:09] Vera Bluefield 4 STX, where AI keeps its memory. [00:41:14] Storage processing accelerated by Bluefield 4. [00:41:18] Connecting memory, storage, and in-silicon security. [00:41:22] And NVIDIA Spectrum X Ethernet Photonics. [00:41:26] The world's first Ethernet switch with 200 gigabit co-packaged optics. [00:41:31] TSMC's Coupe Process. [00:41:34] Chip-scale packaging. [00:41:36] And ultra-high-powered laser dies on indium phosphide. [00:41:40] Vera Rubin. [00:41:42] Five connected rack-scale systems. [00:41:44] A supercomputer for AI agents. [00:41:46] 150 supply chain partners across Taiwan. [00:41:50] Millions of square feet of factory floor. [00:41:53] Hundreds of sites, chips, packages, systems, and data centers pushed to the limits of size, power, and scale. [00:42:01] This is what we call extreme co-design. [00:42:04] We did this with Taiwan. [00:42:06] Together, we reinvented computing for the age of AI. [00:42:10] Taiwan was with us at the beginning. [00:42:12] And here today, as we bring Vera Rubin to the world. [00:42:15] Thank you, Taiwan. [00:42:25] Ladies and gentlemen, Vera Rubin. [00:42:28] Vera Rubin was not just built for AI. [00:42:33] Vera Rubin was not built just to run AI. [00:42:37] Vera Rubin was built to run agents. [00:42:41] This is an agentic system. [00:42:44] Imagine the complexity. [00:42:46] Which is the reason why agents is the last computer science breakthrough. [00:42:52] It has taken this many years for agents to realize its potential and become useful. [00:42:57] It stands to reason that the computer that runs it is the most advanced in the world. [00:43:02] This is Vera Rubin. [00:43:04] Let's take a look. [00:43:05] Can we bring out Vera Rubin, please? [00:43:19] And, Janine, do we have the racks, the systems? [00:43:34] It looks heavy. [00:43:38] This is Vera Rubin. [00:43:40] Vera Rubin NVLink 72. [00:43:43] This is the Grok LPX. [00:43:46] At the next GTC, I'm going to talk to you about a lot more of this. [00:43:50] Today, we have so much to talk to you about. [00:43:53] This is Vera CPU rack. [00:43:56] 256 CPUs, all liquid cooled. [00:43:59] Let me tell you about Vera in just a moment. [00:44:02] This is the Vera Bluefield storage processing system. [00:44:07] And also security system. [00:44:09] And, of course, this is our Mellanox networking. [00:44:13] The world's first CPO. [00:44:16] This is Vera Rubin. [00:44:18] Incredible technology all coming together. [00:44:20] Now, when we built, when we built Hopper, we built Hopper, as you know, for pre-training. [00:44:27] Pre-training was the most important application, the most important workload we're working on at the time. [00:44:32] Then when we worked on Grace Blackwell, everybody said, Jensen, you know, NVIDIA is really good at pre-training. [00:44:40] Inference is so easy. [00:44:43] Do you remember that? [00:44:45] People used to say inference is so easy. [00:44:47] We could do that, too. [00:44:48] But as you know, inference equals money. [00:44:52] And the models, MOEs, are so complicated. [00:44:56] And to do it at incredibly high response time, fast interactivity, and high throughput at the same time is incredibly hard. [00:45:06] Which is the reason why we created NVLink 72. [00:45:09] Today, NVIDIA's token cost is the lowest in the world. [00:45:14] It's not by 10%, by X factors, orders of magnitude. [00:45:19] All because we did extreme co-design, all because we understood the computing model, the computing pattern of inference, and we were able to create NVLink 72. [00:45:31] Now, with Vera Rubin, it is beyond inference. [00:45:36] It is now inference in an agentic system. [00:45:40] This is Vera Rubin. [00:45:43] No cables. [00:45:45] No hoses. [00:45:47] No fans. [00:45:49] What used to take the last time when I showed this to you, we had cables everywhere. [00:45:55] The cables were amazing to look at. [00:45:58] But now, there's a PCB in the middle, which connects both sides. [00:46:04] What used to take two hours, now takes five minutes. [00:46:07] The reliability and the resilience of Vera Rubin is going to be off the charts. [00:46:12] This is our Vera CPU tray. [00:46:16] The most advanced CPUs that has ever been built. [00:46:20] I'm going to show you that in just a second. [00:46:23] And this is our storage tray. [00:46:27] Two Vera CPUs, four CX9, incredible amounts of software. [00:46:35] This is our new LPX, LPU30, the Grok system, designed for very low latency inference. [00:46:44] The throughput is delivered by Vera Rubin and extended with NVLink 72. [00:46:51] If you want to extend that even further, you can have Grok LPUs. [00:46:57] Here, we have the Vera Rubin NVLink, the switch tray. [00:47:01] This is the switches in the middle. [00:47:04] And this is revolutionary. [00:47:06] Because of Vera Rubin's, because of NVLink 72 and the NVLink switches that we created and invented. [00:47:13] And this is our Ethernet switches for scale out. [00:47:19] What's amazing is we introduced these two systems for Grace Blackwell. [00:47:26] These two systems were created for Grace Blackwell. [00:47:29] And today, NVIDIA is the largest networking company in the world. [00:47:34] I'm so proud of the networking team. [00:47:37] This is such an incredible enabler for everything that we do. [00:47:41] I'm going to now talk to you about the next major industry we're going to be part of. [00:47:47] Thank you, Janine. [00:47:51] Thank you. [00:47:53] I think there are 2,000 people back there pulling that. [00:48:07] Okay, let's talk about CPUs. [00:48:13] Varus CPUs, CPUs built for the age of AI. [00:48:21] All of the CPUs until now were created for people. [00:48:27] We were the users. [00:48:29] We were the users. [00:48:31] We were the renters. [00:48:33] The way we use CPUs, we live in a world counted by seconds. [00:48:39] The way we rent CPUs in the cloud. [00:48:42] Each one of them, the more CPU cores you have, the more you can rent. [00:48:48] The economics of the old, the use case of the old CPU, and the economics of the old CPU, fundamentally different than agents. [00:48:57] Agents are impatient. [00:49:01] They don't live in a world that is in seconds. [00:49:03] They live in a world that's in nanoseconds. [00:49:06] When it uses a tool, it wants the response time to be as fast as possible. [00:49:12] When it accesses database, it has to come back as soon as possible. [00:49:17] Every moment that the agent is waiting, keeps it from going to the next step, the next step, the next step. [00:49:26] It is vital that we make the CPUs as low latency as possible, as interactive as possible. [00:49:35] So we created Vera CPU for the age of AI. [00:49:39] Now, inside our system is used for three different ways. [00:49:43] The first way, of course, is Vera Rubin for thinking. [00:49:50] And inside the Vera Rubin rack, there are already two CPUs. [00:49:55] As you know, we are building and selling millions of Vera Rubins. [00:50:02] We have sold millions of Grace Blackwalls. [00:50:05] Nvidia already is one of the largest CPU makers in the world. [00:50:09] In the Vera Rubin rack are two CPUs. [00:50:13] One for orchestrating and managing the GPUs. [00:50:18] Managing the KV cache. [00:50:21] Dealing with all of the software that runs in the rack. [00:50:25] We also have the Grace Bluefield that is used for security and isolation. [00:50:32] The Vera Compute is used for the harness, the orchestration of the AI models, tool use, accessing the database. [00:50:42] And the data servers are right here, Vera Bluefield. [00:50:47] The fastest storage servers, the fastest storage system the world has ever made. [00:50:54] And the reason why this is so vital is because agents are accessing memory so incredibly fast. [00:51:02] These systems, the storage server and the CPUs, are now the critical path of the most expensive part of the data center. [00:51:14] This is the most expensive for a good reason. [00:51:17] The economics, the economics of the AI factory is tokens. [00:51:24] And the tokens are created here. [00:51:27] And so of course you want to manufacture and generate as many tokens as possible. [00:51:32] This is where you put all of your economics. [00:51:35] And this has to not be in the way. [00:51:38] And so Vera CPU has great pressure on the Vera, on the CPU architecture. [00:51:44] Which is the reason why we built a brand new architecture from the ground up. [00:51:49] A CPU the world has never seen before. [00:51:51] We call it Vera. [00:51:53] This is CPU for agents. [00:51:57] All the CPUs of the past, we built for humans. [00:52:01] This CPU is built for agents. [00:52:04] Well, there are four things to keep in mind. [00:52:07] The four takeaways. [00:52:09] The first takeaway is that the instructions per clock of Vera has to be incredibly good. [00:52:16] Because we need the latency to be short. [00:52:19] We need the processing time. [00:52:21] Single threaded performance. [00:52:23] Not throughput. [00:52:25] Single threaded performance has to be world class. [00:52:28] Absolutely the best. [00:52:29] Single threaded performance. [00:52:31] Which is the reason why the IPC, the instructions per clock of Vera is so high. [00:52:37] It's the highest in the world. [00:52:39] 10 instructions fetched, decoded and executed per clock. [00:52:43] Number one. [00:52:45] Number two. [00:52:47] The bandwidth necessary to move data in and out for the CPU has to be utterly world class. [00:52:54] The second thing is bandwidth per core. [00:52:58] The third is just bandwidth period. [00:53:01] We're moving. [00:53:03] I said earlier, agentic systems is fundamentally disaggregated and distributed. [00:53:11] Disaggregated and distributed. [00:53:13] When computing is disaggregated and distributed, networking becomes the problem. [00:53:19] Therefore, we have to move the data around as fast as possible between the CPU cores and between the CPU and the storage, the CPU and the GPU. [00:53:29] The bandwidth around the system and inside the CPU core has to be utterly world class. [00:53:35] This is the first CPU that's been built a long time. [00:53:40] That is literally at radical limits with a fabric that connects all of the CPU cores that is speed of light. [00:53:48] It's 3.6 terabytes per second. [00:53:52] No chiplet tax. [00:53:54] No chip boundary crossings because we need to have everything. [00:53:59] Because the CPU cores are talking to each other with extremely high bandwidth. [00:54:04] They're not rented core per core per core. [00:54:07] They're all working together. [00:54:09] The cross sectional bandwidth of Vera is off the charts. [00:54:12] It's the first one to be PCI Express Gen 6. [00:54:16] It is also the first one to have LPDDR5 with 1.2 terabytes per second. [00:54:24] Three times, two to three times the bandwidth of the highest performance CPUs on the outside. [00:54:31] Three times the bandwidth on the inside. [00:54:34] The bandwidth per core and the bandwidth period is world class. [00:54:39] Now, remember, I showed you earlier. [00:54:41] The number of CPU cores, the number of CPUs is going to be quite high. [00:54:46] And the reason for that is very simple. [00:54:50] We created CPUs for humans in the past. [00:54:55] And humans, there are only 1 billion of us. [00:54:59] There will be billions of agents. [00:55:03] And these agents are going to be using the CPUs with very little patience. [00:55:09] Because the cost of the GPU they sit next to is too high. [00:55:12] And therefore, too valuable, too precious. [00:55:17] Therefore, these CPUs are going to be both performant, but they also have to be extremely energy efficient. [00:55:26] So that we can cram as much CPU as we can into the factory without taking away power from the token generation, which we know is how we make money. [00:55:38] These four properties, instructions per clock or single-threaded performance, bandwidth per core, the total bandwidth around the chip and inside the chip, and energy efficiency defines Vera. [00:55:53] It is absolutely world class. [00:55:56] When you compare it to the highest performance x86, it is just off the charts. [00:56:01] When you compare it in real single-threaded performance, real performance, it's off the charts. [00:56:10] It is incredible to be able to deliver 5% improvement on CPUs. [00:56:15] It is incredible to be able to deliver 10%. [00:56:18] But this kind of performance speed up is just unheard of. [00:56:22] This is NVIDIA Vera. [00:56:25] What do you think? [00:56:33] Let's take a look. [00:56:35] Agentic AI changes the role of the CPU. [00:56:39] The CPU is now the conductor, and the GPU is the orchestra. [00:56:43] Traditional CPUs were built for a different era, maximizing cores per socket. [00:56:49] Slice them up, virtualize, rent by the hour. [00:56:53] In the age of agents, the CPU is now a bottleneck to GPU utilization, directly affecting token throughput, latency, and user experience. [00:57:03] NVIDIA Vera is the CPU, built for the agentic loop, combining NVIDIA's custom data center CPU core with the scalable coherency fabric for the right balance of performance cores and bandwidth to maximize AI factory output. [00:57:18] At the heart of Vera is the NVIDIA Olympus core, built for modern data center workloads, branch-heavy Python runtimes, tool calls, and sandbox code execution. [00:57:30] Each core is tuned for throughput. [00:57:33] A neural branch predictor, evaluating two taken branches per cycle. [00:57:37] A 10-wide decode engine, brings in more work each cycle. [00:57:41] A large, out-of-order engine keeps instructions moving. [00:57:44] Advanced prefetchers, with a novel graph engine, anticipating the next data path. [00:57:49] But fast cores only matter when data arrives correctly and on time. [00:57:54] Vera is the first CPU to use LPDDR5X memory, while correcting multiple errors simultaneously, without compromising bandwidth. [00:58:04] Vera achieves 40% lower peak memory latency versus x86, keeping cores fed on time through retrieval, analytics, and sandbox execution. [00:58:14] NVIDIA's second-generation scalable coherency fabric unifies all 88 Olympus cores on a monolithic mesh, with separate dies for memory and I/O. [00:58:25] Cores are not split across chiplets, enabling 50% faster core-to-core communication than traditional CPUs. [00:58:33] And memory-coherent NVLink chip-to-chip connects GPUs directly to the fabric. [00:58:40] Beyond GPUs, NVLink chip-to-chip can scale Vera up to multiple sockets, enabling massive bandwidth between CPUs. [00:58:49] Vera delivers 1.8 times the agentic sandbox performance of x86 CPUs. [00:58:55] Standalone Vera racks run agent sandboxes, tools, code, and data pipelines. [00:59:01] Tightly coupled to Reuben GPUs, Vera keeps accelerated workflows moving. [00:59:07] NVIDIA Vera Bluefield 4 STX powers context memory and AI storage. [00:59:13] Compute, networking, storage. [00:59:17] Vera is the CPU for the age of agents. [00:59:21] The CPU for the age of agents. [00:59:26] This is going to be our new major growth driver. [00:59:31] The reviews are already coming out. [00:59:34] And it's pretty good. [00:59:36] That's pretty good stuff. [00:59:41] Now remember, [00:59:47] Grace and Vera are also the most highly qualified CPUs in the world of AI because every single data center, every single cloud, every single enterprise, every company that works with NVIDIA on AI has already qualified. [01:00:08] Grace, the entire software stack has already been optimized for Grace. [01:00:13] Every company will be qualifying Vera. [01:00:16] Vera will be the most optimized agentic CPU in the world. [01:00:21] Simply because it's going to go with Vera Rubin, simply because we made the big hard switch. [01:00:28] In fact, during Grace Blackwell transition, the biggest risk was going from external CPU x86 into Grace Blackwell. [01:00:38] That transition was extremely dangerous, but we did it with incredible execution. [01:00:44] Now Grace is literally synonymous with Grace Blackwell. [01:00:49] People say Blackwell. [01:00:50] They say Grace Blackwell because it is utterly now everywhere. [01:00:54] Every company's software stack has been optimized for it. [01:00:57] Everybody's security stack has been optimized for it. [01:01:00] And now here comes Vera. [01:01:02] I'm super excited about that. [01:01:03] Now look at some of the performance numbers. [01:01:06] Speed ups is one thing. [01:01:08] It is extremely hard to speed up SQL, SQL, the most famous domain specific language DSL that has ever been created. [01:01:23] Before SQL, you know, before CUDA, there was SQL. [01:01:28] Before OpenGL, there was SQL invented by IBM. [01:01:33] Today, it is the structured database engine of the planet. [01:01:36] Everybody uses SQL. [01:01:38] This is SQL running three times faster. [01:01:42] Not 10% faster. [01:01:43] Not 25% faster. [01:01:45] Ten times, three times faster. [01:01:48] Incredible. [01:01:49] This is real time. [01:01:52] The next one is real time stream processing. [01:01:56] Remember, your AI is going to be not just reading documents. [01:02:00] Your AI is going to be watching for telemetry, especially inside a factory, [01:02:05] inside a stock exchange. [01:02:08] You're going to be looking for telemetry continuously. [01:02:11] The burst of data that's coming in goes into a CPU. [01:02:15] This is Vera CPU running real time stream processing for New York Stock Exchange. [01:02:22] Lynn Martin, the president of New York Stock Exchange has been so gracious to partner with us. [01:02:27] This system is run all over the world in real time stream processing. [01:02:33] Vera CPU six times, all because of the bandwidth, the single threaded instruction execution, the bandwidth inside between the cores, the bandwidth outside. [01:02:45] Vera is completely revolutionary. [01:02:48] That's Vera. [01:02:56] You know, X factors is something you talk about when you're talking about GPUs. [01:03:00] It is quite rare that somebody talks about X factors on real workload, real workload that is associated with CPUs. [01:03:09] I'm so proud of the team. [01:03:10] You guys did such a great job. [01:03:12] We have an extraordinary roadmap coming. [01:03:15] But what's really exciting is almost everybody is supporting Vera. [01:03:22] They're as excited as we are. [01:03:23] This is Vera opening up. [01:03:26] It's opened up a brand new market. [01:03:29] Agents. [01:03:31] Agents is a new workload. [01:03:33] We build CPUs for humans in the past. [01:03:36] We need CPUs for agents, agentic systems. [01:03:41] The properties are different. [01:03:42] Why would the old CPUs be the same? [01:03:44] We are building millions and millions of errors. [01:03:50] Millions of errors. [01:03:51] And to go to market with us, Taiwan's ODMs and computer makers, all the OEMs, and you could see the early adopters. [01:04:02] The early adopters are the agentic companies. [01:04:06] This is the beginning of a new market. [01:04:09] A market that never existed before. [01:04:11] It's not going to take away from the old markets, but this is a new market. [01:04:16] CPU for agents. [01:04:19] And this market will surely be larger than the last. [01:04:23] And the reason for that is because there will be a lot more agents than there are people. [01:04:27] And then the agents are very impatient. [01:04:30] So, NVIDIA, Vera, CPU. [01:04:33] Thank you. [01:04:41] This is the most important slide, really. [01:04:43] This is the takeaway. [01:04:45] The takeaway here is that this is the application pattern. [01:04:48] This is the computing pattern of the next decade. [01:04:54] Agents, harnesses, orchestrating large language models. [01:05:00] Every company will run it. [01:05:03] Every company will be an agent company. [01:05:06] Every company will have agents running inside. [01:05:09] Every company will see that agents will need its own operating system. [01:05:17] Every company is asking us, how do we run agents safely? [01:05:21] How do we build agents for our own workloads? [01:05:26] And so we have the NVIDIA Agent Toolkit for enterprise AI. [01:05:32] You've seen me build this in plain sight. [01:05:35] Almost everything that NVIDIA does, as you know, at every GTC, if you go back and look at my GTC five years ago or 10 years ago, you will see today. [01:05:43] This you've seen me talking about for several years now because we've been building for this moment. [01:05:50] There are four things that companies need in order to build agents as a service or build agents to operate. [01:05:59] The first thing you need is you need models. [01:06:02] Of course, large language models, the smarter, the better, the cheaper, the better, the faster, the better. [01:06:10] The second is you need a harness to orchestrate the whole thing. [01:06:15] The third, these eight, these models want to use tools and these tools come with its skills. [01:06:22] And I showed you Cuda X libraries. [01:06:25] Those are going to be amazing tools for the agents in the future. [01:06:29] And lastly, you need a runtime. [01:06:32] You need the operating system that holds it all together. [01:06:35] This is the NVIDIA Toolkit for agents. [01:06:40] It includes models that you can modify. [01:06:47] NVIDIA's world class open models. [01:06:49] And I want to show you more. [01:06:51] You can run agents from anybody. [01:06:54] You could run Cloud Code, Incredible Agent. [01:06:57] Codex, Incredible Agent. [01:06:58] You could run it inside this harness called Open Shell, which will be highly secure for your inside the enterprise. [01:07:06] The shell protects the agent, keeps it grounded in security policies. [01:07:14] Privacy is protected. [01:07:16] Its rights and privileges are given. [01:07:19] Its identities protected. [01:07:21] So this Open Shell is being adopted all over the world. [01:07:24] NVIDIA Open Shell is open source. [01:07:26] You're going to see so many companies adopted. [01:07:29] Red Hat, Canonical, Microsoft. [01:07:33] It's going to be adopted everywhere. [01:07:35] This is an important, this is the runtime. [01:07:38] And this runtime is fully optimized for the NVIDIA AI platform, which is everywhere. [01:07:45] So you can run Open Shell in any cloud, on prem, and even on device. [01:07:51] So you have, you have now tools and libraries that they can use. [01:07:57] You have models that you can modify or use as is. [01:08:01] Or you have agents. [01:08:03] You have to be open claw. [01:08:05] Hermes, another incredible, another incredible harness. [01:08:10] These agent, agentic harnesses can now run on prem or for you anywhere. [01:08:16] Okay. [01:08:16] So four things. [01:08:18] And this represents the operating system of the modern enterprise. [01:08:23] Now, how do we use this? [01:08:25] One of my favorite use cases of agents is chip designers. [01:08:31] It is the single most important thing that NVIDIA does. [01:08:35] And so, of course, we have to partner with Cadence to build super agent. [01:08:41] A chip design super agent. [01:08:44] It's orchestrated by codex or cloud code. [01:08:49] It has RTL and architecture diagrams or schematics or specifications as input and whatever you need to fix. [01:08:58] And together, we created some super agents that are optimized for the NVIDIA runtime with Nemo Tron. [01:09:09] And let's take a look. [01:09:10] It's really incredible. [01:09:13] Cadence and NVIDIA are partnering to build chip design agents. [01:09:18] Hundreds of thousands of NVIDIA chips come together to make the AI factories that power the world's frontier AI models. [01:09:26] Designing these chips and the systems they run in is one of the hardest engineering challenges. [01:09:32] Trillions of transistors, three-dimensional circuits, microscopic scale, every gate, every wire, synchronized to picoseconds must work in perfect harmony with no margin for error. [01:09:46] Physical prototypes are too slow and too costly. [01:09:49] So engineers work in the digital realm. [01:09:51] Each chip begins as a set of architectural specifications, then translated into RTL, the language of chip design. [01:09:59] RTL must be verified in simulation. [01:10:02] A single bug can delay a chip by months. [01:10:05] At NVIDIA, thousands of engineers, billions of compute hours per year, millions of tests, written, run, and debugged. [01:10:13] It's a cycle that takes teams weeks. [01:10:15] To compress this cycle, Cadence and NVIDIA built a design verification agent. [01:10:20] Codex orchestrates the process. [01:10:22] Cadence ChipStack launches the RTL verification loop, powered by Nematron and secured by NVIDIA OpenShell, calling on expert sub-agents in RTL generation, test bench creation, regression testing, and debugged. [01:10:38] The system drives itself. [01:10:40] The ChipStack agents run hundreds of simulations with Cadence Exilium. [01:10:44] Formal verification with Jasper. [01:10:47] Design flaws, revealed. [01:10:49] Bugs in the code, fixed. [01:10:51] What once took weeks, now takes hours. [01:10:54] Verification cycles, over 40 times faster. [01:10:58] Together, NVIDIA and Cadence are reinventing chip design with AI agents. [01:11:05] From weeks, from weeks to hours, from weeks to hours, from weeks to hours, from weeks to hours. [01:11:12] NVIDIA has thousands of chip designers. [01:11:15] We are going to hire hundreds of thousands of Cadence super agents that work with us so that we can accelerate our company, so that we can be even more ambitious, create even more amazing things, run even faster. [01:11:30] We saw earlier that the toolkit with models, harness, tools, the tools in this case are Cadence simulators and verifiers, formal verification systems. [01:11:44] It is the reason why we are working with Cadence so hard to accelerate all of their tools on CUDA, because the agents are impatient. [01:11:52] The agents want the answer immediately. [01:11:55] And so, models, harnesses, accelerated CUDA, accelerated libraries and tools, and then the runtime. [01:12:05] What you saw just now is all of that coming together. [01:12:09] Now one of the things that it starts with is a great model that Cadence could modify and tune to be expert at the Cadence workflow, at the Cadence expertise, so that they could create super agents that are proprietary to Cadence with their proprietary knowledge. [01:12:29] They have to start with an excellent model. [01:12:30] They have to start with an excellent model. [01:12:31] We call it Nemo Tron. [01:12:32] NVIDIA is dedicated to build open models for the world, so that all of you, all of us, could create our own agents. [01:12:42] Today, we're announcing the Nemo Tron 3 Ultra. [01:12:49] Yep. [01:12:50] Our next open model, and it is smart. [01:12:58] The Nemo Tron models not only give you the model, we give you all the data that we use to train the model, and because we have a coalition of incredible partners, you can see all of our partners down here. [01:13:13] We work together, contribute data to each other. [01:13:18] Nemo Tron is trained on one of the largest suites of long running reasoning models, long running tool task solving tool using data sets in the world. [01:13:30] Because of all of our great partnerships, all of this from the model, the training script, and the data made completely available to you. [01:13:41] This is open models at its best, the best open model system policies in the world. [01:13:48] Simple goal is so that you can take all of it, add to it, make it even better, make it yours. [01:13:55] Nemo Tron 3 Ultra is five times faster. [01:14:00] This is the world's first model based on a hybrid architecture of SSM state space models with mixture of experts. [01:14:11] The architecture is incredibly fast. [01:14:14] We made it fast so that you could think fast. [01:14:16] When you think fast, you could think longer at the same cost. [01:14:19] So five times faster. [01:14:20] It is also 30% cheaper, 30% lower cost to run in total flops and total inference time than even the most cost effective in the world. [01:14:34] We're comparing against the world's best open models. [01:14:37] Frontier smart. [01:14:38] Frontier smart. [01:14:40] Five times faster. [01:14:42] 30% cheaper. [01:14:44] Completely open. [01:14:46] We're completely dedicated to this. [01:14:48] This is now Nemo Tron 3. [01:14:50] We're currently working on Nemo Tron 4. [01:14:53] So this entire toolkit from models, harnesses, tools and skills and runtimes is the reason why every enterprise company in the world has the ability now to create their own agents, just like Cadence did with their super agents. [01:15:14] So many companies, Cadence and CrowdStrike and Decello and Palantir, SAP and ServiceNow. [01:15:20] People were always said, Jensen, the agents are going to disrupt these markets. [01:15:26] I said completely opposite and you can now see it. [01:15:30] Agents is going to create the largest opportunity ever for my partners and friends. [01:15:36] And we have the Nemo, the, the Nvidia agentic toolkit for enterprise AI to help them. [01:15:43] So there you go. [01:15:51] First, Vera Rubin in full production. [01:15:54] Two, Vera CPU, CPU built for a new generation for agents. [01:16:00] And three, Nvidia's enterprise AI toolkits so that every enterprise and every enterprise software company can build agents. [01:16:12] My relationship with you started here. [01:16:23] And many of you, many of you, many of my friends and partners here in Taiwan, your companies started here. [01:16:33] This is in a lot of ways, the beginning of the modern computer industry, 40 years now. [01:16:41] Nvidia is 33 years old. [01:16:44] The PC industry was already starting to get to Windows one and Windows two and Apple, Apple one and Apple two. [01:16:52] And by the time that we came along, Windows 3.1 was the PC. [01:16:58] And as you know, Windows 95 made PC personal. [01:17:03] It took PC from enterprises, companies and made it into a consumer electronics device. [01:17:11] Everybody should have one. [01:17:12] And everybody does. [01:17:14] This is the beginning. [01:17:16] This computing platform did several things incredibly smart. [01:17:20] Windows was not just disaggregated, as you know. [01:17:24] Windows was properly abstracted. [01:17:27] It was architected just right. [01:17:29] You know, systems BIOS, open chip sets, the operating system with drivers, drivers that could be connected and installed at runtime. [01:17:42] And an abstraction layer with a multimedia API that opened up the PC to what we all know today. [01:17:53] Each one of these elements were essential in making the PC so popular. [01:17:59] 40 years later, Microsoft and Nvidia are going to reinvent the PC. [01:18:07] This is going to be the new PC. [01:18:10] Now tomorrow night, tomorrow night, I think it's tomorrow night, our time. [01:18:14] But I'm going to be with Satya. [01:18:16] We're going to talk a lot more about the work that we're doing together. [01:18:20] Microsoft and Nvidia over the last three years, it took this long to completely reinvent how the PC is going to work so that we could be ready for this moment. [01:18:31] As I mentioned earlier, that compute pattern called the agent is going to run in AI clouds. [01:18:39] It's going to run inside enterprises. [01:18:43] It is also going to run on your PC. [01:18:46] What's going to happen to that PC when it has an autonomous agent? [01:18:50] An agent that's helping you that understands you. [01:18:53] You could talk to it. [01:18:54] It could look at you. [01:18:56] You could. [01:18:58] To read files. [01:18:59] Go help you. [01:19:01] Do some research. [01:19:02] It could do a lot more that I'll show you. [01:19:05] But the new operating system. [01:19:07] Is of course the old operating system. [01:19:10] Plus. [01:19:11] Large language models. [01:19:13] Large language models in a lot of ways is the modern version of DirectX. [01:19:18] It has, of course, input and output. [01:19:21] Understands prompts. [01:19:22] It understands computer vision. [01:19:24] It can generate video. [01:19:25] It can generate sounds. [01:19:26] It is the modern extension. [01:19:29] The intelligence extension. [01:19:31] Of the PC. [01:19:32] Of a computer. [01:19:34] And on top of that, the application, as I mentioned before, is going to be replaced. [01:19:40] By now an agentic runtime. [01:19:43] And that is the modern application. [01:19:45] An agent. [01:19:46] Let's now take a look at what it can do. [01:19:51] It started with a spark. [01:19:53] An idea. [01:19:55] To reimagine the PC for the first time in 40 years. [01:19:59] For the age. [01:20:00] Of AI. [01:20:02] What becomes of our personal computer in a world of agents? [01:20:07] Agents running natively. [01:20:09] Connected to models. [01:20:11] Local or in the cloud. [01:20:13] Our personal AI. [01:20:15] Sandboxed for security. [01:20:16] Running continuously. [01:20:18] Getting work done. [01:20:20] The chips and the OS must evolve. [01:20:24] Introducing RTX Spark. [01:20:27] Everything we've learned over 33 years. [01:20:30] Distilled into one chip. [01:20:33] Blackwell RTX GPU. [01:20:36] With 6,144 CUDA cores. [01:20:39] One petaflop of AI performance. [01:20:42] A custom 20 core grace CPU. [01:20:45] Built in partnership with MediaTek. [01:20:47] Fused by MVLink. [01:20:49] 128 gigabytes of unified memory. [01:20:54] TSMC 3 nanometer process. [01:20:57] 70 billion transistors. [01:20:59] And in close collaboration with Microsoft. [01:21:03] A Windows platform for agents. [01:21:06] We're reinventing the personal computer. [01:21:10] For creating. [01:21:11] For gaming. [01:21:11] For agents. [01:21:12] This is the dawn of a new personal computing revolution. [01:21:22] And it starts with NVIDIA RTX Spark. [01:21:27] here it is of course i got to show you the most beautiful part which is video games [01:21:49] it is it's also the closest to our heart this is forza this is 007 by the way [01:21:56] the new 007 game i'm looking forward to playing it i look a little bit like him [01:22:02] ladies and gentlemen nvidia's rtx spark laptops now [01:22:13] thank you [01:22:19] i have too many things in my pocket [01:22:24] okay all right this is the most amazing ship the world has ever built this is the n1x that we [01:22:33] built in partnership with media tech i think i saw i saw rick earlier this is n1x this is a beautiful [01:22:39] chip this is this is a a chip that frankly would take 33 years to build and the reason for that is [01:22:48] it's because a hundred percent of nvidia software stack runs here if you want to run a digital [01:22:55] biology no problem if you want to do seismic processing no problem you want astrophysics no [01:23:00] problem everything associated with cuda all the physics all the biology all the genomics [01:23:06] all the ai no problem all the computer graphics no problem every single application nvidia has ever [01:23:13] ever created and every single application that windows has ever run microsoft and nvidia meticulously [01:23:22] optimized everything so that this computer literally runs everything the world has ever created plus [01:23:31] it now runs agents an incredible computer i'm so proud of it [01:23:42] okay now i want you to keep that in mind in the next video i just i'm going to show you just imagine [01:23:51] everything here is going to run on your pc now that computer could have a local nematron 3 ultra model [01:23:59] or nematron 3 super model or it could have a cloud code or codex or some other model in the cloud or [01:24:07] something on the network and it's going to it's going to work and do something amazing let's play it [01:24:15] every house starts as an idea getting from idea to design takes a myriad of tools expertise and a lot of time [01:24:27] now an agent running locally on rtx spark can help me design a house using the tools on my laptop [01:24:34] with an open shell sandbox running the hermes harness connected to claude sonnet in the cloud [01:24:40] i select the site share my concept sketches and mood board of styles to inspire my design [01:24:46] and the prompt a text description of the requirements and the design intent [01:24:55] my agent goes to work using the tools on my laptop it opens rhino and starts modeling the site [01:25:02] shaping terrain setbacks and the building envelope then it proposes building forms optimized for cost [01:25:09] comfort and quality with the form defined my agent generates the interior layout walls circulation [01:25:18] rooms begin to take shape i jump in whenever i want to adjust to change [01:25:27] doors windows and structural elements are placed automatically my agent detects its own mistakes [01:25:35] and fixes them when i approve the agent exports the model from rhino into blender materials and object [01:25:44] properties transfer with the design context intact i fine-tune the materials get the look just right [01:25:52] and then i pick the shots blender renders the house my agent using generative ai with the flux 2 model makes [01:26:00] them photo real multiple viewpoints lighting conditions what was once a complex workflow is now guided and [01:26:07] and simplified by my agent working with on rtx spark design at the speed of imagination [01:26:22] pc in the world of agents the developers are so excited about this is an incredible computer [01:26:29] all of the acceleration all the software capabilities associated with it working with every developer to make it incredible for all of you [01:26:38] the next one [01:26:40] adobe [01:26:41] incredible tool suite of course used by tens of millions of people around the world they have re-engineered [01:26:48] the architecture the core of adobe photoshop and premiere [01:26:51] and then release it for rtx spark it is twice as fast it's already fast now it's going to be twice as fast [01:26:58] and it's also designed to be agent friendly with its mcp server it can now interact with agents on your laptop [01:27:07] the number of customers the number of partners that are so excited to bring rtx rtx spark to the market [01:27:14] it's just incredible you know this is the first across the lineup of pc reinvention for 40 years [01:27:24] and i'm just so happy that all of you and the ecosystem around the world has joined us this is [01:27:30] basically everybody everybody will support rtx spark and will be building incredibly smart and powerful and [01:27:38] beautiful laptops with all of us thank you very much [01:27:47] but that's not all that's not all rtx spark is a reinvention [01:27:54] of laptop but in fact microsoft nvidia is reinventing all of pc and today we're announcing a whole new line [01:28:04] three revolutionary windows machines covering desktop laptop and workstations [01:28:11] all 100 windows compatible 100 cuda 100 nvidia ai tensor core everything that runs that you see that [01:28:22] runs on nvidia and all these different platforms around the world runs here this is the first completely [01:28:30] re-engineered reinvented line of pcs that has happened in 40 years now what's really amazing is this so [01:28:37] this is this is the rtx spark laptop this is the desktop so this one's from msi joseph this one's yours [01:28:49] okay look how beautiful it is this agent could run 24 7 meter free and you could download your agent [01:28:58] you could raise your lobster in here this is your claw it's running all the time [01:29:07] no meter anxiety and it's sitting here connected to your whole house connected to your laptop connected [01:29:15] to your display all the cameras your your dryer your water cooler your water heater your everything [01:29:23] whatever you want your security system all connected to this and this becomes your personal ai your personal ai agent [01:29:32] and it gets smarter and smarter and smarter over time because today we have nemotron 3 ultra [01:29:37] tomorrow we have nemotron 4 and then nemotron 5 nemotron 6 and we just keep getting us smarter and smarter smarter [01:29:44] and meanwhile this is sitting at home helping you do things if you want to book a travel no problem and [01:29:51] if you [01:29:53] if you want an incredible system [01:29:57] this is a dgx station for windows compatible with windows wants everything in windows and and [01:30:06] it has 768 gigabytes of memory and so you could run a trillion parameter model this is unbelievable 20 [01:30:16] petaflops 8 terabytes per second of memory bandwidth and this sits by your desk you basically if you're a [01:30:26] developer of large language models your developer of agents having this sit by your desk gives you all the [01:30:34] compute you need and then when you deploy it you put it into the cloud now there's something that if you [01:30:40] look at this and think about this something is happening here [01:30:45] remember [01:30:48] 15 20 years ago we used to have an idea called a phone [01:30:53] today we have an idea called a pc [01:30:57] today when you think about your phone [01:31:00] the one thing you don't do with it is make phone calls [01:31:04] you do just about everything else [01:31:09] and so that phone means something very different to you than a phone of the past [01:31:16] i am certain what's going to happen here is that the pc 10 years from now and the pc that you think [01:31:22] about today a tool whether you launch applications [01:31:28] click and type [01:31:30] and this pc is going to be completely different [01:31:34] here's my theory [01:31:36] i can totally imagine [01:31:38] just as every house today has a home theater [01:31:41] where many houses have home theaters big tvs [01:31:46] lawnmowers [01:31:48] dishwashers [01:31:50] i could totally imagine that someday there's actually an ai supercomputer in your house [01:31:55] and it's running all of your agents it's running all of your assistants [01:32:00] and they're doing all kinds of things for you all the time [01:32:04] and you have to have it in your house just like you have a home theater in your house you have [01:32:08] stereos in your house you have game consoles in your house you want to assist ai agent computers running in your house [01:32:16] and these in time becomes a lot more like r2d2 to you it becomes more like c3po to you [01:32:26] then it feels like a pc to you [01:32:30] there is no question this reinvention of the computer [01:32:34] is as big of a deal as the reinvention of the phone into what we now know as the smartphone [01:32:39] and so this is the beginning of that journey this is the beginning of a new line [01:32:45] and so we have a road map for this this is a brand new product family for us [01:32:50] every single generation of architecture we will have a desktop a laptop a workstation [01:32:57] and then a desktop a laptop and workstation and the thing that i'm just incredibly pleased [01:33:03] incredibly honored is that a hundred percent of the world's pc industry has joined us to reinvent [01:33:11] the pc a new line a new beginning thank you [01:33:28] as you know agentic ai is just a digital robot [01:33:36] it understands it reasons it plans and it acts and use tools [01:33:43] agentic ai is going to run across all of these computers [01:33:47] and you've seen me talk about each and every one of these over time [01:33:51] we're working on human or robotics computers [01:33:54] robotics computers of all kinds we're working on self-driving car computers we're working on satellites [01:34:00] you have g-force which is has tensor cores i just talked about a whole new line of pcs [01:34:06] agriculture equipment manufacturing equipment heavy industry equipment will all be agentic [01:34:12] you'll even have a little agentic [01:34:15] helper for yourself even your base stations the radio stations of the future are going to be agentic [01:34:23] understanding traffic and thinking about how to coordinate with the other base stations so that [01:34:30] you could use as little energy as possible increase the utilization the efficiency of the spectral [01:34:36] efficiency and so everything will run agents today nvidia is largely in the center [01:34:43] but i am pretty certain that there will be tens of billions hundreds of billions over time of agentic [01:34:51] systems agentic computers that are going to be running around the world the biggest problem is data [01:34:59] in the case of language models all the english and all the language that we have on the internet that [01:35:04] we trained on was from the perspective of us we wrote it and we're reading it however in order to create a data [01:35:12] for ai robotics it has to be in the perception the perspective of the robot and most of the world's video [01:35:21] data is from a third person not first person and so agentic systems robotic systems physical ai [01:35:30] the data is the hardest problem you've seen us move up this ladder we started with tele operations [01:35:37] which is basically human demonstration this is no different than the big breakthrough of reinforcement [01:35:43] learning human feedback this then we use simulation this is where omniverse comes in [01:35:49] this is no different than reinforcement learning verifiable rewards okay and so we use these systems to bootstrap [01:36:00] the ai model the physical ai model eventually we're able to learn from third per third person [01:36:07] reprojecting it into first person and now eventually through bootstrapping we have a world foundation [01:36:15] model that can understand the physical world from any perspective you want third third person first [01:36:22] person outside and inside out doesn't matter this is a big breakthrough indeed and today [01:36:29] we're announcing cosmos 3 cosmos 3 is the frontier of physical ai we are at the frontier with language [01:36:42] models there are so many people working on it however in physical ai we are absolutely the world's [01:36:49] best i am so proud of the team for doing this this is the foundation model for all of your work [01:36:55] whenever you want to create a robot whenever you want to create a factory robot or a robot that works in [01:37:00] a factory any kind of robot there in that involves physical world you now have a companion a cosmos 3 [01:37:10] that can understand and reason it can generate it can simulate in the loop it can even be the policy [01:37:18] itself it is on the top of leaderboards all over the all over the world i am incredibly proud of cosmos and today [01:37:24] we're announcing cosmos 3. let's take a look the real world is infinite and unpredictable [01:37:54] Thank you. [01:38:24] Thank you. [01:38:54] Thank you. [01:39:00] Thank you. [01:39:02] Thank you. [01:39:04] Thank you. [01:39:08] Thank you. [01:39:10] Thank you. [01:39:14] Thank you. [01:39:16] Thank you. [01:39:22] Thank you. [01:39:28] Thank you. [01:39:30] Thank you. [01:39:30] Thank you. [01:39:32] Thank you. [01:39:40] Thank you. [01:39:42] Thank you. [01:39:48] Thank you. [01:39:50] Thank you. [01:39:52] Thank you. [01:40:00] Thank you. [01:40:02] Thank you. [01:40:04] Thank you. [01:40:06] Thank you. [01:40:08] Thank you. [01:40:10] Thank you. [01:40:10] Thank you. [01:40:12] Thank you. [01:40:18] Thank you. [01:40:20] Thank you. [01:40:20] Thank you. [01:40:22] Thank you. [01:40:30] Thank you. [01:40:32] Thank you. [01:40:34] Thank you. [01:40:36] Thank you. [01:40:38] Thank you. [01:40:40] Thank you. [01:40:40] Thank you. [01:40:42] Thank you. [01:40:44] Thank you. [01:40:46] Thank you. [01:40:48] Thank you. [01:40:50] Thank you. [01:40:50] Thank you. [01:40:52] nvidia hyperion systems that are able to run alpha mayo or anybody else's av stack we are also [01:41:00] connected into mobility services approximately 97 of the world's mobility services are connecting [01:41:06] with us so that when we deploy alpha mayo on the hyperion runtime with the halos operating system [01:41:15] we will be able to connect to all of these services across the world let's take a look at this [01:41:23] hey mercedes let's go to my favorite sandwich shop routing to your destination lane is clear pulling [01:41:31] out to start drive nudge left due to the stationary lead vehicle ahead blocking our lane slow down to [01:41:38] stop at the stop sign controlling the intersection stop to yield to the pedestrian since the person [01:41:43] is in our lane yield to the cut in vehicle from the left nudge left to clear the stopped vehicle [01:41:48] blocking on the right keep distance to the cut in vehicle since it is merging into our lane [01:41:53] nudge left due to the stopped band blocking the right side of our lane [01:41:56] they are in our lane crossing ahead stop to keep distance to the lead vehicle [01:41:59] keep distance to the vehicle directly ahead in our lane keep distance to the vehicle directly ahead [01:42:02] in our lane stop to the stop sign since the intersection is controlled by the cross traffic [01:42:05] since the vehicle is crossing ahead keep distance to the lead vehicle [01:42:08] due to the truck blocking the right side of our lane [01:42:09] nudge right due to the truck blocking the left side of our lane [01:42:11] nudge left due to the truck blocking the right side of our lane [01:42:12] nudge left due to the truck blocking the right side of our lane [01:42:15] nudge left due to the truck blocking the right side of our lane [01:42:15] nudge left due to the truck blocking the right side of our lane [01:42:16] nudge left due to the truck blocking the right side of our lane [01:42:17] nudge left due to the truck blocking the right side of our lane [01:42:19] nudge left due to the truck blocking the right side of our lane [01:42:20] nudge left due to the truck blocking the right side of our lane [01:42:22] nudge left due to the truck blocking the right side of our lane [01:42:23] nudge left due to the truck blocking the right side of our lane [01:42:24] nudge left due to the truck blocking the right side of our lane [01:42:27] nudge left due to the truck blocking the right side of our lane [01:42:29] nudge left due to the truck blocking the right side of our lane [01:42:30] nudge left due to the truck blocking the right side of our lane [01:42:32] nudge left due to the truck blocking the right side of our lane [01:42:33] nudge left due to the truck blocking the right side of our lane [01:42:35] nudge left due to the truck blocking the right side of our lane [01:42:36] nudge left due to the truck blocking the right side of our lane [01:42:37] nudge left due to the truck blocking the right side of our lane [01:42:37] nudge left due to the truck blocking the right side of our lane [01:42:38] nudge left due to the truck blocking the right side of our lane [01:42:39] nudge left due to the truck blocking the right side of our lane [01:42:42] nudge left due to the truck blocking the right side of our lane [01:42:44] and so alpha mayo is a reasoning car the technology that we've created [01:42:49] also applies to humanoids of course there are many new breakthroughs that has [01:42:53] to happen the nvidia isaac groot is our human or [01:42:57] robotic stack model data generation simulation [01:43:06] the runs the runtime including the operating system [01:43:09] this represents Groot platform the isaac Groot platform [01:43:16] every one of our systems as you can see the exact same pattern [01:43:19] whether it's agentic system for the cloud [01:43:22] agentic system for the pc a robotic system [01:43:26] for a self-driving car a robotic system for a human or robot [01:43:29] all the same and of course in every single case [01:43:34] we build everything completely [01:43:37] we build everything vertically completely [01:43:42] integrated with co-design extreme co-design [01:43:45] and then we open it up for everybody to use whichever part you like [01:43:49] and whatever you want to use we even help you modify [01:43:54] but the one thing that is missing is we need [01:43:57] a reference platform for robotic systems [01:44:00] these robotic systems are so complicated so many motors so many sensors [01:44:04] so fragile and yet we need to have a way to deliver these reference platforms just like we do with [01:44:12] pcs and dgx's and clouds and self-driving cars we now are going to do it for robots [01:44:18] today we're announcing the nvidia isaac Groot a reference humanoid robot all fully integrated [01:44:25] 25 degrees of freedom on that on each hand made by sharpa 31 degrees of freedom on the robot [01:44:33] six feet 150 pounds just like me [01:44:41] the first number is the first number is shorter the second number is bigger [01:44:46] otherwise pretty close and and this platform runs the new thor and our entire software stack [01:44:53] data generation stack data simulation stack the runtime all integrated into [01:44:58] a robot that is designed for everyone to use now we built this for higher education and university researchers [01:45:07] because for them to build this is insanely hard to do and so let's take a look at that [01:45:13] the next leap in ai is general purpose robots humanoids but building one is hard every team starts from [01:45:20] scratch stitching together simulators tele-op systems data pipelines and training infrastructure [01:45:27] months of setup before research can start nvidia isaac group an open development platform for humanoid robots [01:45:36] open models simulation and training libraries and data generators plus the robot computer [01:45:44] fully pipe clean ready to go in hours first set up the simulation environment in isaac lab [01:45:54] capture demonstrations with isaac tele-op on a real or simulated robot [01:46:01] generate synthetic data with omniverse and cosmos scaling one demonstration into thousands [01:46:09] train policies evaluate them in isaac lab arena [01:46:16] deploy through isaac ross running on jetson thor [01:46:30] every element modular open use ours or swap in your own [01:46:38] Groot is powering robotics research across every discipline for every domain [01:46:43] from research labs to factory floors from research labs to factory floors one open platform [01:46:55] and now a new addition isaac Groot reference design robots built on nvidia's open platform [01:47:03] ready for frontier research for any lab anywhere the age of robotics starts here nvidia isaac Groot [01:47:13] so many robots [01:47:23] we're working with just about everybody who's working on robots in the world or robotic systems in world [01:47:28] let me tell you what i told you the computer industry has been completely changed [01:47:34] in the last six months everything changed everything changed because agents were realized and it converged [01:47:42] with the latest frontier models and it made possible the ai to now do useful work [01:47:49] the computing pattern will repeat over and over and over again this computing pattern of an agent that's a [01:47:56] model a harness that uses tools with skills and runs in a runtime that runtime depends on whether it's in [01:48:04] the cloud or on prem on a pc or in a robot but the computing pattern is exactly the same for all of them [01:48:12] you will use different harnesses because of your preference you'll use different models because of your [01:48:16] preference you will improve them for your proprietary use you would create sub super agents that you can [01:48:23] rent to other people to help them do their work this agentic platform this agentic pattern nvidia has an [01:48:30] enterprise ai toolkit this is a wonderful way for all of you to engage ais and for us it's a wonderful [01:48:38] growth opportunity vera rubin is in full production whereas grace blackwell was created to process ai [01:48:47] particularly inference vera rubin was created to run agents it is in full production it is much much [01:48:55] more than a gpu it is an entire disaggregated distributed agent processing system nvidia has really [01:49:04] become an infrastructure company not just a gpu company not just a systems company but an infrastructure [01:49:10] company to help you generate the maximum revenues the maximum profit and to get there as soon as possible [01:49:17] the agent world this new way of doing computing where you build cpus now for agents not for people [01:49:26] cpus for agents has its own special requirement and our nvidia vera is revolutionary i'm so happy about [01:49:34] its ramp the orders already is going to make it the fastest and the most successful product launch in our [01:49:41] company's history nvidia and microsoft has created a whole new line of pcs this is a new beginning and [01:49:48] of course that exact same agentic pattern that i agentic processing pattern computing pattern that i just [01:49:54] described is also going to run on all kinds of devices i mentioned pcs but in the future it'll be robots and [01:50:03] satellites and base stations and factories in the cloud on prem at the edge this pattern agentic ai system [01:50:12] this agentic computing pattern will be replicated in computers all over how we think about the personal [01:50:19] computer will very likely change i want to thank all of you for your partnership your friendship we [01:50:26] we couldn't be here without everything that we do together i am so proud of how you've been so [01:50:31] successful this last year the next year is going to be even more i have one more thing for you let's take a [01:50:38] look [01:50:59] you ready taiwan [01:51:03] let's do this the keynotes done at computex jensen show the world what's next useful ai has arrived agents [01:51:13] working by your side but in case you missed things we said today we're gonna break it all down for you [01:51:19] taipei agents used to be misunderstood only movie stars had them in hollywood now we all got teams making [01:51:26] dreams come true building companies from living rooms but they need so much compute we hear you [01:51:33] that's why we created vera ruben skull the show is true the cheapest tokens coming through ten times [01:51:40] faster inference heaven more special agents than 007 bluefield keeps agents memory true now let's talk [01:51:48] about its cpu 50 faster that's outrageous not for vera it's built for agents nvlink fusion blends [01:51:55] asics smartly everyone's welcome to the nvlink party well if you like that introduction [01:52:02] and there are rubens in full production in full production memotron ultra leads the run 5x faster [01:52:08] work gets done memoclaw keeps the guardrails right open shell keeps the sandbox tight your code migrated and [01:52:16] reviewed all before this song is through here's a five layer cake [01:52:23] make no mistake global ai clouds build lots of gigawatts dsx keeps power lean connecting dots every watt [01:52:30] optimized for you so you can have your cake can eat it too rtx spark is funny here biggest pc moment in 40 years [01:52:39] agents powering our work is running anywhere windows go harnesses run on cpu models fly on gpu [01:52:49] cosmos builds worlds that robots need turn and compute into synthetic feet [01:52:54] alpha myoses and reasons through understands roads like people do who is how they learn to move [01:53:01] learning skills and finding skills and finding ground through the trees powered by thought the future is humanoid [01:53:09] and we'll be right back to the future is humanoid [01:53:11] and we'll be right back to the future is humanoid [01:53:14] and we'll be right back to the future is humanoid [01:53:15] and we'll be right back to the future is humanoid [01:53:17] and we'll be right back to the future is humanoid [01:53:19] and we'll be right back to the future is humanoid [01:53:19] and we'll be right back to the future is humanoid [01:53:21] and we'll be right back to the future is humanoid [01:53:21] and we'll be right back to the future is humanoid [01:53:23] and we'll be right back to the future is humanoid [01:53:23] and we'll be right back to the future is humanoid [01:53:23] and we'll be right back to the future is humanoid [01:53:25] and we'll be right back to the future is humanoid [01:53:25] and we'll be right back to the future is humanoid [01:53:27] and we'll be right back to the future is humanoid [01:53:27] and we'll be right back to the future is humanoid [01:53:40] and we'll be right back to the future is humanoid [01:53:42] and we'll be right back to the future [01:53:44] and we'll be right back to the future [01:53:46] and we'll be right back to the future [01:53:48] and we'll be right back to the future [01:53:50] and we'll be right back to the future [01:53:52] and we'll be right back to the future [01:53:54] and we'll be right back to the future [01:53:56] and we'll be right back to the future [01:53:58] and we'll be right back to the future [01:54:00] and we'll be right back to the future [01:54:02] and we'll be right back to the future [01:54:04] and we'll be right back to the future [01:54:06] and we'll be right back to the future [01:54:08] and we'll be right back to the future [01:54:10] and we'll be right back to the future [01:54:12] and we'll be right back to the future [01:54:14] and we'll be right back to the future [01:54:16] and we'll be right back to the future [01:54:18] and we'll be right back to the future