Nvidia Microduck AI Robots are mind blowing - World Premiere and First Look

[00:00:00] Speaker 1: hey guys oh yeah okay come on here come over here show people you can walk and you have a camera oh yeah don't trip can you guys sit down okay stand up take a nap take a nap you need to take a nap okay stand up did you know that you were you were created in here you were created on rtx spark i know and trained you in the cloud on a whole bunch of nvidia super computers and you learned your skills right here on rtx spark in a digital twin the omniverse digital twin is that incredible i know i know you guys are so cute and and uh your your uh your parents are called pollen p-o-l-l-e-n is that right uh-huh pollen robotics and apparently everybody loves you guys so much you're sold out i know so if you go to the pollen website everybody everybody watching this you know there's going to be like 20 million viewers everybody watching this go to the pollen website and place an order i think this startup company is like 10 people they might blow up poof it's going to be so exciting everybody should have one you guys are so cute and so we'll just have an rtx spark and we'll teach your new skills isn't that right oh wait oh look at that that's incredible can you do a somersault that's so good that's so good wow okay well guess what okay so today what do we talk about we talked about europe building its ai economy and it starts with infrastructure and we announced a brand new brand new system called dgx pod it makes it easy for you to build ai factories and these ai factories don't just run models anymore pay attention stay focused come here come here come over here stay focused and these ai factories don't just run there you go sit down yeah they don't just run ai models anymore they run entire agents and these agents are consistent of five things there's the large language model that does the perception reasoning planning and acting and it runs in conjunction with a harness that turns it essentially exoskeleton everyone's that harness sits inside runs inside a secure runtime we call open shell which has just so many people that have supported it and you give it access to knowledge and tools and this agent runs on top of these computers but we're also extending into the next generation which is where you guys come in physical ai so that's it that's what we talked about everybody can build agents every company in europe will come will become an ai company there's no question everybody will become an ai company and we're going to have a thriving ai economy here in europe so after 33 years what an incredible journey and we made a really cool video you guys want to watch it together okay come on come over here just come over here just a little bit we'll get out of the way come here top speed top speed so this this is the prompt that is going to run the next application and what what you're about to see is this you're about to see a robotics application and while you're watching this demo just remember there's an agent running on this personal computer this demo runs across three computers the first computer is to train the second is a digital twin and the third is to put that ai into the computer itself okay so two very two ideas the first idea is agents how do you build it and run it and what you can use it to do and the second is physical ai computing model which consists of three computers let's take a look meet micro duck hugging faces robot let's teach it to see and walk with nvidia rtx spark i use hermes as my agent harness nemotron and open ai's gpt6 astra as my models and cuda x accelerated tools free cad blender and isaac sim newton physics engine and isaac lab i'll run everything on my rtx spark except when i need to burst larger workloads to cloud first i describe the course and what my micro duck needs to learn on rtx spark hermes and nemotron plan the course listing every object required astra takes it from there using free cad to model 3d objects blender to apply materials and omniverse sim ready libraries to add physical properties in isaac sim astra composes the scene astra rigs micro ducks joints actuators and links and simulates how micro duck moves with newton physics engine now training begins in the cloud thousands of micro ducks train in parallel in isaac lab every fall a lesson improving the policy every time omniverse libraries simulate micro ducks cameras teaching it to see with perception and physics working together my micro duck can avoid obstacles navigate tight spaces and adapt to its surroundings i download the policy to rtx spark and use nemotron and isaac sim to evaluate my micro duck with multi-robot and he's on his way nvidia rtx spark build and run ai agents and their accelerated tools right on your laptop welcome to gtc i want to thank all of you i want to thank all of you all the sponsors you can see all the names of companies that are here all the partners we've been working with for 33 years micro duck my new friends um let's work together to build europe's ai economy and put ai to work all right give everybody have a great gtc