🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA This session reminds me a lot of the talk Mofi Rahman @[email protected], Rob Koch, and I will be giving later today! (2:30pm ish in the 101 Track! Join us!)

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch This talk has a lot of Callouts to past KubeCon talks for more context about AI. Also a shoutout to Dynamic Resource Allocation, a relatively new Kubernetes feature with potential to enable AI workloads! They also touched on GPU Sharing concepts- important for efficiency.

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch This section dives into the details of running resource-hungry AI workloads on Kubernetes today. Topology-aware placement for performance and fault tolerance/resiliency in these slides.

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Observability, fault tolerant scheduling, and multi-dimensional optimization. It closes by encouraging the audience to learn more about the topics discussed. Make sure you check out the recording for more detail!

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch .Microsoft Azure presents the first Sponsored Keynote, 'Build an Open Source Platform for AI/ML' Using Open Source models makes AI workloads much easier & more accessible to run, but there's still plenty of steps to go through and decisions to make.

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Microsoft Azure .Microsoft Azure presents KAITO, Kubernetes AI Tooling Operator. A Custom Resource Definition/Operator for running AI models on Kubernetes.

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Microsoft Azure Now a panel on Optimizing Performance and Sustainability for AI! Featuring susan wu88 (@googlecloud), Ricardo Rocha (@CERN), Clayton Coleman (@googlecloud), Victor (@AmpereComputing), and LuQiu (@Alluxio)

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Microsoft Azure susan wu88 Google Cloud Ricardo Rocha CERN Clayton Coleman Victor Ampere Alluxio .Clayton Coleman is wearing the shirt Tim Hockin (thockin.yaml), Josh Berkus, and I designed! ON THE KEYNOTE STAGE! 🥹💖🤩

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Microsoft Azure susan wu88 Google Cloud Ricardo Rocha CERN Clayton Coleman Victor Ampere Alluxio Tim Hockin (thockin.yaml) A cool thing about this panel is that they have several slides to help illustrate the points they're making in the panel! Make sure you check out the recording for detail!

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Microsoft Azure susan wu88 Google Cloud Ricardo Rocha CERN Clayton Coleman Victor Ampere Alluxio Tim Hockin (thockin.yaml) The panel closed with a convenient slide of quick tips for AI on Kubernetes. It's becoming the standard platform, allocations need to match usage as best we can. CPUs have a role to play in acceleration. And choose the right specialized hardware for your use case!

🌻 Priyanka Sharma🌻 CNCF 👩‍💻 Paige Bailey Google AI Mistral AI Jeffrey Morgan ollama Nikhita Raghunath NVIDIA Mofi Rahman @[email protected] Rob Koch Microsoft Azure susan wu88 Google Cloud Ricardo Rocha CERN Clayton Coleman Victor Ampere Alluxio Tim Hockin (thockin.yaml) .Nikhita Raghunath runs a FABULOUS 'Cloud Native News Show' (AI edition) segment! A great way to share some great news: CNCF has formed a new AI Working Group!