PyTorch

PyTorch Expert Exchange Webinar: How does batching work on modern GPUs? with Finbarr Timbers, an AI researcher, who writes at Artificial Fintelligence and has worked at a variety of large research labs, including DeepMind and Midjourney Batch inference is the most basic optimization that you can do to improve GPU utilization. It is often overlooked and misunderstood because of how common it is. Here, we walk through why, exactly, batching works, and help you develop intuition for what exactly is going on inside your GPU.

We'll be live today in 1 hour ⏱️ Find out how you can develop intuition for what exactly is going on inside your GPU

Batch inference is the most basic optimization that you can do to improve GPU utilization. It is often overlooked and misunderstood because of how common it is. AI researcher, Finbarr Timbers will walk through why, exactly, batching works, and help you develop intuition for what exactly is going on inside your GPU. Join us live on Wednesday at 10am PT for our next PyTorch Expert Exchange: https://hubs.la/Q02XNSDB0

The worldwide PyTorch community grows stronger every day 🔥💪🌏🚀 Last week, Executive Director of PyTorch Foundation Matt White shared updates on PyTorch at Open Source Summit Japan 🇯🇵 #OpenSource #AI #OSSummit #AIdev The Linux Foundation

Pair the vLLM engine with TorchServe to create a full-fledged #LLM serving solution for production 💥 Find out how in our blog: https://hubs.la/Q02WxJQ20

Learn the inner workings of Triton, the hardware agnostic language for GPU programming and powering TorchInductor: https://hubs.la/Q02WlVXr0

PyTorch 2.5.1 has been released with fixes for RPM based distributions, arm64 distributions, torch.compile crashes, MPS crashes, as well as several issues related to attention regressions observed in 2.5.0. For more information, please refer to the release notes at https://hubs.la/Q02Wc2JX0

PyTorch teams at Arm and Meta teamed up to optimize #AI performance through the ExecuTorch framework, which is now available in Beta 🔥 See how you can get started today: https://hubs.la/Q02W1YkR0

Mobile developers, listen up 📲 Thanks to the direct integration of Arm KleidiAI with the ExecuTorch framework through XNNPACK, you can benefit from quicker, more responsive AI-based experiences on mobile. Dive into what's possible: https://hubs.la/Q02W0njD0

Learn more about Intel Corporation GPU support for #PyTorch 2.5 Read the blog: https://hubs.la/Q02VTL670