The increasing demand for AI inference workloads is prompting significant changes to data centre infrastructure and design. Data centres are adapting their physical and computational systems to accommodate the unique requirements of AI inference processing, which differs substantially from traditional computing workloads.