2019 OCP Global Summit

Intel is accelerating AI performance on Intel Xeon Scalable Processors with hardware features and software optimizations boosting performance across a wide range of AI/DL/ML workloads. Starting with the codename Cascade Lake Intel Xeon processors, Intel added the Vector Neural Network Instruction (VNNI) to the AVX-512 instruction set to further boost AI inference performance. In this session, we will provide a detailed overview of VNNI and the optimizations Intel is doing across popular frameworks. And, we’ll live demo these benefits using publicly available frameworks.