Launched Intel Xeon 6 processors and Gaudí 3 AI accelerators capable of handling advanced AI workloads

Intel recently unveiled new hardware focused on improving artificial intelligence (AI) workflows. The company on Tuesday introduced Xeon 6 processors with new performance-core (P-core) and Gaudi 3 AI accelerators for enterprise customers and data centers. The chip maker claims the new hardware will offer both higher throughput and better cost optimization to enable optimal performance per watt and lower total cost of ownership. According to the chipmaker, these devices were launched to enable enterprises to handle ever-increasing workload demands from more advanced AI models.

Intel Xeon 6 processor launched

The chip maker says its new Intel Xeon is equipped with 6 performance-cores. These processors are not meant for retail consumers and will instead power data centers to help enterprises run cloud servers.

Intel claims that the Xeon 6 processor delivers twice the performance of its predecessor due to the increased core count. It also offers double the memory bandwidth and AI acceleration capabilities.

Since it has hardware-based acceleration, it can run very large language models (LLMs) easily. According to Intel, it can “meet the performance demands of AI from the edge to the data center and cloud environments”.

Intel unveils Gaudi 3 AI accelerator

Gaudi 3 is a new generation AI accelerator from Intel. These are specialized hardware chips designed to help machines speed up AI tasks, especially tasks related to deep learning, machine learning, and neural networks. These include GPUs, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), and neural processing units (NPUs).

The Gaudi 3 AI accelerator has 64 tensor processor cores and eight matrix multiplication engines (MMEs) designed to accelerate deep neural network calculations. It has 128GB of HBM2e memory for training and inference and 24 200GB Ethernet ports that enable the server to scale.

Intel’s new AI accelerator is compatible with the PyTorch framework and advanced hugging face transformer and diffuser models. The company has already signed a deal with IBM to deploy Gaudi 3 for IBM Clouds. Dell Technologies is also using the infrastructure for its data centers.