High Performance
Acceleration for GAI
and LLMs
Our Gaudi2 accelerator
is driving improved deep learning price-performance
Gaudi2 architectural features:
built on the proven Gaudi design foundation
- 7nm process technology
- Heterogeneous compute
- 24 Tensor Processor Cores
- Dual matrix multiplication engines
- 24 100 Gigabit Ethernet integrated on chip
- 96 GB HBM2E memory on board
- 48 MB SRAM
- Integrated Media Control
Gaudi2® in the Cloud
Discover the performance and ease of use Gaudi2 provides on the Intel Developer Cloud.
And coming soon: Gaudi2 on the Genesis Cloud.
Gaudi2® in the Data Center
Bring the price-performance advantage into your infrastructure with solutions from Supermicro and IEI.
Learn moreGaudi2 Training and Inference Performance
Gaudi2 delivers choice.
Based on MLPerf Training 3.0 Results published June 2023, Gaudi2 is the ONLY viable alternative to H100 for training
large language models like GPT-3. Read the details >
In addition to the MLPerf industry benchmark, Gaudi2 scores on other third-party evaluations.
Visit https://habana.ai/habana-claims-validation for workloads and configurations. Results may vary https://huggingface.com/blog/habana-gaudi-2-benchmark https://huggingface.co/blog/habana-gaudi-2-bloom
Gaudi2 supports massive, flexible scale out.
With 24x 100 Gigabit Ethernet (RoCEv2) ports integrated onto every Gaudi2, customers benefit from flexible and cost-efficient scalability that extends Gaudi2 performance from one to thousands of Gaudi2.
Figure1: Gaudi 8 accelerator reference design
For more information on building out system scale with Gaudi2, see our Networking with Gaudi page >
Easily build new or migrate
existing models on Gaudi2
SynapseAI Software Stack, optimized for Gaudi platform performance and ease, gives developers the documents, tools, how-to content and reference models to help developers get started on Gaudi quickly and
with ease.
Access and easily implement over 50,000 models with Habana Optimum Library on the Hugging Face hub.
For more information, see our developer site >
