Pre-Training the BERT 1.5B model with DeepSpeed
In this post, we show you how to run Habana’s DeepSpeed enabled BERT1.5B model from our Model-References repository.
BERT, DeepSpeed, developer, Gaudi, Gaudi2, pytorch, synapseai
Art Generation with PyTorch Stable Diffusion and Habana Gaudi
In this post, we will learn how to run PyTorch stable diffusion inference on Habana Gaudi processor, expressly designed for the purpose of efficiently accelerating AI Deep Learning models.
developer, Gaudi, pytorch
Detecting frequent graph re-compilations
In training workloads, there may occur some scenarios in which graph re-compilations occur. This can create system latency and slow down the overall training process with multiple iterations of graph compilation. This blog focuses on detecting these graph re-compilations.
debugging, developer, Gaudi, performance, pytorch
Writing training scripts that can run either on Gaudi, GPU, or CPU
In this tutorial we will learn how to write code that automatically detects what type of AI accelerator is installed on the machine (Gaudi, GPU or CPU), and make the needed changes to run the code smoothly.
developer, Gaudi
Fine tuning GPT2 with Hugging Face and Habana Gaudi
In this tutorial, we will demonstrate fine tuning a GPT2 model on Habana Gaudi AI processors using Hugging Face optimum-habana library with DeepSpeed.
DeepSpeed, developer, Fine Tuning, Gaudi, GPT, GPT2, Hugging Face
Memory-Efficient Training on Habana® Gaudi® with DeepSpeed
One of the key challenges in Large Language Model (LLM) training is reducing the memory requirements needed for training without sacrificing compute/communication efficiency and model accuracy.
DeepSpeed, developer, Gaudi, Large Language Models
Migrating TensorFlow EfficientNet to Habana Gaudi
In this post, we will learn how to migrate a TensorFlow EfficientNet model from running ...
Gaudi
Release of SynapseAI® version 1.6.0
The Habana team is happy to announce the release of SynapseAI® version 1.6.0. In this ...
Gaudi, Gaudi2
The Habana® Labs team is happy to announce the release of SynapseAI® version 1.5.0.
SynapseAI 1.5 brings many improvements, both in usability and in Habana ecosystem support. For PyTorch ...
Gaudi, Gaudi2
Habana Gaudi2 at Intel Vision 22
The Habana team is excited to have launched our next-gen 7nm training and inference processors, ...
Gaudi, Gaudi2
Habana Expands Gaudi® Platform Functionality with SynapseAI® version 1.4.0.
The Habana(R) Labs team is pleased to augment software support for the Gaudi platform with ...
Gaudi
