Pre-Training the BERT 1.5B model with DeepSpeed
January 31, 2023
In this post, we show you how to run Habana’s DeepSpeed enabled BERT1.5B model from our Model-References repository.
Read more
Tag: Gaudi
Art Generation with PyTorch Stable Diffusion and Habana Gaudi
December 16, 2022
In this post, we will learn how to run PyTorch stable diffusion inference on Habana Gaudi processor, expressly designed for the purpose of efficiently accelerating AI Deep Learning models.
Read more
Detecting frequent graph re-compilations
December 2, 2022
In training workloads, there may occur some scenarios in which graph re-compilations occur. This can create system latency and slow down the overall training process with multiple iterations of graph compilation. This blog focuses on detecting these graph re-compilations.
Read more
Writing training scripts that can run either on Gaudi, GPU, or CPU
December 1, 2022
In this tutorial we will learn how to write code that automatically detects what type of AI accelerator is installed on the machine (Gaudi, GPU or CPU), and make the needed changes to run the code smoothly.
Read more
Fine tuning GPT2 with Hugging Face and Habana Gaudi
October 20, 2022
In this tutorial, we will demonstrate fine tuning a GPT2 model on Habana Gaudi AI processors using Hugging Face optimum-habana library with DeepSpeed.
Read more
Memory-Efficient Training on Habana® Gaudi® with DeepSpeed
October 11, 2022
One of the key challenges in Large Language Model (LLM) training is reducing the memory requirements needed for training without sacrificing compute/communication efficiency and model accuracy.
Read more
Migrating TensorFlow EfficientNet to Habana Gaudi
August 23, 2022
In this post, we will learn how to migrate a TensorFlow EfficientNet model from running initially on a CPU to a Habana Gaudi Training processor, expressly designed for the purpose of efficiently […]
Read more
Release of SynapseAI® version 1.6.0
August 15, 2022
The Habana team is happy to announce the release of SynapseAI® version 1.6.0. In this release, we introduce preliminary inference capabilities on Gaudi. For further details, refer to the Inference on Gaudi guide. […]
Read more
The Habana® Labs team is happy to announce the release of SynapseAI® version 1.5.0.
June 16, 2022
SynapseAI 1.5 brings many improvements, both in usability and in Habana ecosystem support. For PyTorch we removed the need for weight permutation, as well as the need to explicitly call load_habana_module. See […]
Read more
Habana Gaudi2 at Intel Vision 22
May 10, 2022
The Habana team is excited to have launched our next-gen 7nm training and inference processors, Gaudi2 for training and Greco for inference, this morning on stage at Intel Vision 22. Sandra Rivera, […]
Read more
Habana Expands Gaudi® Platform Functionality with SynapseAI® version 1.4.0.
April 7, 2022
The Habana(R) Labs team is pleased to augment software support for the Gaudi platform with the release of SynapseAI® version 1.4.0. In this release, we have made several version updates. We now support […]
Read more