Habana Blog

News & Discussion
Tagged: BERT

Pre-Training the BERT 1.5B model with DeepSpeed

In this post, we show you how to run Habana’s DeepSpeed enabled BERT1.5B model from our Model-References repository.
BERT, DeepSpeed, developer, Gaudi, Gaudi2, pytorch, synapseai
Products
Developer
Contact us
Privacy & Legal
© 2025 Habana Labs Ltd. All rights reserved