Habana Blog

News & Discussion
Tagged: BERT

Pre-Training the BERT 1.5B model with DeepSpeed

In this post, we show you how to run Habana’s DeepSpeed enabled BERT1.5B model from our Model-References repository.
BERT, DeepSpeed, developer, Gaudi, Gaudi2, pytorch, synapseai
Products
Solutions
Industries
Developer
Resources
Contact us
Privacy & Legal
Social Media
© 2024 Habana Labs Ltd.
All rights reserved