Skip to content
Menu
Menu
Products
Overview
Intel Gaudi 3
Intel Gaudi2
Intel Gaudi
Intel Gaudi Software
Solutions
Overview
AI for the Cloud
On Premises
Hybrid
Industries
Overview
AI in AV
AI in Fintech
AI in Healthcare
AI in Retail
Developers
Resources
Habana Blog
Events and Webinars
Whitepapers & Datasheets
Content Directory
Contact
Menu
Products
Overview
Intel Gaudi 3
Intel Gaudi2
Intel Gaudi
Intel Gaudi Software
Solutions
Overview
AI for the Cloud
On Premises
Hybrid
Industries
Overview
AI in AV
AI in Fintech
AI in Healthcare
AI in Retail
Developers
Resources
Habana Blog
Events and Webinars
Whitepapers & Datasheets
Content Directory
Contact
Habana Blog
News & Discussion
Tagged: BERT
Habana Blogs
News & Discussion
Tagged: BERT
January 31, 2023
Pre-Training the BERT 1.5B model with DeepSpeed
In this post, we show you how to run Habana’s DeepSpeed enabled BERT1.5B model from our Model-References repository.
BERT
,
DeepSpeed
,
developer
,
Gaudi
,
Gaudi2
,
pytorch
,
synapseai
