An open source library released by Microsoft; called DeepSpeed, greatly advances model training for very large models consisting of more than 100 Billion Parameters.
Deep Speed improves four aspects:
- Scale: up to 10x bigger
- Speed: Up to 5x faster
- Cost: 5x reduction in cost
- Usability: Low code impact.
Please follow the link at the Microsoft Research Blog.
Latest posts by Pulsar Technology Corp (see all)
- Happy Thanksgiving. - November 24, 2022
- Synology Roadmap for 2023 And Beyond. What’s new. - October 27, 2022
- Ubiquiti Insider. What’s new in the UniFi Ubiquiti ecosystem: UniFi Network 7.2, UniFi Protect AI Theta, Building to Building Bridge. - August 18, 2022