ZeRO & DeepSpeed: Enabling models with over 100 Billion Parametrs.

An open source library released by Microsoft; called DeepSpeed, greatly advances model training for very large models consisting of more than 100 Billion Parameters. Deep Speed improves four aspects: Scale: up to 10x bigger Speed: Up to 5x faster Cost: 5x reduction in cost Usability: Low code impact. Please follow the link at the Microsoft Research Blog.

Windows Server 2008 and 2008 R2 End of Support Announcement.

On January 14, 2020, the servers reached End of Support. No more security updates will be available, putting any still running server installations at risk. One of the available options is to migrate to Azure, including porting your existing licenses. Please see the full announcement and available options at Microsoft Windows Server Blog.