DeepSpeed Description
DeepSpeed is a deep learning optimization library that is open source for PyTorch. It is designed to reduce memory and computing power, and to train large distributed model with better parallelism using existing computer hardware. DeepSpeed is optimized to provide high throughput and low latency training.
DeepSpeed can train DL-models with more than 100 billion parameters using the current generation GPU clusters. It can also train as many as 13 billion parameters on a single GPU.
DeepSpeed, developed by Microsoft, aims to provide distributed training for large models. It's built using PyTorch which is a data parallelism specialist.
Pricing
Pricing Starts At:
Free
Pricing Information:
Open source
Free Version:
Yes
Integrations
Company Details
Company:
Microsoft
Year Founded:
1975
Headquarters:
United States
Website:
www.deepspeed.ai/
Media
Recommended Products
Discover HPCC Systems - the truly open source big data solution that allows you to quickly process, analyze and understand large data sets, even data stored in massive, mixed-schema data lakes. Designed by data scientists, HPCC systems is a complete integrated solution from data ingestion and data processing to data delivery. The free online introductory courses and a robust developer community allow you to get started quickly.
Product Details
Platforms
SaaS
Windows
Mac
Linux
On-Premises
Type of Training
Documentation