The Technology Behind BLOOM Training
Not a closed model. BLOOM: 176B parameters, open-source, trained across 46 languages.

Why it matters
BLOOM represents a significant open-source alternative to proprietary large language models, demonstrating that frontier AI capabilities can be built and shared publicly—reshaping expectations around model access and reproducibility.
The key facts
9 to knowBLOOM: 176 billion parameters
Trained across 46 languages
Open-source release (vs. proprietary competitors)
Published July 2022
Built using Megatron and DeepSpeed frameworks
Hugging Face infrastructure deployment
Open-source model trained on open infrastructure
Uses Megatron and DeepSpeed optimization frameworks
Hugging Face flagship initiative
Go to the source
Hugging Face Bloghuggingface.co