FrontierThe story, in brief

The Technology Behind BLOOM Training

Not a closed model. BLOOM: 176B parameters, open-source, trained across 46 languages.

Illustration of a transparent lens revealing connected networks across layers of paper.
Exploring the next frontier of AI research.AI illustration by KeyNews
The KeyNews take

Why it matters

BLOOM represents a significant open-source alternative to proprietary large language models, demonstrating that frontier AI capabilities can be built and shared publicly—reshaping expectations around model access and reproducibility.

The key facts

9 to know
  1. BLOOM: 176 billion parameters

  2. Trained across 46 languages

  3. Open-source release (vs. proprietary competitors)

  4. Published July 2022

  5. Built using Megatron and DeepSpeed frameworks

  6. Hugging Face infrastructure deployment

  7. Open-source model trained on open infrastructure

  8. Uses Megatron and DeepSpeed optimization frameworks

  9. Hugging Face flagship initiative

Go to the source

Hugging Face Bloghuggingface.co

Read original report
Back to today's editionMore frontier news

Keep reading

Related stories

More from Frontier