Current, content updated Jul 2026

Pretraining LLMs

DeepLearning.AI

A short course from Upstage on pretraining LLMs: data preparation, model setup, training and evaluation.

Our take

One of very few accessible courses on pretraining itself.

Best for: ML engineers curious about how base models are built.

Based on the course page, syllabus and pricing, not on completing the course. How we rank

What you'll learn

  • Explore LLM pretraining
  • Explore Tokens
  • Explore Data pipelines

Good

  • No course enrollment fee
  • Focused, topic-specific lessons

Watch out for

  • May require programming or technical foundations

About DeepLearning.AI

DeepLearning.AI publishes online learning content in AI, data, or software development.

Similar courses

United Kingdom Next intake: Sep 2027

Artificial Intelligence MSc

University of Edinburgh

A one-year taught MSc from the School of Informatics in which around half the taught credits come from AI courses such as NLP, computer vision, speech recognition, probabilistic modelling and robot learning, followed by a summer dissertation.

  • Master's degree
  • On campus in Edinburgh
  • 1 year full-time; 2 or 3 years part-time

Teaches Python

Tuition varies See the provider's page

United States

Bachelor of Science in Artificial Intelligence

Carnegie Mellon University

CMU's undergraduate AI degree, introduced in 2018, combining computer science, mathematics, statistics, machine learning, symbolic computation and ethics.

  • Bachelor's degree
  • On campus in Pittsburgh

Tuition varies See the provider's page

France

Master 2 de recherche : Mathématiques, Vision, Apprentissage (MVA)

ENS Paris-Saclay

Research-oriented final-year master's in mathematics for machine learning and computer vision, with courses spread across ENS Paris-Saclay, CentraleSupélec, École Polytechnique, Télécom Paris, Mines Paris and Paris institutions.

  • Master's degree
  • On campus in Gif-sur-Yvette
  • Master 2 (final year)

Tuition varies See the provider's page