Current, content updated Jul 2026
Pretraining LLMs
A short course from Upstage on pretraining LLMs: data preparation, model setup, training and evaluation.
Our take
One of very few accessible courses on pretraining itself.
Best for: ML engineers curious about how base models are built.
Based on the course page, syllabus and pricing, not on completing the course. How we rank
What you'll learn
- Explore LLM pretraining
- Explore Tokens
- Explore Data pipelines
Good
- No course enrollment fee
- Focused, topic-specific lessons
Watch out for
- May require programming or technical foundations
About DeepLearning.AI
DeepLearning.AI publishes online learning content in AI, data, or software development.