# Distributed Training Deepspeed

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages...

- Repository: https://github.com/davila7/claude-code-templates (33041 stars)
- Category: Engineering
- License: MIT
- Last updated: 2026-11-01
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add davila7/claude-code-templates --skill distributed-training-deepspeed -g -a claude-code -y`
Codex: `npx skills add davila7/claude-code-templates --skill distributed-training-deepspeed -g -a codex -y`
Cursor: `npx skills add davila7/claude-code-templates --skill distributed-training-deepspeed -g -a cursor -y`
Gemini CLI: `npx skills add davila7/claude-code-templates --skill distributed-training-deepspeed -g -a gemini-cli -y`

## Description

Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Deepspeed Skill

Comprehensive assistance with deepspeed development, generated from official documentation.

## When to Use This Skill

This skill should be triggered when:
- Working with deepspeed
- Asking about deepspeed features or APIs
- Implementing deepspeed solutions
- Debugging deepspeed code
- Learning deepspeed best practices

## Quick Reference

### Common Patterns

The rest: https://github.com/davila7/claude-code-templates/blob/HEAD/cli-tool/components/skills/ai-research/distributed-training-deepspeed/SKILL.md