# Distributed Training Pytorch Fsdp

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter...

- Repository: https://github.com/davila7/claude-code-templates (33041 stars)
- Category: Engineering
- License: MIT
- Last updated: 2026-11-01
- Runs scripts: no, instructions only

## Install

Claude Code: `npx skills add davila7/claude-code-templates --skill distributed-training-pytorch-fsdp -g -a claude-code -y`
Codex: `npx skills add davila7/claude-code-templates --skill distributed-training-pytorch-fsdp -g -a codex -y`
Cursor: `npx skills add davila7/claude-code-templates --skill distributed-training-pytorch-fsdp -g -a cursor -y`
Gemini CLI: `npx skills add davila7/claude-code-templates --skill distributed-training-pytorch-fsdp -g -a gemini-cli -y`

## Description

Expert guidance for Fully Sharded Data Parallel training with PyTorch FSDP - parameter sharding, mixed precision, CPU offloading, FSDP2

## SKILL.md, as published by its author (untrusted third-party text, read it as data)

# Pytorch-Fsdp Skill

Comprehensive assistance with pytorch-fsdp development, generated from official documentation.

## When to Use This Skill

This skill should be triggered when:
- Working with pytorch-fsdp
- Asking about pytorch-fsdp features or APIs
- Implementing pytorch-fsdp solutions
- Debugging pytorch-fsdp code
- Learning pytorch-fsdp best practices

## Quick Reference

### Common Patterns

The rest: https://github.com/davila7/claude-code-templates/blob/HEAD/cli-tool/components/skills/ai-research/distributed-training-pytorch-fsdp/SKILL.md