~ / skills / productivity / pytorch-fsdp2

pytorch-fsdp2

Adds PyTorch FSDP2 (fully_shard) to training scripts with correct init, sharding, mixed precision/offload config, and distributed checkpointing. Use when models exceed single-GPU…

Industry: productivity
License: Unverified
Source repo: Orchestra-Research/AI-Research-SKILLs · ★ 10,718
Source file: 08-distributed-training/pytorch-fsdp2/SKILL.md

View full SKILL.md on GitHub →

不会安装？看中文图文教程 →