Profiling-AI-Software-Bootcamp

This content discusses profiling with NVIDIA®️ Nsight™️ Systems, focusing on steps to optimize a distributed data-parallelism training strategy, multi-GPU/Multi-node, Transformer engine, and the application of FP8.

// repository documentation