Files
model_garden/notebooks/official/reduction_server

PyTorch distributed training with Vertex AI Reduction Server

Learn how to create a PyTorch distributed training job that uses PyTorch distributed training framework and tools, and run the training job on the Vertex AI Training service with Reduction Server.

The steps performed include:

* Create a PyTorch distributed training application
* Package the training application with pre-built containers
* Create a custom job on Vertex AI with Reduction Server
* Submit and monitor the job

   Learn more about Vertex AI Training.

   Learn more about Vertex AI Reduction Server.