Track parameters and metrics for custom training jobs: Notebook

This notebook demonstrates how to use Vertex AI SDK for Python to track metrics and parameters for Vertex AI custom training jobs, and how to perform detailed analysis using this data.

Notebook:

This tutorial uses the following Google Cloud ML services and resources:

• Vertex AI dataset
• Vertex AI model
• Vertex AI endpoint
• Vertex AI custom training Job
• Vertex AI Experiments

The steps performed include:

1. Track training parameters and prediction metrics for a custom training job.
2. Extract and perform analysis for all parameters and metrics within a Vertex AI Experiments.

Relevant content

• Vertex ML Metadata
• Custom training overview
• Endpoint
• Create and manage experiment runs