Tracking Model Training Parameters and Metrics in Vertex AI

PMLE By islever Editorial Last updated

Tracking and running ML experiments. Monitoring, testing, and troubleshooting AI solutions.

Short answer

C Use Vertex ML Metadata to track parameters, Vertex AI Experiments to compare model versions, and Vertex AI TensorBoard to visualize metrics per epoch.

Question

You work for a bank. You have been asked to develop an ML model that will support loan application decisions. You need to determine which Vertex AI services to include in the workflow. You want to track the model’s training parameters and the metrics per training epoch. You plan to compare the performance of each version of the model to determine the best model based on your chosen metrics. Which Vertex AI services should you use?
  1. Vertex ML Metadata, Vertex AI Feature Store, and Vertex AI Vizier
  2. Vertex AI Pipelines, Vertex AI Experiments, and Vertex AI Vizier
  3. Vertex ML Metadata, Vertex AI Experiments, and Vertex AI TensorBoard Correct Answer
  4. Vertex AI Pipelines, Vertex AI Feature Store, and Vertex AI TensorBoard

Key Takeaways

The question tests the distinction between Hyperparameter Tuning (Vizier) and Experiment Tracking/Visualization (Experiments + TensorBoard), requiring precise mapping of monitoring needs to services.

Learn how to use Vertex ML Metadata, Vertex AI Experiments, and Vertex AI TensorBoard to track training parameters, visualize epoch metrics, and compare model versions for optimal selection.

Common mistake: Candidates often choose A or B by selecting Vizier, confusing it with general metric tracking. Vizier is for automated optimization, whereas the scenario requires manual comparison and epoch-level visualization provided by Experiments and TensorBoard.

Expert Analysis

The scenario requires a Vertex AI architecture that supports three specific operational needs: tracking training parameters, visualizing metrics per epoch, and comparing model versions to select the best performer. The correct solution must address each of these distinct requirements using the appropriate service.

Vertex ML Metadata is the foundational service for this workflow. It automatically captures metadata about every step in the ML lifecycle, including model artifacts, hyperparameters, and datasets. This central repository allows for lineage tracking and ensures that all training runs are recorded with their associated context, which is essential for comparing different model versions later.

Vertex AI Experiments is designed specifically for organizing and managing multiple training runs. It allows data scientists to group related experiments, tag them with custom labels, and compare performance metrics across different runs side-by-side. This directly addresses the requirement to "compare the performance of each version of the model" and determine the best one based on chosen metrics.

Vertex AI TensorBoard provides the visualization layer for training progress. It ingests logs from training jobs to display real-time charts of loss, accuracy, and other metrics per epoch. This fulfills the explicit need to track "metrics per training epoch," allowing for detailed analysis of how the model learns over time.

Other options are incorrect because they misalign services with tasks. Vizier is used for automated hyperparameter tuning, not primarily for manual comparison or epoch-level visualization. Feature Store is for feature management, not experiment tracking. Pipelines orchestrate steps but do not inherently provide the visualization or comparison interface required here. Therefore, the combination of ML Metadata, Experiments, and TensorBoard is the only set that covers all stated requirements.

Official Reference

Exam Strategy

When answering questions about ML workflow tools, map each functional requirement to its specific service category. Distinguish clearly between 'tracking/comparing' (Experiments/Metadata) and 'automated tuning' (Vizier). For visualization of training curves, always look for TensorBoard. Avoid selecting Feature Store unless the question explicitly mentions feature reuse or serving latency reduction.

Frequently Asked Questions

What is the primary difference between Vertex AI Experiments and Vertex AI Vizier?

Experiments are for organizing, logging, and comparing manual or automated training runs. Vizier is an automated hyperparameter tuning service that optimizes parameters without manual intervention.

Does Vertex ML Metadata store the actual model weights?

No, it stores metadata about the model, such as the artifact location, hyperparameters, and lineage information. The actual model files are stored in Cloud Storage.

Can I use TensorBoard without Vertex AI Experiments?

Yes, you can use standalone TensorBoard, but Vertex AI Experiments provides a managed UI that integrates seamlessly with TensorBoard for easier comparison and tagging of experiments.

More PMLE FAQ →

Community Votes

C
100%

100% of anonymous learners picked answer C. Votes are pick records left by other test-takers — they are not the verified answer.

Discussion 8 contributions

Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.

From public community threads 8

  1. pikachu007 👍 5 Answered C
    Vertex ML Metadata: Tracks model training parameters, hyperparameters, metrics, and lineage information. Stores metadata in a central repository for easy access and comparison. Integrates seamlessly with Vertex AI Experiments and TensorBoard. Vertex AI Experiments: Organizes and manages model training runs as experiments. Visualizes experiment results, including metrics and parameter comparisons. Facilitates tracking of the best performing model versions. Vertex AI TensorBoard: Provides detailed visualizations of training metrics and model performance. Enables analysis of model behavior at each training epoch. Integrates with Vertex AI Experiments for seamless access to experiment data.
  2. info_appsatori 👍 5
    I guess because Vizier is a tool that helps to tune hyperparameters, and in a contrary Tensorboard is a tool to explore experiments.
  3. winston9 👍 3 Answered C
    use Tensorboard to track the model’s training parameters and the metrics per training epoch.
  4. dija123 👍 2 Answered C
    Agree with C
  5. VipinSingla 👍 2
    Why not B ?
Show 3 more comments
  1. taylz876 👍 1 Answered C
    The question has three needs, and each one maps to one service in C: • Track training parameters and compare model versions: Experiments logs the parameters and metrics of each run and compares them side by side, so you can pick the best model. • Metrics per training epoch: TensorBoard draws the loss and accuracy curves epoch by epoch. • A shared record behind it all: ML Metadata is the central store that keeps every run, dataset and model connected and traceable. That matters for a bank, where loan decisions need an audit trail.
  2. pinimichele01 👍 1 Answered C
    agree with pikachu007
  3. Carlose2108 👍 1 Answered C
    I went C

Reader comments & corrections

No reader corrections yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Practice All PMLE Questions

Access 65 questions with complete answers and detailed explanations.

View Full PMLE Practice Test →

← Back to PMLE Study Guide