Which Pipeline Framework Fits a TensorFlow Text-to-Image Workflow?

You are building a TensorFlow text-to-image generative model by using a dataset that contains billions of images with their respective captions. You want to create a low maintenance, automated workflow that reads the data from a Cloud Storage bucket collects statistics, splits the dataset into training/validation/test datasets performs data transformations trains the model using the training/validation datasets, and validates the model by using the test dataset. What should you do?

  1. Use the Apache Airflow SDK to create multiple operators that use Dataflow and Vertex AI services. Deploy the workflow on Cloud Composer.
  2. Use the MLFlow SDK and deploy it on a Google Kubernetes Engine cluster. Create multiple components that use Dataflow and Vertex AI services.
  3. Use the Kubeflow Pipelines (KFP) SDK to create multiple components that use Dataflow and Vertex AI services. Deploy the workflow on Vertex AI Pipelines.
  4. Use the TensorFlow Extended (TFX) SDK to create multiple components that use Dataflow and Vertex AI services. Deploy the workflow on Vertex AI Pipelines. Source Reference Answer

Community Votes

D
52%
C
48%

52% of anonymous learners picked answer D. Votes are pick records left by other test-takers — they are not the verified answer.

Community Insight

Tests your ability to select the appropriate managed pipeline service on Vertex AI, with the common trap being confusing general-purpose KFP with framework-specific TFX despite both deploying to the same orchestration layer.

When building scalable ML workflows on Google Cloud, choosing between Kubeflow Pipelines and TensorFlow Extended (TFX) depends on your underlying framework and data scale. The community consensus strongly favors TFX for TensorFlow-based pipelines due to its native components for large-scale data processing, validation, and training, which significantly reduces maintenance overhead.

Option C (Kubeflow Pipelines) is frequently selected because it also integrates with Vertex AI Pipelines, but it requires more custom component development and lacks TFX's out-of-the-box optimizations for TensorFlow and massive datasets.

Community Discussion (10 comments)

pinimichele01 👍 5 Selected: C
If you use TensorFlow in an ML workflow that processes terabytes of structured data or text data, we recommend that you build your pipeline using TFX. For other use cases, we recommend that you build your pipeline using the Kubeflow Pipelines SDK https://cloud.google.com/vertex-ai/docs/pipelines/build-pipeline#sdk
kornick 👍 1 Selected: C
TFX -> processes terabytes of structured data or text data
wences 👍 2 Selected: D
in this one will go with D, TFX is more specialized than kfp
baimus 👍 2 Selected: D
TFX is going to be easier than kubeflow with custom code, as it basically does exactly what is listed there, by default.
dija123 👍 2 Selected: D
Agree with TFX
PhilipKoku 👍 2 Selected: D
D) TFX is the way forward as it has services to support every step of the use case presented.
fitri001 👍 2 Selected: C
KFP Pipelines: Kubeflow Pipelines (KFP) is a popular open-source framework for building and deploying machine learning workflows. It provides a user-friendly SDK for defining pipelines as components and simplifies workflow orchestration. Vertex AI Pipelines Integration: Vertex AI Pipelines is a managed service from Google Cloud that integrates seamlessly with KFP. You can deploy your KFP-defined workflow on Vertex AI Pipelines, leveraging its features like scheduling, monitoring, and versioning. Dataflow and Vertex AI Services: Both Dataflow and Vertex AI are Google Cloud services well-suited for this workflow
winston9 👍 2 Selected: D
C and D are valid options. if the model is created in TF, use TFX, in any other case, use KFP; therefore, here is D
BlehMaks 👍 3 Selected: C
https://cloud.google.com/vertex-ai/docs/pipelines/build-pipeline#sdk
pikachu007 👍 2 Selected: D
Airflow (A): While versatile, Airflow often requires more manual configuration and integration with ML services, potentially increasing maintenance effort. MLFlow (B): MLFlow focuses on experiment tracking and model management, lacking built-in pipeline components for data processing and model training. Kubeflow Pipelines (C): KFP is flexible but requires more setup and infrastructure management compared to TFX's managed services.

Comments & Corrections

No comments yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Submitted for moderation before publishing. Keep it helpful and respectful.

Expert Analysis

Why the Answer Is Correct

TFX is explicitly designed for TensorFlow ecosystems and provides production-ready components like ExampleGen, StatisticsGen, Transform, Trainer, and Evaluator that directly satisfy every step outlined in the scenario. Deploying TFX on Vertex AI Pipelines delivers a fully managed, low-maintenance orchestration environment that automates data ingestion, splitting, transformation, training, and evaluation without requiring manual infrastructure setup. This approach aligns perfectly with Google Cloud's best practices for handling terabytes of structured or unstructured data within a TensorFlow workflow.

Why the Other Options Are Wrong

Airflow (A) demands extensive manual operator coding and lacks native ML lifecycle integrations, contradicting the low-maintenance requirement. MLFlow (B) specializes in experiment tracking and model registry rather than end-to-end pipeline orchestration, and hosting it on GKE introduces unnecessary operational complexity. While Kubeflow Pipelines (C) offers flexibility and Vertex AI integration, it is a generic open-source framework that requires more boilerplate configuration compared to TFX's specialized TensorFlow tooling.

Community Comment Notes

Multiple users pointed to official documentation recommending TFX specifically for TensorFlow workflows processing large-scale data [1][9]. Contributors emphasized that TFX natively handles the exact pipeline stages mentioned, minimizing custom code and maintenance efforts [4][5]. Although vote counts were nearly split between C and D, the consensus solidified around TFX due to its framework-specific optimizations and lower operational burden [7][10].

Official Reference

Exam Strategy

Always match the pipeline SDK to the core ML framework: use TFX for TensorFlow projects and reserve KFP for PyTorch, scikit-learn, or cross-framework data engineering tasks. On exam day, prioritize solutions that leverage fully managed Google Cloud services and eliminate options requiring manual cluster management or custom orchestration code.

Related Analysis

Practice All PMLE Questions

Access 65 questions with complete answers and detailed explanations.

View Full PMLE Practice Test →

← Back to PMLE Study Guide