How to mitigate zonal failures in Dataflow?

You are designing a Dataflow pipeline for a batch processing job. You want to mitigate multiple zonal failures at job submission time. What should you do?

  1. Submit duplicate pipelines in two different zones by using the --zone flag.
  2. Set the pipeline staging location as a regional Cloud Storage bucket.
  3. Specify a worker region by using the --region flag. Source Reference Answer
  4. Create an Eventarc trigger to resubmit the job in case of zonal failure when submitting the job.

Community Votes

C
100%

100% of anonymous learners picked answer C. Votes are pick records left by other test-takers — they are not the verified answer.

Community Insight

The question tests knowledge of Dataflow regional deployment for high availability, distinguishing it from zonal deployment to avoid the trap of manual redundancy.

To ensure high availability for Dataflow batch jobs, you should specify a worker region rather than a specific zone. The community consensus confirms that using the --region flag allows Google Cloud to automatically distribute resources across multiple zones, mitigating the risk of zonal failures.

Selecting Option A is a common error because it suggests manually duplicating pipelines, which is inefficient compared to using the built-in resilience of regional configuration.

Community Discussion (6 comments)

Matt_108 👍 10 Selected: C
Option C: https://cloud.google.com/dataflow/docs/guides/pipeline-workflows#zonal-failures
raaad 👍 6 Selected: C
  • Specifying a worker region (instead of a specific zone) allows Google Cloud's Dataflow service to manage the distribution of resources across multiple zones within that region
Pime13 👍 1 Selected: C
C. Specify a worker region by using the --region flag. This ensures that your Dataflow job is submitted to a region rather than a specific zone, providing higher availability and resilience against zonal failures https://cloud.google.com/dataflow/docs/guides/pipeline-workflows#zonal-failures
JyoGCP 👍 1 Selected: C
Option C
Sofiia98 👍 1 Selected: C
https://cloud.google.com/dataflow/docs/guides/pipeline-workflows#zonal-failures
scaenruy 👍 2 Selected: C
C. Specify a worker region by using the --region flag.

Comments & Corrections

No comments yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Submitted for moderation before publishing. Keep it helpful and respectful.

Expert Analysis

Why the Answer Is Correct

Specifying a worker region using the --region flag is the correct approach because it allows the Dataflow service to automatically manage the distribution of worker resources across multiple availability zones within that region. This configuration ensures that if a specific zone experiences a failure, the pipeline can continue processing using resources in the remaining healthy zones, thereby providing fault tolerance at the job submission time.

Why the Other Options Are Wrong

Option A is incorrect because manually submitting duplicate pipelines in different zones adds operational overhead and complexity without leveraging the service's native high-availability capabilities. Option B, while good practice for storage, does not inherently control the placement of compute workers to prevent zonal failures. Option D is incorrect because Eventarc is used for event-driven architectures and triggering workflows based on events, not for managing the resilience of batch job submissions against infrastructure failures.

Community Comment Notes

Community comments overwhelmingly support Option C, citing the official Google Cloud documentation on pipeline workflows and zonal failures. Users emphasize that relying on the platform to manage resource distribution via the region flag is the standard best practice for achieving resilience in Dataflow jobs.

Official Reference

Exam Strategy

When facing questions about infrastructure resilience on Google Cloud, prioritize options that utilize regional resources over zonal ones. Remember that platform-managed redundancy is generally preferred over manual duplication or custom retry logic.

Related Analysis

← Back to PDE Study Guide