Deploying LLMs via Google Cloud Model Garden MaaS

PMLE By islever Editorial Last updated

Short answer

D Use the DeepSeek-V3.2 model as a service (MaaS) in Model Garden and invoke it via the OpenAI Python SDK with a custom endpoint URL.

Question

You are an enterprise AI architect in a large international company. An ML team has asked you to help with development of a pilot of a customer support bot. The ML team plans to use the DeepSeek-V3.2 model, and they expect a few hundred requests per day. You need to quickly deploy the model using a cost-efficient approach. What should you do?
  1. Use the DeepSeek-V3.2 model as a service (MaaS) in Model Garden. Send HTTP requests in the Agent Platform endpoint using the Python requests library.
  2. Download the DeepSeek-V3.2 binaries from Model Garden, and deploy the model on a Google Kubernetes Engine (GKE) Autoscaling cluster. Send HTTP requests to the GKE endpoint using the Python requests library.
  3. Navigate to the DeepSeek-V3.2 model card in Model Garden. Click “Deploy model” to deploy it as an Agent Platform endpoint. Invoke the endpoint using the aiplatform SDK.
  4. Use the DeepSeek-V3.2 model as a service (MaaS) in Model Garden. Use a Python client from the openai SDK, and pass a custom endpoint URL to the client. Correct Answer

Key Takeaways

The question tests knowledge of MaaS capabilities, specifically that Google Cloud supports OpenAI-compatible interfaces for third-party models, enabling rapid development without infrastructure overhead.

Learn how to deploy the DeepSeek-V3.2 model efficiently using Google Cloud Model Garden's Model-as-a-Service (MaaS) feature. Discover why the OpenAI SDK integration provides the most cost-effective solution for low-volume AI workloads.

Common mistake: Option A is incorrect because MaaS endpoints are not typically invoked directly through generic Agent Platform endpoints using raw Python requests; they require an SDK or compatible interface. Option B is wrong because deploying on GKE introduces unnecessary infrastructure costs and complexity for a low-traffic pilot.

Expert Analysis

The scenario requires a cost-efficient, quick deployment for a low-volume workload (a few hundred requests per day) using the DeepSeek-V3.2 model on Google Cloud. The key constraint is minimizing infrastructure management and upfront costs.

Model-as-a-Service (MaaS) in Google Cloud Model Garden allows users to access foundation models without managing the underlying compute infrastructure. This eliminates the need to provision and maintain servers or clusters, which aligns with the requirement for a "cost-efficient" and "quick" approach. For low-frequency traffic like this, paying per token via MaaS is significantly more economical than keeping a dedicated cluster running idle.

Regarding the implementation method, Google Cloud's MaaS endpoints are designed to be OpenAI-compatible. This means they support the standard API structure used by the OpenAI Python SDK. By configuring the base_url parameter in the SDK client to point to the specific MaaS endpoint URL, developers can invoke the model using familiar code patterns without writing custom HTTP request handlers or navigating complex agent platform integrations. Option D correctly identifies both the service type (MaaS) and the appropriate client interface (OpenAI SDK with custom endpoint).

Exam Strategy

When evaluating deployment options for AI models, always compare the operational overhead against the expected workload volume. For low-to-medium traffic, managed services (MaaS) usually outperform self-managed clusters (GKE/VMs) due to zero idle costs. Additionally, verify the API compatibility of the managed service; many modern cloud MaaS offerings support industry-standard clients like the OpenAI SDK to accelerate development.

Frequently Asked Questions

Why is MaaS better than GKE for low-volume model serving?

MaaS eliminates fixed infrastructure costs. You only pay for tokens processed, whereas GKE requires you to pay for continuous node uptime even when the model is idle.

Can I use the OpenAI SDK with Google Cloud MaaS?

Yes, Google Cloud Model Garden endpoints are often OpenAI-compatible. You can configure the OpenAI Python SDK's base_url to point to the specific MaaS endpoint.

More PMLE FAQ →

Community Votes

D
100%

100% of anonymous learners picked answer D. Votes are pick records left by other test-takers — they are not the verified answer.

Discussion 2 contributions

Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.

From public community threads 2

  1. taylz876 👍 1 Answered D
    Why D is right, one piece at a time • MaaS (Model as a Service) means you rent the model, not the machines. Google already runs DeepSeek for you. You send a request, get an answer, and pay per token (the amount of text sent and received). “Pay per token, no upfront commitment." There's nothing to deploy, no machine to pay for between requests, and no infrastructure to manage. • That fits the situation. A few hundred requests a day is tiny. Paying per token costs almost nothing, while paying for a machine that runs all day would waste money. • Quick to start. "First step to use a MaaS model → enable its API in Model Garden." You enable the API and start sending requests, so you're up in minutes. • How you call it: MaaS models speak the same request format as OpenAI's models (called an OpenAI-compatible API). So you use the common openai Python library, and instead of OpenAI's address you pass in Google's endpoint URL for the model. That's what "pass a custom endpoint URL to the client" means in D. It lets the team use code they likely already know. Why the others are wrong • A: It's MaaS too, but it describes sending raw HTTP requests to an "Agent Platform endpoint" with the requests library. A MaaS model isn't an endpoint that you deploy and manage, and calling it with the standard client in D is the intended way. • B: Downloading the model files and running them on a GKE cluster means you build and look after the servers and pay for the cluster around the clock, which is the opposite of cheap and quick for a pilot. • C: Clicking "Deploy model" creates your own endpoint on machines (often with expensive GPUs) that bill all day, even when nobody is sending requests. For a few hundred requests a day, that's wasteful.
  2. n2183712847 👍 1 Answered D
    Correct answer: D. Using DeepSeek-V3.2 as a managed Model-as-a-Service (MaaS) endpoint with the OpenAI Python SDK provides the quickest, most cost-efficient approach for a few hundred daily requests without managing infrastructure; A is incorrect because MaaS is typically invoked through the supported OpenAI-compatible interface rather than directly through an Agent Platform endpoint with requests, while B requires unnecessary GKE infrastructure and C requires deploying and managing a dedicated endpoint.

Reader comments & corrections

No reader corrections yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Practice All PMLE Questions

Access 65 questions with complete answers and detailed explanations.

View Full PMLE Practice Test →

← Back to PMLE Study Guide