Understanding Context Windows in Amazon Bedrock Foundation Models

AIF-C01 By islever Editorial Last updated

Describe design considerations for applications that use foundation models.

Short answer

B The context window determines the maximum number of tokens that can be processed in a single prompt, directly informing the choice of foundation model based on required input length.

Question

A company wants to build a generative AI application by using Amazon Bedrock and needs to choose a foundation model (FM). The company wants to know how much information can fit into one prompt.
Which consideration will inform the company's decision?
  1. Temperature
  2. Context window Correct Answer
  3. Batch size
  4. Model size

Key Takeaways

The question tests the distinction between model architecture constraints (context window) and model complexity (parameter count), identifying context window as the sole determinant of prompt length.

Learn why the context window is the critical factor for determining prompt limits when selecting a foundation model in Amazon Bedrock.

Common mistake: Candidates often choose 'Model size' because they associate larger models with greater capability. However, model size refers to parameter count, not input token capacity, making it incorrect for this specific constraint.

Expert Analysis

The question asks specifically about the limit on how much information can fit into one prompt when choosing a foundation model in Amazon Bedrock. This is a direct reference to the context window, which defines the maximum number of tokens (input and output combined) that a model can process in a single inference request.

Context window (B) is the correct answer because it is the architectural constraint that dictates prompt length. Different foundation models have different context window sizes (e.g., 32K, 128K, or more). If a company needs to include large documents or extensive conversation history in a prompt, they must select a model with a sufficiently large context window.

The most attractive wrong answer is likely D. Model size. Many candidates confuse "model size" (the number of parameters, e.g., 7B vs 70B) with input capacity. While larger models often come with larger context windows, the two are distinct concepts. Model size refers to the model's complexity and parameter count, not its input token limit. A small model could theoretically have a large context window if architected that way, though typically they correlate. The key distinction is that "Model size" does not define the prompt length limit; only the context window does.

Temperature (A) controls randomness and creativity, unrelated to input size. Batch size (C) is an inference optimization parameter for processing multiple requests simultaneously, not a per-prompt limit.

Official Reference

https://docs.aws.amazon.com/bedrock/latest/userguide/model-parameters.html

This link opens the official vendor documentation in a new tab.

Exam Strategy

When asked about input/output limits, token counts, or memory constraints in LLM questions, always look for 'Context Window' or 'Token Limit'. Do not confuse these with 'Model Size' (parameters) or 'Temperature' (randomness). Read the question carefully to see if it asks about content generation quality (Temperature) or data capacity (Context Window).

Frequently Asked Questions

What is the difference between context window and model size?

Context window refers to the maximum number of tokens (input + output) a model can process at once. Model size refers to the number of parameters in the model, which affects complexity and performance, not necessarily input length.

Does a larger context window mean a better model?

Not necessarily. A larger context window allows for longer inputs but does not guarantee higher intelligence or accuracy. You must balance context window size with other factors like reasoning capability and cost.

More AIF-C01 FAQ →

Community Votes

B
100%

100% of anonymous learners picked answer B. Votes are pick records left by other test-takers — they are not the verified answer.

Discussion 10 contributions

Compiled from public community threads and reader submissions, lightly edited for clarity. Handles and vote tallies are shown as recorded, and comments reflect the views of individual contributors.

From public community threads 10

  1. Moon 👍 14 Answered B
    A company needs to know the maximum input size for a single prompt when choosing a Foundation Model (FM) in Amazon Bedrock. A. Temperature: This controls the randomness of the output, not the input prompt length. Temperature affects creativity, not input size. B. Context window: This defines the maximum length of the input prompt the model can process. It directly limits how much information can be included. C. Batch size: This is the number of prompts processed at once, affecting throughput, not individual prompt length. It's about processing multiple prompts efficiently. D. Model size: This relates to the model's overall capacity and complexity, not directly to the input prompt length. Size impacts performance, not input limits. Therefore, B. Context window is the correct answer.
  2. Jessiii 👍 3 Answered B
    Context window: The context window refers to the amount of text (or tokens) that a model can process at once. This is crucial when working with foundation models (FMs) like those available in Amazon Bedrock, as it defines the maximum input size for the prompt. The context window determines how much of the prompt the model can "remember" and use to generate responses. If the prompt exceeds the context window, the model will only process the portion of the prompt that fits within this limit, potentially missing important details.
  3. eesa 👍 2 Answered B
    B. Context window The context window of a foundation model determines the maximum amount of text that can be processed in a single prompt. A larger context window allows for more complex and informative prompts, while a smaller context window limits the amount of information that can be provided. The other options are not directly related to the maximum prompt length: Temperature: This parameter controls the randomness of the model's output. Batch size: This refers to the number of samples processed in a single batch during training or inference. Model size: This refers to the number of parameters in the model, which affects its complexity and performance. Therefore, when choosing a foundation model for a generative AI application, the company should carefully consider the context window to ensure that it can accommodate the desired input length.
  4. jove 👍 2 Answered B
    The context window refers to the maximum number of tokens (words or pieces of words) that a foundation model can process in a single input prompt.
  5. Rcosmos 👍 1 Answered B
    A resposta correta é B. Janela de contexto. A janela de contexto determina quantos tokens (palavras ou partes de palavras) o modelo pode processar de uma vez. Quanto maior a janela de contexto, mais informações podem ser inseridas no prompt para influenciar a resposta gerada. Isso é essencial para prompts longos ou que exigem mais detalhes e contexto. Os outros fatores também são importantes, mas influenciam outros aspectos do modelo: Temperatura afeta a aleatoriedade das respostas, tornando-as mais criativas ou previsíveis. - Tamanho do lote impacta a eficiência durante o treinamento ou inferência em múltiplas solicitações. Tamanho do modelo** pode afetar a capacidade de resposta e consumo de recursos, mas não define diretamente a quantidade de informações no prompt.
Show 5 more comments
  1. eesa 👍 1 Answered B
    The correct answer is: B. Context window Explanation: The context window of a foundation model (FM) determines how much information can fit into one prompt. It refers to the maximum number of tokens (words, characters, or subwords) that the model can process in a single input prompt, including the input and the output combined. The context window size varies across different foundation models, and understanding this parameter is critical for applications like document summarization or question-answering systems where long inputs need to be processed.
  2. ruchika04 👍 1 Answered B
    Context Window: It refers to amount of text that a model can process at once.
  3. 85b5b55 👍 1 Answered B
    The context-window is the input prompt for the model generation.
  4. venkatcdataeng 👍 1 Answered B
    context window tells amount of tokens need for prompt
  5. 65703c1 👍 1 Answered B
    B is the correct answer.

Reader comments & corrections

No reader corrections yet — spotted an error or have a note? Share it below.

Log in to comment, report an error, or add a note about this question.

Practice All AIF-C01 Questions

Access 100 questions with complete answers and detailed explanations.

View Full AIF-C01 Practice Test →

← Back to AIF-C01 Study Guide