A company wants to use a large language model (LLM) on Amazon Bedrock for sentiment analysis. The company needs the LLM to produce more consistent responses to the same input prompt. Which adjustment to an inference parameter should the company make to meet these requirements?
Select an option, then click Submit answer.
Reference / correct answer:
Decrease the temperature value.
Most accepted answer: A. Decrease the temperature value.
Community votes: A=4
Selected Answer: A Temperature controls the randomness/creativity of model outputs: - Lower temperature (→ 0) = more deterministic, consistent, and predictable responses - Higher temperature (→ 1) = more random, creative, and varied responses upvoted 1 times
Selected Answer: A A is the correct answer upvoted 1 times
Selected Answer: U A. Diminua o valor da temperatura. ✅ Explicação:O parâmetro temperatura controla o nível de aleatoriedade nas respostas geradas por um modelo de linguagem. Temperatura baixa (ex: 0.2) → respostas mais determinísticas e consistentes. Temperatura alta (ex: 0.8 ou 1.0) → respostas mais variadas e criativas. Aplicação ao caso: Para que o LLM produza respostas mais consistentes ao mesmo prompt (como é desejado na análise de sentimentos, onde a estabilidade na resposta é essencial), a empresa deve diminuir a temperatura. upvoted 1 times
Selected Answer: A A. Decrease the temperature value: The temperature parameter controls the randomness of the model’s output. Lower temperatures make the model more deterministic and lead to more consistent and focused responses, while higher temperatures introduce more randomness and variety. For sentiment analysis, where you want consistent outputs for the same input, decreasing the temperature will help achieve more predictable and reliable results. upvoted 4 times
Selected Answer: A Lowering the temperature value in an LLM controls the randomness of the model's output. A lower temperature (close to 0) makes the model's predictions more deterministic and consistent, leading to similar outputs for identical prompts. This is particularly beneficial in tasks like sentiment analysis, where consistency and reliability in responses are crucial. upvoted 2 times