Question 1140

Where the Bill Lives

A request sends 12,000 input tokens and generates 800 output tokens. Your provider charges $3 per million input tokens and $15 per million output tokens. Which change cuts the per-request cost the most?

A

Lower the temperature, which makes the model more deterministic and produces shorter completions

B

Halve the prompt: input is $0.036 of the $0.048 total, so trimming it saves about $0.018

C

Halve the output budget, since output is priced five times higher per token and therefore dominates the bill

D

Stream the response, since tokens the client never reads are not billed