Part 09 · Fine-tuning and Serving Models
Making LLMs Faster and Cheaper
TTFT & TPSPrompt cachingSpeculative decodingModel routing
Where the time and money go: time to first token vs tokens per second, prompt caching, speculative decoding, and sending easy questions to a cheaper model.
⏱ 1-2 hours · Station 75 of 92