AI Glossary
Latency
The waiting time between sending an instruction and the AI starting to reply. Bigger models or reasoning models usually have higher latency.
Example: A customer service chatbot needs low latency; a weekly report can wait 2 minutes, no problem.
