Latency
Definition
The delay between asking an AI for something and getting the answer. Low latency feels instant. High latency is the pause you sit through while a tool "thinks." It depends on the size of the model, how busy the service is, and how much work your request takes. For a quick question it hardly matters. For anything you're doing repeatedly, it adds up.
Why It Matters
It's the difference between a tool that feels snappy and one that feels sluggish. When people compare AI tools on "speed," latency is usually what they mean.
What does that look like in practice?
That pause after you hit send, while the tool seems to 'think,' is latency.
What people actually mean when they say this
When someone says a tool 'feels slow,' they usually mean high latency: the lag between asking and getting an answer.
Last reviewed: June 2026
Knowing the word is just the start.
We help non-tech people go from looking things up to actually using AI confidently. Tutorials, prompts, plain English. All of it, for less than a cup of coffee a month.
Show Me How This Works →Start free. Cancel anytime. No judgment, ever.