Capacity and concurrency

The agent always answers — until everyone calls at once

A voice agent has no queue, and therefore no warning light either. Capacity is the lowest of four numbers, and the four are owned by four different parties.

A woman in her fifties in an olive rain jacket sits alone in the driver's seat of a parked car, seen from outside through the open side window, the phone just lowered in her left hand and her right hand resting on the steering wheel, in hard afternoon light

A voice agent has no queue. That is half the point of it — and it is also why nobody sees the peak coming.

A contact centre with twelve people on shift takes twelve calls at a time. If sixty come in, forty-eight wait in a queue. The queue is unpleasant for the people standing in it, but it is also a warning: a number grows on a screen, somebody sees it, and somebody has time to act. An agent that answers on the first ring has no such intermediate step. It takes everything — right up until it doesn't, and that happens with no run-up at all.

Peaks rarely arrive evenly spread. A power cut in one district, a product recall, a cancelled departure, an invoice with the wrong amount sent to twelve thousand customers: whatever makes people call reaches all of them inside the same few minutes. That is the one hour your phone line really exists for — and the only hour your capacity is genuinely tested.

Capacity is four ceilings, not one

"How many calls can the agent handle?" has no single answer, because capacity does not sit in one place. It is the lowest of four numbers, and the four are owned by four different parties.

The lines in. Your telecoms provider has set a limit on how many simultaneous calls your number can carry. That number is in the contract, it was usually set from how many people you had when the contract was written, and it has rarely been revisited since.

The platform. The voice agent vendor has its own limit on concurrent sessions — per account, sometimes per agent.

The model. The speech-to-speech model behind the voice has quotas: concurrent streams, requests per second, tokens per minute. This ceiling is the least visible to you, because it sits two links away.

The business system. The system the agent looks things up in will take a certain number of simultaneous queries. That number was sized for a handful of case workers clicking through screens, not for eighty agents asking at once.

Your capacity is the lowest of the four. Everything above it is theory.

Each ceiling breaks with its own sound

What makes this hard to spot is that the four failures look nothing like each other.

When the lines go, the caller hears an engaged tone or a message from the carrier. The call was never yours, so it is not in your statistics either. It is the most serious of the four, and the only one that is completely invisible from the inside.

When the platform goes, the call is rejected or sent on to whatever you have configured as a fallback — if you have configured one.

When the model goes, the call connects. The agent answers, greets the caller, and then falls silent mid-sentence. In the log it looks like a completed call where the customer hung up.

When the business system goes, the agent answers perfectly normally but cannot look anything up. It becomes a talking FAQ: pleasant, fast and unable to say anything about that particular order. At that point it is the knowledge base answering instead of the business system, and that is a different conversation from the one the customer rang for.

Only the second of the four looks like a fault. The other three look like something else entirely: a number that doesn't answer, a customer who hung up, an agent that couldn't help.

Want to talk it through with someone who has done this before?

Fifteen minutes on a call. We will tell you honestly whether a voice agent fits your setup – and what has to be settled before it goes live.

15 minutes · no obligation · pick your own time

The fallback usually shares a bottleneck with the agent

"If the agent can't manage it, it transfers to us" is a good plan right up until it isn't. The transfer to a human normally goes out over the same connection the call came in on. If it is the line ceiling that breaks, the transfer breaks in the same moment — and the manual fallback is gone exactly when it is needed.

The same goes for the fallback meant to take over during an outage. A vendor outage and a spike in your own volume look identical from the customer's side, but they call for different answers, and only one of them can be dealt with in a contract.

Four things that cost nothing

Find the four numbers. Write them down with a name beside each — who at the carrier, who at the platform vendor, who owns the model quota, who owns the business system. Most organisations know one of the four.

Decide what happens at the ceiling. A recorded message about unusually heavy demand, with the offer of a call back, is not a good experience. It is still considerably better than an engaged tone, and it takes an afternoon to set up.

Set your own limit below the lowest ceiling. Then the break happens somewhere you control, with a message you wrote, rather than at a third party that has no idea who is calling.

Measure the peak, not the average. How many simultaneous calls did you have at most last month? That number is in the logs, and it is the only one that matters here. Averages flatter on this point too.

The one hour

An agent that takes fifteen calls at a time for twelve months, and does not take two hundred on that one morning in January, has not done the job. It has had a quiet year.

Every link in a call has to hold at once — and it has to hold just as well when there are two hundred of them as when there is one.

Threll.ai builds voice agents in Norwegian, Swedish and Danish. The question is easy to ask today: what is the lowest of your four numbers, and what does caller number two hundred and forty hear?