Language auto-detection for Voice Translation

Language auto-detection identifies the language your customer is speaking during a call and prompts you to start Voice Translation in that language. You don't need to pick the language manually or match it to how the call was routed: Krisp detects it from the customer's speech. This feature is turned on by Krisp, so if you want to have this option enabled for your team, reach out to us.

How language auto-detection works

During a call, Krisp listens to the customer's audio and detects the language being spoken. Once it identifies the language with enough confidence, a prompt appears at the top of the Live Widget showing the detected language, for example, Spanish detected.

Depending on the prompt:

• Enable appears when Voice Translation isn't running in the detected language yet, and starts it in that language for the call.

• Switch appears when Voice Translation is already active in a different language, and switches the customer's language to the detected one.

• Dismiss (X) closes the prompt and keeps your current setup. You can still select a language manually at any time.

When detection can't complete

Sometimes Krisp can't act on a detection. You'll see one of these messages with a Retry option:

• Language detection failed means Krisp couldn't determine the language from the audio. Click Retry to run detection again
• [Language] not available (for example Haitian not available) means the detected language isn't currently supported for Voice Translation. Click Retry to detect again, or select a supported language manually.

For the full list of languages Voice Translation supports, see Supported languages for Krisp Voice Translation.

Good to know

• By default, detection is based on the customer's speech, so the prompt appears once the customer has spoken enough for Krisp to identify the language with confidence. It may take a few sentences before you see it. 
• Detection can be enabled to work for customer's speech, agent speech, or both sides of the conversation.
• If you dismiss a prompt, you can still start or change the language manually at any time.
• Language auto-detection doesn't rely on how the call was routed, so it works even when no CCaaS skill is mapped to the call.

How auto-detection is enabled

Language auto-detection is enabled by Krisp on the backend. There's no toggle for it in the Admin Portal yet. To turn it on for your team, reach out to your Krisp contact or email our Customer Engineering team at support@krisp.ai. Once it's enabled, agents start seeing detection prompts automatically during calls, with no setup on their side.

Detection needs clean, per-call audio to work reliably, and performs best with softphones that provide the call start and end events instead of keeping persistent streams. On calling apps that use a persistent audio stream, detection may not work as expected.

Language auto-detection vs Language suggestion

Both features prompt you to start Voice Translation in a specific language, but they decide the language differently:

• Language auto-detection identifies the language from the customer's speech during the call. It doesn't depend on CCaaS skills, so it works on any call once Krisp enables it.
• Language suggestion is based on the CCaaS skill mapped to the call by your Admin, and appears at the start of the call before anyone speaks.

To learn how skill-based prompts work, see Language suggestion for Voice Translation.