This demo shows how quickly an AI Agent can identify your spoken language and translate it. The demo begins by anticipating English and will translate your spoken statement into Spanish. From there, it will pivot quickly to translating anything spoken in another language and will repeat it back to you in English. Anything then spoken in English will be translated into the last non-English spoken language translated. To end the demo, say goodbye or hang up.
How It Works
At the beginning of each call, the application provides the AI Agent with its ‘instructions’ — the guidance it relies on to understand the tasks it will perform, the goals of the demo and any appropriate guardrails.
These instructions are shown for you below. They are embedded in the call-handling software and are provided to the OpenAI Realtime Voice agent at the start of each call.
In addition to the specific instructions provided, the AI agent can interpret caller intent, work through multi-step tasks, and adapt when a caller gives incomplete information. For example, Jordan can automatically continue the conversation in the caller’s language without needing separate instructions for each language.
This sample also works with Voice Nexus Service (VNS). For more information about the underlying integration, see the Voice Nexus Service Documentation.
AI Call Sample: Translator
To try this demo, call 720-547-3447.