Speech-to-text service information

To connect VoiceAI Connect to a speech-to-text service provider, certain information is required from the provider, which is then used in the VoiceAI Connect configuration for the bot.

Microsoft Azure Speech Services

Connectivity

To connect to Azure's Speech Service, you need to provide AudioCodes with your subscription key for the service. To obtain the key, see Azure's documentation at https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/get-started.

The key is configured on VoiceAI Connect using the credentials > key parameter in the providers section.

Note: The key is only valid for a specific region. The region is configured using the region parameter.

Language Definition

To define the language, you need to provide AudioCodes with the following from Azure's Speech-to-text table:

• 'Locale' (language)

This value is configured on VoiceAI Connect using the language parameter. For example, for Italian, the parameter should be configured to it-IT.

VoiceAI Connect can also use Azure's Custom Speech service. For more information, see Azure's documentation at https://docs.microsoft.com/en-us/azure/cognitive-services/speech-service/how-to-custom-speech-deploy-model . If you use this service, you need to provide AudioCodes with the custom endpoint details.

Google Cloud Speech-to-Text

Connectivity

To connect to Google Cloud Speech-to-Text service, see Google Dialogflow ES bot framework for required information.

Language Definition

To define the language, you need to provide AudioCodes with the following from Google's Cloud Speech-to-Text table:

• 'languageCode'

This value is configured on VoiceAI Connect using the language parameter. For example, for English (South Africa), the parameter should be configured to en-ZA.

Nuance

Connectivity

To connect VoiceAI Connect to this Nuance Krypton speech service, it can use the WebSocket API or the open source Remote Procedure Calls (gRPC) API. To connect to Nuance Mix, it must use the gRPC API.

VoiceAI Connect is configured to connect to the specific Nuance API type, by setting the type parameter in the providers section, to nuance or nuance-grpc.

You need to provide AudioCodes with the URL of your Nuance's speech-to-text endpoint instance. This URL (with port number) is configured on the VoiceAI Connect using the sttHost parameter.

Note: Nuance offers a cloud service (Nuance Mix) as well as an option to install an on-premise server. The on-premise server is without authentication while the cloud service uses OAuth 2.0 authentication (see below).

VoiceAI Connect supports Nuance Mix, Nuance Conversational AI services (gRPC) API interfaces. VoiceAI Connect authenticates itself with Nuance Mix (which is located in the public cloud), using OAuth 2.0. To configure OAuth 2.0, use the following providers parameters: oauthTokenUrl, credentials > oauthClientId, and credentials > oauthClientSecret.

Language Definition

• Nuance Vocalizer: To define the language, you need to provide AudioCodes with the following from Nuance's Vocalizer Language Availability table:

  • 'Language Code'

This value (ISO 639-1 format) is configured on VoiceAI Connect using the language parameter. For example, for English (USA), the parameter should be configured to en-US.

• Nuance Krypton (Ver. 4.5) WebSocket-based API: To define the language, you need to provide AudioCodes with the language code from Nuance. This value (ISO 639-3 format) is configured on VoiceAI Connect using the language parameter under the bots section. For example, for English (USA), the parameter should be configured to eng-USA.

Amazon Transcribe Speech-to-Text Service

To connect to Amazon Transcribe speech-to-text service, you need to provide AudioCodes with the following:

• An account with admin permissions to use the transcribe feature (see here).

• AWS account keys:

• Access key

• Secret access key

• AWS Region (e.g., "us-west-2")

VoiceAI Connect is configured to connect to Amazon Transcribe, by setting the type parameter to aws under the providers section.

For languages supported by Amazon Transcribe, click here. The language value is configured on VoiceAI Connect using the language parameter under the bots section.

AmiVoice

To define the AmiVoice speech-to-text engine at the VoiceAI Connect, you need to provide AudioCodes with the following from AmiVoice's customer service:

• Provider Type: Set provider's type parameter to "amivoice".

• Voice Recognition API Endpoint: This is the address of the AmiVoice speech-to-text engine and is configured on VoiceAI Connect using the sttUrl parameter of the provider configuration. For example: ws://mrcp3.amivoicethai.com:14800.

• Connection Engine Name: This is the desired type of speech-to-text engine being used and is configured on VoiceAI Connect using the folderId parameter of the provider configuration. For example: AmiBiLstmThaiTelephony8k_GLM.

• App Key: This is the credential key for connecting to the AmiVoice engine and is configured using the token parameter in the credentials section of the provider configuration.

AudioCodes LVCSR

Connectivity

To connect VoiceAI Connect to the AudioCodes LVCSR service, set the type parameter in the providers section, to "audiocodes-lvcsr".

You need to provide AudioCodes with the URL of your AudioCodes LVCSR’s speech-to-text endpoint instance. This URL (<address>:<port>) is configured on the VoiceAI Connect using the sttHost parameter.

The key (optional) is used in the query parameter of the URL of the WebSocket (if not provided, the key “1” is used).

Note: The LVCSR speech-to-text provider is currently only applicable to agent-assist calls, for which the bot will receive the speech-to-text events using the speechHypothesis event.

Yandex

To connect to Yandex, please contact AudioCodes for information.

Uniphore

To connect VoiceAI Connect to the Uniphore speech-to-text service, set the type parameter in the providers section to uniphore.

You need to provide AudioCodes with the URL of your Uniphore speech-to-text endpoint instance. This URL (<address>:<port>) is configured on the VoiceAI Connect using the sttHost parameter.