Picovoice WordmarkPicovoice Console
Introduction
Introduction
AndroidC.NETFlutterlink to GoiOSJavaNvidia JetsonLinuxmacOSNodejsPythonRaspberry PiReact NativeRustWebWindows
AndroidC.NETFlutterlink to GoiOSJavaNodejsPythonReact NativeRustWeb
SummaryPicovoice LeopardAmazon TranscribeAzure Speech-to-TextGoogle ASRGoogle ASR (Enhanced)IBM Watson Speech-to-Text
FAQ
Introduction
AndroidC.NETFlutterlink to GoiOSJavaNodejsPythonReact NativeRustWeb
AndroidC.NETFlutterlink to GoiOSJavaNodejsPythonReact NativeRustWeb
FAQ
Introduction
AndroidCiOSLinuxmacOSPythonWebWindows
AndroidCiOSPythonWeb
SummaryOctopus Speech-to-IndexGoogle Speech-to-TextMozilla DeepSpeech
FAQ
Introduction
AndroidAngularArduinoBeagleBoneCChrome.NETEdgeFirefoxFlutterlink to GoiOSJavaNvidia JetsonLinuxmacOSMicrocontrollerNodejsPythonRaspberry PiReactReact NativeRustSafariUnityVueWebWindows
AndroidAngularC.NETFlutterlink to GoiOSJavaMicrocontrollerNodejsPythonReactReact NativeRustUnityVueWeb
SummaryPorcupineSnowboyPocketSphinx
Wake Word TipsFAQ
Introduction
AndroidAngularBeagleBoneCChrome.NETEdgeFirefoxFlutterlink to GoiOSJavaNvidia JetsonlinuxmacOSNodejsPythonRaspberry PiReactReact NativeRustSafariUnityVueWebWindows
AndroidAngularC.NETFlutterlink to GoiOSJavaNodejsPythonReactReact NativeRustUnityVueWeb
SummaryPicovoice RhinoGoogle DialogflowAmazon LexIBM WatsonMicrosoft LUIS
Expression SyntaxFAQ
Introduction
AndroidBeagleboneCiOSNvidia JetsonLinuxmacOSPythonRaspberry PiRustWebWindows
AndroidCiOSPythonRustWeb
SummaryPicovoice CobraWebRTC VAD
FAQ
Introduction
AndroidCiOSPythonWeb
AndroidCiOSPythonWeb
SummaryPicovoice KoalaMozilla RNNoise
Introduction
AndroidAngularArduinoBeagleBoneC.NETFlutterlink to GoiOSJavaNvidia JetsonMicrocontrollerNodejsPythonRaspberry PiReactReact NativeRustUnityVueWeb
AndroidAngularCMicrocontroller.NETFlutterlink to GoiOSJavaNodejsPythonReactReact NativeRustUnityVueWeb
Picovoice SDK - FAQ
IntroductionSTM32F407G-DISC1 (Arm Cortex-M4)STM32F411E-DISCO (Arm Cortex-M4)STM32F769I-DISCO (Arm Cortex-M7)IMXRT1050-EVKB (Arm Cortex-M7)
FAQGlossary

IBM Watson Benchmark


The IBM Watson Natural Language Understanding service is a cloud offering that is capable of extracting metadata from text. For speech input, Watson Speech to Text can be used to transcribe audio files. For domain-specific contexts, the customization interface can be used to create a custom language model to improve speech recognition performance.

Prerequisites

  • Ubuntu 20.04 (x86_64)
  • Git
  • Python
  • PIP
  • IBM Watson Account

Usage

  1. Clone the repository:
git clone https://github.com/Picovoice/speech-to-intent-benchmark.git
  1. Install the dependencies:
pip3 install -r requirements.txt
  1. Create a NLU service.

  2. Create a standard plan Speech to Text service.

  3. Create a Knowledge Studio service and create a new Workspace.

  4. In your new Workspace, upload the previously created type system data/watson/entity_types.json.

  5. In the Rules page under Rule-based Model, create a class for each entity type.

  6. In the Dictionaries page, import data/watson/barista_dictionaries.zip. Select the corresponding entity type and corresponding rule-class for each dictionary.

  7. In the Versions page, go to the Rule-based Model Type Mapping tab and map each entity type to the corresponding class.

  8. Return to the Rule-based Model page and save for deployment. You should see a model with version number 1.0. Deploy this model to Natural Language Understanding, and take note of your model ID.

  9. Run the benchmark:

python3 src/bench.py \
--engine IBM_WATSON \
--noise cafe \
--ibm_watson_model_id ${YOUR_MODEL_ID} \
--ibm_watson_stt_apikey ${YOUR_STT_API_KEY} \
--ibm_watson_stt_url ${YOUR_STT_URL} \
--ibm_watson_nlu_apikey ${YOUR_NLU_API_KEY} \
--ibm_watson_nlu_url ${YOUR_NLU_URL}
python3 src/bench.py \
--engine IBM_WATSON \
--noise kitchen \
--ibm_watson_model_id ${YOUR_MODEL_ID} \
--ibm_watson_stt_apikey ${YOUR_STT_API_KEY} \
--ibm_watson_stt_url ${YOUR_STT_URL} \
--ibm_watson_nlu_apikey ${YOUR_NLU_API_KEY} \
--ibm_watson_nlu_url ${YOUR_NLU_URL}

Result

IBM Watson voice assistant accuracy across various noise levelsIBM Watson voice assistant accuracy across various noise levels

Was this doc helpful?

Issue with this doc?

Report a GitHub Issue
IBM Watson Benchmark
  • Prerequisites
  • Usage
  • Result
Platform
  • Leopard Speech-to-Text
  • Cheetah Streaming Speech-to-Text
  • Octopus Speech-to-Index
  • Porcupine Wake Word
  • Rhino Speech-to-Intent
  • Cobra Voice Activity Detection
Resources
  • Docs
  • Console
  • Blog
  • Demos
Sales
  • Pricing
  • Starter Tier
  • Enterprise
Company
  • Careers
Follow Picovoice
  • LinkedIn
  • GitHub
  • Twitter
  • Medium
  • YouTube
  • AngelList
Subscribe to our newsletter
Terms of Use
Privacy Policy
© 2019-2022 Picovoice Inc.