Picovoice Cheetah Streaming Speech-to-Text Benchmark
Prerequisites
- Ubuntu 20.04 (x86_64)
- Git
- Python
- PIP
- Picovoice Console Account
Usage
Setup
- Clone the repository:
- Install the dependencies:
- Create a free Picovoice Console account and copy your
AccessKey
.
Word Accuracy Benchmark
- Run the benchmark:
--picovoice-model-path ${PICOVOICE_MODEL_PATH}
is required for non-English languages and Cheetah Fast models. Model files can be downloaded from the Cheetah GitHub Repo.- To measure the Punctuation Error Rate (PER) add
--punctuation
to the command.
Word Emission Latency Benchmark
Follow the instructions here to generate word timing information.
Run the benchmark: