Setup local AI services to serve Ozeki Voice Keyboard

This page provides guides for setting up local AI services including Whisper for speech detection and various LLM backends for Ozeki Voice Keyboard.

Setup AI speech detector

This page provides comprehensive information for setting up Whisper Speech Detector with Ozeki Voice Keyboard across different platforms including Windows, Windows with WSL, and Ubuntu Linux. If you serve speech detection from your own server your transcriptions will not leave your network. Read more: How to use Whisper as a Speech Detector in Ozeki Voice Keyboard

To go directly to platform specific setups, you may follow these links:

Setup LLM backend

This page provides guides on configuring different LLM backends for Ozeki Voice Keyboard, including Ollama on Windows, LLama.cpp on Ubuntu, and vLLM on Ubuntu.If you serve speech detection from your own server your transcriptions will not leave your network. Read more: How to use different LLM backends in Ozeki Voice Keyboard

To go directly to platform specific setups, you may follow these links:


More information