Portfolio App · AI

OpenTalk AI

In progress Own project

OpenTalk AI listens to the microphone and the computer’s audio, turns speech into live text, translates it into the language you choose and drafts three replies that fit the conversation. It is my open-source project (MIT), now in pre-release: tested on macOS (Apple Silicon); the Windows version compiles and passes the tests, and testing on a real Windows machine is under way.

OpenTalk AI

The challenge

On a call in a foreign language it is hard to listen, understand and find the right reply all at the same time.

What I did

  • Live transcription: the microphone and system audio are captured separately, so it never gets mixed up who is speaking.
  • Live translation: numbers, links and the terms in your glossary are not lost in translation, and this is checked automatically.
  • Reply suggestions in different tones that follow the conversation; they never make up prices, dates or commitments.
  • Arabic support with tashkeel (diacritics) and speech output. The interface is in Azerbaijani, English and Russian.
  • Not tied to one provider: OpenAI, OpenRouter, Gemini, Claude, DeepSeek, Groq or any OpenAI-compatible service, with your own key.
  • Fully local mode: with the built-in Whisper and Ollama, transcription, translation and replies run on the computer itself; “local only” mode blocks cloud requests in the app core.
  • Privacy first: audio is never written to disk, API keys are kept only in the operating system’s secure storage, nothing goes to the cloud and no model is downloaded without your consent.
  • The Rust core is split into 11 crates: audio capture, transcription, translation and reply generation don’t depend on each other or on the AI providers, so adding a service means writing one adapter. Unsafe code is forbidden, and every IPC command is opened by its own permission.

Results

  • An installer of about 4 MB.
  • More than 350 automated tests; CI runs on macOS and Windows.
  • The local mode (Whisper + Ollama) is tested end to end with real models on macOS.

Technologies

  • Tauri 2
  • Rust
  • React 19
  • TypeScript
  • whisper.cpp (Metal)
  • ScreenCaptureKit / WASAPI
  • Ollama
GitHub

Need something similar?

Get a quote