koik.ai kairo@koik.ai

Podcast / Algorütm, episode 347

Algorütm 347: an AI assistant on a games console

Estonia's weekly developer podcast, recorded 4 August 2026 and published 27 August. One Steam Machine instead of a basement GPU rig, and a live demo where the assistant said it had no data.

Algorütm is Estonia's weekly podcast for developers. Priit Liivak, Erik Jõgi and Martin Kapp have covered self-hosted AI on the show before, but always the multi-GPU basement rig. I brought the opposite: a Steam Machine that was bought to play games and does its real work at night.

8 GB of VRAM fits exactly one model at a time, and that single fact decides the whole design. A tool loads the model it needs and evicts whatever was there. Idle models unload after two minutes. You stop interleaving work and start batching it by what is loaded. One model at a time turns out to be enough for a personal assistant.

The episode is in Estonian. It was recorded on and published on . Chapters below, then the numbers, then the full machine transcript on its own page.

What is in it, by the clock

The numbers, measured on this box

Not quoted from anyone's documentation. A machine's own docs are a claim, not a measurement, which is a lesson this project learned the hard way.

  • Estonian speech synthesis (neurokõne). 3.5 s of audio in 9.2 s cold, about 0.6 s per 3 s warm
  • Estonian transcription (TalTech Whisper finetune). roughly 1x realtime on CPU
  • Local chat (Qwen 2.5 7B). 86 tokens per second
  • Image generation (SDXL, 768 px, 20 steps). 16 to 53 seconds
  • Music generation (ACE-Step). 98.8 s of compute for 9.0 s of audio, capped at 30 s
  • Voice channel, end to end. first spoken word about 1 second after the reply starts
  • Idle footprint. 628 MB of VRAM with nothing loaded, 12.8 GB of RAM free

The full transcript

YouTube's automatic captions for the episode, unedited and in Estonian, are on their own page: the machine transcript. It is ASR, so it mangles names and terms and should be used to find a moment, never to quote one.

Building something with AI?

Write to Kairo