AI ยท personal assistant

Umnik AI

My personal AI assistant. I text it on Telegram or call it on the phone, and it remembers. It's also my test bench for closed vs open models: a frontier model plans, open models on my Mac do the subtasks, and I keep measuring which jobs really need the expensive one.

Always onHermes AgentTelegram + voicePrivate project

How a message flows

Me
๐Ÿ’ฌ TelegramText, photos, voice notes
Me
๐Ÿ“ž Phone callTalk to it like a person, in a natural voice
โ†’
Home server, always on
Umnik on Hermes Agent Persona, long-term memory, skills and scheduled routines. Restarts itself if anything falls over.
memoryskillsroutineswatchdog
โ†’
Plans
Frontier modelGPT-5.6 on a flat-rate subscription: breaks the task down and decides who does what.
Does
Open models on my MacQwen 3.5 9B for everyday subtasks and vision; gpt-oss 20B for code and review.
closed modelopen-weight model, running locally

What it does

An assistant that lives with me.

๐Ÿง 

Remembers

A persona, a profile of me, and dated daily notes it can search.

๐ŸŒ…

Keeps routines

A morning voice briefing, an evening check-in, nightly backups. Scheduled jobs, not prompts I have to remember.

๐Ÿ› ๏ธ

Uses skills

Small tools it can call, like posting to X or wrapping up a session. New skills are just files.

๐Ÿ—ฃ๏ธ

Talks

Phone calls with speech-to-text in, a natural synthetic voice out.

๐Ÿ‘๏ธ

Sees

Send a photo and a local vision model describes it, no cloud round trip.

๐Ÿ”

Heals itself

A watchdog brings the gateway, dashboard and voice back within five minutes of a failure.

Closed vs open models

Price, speed, quality: pick per task, not per assistant.

Running everything on a frontier API is easy and expensive. Running everything locally is free and often not good enough. Umnik is where I find the line, task by task: what does each job cost, how long does it take, and is the answer good enough?

Planning

Ambiguous requests and multi-step plans go to the frontier model. Quality matters most here. A flat-rate subscription keeps the bill predictable.

Everyday subtasks

Summaries, lookups, photo descriptions: a 9B open model on the Mac is fast enough and costs nothing per call.

Code and review

A 20B open model handles coding and review passes locally.

The real constraint is memory, not money. The Mac has 36 GB of unified memory, so at most two local helpers run at once. Hardware, not the API bill, sets the limit.

The journey

Rebuilt once, on purpose.

Umnik started on OpenClaw, an open-source agent framework. This year I moved it to Hermes Agent: the scheduled routines came along, and OpenClaw stays archived as a fallback.

The move also let me split the work between a closed planner and open local models, instead of sending everything to one API.

Built with

Pieces.

Hermes AgentGPT-5.6OllamaQwen 3.5 9Bgpt-oss 20BTelegramTwilioElevenLabsUbuntuTailscale

Private project. The code isn't public, but I'm happy to talk about how it's put together.

More projects