I’m building a personal voice agent on ESP32-based hardware that acts as a thin mic and speaker layer.

On the agent side, I’m experimenting with a quorum-based orchestration for common agent tools that I have.

I call FunctionGemma, LFM2.5 and Needle 2 concurrently with the transcript. If they reach a quorum on a tool call, the tool is invoked locally in under 100ms. Otherwise it’s offloaded to my Hermes Agent to make the call.