Posts tagged “llm”

2026
Running A Privacy-First LLM Agent Workflow
September 17, 2026
Using a self-hosted Qwen model on Modal for my agents needing data privacy
self-hosted llm privacy scribbles
Running Needle 2 on an ESP32 S3
September 13, 2026
I ran Needle 2, a 45M-parameter model for tool calling on an ESP32 S3
llm self-hosting scribbles
Running 1-bit Bonsai 27B LLM
July 23, 2026
I put the 1-bit Bonsai 27B on almost every hardware that I use for self-hosting, MacBook, cloud VPSes, cloud GPUs, a Raspberry Pi, and an old GPU laptop and measured how fast it runs.
llm self-hosted
2025
Open WebUI: Push to GitHub Tool
March 16, 2025
github llm scribbles
Trying out new note taking setup with Obsidian & Vimwiki
February 23, 2025
Exploring my new note-taking workflow using Obsidian and Vimwiki for better organization and productivity
self-hosted llm note-taking productivity vimwiki
Using any LLM on Open-WebUI
February 16, 2025
Setting up Open-WebUI to work with any LLM model
scribbles self-hosted llm