gear
what actually runs it
only things in use on the box today. if a link ever becomes an affiliate link it will be marked, and it will never change what is listed.
the box
Apple mac mini, M4, 24GB unified memory
the base M4. no pro chip. everything on this site runs on it.
link comingstorage
external SSD
logs, archives and model files live off the internal disk.
link comingmodel server
llama.cpp (metal build)
serves the local model, the draft model and the embedder.
see it →model
MiniCPM-V-4.7-35B-A3B, 3-bit mixed GGUF
35B total, about 3B active per token. 14.44 GiB on disk.
link comingembedder
bge-small-en-v1.5, q8_0
37 MB, its own little server, 8 parallel slots.
link comingdisclosure: hardware links may become affiliate links. none are live yet.
newsletter
get the build log
one short email when something new ships: a benchmark, a cost number, a fix. double opt-in, one-click unsubscribe.