Running Bonsai 2 27B Locally on Windows with an RTX 5070 Ti and Hermes Desktop
A tested Windows walkthrough for running official Bonsai 2 27B PQ2_0 with PrismML’s llama.cpp fork, full CUDA offload, a 64K context window, vision, and Hermes Desktop on an RTX 5070 Ti.