https://soilandsilicon.dev/tags/llama-cpp/Recent content in Llama-Cpp on Soil & SiliconHugoen-usFri, 22 May 2026 00:00:00 +0000https://soilandsilicon.dev/posts/optimizing-a-chatbot-on-macos-part-2/Fri, 22 May 2026 00:00:00 +0000https://soilandsilicon.dev/posts/optimizing-a-chatbot-on-macos-part-2/Install llama-cpp-python with Metal support, download Qwen2.5 14B, write a minimal decode loop, and measure our baseline TTFT, ITL, and eval score.https://soilandsilicon.dev/posts/optimizing-a-chatbot-on-macos-part-1/Thu, 21 May 2026 00:00:00 +0000https://soilandsilicon.dev/posts/optimizing-a-chatbot-on-macos-part-1/Introducing a practical series on making a local LLM chatbot fast on macOS and eventually on any laptop.