Most people use Ollama or llama.cpp for local LLMs, but these are the tools I switch to when it gets serious
Source ↗
👁 10
💬 0
Ollama has become the default answer when someone asks how to run a local LLM, and for good reason. It's easy, it works across platforms, and it hides enough of the ugly parts that you can go from nothing to a working model in minutes. llama.cpp sits underneath a huge amount of the local AI world too, especially if you're using GGUF models, so neither one is going away.
Comments (0)