#local-ai-models

Articles tagged with #local-ai-models

Running Large MoE LLMs on Modest Hardware with FreeToken
A new open-source inference engine designed to run MoE models on hardware that doesn't have enough VRAM to hold them
Sep 10, 202615 min read14
Turning a Dell OptiPlex 7060 SFF into a Cheap Local AI Inference Box
An RTX A1000, two NVMe drives and a little airflow turn an old office PC into a surprisingly useful AI server.
Aug 23, 202612 min read51