Local AI models and tools
Find AI models and tools suited to local, offline, self-hosted, or constrained environments.
Map the topic before choosing
Local deployment is not only about whether a model runs. Consider memory, CPU/GPU fit, quantization, licensing, and whether data must leave the device. Put those constraints into the natural-language query instead of searching only for local.
Use this page to understand the topic and discover candidates. When you are ready to compare deployment, budget, or capability constraints, open the decision guide above.
Curated KG entry points
A small set of entry points for discovering this topic, not a paid ranking or an official product review. Return to the homepage for the full semantic retrieval and second-stage summary.
self-hosted deployment
KG-recorded mechanism related to 自托管部署; detailed English notes are not yet available.
Mechanismoffline evaluations
KG-recorded mechanism related to offline evaluations; detailed English notes are not yet available.
MechanismLocal Inference
Running AI models on local hardware (e.g., GPUs) instead of cloud servers.
MechanismLocal Model Deployment
KG-recorded mechanism related to Local Model Deployment; detailed English notes are not yet available.
MechanismOffline Top-K Logits
KG-recorded mechanism related to Offline Top-K Logits; detailed English notes are not yet available.
Mechanismoffline policy-relative difficulty
KG-recorded mechanism related to 离线策略相对难度; detailed English notes are not yet available.
ToolOllama
Ollama is a tool for running open models locally and also offers hosted cloud models.
AgentChatGPT Work
KG-recorded agent related to ChatGPT Work; detailed English notes are not yet available.
Share feedback on this topic
Anonymous feedback is attached to this topic page, stays outside the KG, and is visible to other visitors.