Public KG record
GGUF
Recorded overview
Quantized format (e.g., Q4_K_M) for efficient local execution of LLMs on CPU/VRA
An evidence-backed entity from the project knowledge graph; detailed tool metadata is still being added.
Recorded details
- Benchmarks: 提供Llama-2-7B级模型的量化质量与大小参考表
- Capabilities: 支持 PTQ1_0 三值打包
- Capabilities: 支持 PQ2_0 三值打包
- Capabilities: 支持内存映射兼容
- Capabilities: 支持单文件部署设计
- Deployment: 适合端侧部署
- Deployment: 服务于端侧部署
- Integrations: 可与llama.cpp集成
Evidence coverage
The KG currently records 10 known information dimensions and has 9 undocumented dimensions, linked to 10 public source articles. These counts describe record coverage, not model performance or verified fit.