Hardware LLM Optimizer#

Detects PC hardware configuration and recommends which large language models can run.

Features#

1. Auto-detect: CPU, RAM, GPU (NVIDIA/AMD), VRAM
2. Calculate: Maximum runnable model size
3. Quantization: FP16 / 8bit / 4bit / 2bit recommendation
4. Model Suggestion: Llama 2/3, Qwen, Mistral, Phi, Gemma, Yi, etc.
5. Bottleneck Analysis: System constraint diagnosis
6. Deployment Tools: Ollama, Llama.cpp, vLLM, Chatbox
7. Optimization Tips: Low VRAM solutions
8. Minimum Config Table: 3B/7B/13B/34B/70B requirements

Usage#

When user asks about running LLMs on their computer:

text

检测电脑配置
大模型推荐
能跑什么模型
硬件检测
LLM优化

Quick Run#

bash

python3 skills/hardware-llm-optimizer/detect.py

Requirements#

• Python 3.8+
• psutil: pip install psutil
• nvidia-smi (optional, for NVIDIA GPU detection)

Minimum Config Reference#

ModelMin VRAMRec VRAMQuantization3B2GB4GBQ47B6GB8GBQ4/Q813B10GB16GBQ4/Q834B20GB32GBQ470B40GB80GBQ4

Chinese Interface#

This skill outputs in Chinese for user convenience.