Qwen3 32B の必要メモリ
量子化別の必要メモリ 推定
| 量子化 | 4K文脈 | 32K | 128K |
|---|---|---|---|
| Q4_K_M | 23.0 GB | 30.5 GB | 56.2 GB |
| Q5_K_M | 26.6 GB | 34.1 GB | 59.9 GB |
| Q8_0 | 38.7 GB | 46.2 GB | 72.0 GB |
| FP16 | 71.0 GB | 78.5 GB | 104.2 GB |
| 量子化 | 4K文脈 | 32K | 128K |
|---|---|---|---|
| Q4_K_M | 23.0 GB | 30.5 GB | 56.2 GB |
| Q5_K_M | 26.6 GB | 34.1 GB | 59.9 GB |
| Q8_0 | 38.7 GB | 46.2 GB | 72.0 GB |
| FP16 | 71.0 GB | 78.5 GB | 104.2 GB |