Elenco dei modelli di linguaggio

Nome del modello	File GGUF	Parametri
Qwen3.6-35B-A3B-UD-Q3_K_XL-T_0_6-128K	https://huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF	c=131172, temp=0.6, fa=true, gpu-layers=999
Qwen3.6-35B-A3B-UD-Q3_K_XL-T_0_6-256K	https://huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF	c=262144, temp=0.6, fa=true, gpu-layers=999
Qwen3.6-35B-A3B-UD-Q3_K_XL-128K	https://huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF	c=131172, fa=true, gpu-layers=999
Qwen3.6-35B-A3B-UD-Q3_K_XL-256K	https://huggingface.co/unsloth/Qwen3.6-35B-A3B-MTP-GGUF	c=262144, fa=true, gpu-layers=999
gemma-4-26B-A4B-it-UD-Q4_K_M-128K	https://huggingface.co/unsloth/gemma-4-26B-A4B-it-GGUF	c=131172, fa=true, gpu-layers=999

OpenCode config (example)

{
    "$schema": "https://opencode.ai/config.json",
    "model": "Qwen3.6-35B-A3B-UD-Q3_K_XL-T_0_6-128K",
    "provider": {
        "llama-cpp": {
            "npm": "@ai-sdk/openai-compatible",
            "options": {
                "baseURL": "https://llm.hq.mittelab.org/v1"
            },
            "models": {
                "Qwen3.6-35B-A3B-UD-Q3_K_XL-T_0_6-128K": {
                    "tools": true,
                    "modalities": { "input": ["text"] },
                    "limit": { "context": 32000, "output": 8192 }
                }
            }
        }
    }
}

Pi config (example)

*~/.pi/agent/settings.json*

{
    "defaultProvider": "llama.cpp",
    "defaultModel": "Qwen3.6-35B-A3B-UD-Q3_K_XL-T_0_6-128K"
}

*~/.pi/agent/models.json*

{
    "providers": {
        "llama.cpp": {
            "baseUrl": "https://llm.hq.mittelab.org",
            "api": "openai-completions",
            "apiKey": "llama.cpp",
            "models": [
                { "id": "Qwen3.6-35B-A3B-UD-Q3_K_XL-T_0_6-128K", "contextWindow": 32000 }
            ]
        }
    }
}

*~/.pi/agent/auth.json*

{
    "llama.cpp": {
        "type": "api_key",
        "env": {
            "LLAMA_BASE_URL": "https://llm.hq.mittelab.org"
        }
    }
}

Nota: Questa pagina è stata generata automaticamente, non modificare!