GGUF

granite 3.2 8b

ibm

granite

A small and capable LLM from IBM

Model info

Model

granite 3.2 8b

Author

ibm

Arch

granite

Parameters

8B

Format

gguf

Size on disk

about 4.94 GB

Download and run granite 3.2 8b

Open in LM Studio to view download options

Download granite-3.2-8b from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get granite-3.2-8b

Call granite-3.2-8b from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "granite-3.2-8b",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more


lmmy