Dense LLM from IBM supporting up to 128K context length, trained on 12T tokens. Suitable for general instructions following and can be used to build AI assistants

15.3K Downloads

5 stars

Capabilities

Minimum system memory

5GB

Tags

8B
granite

README

granite 3.1 8b instruct by ibm-granite

Supports context length of 131072 tokens.

Intended for general instructions, summarization, text classification and extraction, Q/A, RAG, coding, function calling, and long context tasks.

Supported Languages: English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. Users may finetune Granite 3.1 models for languages beyond these 12 languages.

Sources

The underlying model files this model uses