← All Models

GGUF

Mistral 7B v0.3

•

MistralAI

mistral

One of the most popular open-source LLMs, Mistral's 7B Instruct model's balance of speed, size, and performance makes it a great general-purpose daily driver.

Model info

Model

Mistral 7B v0.3

Author

MistralAI

Repository

🤗 lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF↗

Arch

mistral

Parameters

7B

Format

gguf

Size on disk

about 4.37 GB

Download and run Mistral 7B v0.3

Open in LM Studio to view download options

Download mistral-7b from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get mistral-7b

Call mistral-7b from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral-7b",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more


lmmy