Mistral Nemo 2407

MistralAI

mistral

A slightly larger 12B parameter model from Mistral AI, NeMo offers a long 128k token context length, advanced world knowledge, and function calling for developers.

Model info

Model

Mistral Nemo 2407

Author

MistralAI

Arch

mistral

Parameters

12B

Format

gguf

Size on disk

about 6.56 GB

Download and run Mistral Nemo 2407

Open in LM Studio to view download options

Download mistral-nemo from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get mistral-nemo
If you don't have it yet, get it by running npx lmstudio install-cli

Call mistral-nemo from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "mistral-nemo",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more