← All Models

Mistral Nemo 2407

•

MistralAI

mistral

A slightly larger 12B parameter model from Mistral AI, NeMo offers a long 128k token context length, advanced world knowledge, and function calling for developers.

Model info

Model

Mistral Nemo 2407

Author

MistralAI

Arch

mistral

Parameters

12B

Size on disk

about 6.56 GB

Format

gguf

Download and run Mistral Nemo 2407

Open in LM Studio to view download options

Use Mistral Nemo 2407 in your code

💡 LM Studio needs to be installed and run at least once for this to work. Don't have it yet? Get it here.

CLI Bootstrap

npx lmstudio install-cli # (only needed once)

Model Load

lms load lmstudio-community/mistral-nemo-instruct-2407-gguf
Alternatively, load the model in the LM Studio app.

Use Mistral Nemo 2407 via an OpenAI-like API

Reuse your existing OpenAI client code and point it to LM Studio instead.

Python example
# Example: reuse your existing OpenAI client code
from openai import OpenAI

# Point to the local server
client = OpenAI(base_url="http://localhost:1234/v1", 
                api_key="lm-studio") # not used

completion = client.chat.completions.create(
  model="lmstudio-community/mistral-nemo-instruct-2407-gguf",
  messages=[
    {"role": "system", "content": "Always answer in rhymes."},
    {"role": "user", "content": "Introduce yourself."}
  ],
  temperature=0.7,
)

print(completion.choices[0].message)

Develop

Learn more