← All Models

Command-R

•

CohereForAI

cohere

Able to chat in more than 10 languages, Cohere AI's Command-R is optimized for RAG but can perform well in any task.

Model info

Model

Command-R

Author

CohereForAI

Arch

cohere

Parameters

35B

Size on disk

about 13.82 GB

Format

gguf

Download and run Command-R

Open in LM Studio to view download options

Use Command-R in your code

💡 LM Studio needs to be installed and run at least once for this to work. Don't have it yet? Get it here.

CLI Bootstrap

npx lmstudio install-cli # (only needed once)

Model Load

lms load lmstudio-community/c4ai-command-r-v01-gguf
Alternatively, load the model in the LM Studio app.

Use Command-R via an OpenAI-like API

Reuse your existing OpenAI client code and point it to LM Studio instead.

Python example
# Example: reuse your existing OpenAI client code
from openai import OpenAI

# Point to the local server
client = OpenAI(base_url="http://localhost:1234/v1", 
                api_key="lm-studio") # not used

completion = client.chat.completions.create(
  model="lmstudio-community/c4ai-command-r-v01-gguf",
  messages=[
    {"role": "system", "content": "Always answer in rhymes."},
    {"role": "user", "content": "Introduce yourself."}
  ],
  temperature=0.7,
)

print(completion.choices[0].message)

Develop

Learn more