← All Models

GGUF

Hermes 3 Llama 3.1 8B

•

NousResearch

llama

A fine-tune of Meta's Llama 3.1, Hermes is further trained on hand-curated datasets as well and synthetic data. Excels in dialogue and code generation.

Model info

Model

Hermes 3 Llama 3.1 8B

Author

NousResearch

Repository

🤗 NousResearch/Hermes-3-Llama-3.1-8B-GGUF↗

Arch

llama

Parameters

8B

Format

gguf

Size on disk

about 4.92 GB

Download and run Hermes 3 Llama 3.1 8B

Open in LM Studio to view download options

Download hermes-3-8b from the terminal

Download the model using lms — LM Studio's developer CLI.

lms get hermes-3-8b

Call hermes-3-8b from your code

curl http://localhost:1234/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "hermes-3-8b",
    "messages": [
      { "role": "system", "content": "Always answer in rhymes." },
      { "role": "user", "content": "Introduce yourself." }
    ],
    "temperature": 0.7,
    "max_tokens": -1,
    "stream": true
  }'

Next Steps: Build! 🔨

Learn more


lmmy