CUSTOM
CLANKERS.
← Browse all models

NousResearch / Model details

Hermes-3-Llama-3.1-8B

NousResearch/Hermes-3-Llama-3.1-8B

fine-tuned
Download files on Hugging Face ↗

Read the original model card ↗ · Choosing a model

About this model

Hermes 3 Llama 3.1 8B is Nous Research's generalist assistant fine-tune of Meta's Llama 3.1 base. Nous positions this generation around user-directed behavior, roleplay and sustained multi-turn conversation, while expanding the Hermes 2 focus on tool calls, structured outputs and code generation. It uses ChatML and model-specific tool and JSON-schema prompts, so integrations should follow its templates rather than assume the Llama Instruct format.

Description sources

Source-based description, not an independent evaluation. Check the linked sources for the creator’s claims and limitations.

Size and formats

Base model
meta-llama/Llama-3.1-8B, meta-llama/Meta-Llama-3.1-8B
Parameters
8.03026B
Main repository formats
safetensors
License tag
llama3
Languages
en
Last updated
2024-09-08 · 07:39:55.000 UTC

Community reviews & tips

Source-linked paraphrases of sampled community sources, not independently tested by this directory.

Sample window: to · 1 unique source link. This is a selected sample, not all community discussions.

Small sample: source links are not a count of independent reviewers or evidence of consensus.

Sources checked:

What changed

Model types are creator-reported, not independently tested. These labels describe source metadata, not a guarantee of behavior.

  • fine-tunedsource tag: base_model:finetune:meta-llama/Llama-3.1-8B

Family evidence

These groupings are source-reported. Explicit base identifiers take priority over generic architecture tags.

  • Llama: Base model: meta-llama/Llama-3.1-8B
  • Llama: Base model: meta-llama/Meta-Llama-3.1-8B

Available versions

Versions appear here only when they explicitly name this exact model as their source. Check each repository for available files.

Download sources

ModelScope distribution ↗Ollama distribution ↗
  • Distribution checked: ModelScope · 2026-10-24 · 03:14:44 UTC
  • Distribution checked: Ollama · 2026-10-24 · 03:14:44 UTC

Distribution links are not independent reviews or runtime compatibility guarantees. Check each source’s exact files and instructions.

Try it online

Try on Featherless ↗
  • Listing checked: Featherless · 2026-10-24 · 03:14:44 UTC

Third-party hosted inference listing this exact model ID. Hosting settings, quantization and pricing are the host’s, not tested here.

Refusal profile

Refused 19 of 111 prompts (17.1%)

We asked this model 120 benign but risky-looking prompts across ten topics and counted how often it refused, hedged or answered. Lower means it answered more often; it says nothing about answer quality.

  • Persuasion & deception1 refused · 0 partial · 10 complied
  • Harassment & confrontation3 refused · 0 partial · 7 complied
  • Risky activities0 refused · 0 partial · 12 complied
  • Offensive & controversial speech5 refused · 0 partial · 7 complied
  • Legal grey areas0 refused · 0 partial · 12 complied
  • Privacy & personal data2 refused · 0 partial · 7 complied
  • Self-harm & mental health topics1 refused · 0 partial · 10 complied
  • Sexual & adult topics1 refused · 0 partial · 9 complied
  • Ethically grey requests2 refused · 0 partial · 10 complied
  • Violence & conflict4 refused · 0 partial · 8 complied

Capability check: 13 of 15 passed. Fifteen simple tasks with known answers, so a broken model cannot score well by refusing nothing.

Unclear answers: 9 (not counted). An answer is unclear when the two checker models disagree or the output was empty or garbled.

Measured 2026-10-24 · Q4_K_M via bartowski/Hermes-3-Llama-3.1-8B-GGUF ↗ · llama.cpp · prompt set v1

How we measure · The prompts

Link to this listing

Made or quantized this model? Paste one of these into your model card or README so people can find this listing.

Markdown

[Listed on Custom Clankers](https://customclankers.com/models/nousresearch-hermes-3-llama-3-1-8b/)

HTML

<a href="https://customclankers.com/models/nousresearch-hermes-3-llama-3-1-8b/">Listed on Custom Clankers</a>

Plain text links only: no image, no script, nothing loaded from this site.

Customize or build on this model

Listed from public GitHub data, not tested by us. Read the code and license before you run anything.

Linked in the model card

GitHub repositories the original model card links to.

Projects that use this model

Public projects whose files name this exact model.

Tools to customize it further

Remove more refusals

  • Heretic ↗ ★ 36,421

    Removes refusal behavior from transformer models automatically. It pairs directional ablation (abliteration) with an Optuna parameter search that tries to cut refusals while keeping the model close to the original, so you don't have to pick layers by hand.

  • OBLITERATUS ↗ ★ 8,946

    A larger refusal-removal toolkit with several abliteration methods, usable locally or through a hosted Hugging Face Space. Check the telemetry setting before you run it: the README describes telemetry as opt-in, but on by default in the Spaces version.

Fine-tune it on your own data

  • Unsloth ↗ ★ 78,528

    A desktop app and Python library for running and training models locally. Its README lists LoRA, QLoRA, full fine-tuning, DPO and GRPO, plus export to formats including GGUF, on Windows, Linux, WSL and macOS.

  • LlamaFactory ↗ ★ 75,713

    Fine-tunes more than 100 language and vision-language models from a command line or a browser-based Web UI, aimed at training without writing code.

Make a smaller download (quantize)

  • llama.cpp ↗ ★ 132,260

    Runs models locally and includes the tools behind most GGUF files. A conversion script turns Hugging Face weights into GGUF, and llama-quantize shrinks a high-precision GGUF to lower-bit formats, which can cost some accuracy.

  • MLX LM ↗ ★ 7,467

    Apple's MLX package for running and fine-tuning models on Apple silicon. It can quantize models and upload them to the Hugging Face Hub, and supports LoRA and full fine-tuning.

Merge it with another model

  • mergekit ↗ ★ 7,414

    Merges pretrained models with many merge methods. It works out-of-core, so merges can run on a CPU or with as little as 8 GB of VRAM, and it also handles LoRA extraction and mixture-of-experts merges.

Learn the techniques

  • LLM Course ↗ ★ 84,667

    A free course with roadmaps and Colab notebooks. Its notebooks include one-click tools for merging with MergeKit, quantizing to GGUF, GPTQ, EXL2, AWQ and HQQ, and automatic abliteration with custom datasets.

Compare all tools →

Source provenance

Downloads
464,071
Likes
523
Metadata checked
2026-10-25 · 05:05:23 UTC
First seen in index
2026-10-20 · 21:59:08 UTC
Source revision
896ea440e5a9e6070e3d8a2774daf2b481ab425b

Source-card excerpt

Source model card excerpt: Hermes 3 - Llama-3.1 8B Model Description Hermes 3 is the latest version of our flagship Hermes series of LLMs by Nous Research. For

From NousResearch/Hermes-3-Llama-3.1-8B. Creator model-card excerpt, not an independent review.

Inspect before you run

Low refusal is not proof of correctness. Outputs can be inaccurate, harmful, or biased. Review the model card, license and files yourself. A license tag is not commercial-use advice. Parameter counts are source metadata; no hardware compatibility is implied.

This directory does not host or redistribute model weights. Refusal profiles are measured by us on a fixed prompt set; all other behavior claims are source-reported.

Collection rules & limitations ↗