Nous-Hermes-2-Mixtral-8x7B-DPO

Customize or build on this model

Listed from public GitHub data, not tested by us. Read the code and license before you run anything.

Linked in the model card

GitHub repositories the original model card links to.

• axolotl-ai-cloud/axolotl ↗

  Repo’s own description: Go ahead and axolotl questions

  ★ 12,629 · Last updated 2026-10-25 · License: Apache-2.0

Projects that use this model

Public projects whose files name this exact model.

• FlagOpen/FlagEmbedding ↗

  Repo’s own description: Retrieval and Retrieval-augmented LLMs

  ★ 12,272 · Last updated 2026-08-24 · License: MIT

  Names this model in: research/Long_LLM/longllm_qlora/src/chat.py ↗

• togethercomputer/MoA ↗

  Repo’s own description: Together Mixture-Of-Agents (MoA) – 65.1% on AlpacaEval with OSS models

  ★ 2,989 · Last updated 2025-01-07 · License: Apache-2.0

  Names this model in: FastChat/fastchat/conversation.py ↗

• huggingface/cookbook ↗

  Repo’s own description: Open-source AI cookbook

  ★ 2,753 · Last updated 2026-10-06 · License: Apache-2.0

  Names this model in: notebooks/en/tgi_messages_api_demo.ipynb ↗

• qhjqhj00/MemoRAG ↗

  Repo’s own description: Empowering RAG with a memory-based data interface for all-purpose applications!

  ★ 2,271 · Last updated 2025-09-11 · License: Apache-2.0

  Names this model in: train/src/chat.py ↗

• AK391/ai-gradio ↗

  Repo’s own description: A Python package that makes it easy for developers to create AI apps powered by various AI providers.

  ★ 1,637 · Last updated 2025-04-08 · License: not stated

  Names this model in: ai_gradio/providers/__init__.py ↗

• prometheus-eval/prometheus-eval ↗

  Repo’s own description: Evaluate your LLM's response with Prometheus and GPT4 💯

  ★ 1,121 · Last updated 2025-04-25 · License: Apache-2.0

  Names this model in: train/scripts/conversation.py ↗

Tools to customize it further

Remove more refusals

• Heretic ↗ ★ 36,421

  Removes refusal behavior from transformer models automatically. It pairs directional ablation (abliteration) with an Optuna parameter search that tries to cut refusals while keeping the model close to the original, so you don't have to pick layers by hand.

• OBLITERATUS ↗ ★ 8,946

  A larger refusal-removal toolkit with several abliteration methods, usable locally or through a hosted Hugging Face Space. Check the telemetry setting before you run it: the README describes telemetry as opt-in, but on by default in the Spaces version.

Fine-tune it on your own data

• Unsloth ↗ ★ 78,528

  A desktop app and Python library for running and training models locally. Its README lists LoRA, QLoRA, full fine-tuning, DPO and GRPO, plus export to formats including GGUF, on Windows, Linux, WSL and macOS.

• LlamaFactory ↗ ★ 75,713

  Fine-tunes more than 100 language and vision-language models from a command line or a browser-based Web UI, aimed at training without writing code.

Make a smaller download (quantize)

• llama.cpp ↗ ★ 132,260

  Runs models locally and includes the tools behind most GGUF files. A conversion script turns Hugging Face weights into GGUF, and llama-quantize shrinks a high-precision GGUF to lower-bit formats, which can cost some accuracy.

• MLX LM ↗ ★ 7,467

  Apple's MLX package for running and fine-tuning models on Apple silicon. It can quantize models and upload them to the Hugging Face Hub, and supports LoRA and full fine-tuning.

Merge it with another model

• mergekit ↗ ★ 7,414

  Merges pretrained models with many merge methods. It works out-of-core, so merges can run on a CPU or with as little as 8 GB of VRAM, and it also handles LoRA extraction and mixture-of-experts merges.

Learn the techniques

• LLM Course ↗ ★ 84,667

  A free course with roadmaps and Colab notebooks. Its notebooks include one-click tools for merging with MergeKit, quantizing to GGUF, GPTQ, EXL2, AWQ and HQQ, and automatic abliteration with custom datasets.

Compare all tools →