nous hermes
**Nous Hermes** is a **highly influential family of merged and fine-tuned language models created by Nous Research that consistently ranks among the top open-source models by combining multiple specialized fine-tunes through model merging techniques** — pioneering the community-driven approach of blending expert models (reasoning, coding, creative writing) into unified generalists that outperform their individual components, with the flagship Hermes models serving as the foundation for thousands of downstream community merges.
---
**Core Methodology**
Nous Research's approach combines **expert fine-tuning** with **model merging**:
| Component | Detail |
|-----------|--------|
| **Base Models** | Llama 2, Mistral, Llama 3 (varies by version) |
| **Merging Technique** | TIES-Merging, DARE, SLERP — combining weights from multiple specialized fine-tunes |
| **Training Data** | Curated from OpenHermes, Airoboros, Capybara, and proprietary Nous datasets |
| **Philosophy** | Uncensored, high-quality instruction following without artificial refusals |
| **Key Versions** | Hermes-2-Pro (Mistral), Hermes-3 (Llama 3.1) |
The critical insight: rather than training one model on everything, train **specialist models** on different capabilities (math, code, roleplay, reasoning) and then **merge their weights** into a single generalist that inherits all skills.
---
**Model Merging Innovation**
**Model merging** is the technique of combining the weights of multiple fine-tuned models without additional training:
- **SLERP (Spherical Linear Interpolation)**: Smoothly interpolates between two model weight spaces, preserving the geometric structure of the learned representations
- **TIES-Merging**: Trims small weight changes, resolves sign conflicts between models, and merges only the agreed-upon directions — preventing destructive interference
- **DARE**: Randomly drops delta parameters and rescales the remainder, creating sparse but effective merged models
Nous Research was among the first to systematically apply these techniques to create production-quality models, proving that **ensemble knowledge could be compressed into a single model** without inference overhead.
---
**🏗️ The Nous Ecosystem**
**Nous Research** operates as a decentralized AI research collective:
- **Hermes**: The flagship instruction-following line — known for being "uncensored" (no artificial refusals) while remaining helpful and aligned
- **Capybara**: Focused on multi-turn conversation quality with long, detailed responses
- **Nous-Yarn**: Extended context length models (128k+ tokens) using YaRN (Yet another RoPE extensioN)
- **Forge**: The community platform where members submit datasets and compete in model training
**OpenHermes-2.5 Dataset**: Their signature dataset aggregating 1M+ high-quality conversations from GPT-4 synthetic data, reasoning traces, and domain expertise — widely used by the entire open-source community as a standard fine-tuning dataset.
---
**Impact & Legacy**
Nous Hermes models have dominated the **Hugging Face Open LLM Leaderboard** across multiple weight classes. Their contributions established several community norms:
- Model merging as a legitimate technique (not just a "hack")
- Uncensored models as the preferred base for downstream applications
- Community-driven, transparent development over corporate secrecy
- The OpenHermes dataset as a standard benchmark for fine-tuning quality
The "Nous" approach — combine the best open datasets, merge specialist models, iterate rapidly — became the **template for the entire open-source LLM community** and influenced how Hugging Face, Axolotl, and mergekit tools evolved.