Hermes 2 Mistral 7B DPO

About Hermes 2 Mistral 7B DPO

This is the flagship 7B Hermes model, a Direct Preference Optimization (DPO) of [Teknium/OpenHermes-2.5-Mistral-7B](/models/teknium/openhermes-2.5-mistral-7b). It shows improvement across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA. The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets.

Model Specifications

Nous Research Model Lineup

Compare all models from Nous Research to find the best fit

Similar Models from Other Providers

Cross-brand alternatives with similar capabilities

Gemma 3n 4B

Google

Input: Free

Output: Free

Context: 33k

Qwen2.5-VL 7B Instruct

Alibaba Qwen

Input: Free

Output: Free

Context: 33k

Seedream 4.5

ByteDance

Input: Free

Output: Free

Context: 4k

FLUX.2 Max

Black Forest Labs

Input: Free

Output: Free

Context: 47k

🚀 Quick Start

Get started with Hermes 2 Mistral 7B DPO API

from openai import OpenAI

client = OpenAI(
    base_url="https://api.provider.com/v1",
    api_key="YOUR_API_KEY"
)

response = client.chat.completions.create(
    model="nousresearch/nous-hermes-2-mistral-7b-dpo",
    messages=[
        {"role": "user", "content": "Hello!"}
    ]
)
print(response.choices[0].message.content)

Continue Your Decision