Nemotron-4 340B Instruct

About Nemotron-4 340B Instruct

Nemotron-4-340B-Instruct is an English-language chat model optimized for synthetic data generation. This large language model (LLM) is a fine-tuned version of Nemotron-4-340B-Base, designed for single and multi-turn chat use-cases with a 4,096 token context length. The base model was pre-trained on 9 trillion tokens from diverse English texts, 50+ natural languages, and 40+ coding languages. The instruct model underwent additional alignment steps: 1. Supervised Fine-tuning (SFT) 2. Direct Preference Optimization (DPO) 3. Reward-aware Preference Optimization (RPO) The alignment process used approximately 20K human-annotated samples, while 98% of the data for fine-tuning was synthetically generated. Detailed information about the synthetic data generation pipeline is available in the [technical report](https://arxiv.org/html/2406.11704v1).

Model Specifications

NVIDIA Model Lineup

Compare all models from NVIDIA to find the best fit

Similar Models from Other Providers

Cross-brand alternatives with similar capabilities

Gemma 3n 4B

Google

Input: Free

Output: Free

Context: 33k

Qwen2.5-VL 7B Instruct

Alibaba Qwen

Input: Free

Output: Free

Context: 33k

Seedream 4.5

ByteDance

Input: Free

Output: Free

Context: 4k

FLUX.2 Max

Black Forest Labs

Input: Free

Output: Free

Context: 47k

🚀 Quick Start

Get started with Nemotron-4 340B Instruct API

from openai import OpenAI

client = OpenAI(
    base_url="https://api.provider.com/v1",
    api_key="YOUR_API_KEY"
)

response = client.chat.completions.create(
    model="nvidia/nemotron-4-340b-instruct",
    messages=[
        {"role": "user", "content": "Hello!"}
    ]
)
print(response.choices[0].message.content)

Continue Your Decision