Skip to content

Build AI Agents with NVIDIA

NVIDIA NIM-hosted models

Available NVIDIA Models

ModelID
Llama 3.1 8B Instructmeta/llama-3.1-8b-instruct
Llama 3.3 70B Instructmeta/llama-3.3-70b-instruct

Quick start code

agent.py
from agno.agent import Agent
from agno.models.nvidia import Nvidia

agent = Agent(
    name="My NVIDIA Agent",
    model=Nvidia(id="meta/llama-3.1-8b-instruct"),
    instructions=["You are a helpful assistant."],
    markdown=True,
)

agent.print_response("Hello! What can you help me with?")

Install: pip install agno Then set NVIDIA_API_KEY

Contact Us

Press Ctrl+Enter to send