Skip to main content

Groq logoGroq

通过 Mastra 的模型路由访问 9 个 Groq 模型。身份验证会自动使用 GROQ_API_KEY 环境变量处理。

🌐 Access 9 Groq models through Mastra's model router. Authentication is handled automatically using the GROQ_API_KEY environment variable.

在Groq文档中了解更多。

🌐 Learn more in the Groq documentation.

.env
GROQ_API_KEY=your-api-key
src/mastra/agents/my-agent.ts
import { Agent } from "@mastra/core/agent";

const agent = new Agent({
  id: "my-agent",
  name: "My Agent",
  instructions: "You are a helpful assistant",
  model: "groq/llama-3.1-8b-instant"
});

// Generate a response
const response = await agent.generate("Hello!");

// Stream a response
const stream = await agent.stream("Tell me a story");
for await (const chunk of stream) {
  console.log(chunk);
}
info

Mastra 使用与 OpenAI 兼容的 /chat/completions 端点。某些特定提供商的功能可能无法使用。详见 Groq 文档。

🌐 Mastra uses the OpenAI-compatible /chat/completions endpoint. Some provider-specific features may not be available. Check the Groq documentation for details.

模型
Direct link to 模型

🌐 Models

ModelContextToolsReasoningImageAudioVideoInput $/1MOutput $/1M
groq/llama-3.1-8b-instant131K$0.05$0.08
groq/llama-3.3-70b-versatile131K$0.59$0.79
groq/meta-llama/llama-4-maverick-17b-128e-instruct131K$0.20$0.60
groq/meta-llama/llama-4-scout-17b-16e-instruct131K$0.11$0.34
groq/meta-llama/llama-guard-4-12b131K$0.20$0.20
groq/moonshotai/kimi-k2-instruct-0905262K$1$3
groq/openai/gpt-oss-120b131K$0.15$0.60
groq/openai/gpt-oss-20b131K$0.07$0.30
groq/qwen/qwen3-32b131K$0.29$0.59
9 available models

高级配置
Direct link to 高级配置

🌐 Advanced Configuration

自定义头
Direct link to 自定义头

🌐 Custom Headers

src/mastra/agents/my-agent.ts
const agent = new Agent({
  id: "custom-agent",
  name: "custom-agent",
  model: {
    url: "https://api.groq.com/openai/v1",
    id: "groq/llama-3.1-8b-instant",
    apiKey: process.env.GROQ_API_KEY,
    headers: {
      "X-Custom-Header": "value"
    }
  }
});

动态模型选择
Direct link to 动态模型选择

🌐 Dynamic Model Selection

src/mastra/agents/my-agent.ts
const agent = new Agent({
  id: "dynamic-agent",
  name: "Dynamic Agent",
  model: ({ requestContext }) => {
    const useAdvanced = requestContext.task === "complex";
    return useAdvanced
      ? "groq/qwen/qwen3-32b"
      : "groq/llama-3.1-8b-instant";
  }
});

直接提供商安装
Direct link to 直接提供商安装

🌐 Direct Provider Installation

这个提供程序也可以作为独立包直接安装，可以用来替代 Mastra 模型路由字符串。有关更多详细信息，请查看 包文档。

🌐 This provider can also be installed directly as a standalone package, which can be used instead of the Mastra model router string. View the package documentation for more details.

npm install @ai-sdk/groq

有关详细的特定提供商文档，请参阅 AI SDK Groq 提供商文档。

🌐 For detailed provider-specific documentation, see the AI SDK Groq provider docs.

目录