xAI (Grok) v1.9.0+

Native support for xAI’s Grok models including chat, streaming, vision, structured output, reasoning, and image generation.

Configuration
1. Custom Endpoint
Available Models
Features
Supported Features Summary
Getting an API Key

The xAI provider gives you access to the Grok family of models through a clean, NodeLLM-native interface. It supports all core NodeLLM features including streaming, vision, structured outputs, reasoning, and image generation.

Configuration

import { createLLM } from "@node-llm/core";

const llm = createLLM({
  provider: "xai",
  xaiApiKey: process.env.XAI_API_KEY
});

Or via environment variables:

NODELLM_PROVIDER=xai
XAI_API_KEY=xai-...

Custom Endpoint

To route requests through a proxy, override the base URL via xaiApiBase (or the XAI_API_BASE environment variable):

const llm = createLLM({
  provider: "xai",
  xaiApiBase: "https://my-proxy.example.com/v1"
});

Then use zero-config:

import { NodeLLM } from "@node-llm/core";

const chat = NodeLLM.chat("grok-3");

Available Models

Model	Features
`grok-3`	Chat, Streaming, Tools, Structured Output
`grok-3-mini`	Chat, Streaming, Tools, Reasoning
`grok-2-1212`	Chat, Streaming, Tools, Structured Output
`grok-2-vision-1212`	Chat, Streaming, Vision, Structured Output
`grok-imagine-image`	Image Generation

For the full list, run:

const models = await llm.listModels();

Features

💬 Chat

const chat = llm.chat("grok-3");
const response = await chat.ask("Explain event-driven architecture.");
console.log(response.content);

⚡ Streaming

for await (const chunk of chat.stream("Tell me about Node.js")) {
  process.stdout.write(chunk.content || "");
}

👁️ Vision

Use grok-2-vision-1212 to analyze images by passing mixed content arrays:

const chat = llm.chat("grok-2-vision-1212");

const response = await chat.ask([
  { type: "text", text: "What is in this image?" },
  { type: "image_url", image_url: { url: "https://example.com/image.jpg" } }
]);

✨ Structured Output

import { z } from "@node-llm/core";

const Schema = z.object({
  name: z.string(),
  age: z.number(),
  hobbies: z.array(z.string())
});

const response = await chat.withSchema(Schema).ask("Create a fictional user profile.");
console.log(response.parsed); // Fully typed

🧠 Reasoning

grok-3-mini is a reasoning model. Reasoning tokens are tracked automatically.

const chat = llm.chat("grok-3-mini");
const response = await chat.ask("Solve this logic puzzle: ...");

console.log(response.content);    // Final answer
console.log(response.usage);      // Includes reasoning_tokens

🎨 Image Generation

const response = await llm.paint("A futuristic city at night, cyberpunk style", {
  model: "grok-imagine-image"
});

console.log(response.url); // URL of generated image

🛠️ Tool Calling

import { Tool, z } from "@node-llm/core";

class WeatherTool extends Tool {
  name = "get_weather";
  description = "Get the current weather for a city";
  schema = z.object({ city: z.string() });

  async execute({ city }: { city: string }) {
    return `Sunny in ${city}`;
  }
}

const response = await chat.withTool(WeatherTool).ask("What's the weather in London?");

Supported Features Summary

Feature	Supported
Chat	✅
Streaming	✅
Tool Calling	✅
Structured Output	✅
Vision	✅
Image Generation	✅
Reasoning	✅
Embeddings	❌
Transcription	❌
Moderation	❌