AI SDK
OpenAI Compatible Providers

ModelRush

Use the ModelRush OpenAI compatible API with the AI SDK.

ModelRush provides access to AI models through an OpenAI-compatible API. You can use its Chat Completions endpoint with the AI SDK through the @ai-sdk/openai-compatible module.

Setup

Install the OpenAI Compatible provider:

$ pnpm add @ai-sdk/openai-compatible

Create a ModelRush API key and set it as a server-side environment variable:

export MODELRUSH_API_KEY=your-api-key

See the ModelRush quick start for instructions on creating an API key.

Provider Instance

Create a ModelRush provider instance with createOpenAICompatible:

import { createOpenAICompatible } from '@ai-sdk/openai-compatible';

const modelrush = createOpenAICompatible({
  name: 'modelrush',
  apiKey: process.env.MODELRUSH_API_KEY,
  baseURL: 'https://api.modelrush.ai/v1',
});

Language Models

Create a chat model with the .chatModel() factory method and a ModelRush model ID:

const model = modelrush.chatModel('modelrush/deepseek-v4-flash-0731');

Example

Use generateText to generate text with the model:

import { createOpenAICompatible } from '@ai-sdk/openai-compatible';
import { generateText } from 'ai';

const modelrush = createOpenAICompatible({
  name: 'modelrush',
  apiKey: process.env.MODELRUSH_API_KEY,
  baseURL: 'https://api.modelrush.ai/v1',
});

const { text } = await generateText({
  model: modelrush.chatModel('modelrush/deepseek-v4-flash-0731'),
  prompt: 'Explain what an API gateway does in one sentence.',
});

console.log(text);

Supported Models and Capabilities

This integration uses ModelRush's OpenAI-compatible Chat Completions endpoint for text generation. The example model, modelrush/deepseek-v4-flash-0731, accepts text chat messages and returns text.

Use the ModelRush models endpoint or model catalog to find current model IDs and model-specific capabilities and limits. Other ModelRush modalities are outside the scope of this OpenAI-compatible chat integration.

Resources

PreviousNVIDIA NIMNextCheaper Inference