AI SDK
  • Docs
  • Cookbook
  • Providers
  • Showcase
  • Playground
  • Model Library

Announcing AI SDK 5 Alpha!

Learn more
AI SDK Providers
xAI Grok
Vercel
OpenAI
Azure OpenAI
Anthropic
Amazon Bedrock
Groq
Fal
DeepInfra
Google Generative AI
Google Vertex AI
Mistral AI
Together.ai
Cohere
Fireworks
DeepSeek
Cerebras
Replicate
Perplexity
Luma
ElevenLabs
AssemblyAI
Deepgram
Gladia
LMNT
Hume
Rev.ai
OpenAI Compatible Providers
Writing a Custom Provider
LM Studio
NVIDIA NIM
Baseten
Community Providers
Writing a Custom Provider
Qwen
Ollama
Chrome AI
FriendliAI
Portkey
Cloudflare Workers AI
Cloudflare AI Gateway
OpenRouter
Azure AI
Crosshatch
Mixedbread
Voyage AI
Mem0
Letta
LLamaCpp
Anthropic Vertex
Spark
Inflection AI
LangDB
Zhipu AI
SambaNova
Dify
Sarvam
Adapters
LangChain
LlamaIndex
Observability Integrations
Braintrust
Helicone
Laminar
Langfuse
LangSmith
LangWatch
Patronus
Traceloop
Weave
Community ProvidersLLamaCpp

LLamaCpp Provider

The LlamaCpp provider is a prototype that is currently unmaintained.

nnance/llamacpp-ai-provider is a community provider that uses Llama.cpp to provide language model support for the AI SDK.

On this page
LLamaCpp Provider
Elevate your AI applications with Vercel.
Trusted by OpenAI, Replicate, Suno, Pinecone, and more.
Vercel provides tools and infrastructure to deploy AI apps and features at scale.

Resources

DocsCookbookProvidersShowcaseGitHubDiscussions

More

PlaygroundContact Sales

About Vercel

Next.js + VercelOpen Source SoftwareGitHubX

Legal

Privacy Policy

© 2025 Vercel, Inc.