You can use OpenRouter as LLM provider in RAGChat. To use an OpenRouter model, first initialize RAGChat with the OpenRouter model:

import { RAGChat, openrouter } from "@upstash/rag-chat";

export const ragChat = new RAGChat({
  model: openrouter("sao10k/l3-lunaris-8b",{apiKey: "OPEN_ROUTER_KEY"}),
});

Was this page helpful?

MistralAIGroq