You can use Groq as LLM provider in RAGChat. To use an Groq model, first initialize RAGChat with the Groq model:

import { RAGChat, groq } from "@upstash/rag-chat";

export const ragChat = new RAGChat({
  model: groq("llama-3.1-70b-versatile",{apiKey: "GROQ_AI_KEY"}),
});

Was this page helpful?

OpenRouterCustom