NotFoundError: 404 Cannot POST /llm/v1/chat/completions

[jin-kazama-codes]

My code was working perfectly fine for around 2 months but now all of a sudden I have started encountering an error while asking question in chat, I get error in the response of http://localhost:3000/api/chat-stream

`import { RAGChat, upstash } from "@upstash/rag-chat";
import { redis } from "./redis";

export const ragChat = new RAGChat({
model: upstash("mistralai/Mistral-7B-Instruct-v0.2", {
maxTokens: 512,
temperature: 0.7,
topP: 0.9,
}),
redis: redis,
});`

NotFoundError: 404 Cannot POST /llm/v1/chat/completions
at APIError.generate (webpack-internal:///(rsc)/./node_modules/openai/error.mjs:69:20)
at OpenAI.makeStatusError (webpack-internal:///(rsc)/./node_modules/openai/core.mjs:333:65)
at OpenAI.makeRequest (webpack-internal:///(rsc)/./node_modules/openai/core.mjs:377:30)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async eval (webpack-internal:///(rsc)/./node_modules/@langchain/openai/dist/chat_models.js:1378:29)
at async RetryOperation.eval [as _fn] (webpack-internal:///(rsc)/./node_modules/p-retry/index.js:50:12) {
status: 404,

`import { ragChat } from "@/lib/rag-chat";
import { aiUseChatAdapter } from "@upstash/rag-chat/nextjs";
import { NextRequest } from "next/server";

export const POST = async (req: NextRequest) => {
const { messages, sessionId } = await req.json();

const lastMessage = messages[messages.length - 1].content;

const response = await ragChat.chat(lastMessage, { streaming: true, sessionId });
console.log('response', response);
return aiUseChatAdapter(response);
};
`

[Dru-429]

do u got any solution ?

[enesakar]

hello. we stopped hosting llm models. please use openrouter or any other llm provider.