Langchain example
unknown
plain_text
2 years ago
411 B
10
Indexable
const openai = new OpenAI({
apiKey: 'EMPTY', // This is the default and can be omitted
baseURL: 'https://a0oi2ify0b4yv2-7860.proxy.runpod.net/v1',
});
const stream = await openai.chat.completions.create({
messages: newmessages,
model: 'octopus2023-inc/mistral-instructv2-int4-shiftsmart-v5', // model example
stream: true,
max_tokens: 1000,
temperature: temperature
});Editor is loading...
Leave a Comment