Langchain example

 avatar
unknown
plain_text
a year ago
411 B
6
Indexable
const openai = new OpenAI({
    apiKey: 'EMPTY', // This is the default and can be omitted
    baseURL: 'https://a0oi2ify0b4yv2-7860.proxy.runpod.net/v1',
  });

const stream = await openai.chat.completions.create({
      messages: newmessages,
      model: 'octopus2023-inc/mistral-instructv2-int4-shiftsmart-v5', // model example
      stream: true,
      max_tokens: 1000,
      temperature:  temperature
});
Editor is loading...
Leave a Comment