Class ChatCloudflareWorkersAI

A class that enables calls to the Cloudflare Workers AI API to access large language models in a chat-like fashion. It extends the SimpleChatModel class and implements the CloudflareWorkersAIInput interface.

Example

const model = new ChatCloudflareWorkersAI({
  model: "@cf/meta/llama-2-7b-chat-int8",
  cloudflareAccountId: process.env.CLOUDFLARE_ACCOUNT_ID,
  cloudflareApiToken: process.env.CLOUDFLARE_API_TOKEN
});

const response = await model.invoke([
  ["system", "You are a helpful assistant that translates English to German."],
  ["human", `Translate "I love programming".`]
]);

console.log(response);

Hierarchy

  • SimpleChatModel
    • ChatCloudflareWorkersAI

Implements

Constructors

constructor

Properties

baseUrl model streaming cloudflareAccountId? cloudflareApiToken?

Accessors

identifyingParams

Methods

invocationParams validateEnvironment

Constructors

constructor

Properties

baseUrl

baseUrl: string

model

model: string = "@cf/meta/llama-2-7b-chat-int8"

streaming

streaming: boolean = false

Optional cloudflareAccountId

cloudflareAccountId?: string

Optional cloudflareApiToken

cloudflareApiToken?: string

Accessors

identifyingParams

Methods

invocationParams

  • invocationParams(_options?): {
        model: string;
    }

  • Get the parameters used to invoke the model

    Parameters

    • Optional _options: Omit<BaseLanguageModelCallOptions, never>

    Returns {
        model: string;
    }

    • model: string

validateEnvironment

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc