The WatsonxAI class is used to interact with Watsonx AI Inference Endpoint models. It uses IBM Cloud for authentication. This requires your IBM Cloud API Key which is autoloaded if not specified.

Hierarchy

  • LLM<BaseLLMCallOptions>
    • WatsonxAI

Constructors

Properties

endpoint: string
modelId: string = "meta-llama/llama-2-70b-chat"
region: string = "us-south"
version: string = "2023-05-29"
ibmCloudApiKey?: string
ibmCloudToken?: string
ibmCloudTokenExpiresAt?: number
modelKwargs?: Record<string, unknown>
modelParameters?: Record<string, unknown>
projectId?: string

Methods

Generated using TypeDoc