medpromptjs
    Preparing search index...

    Interface BaseLLMInput

    Parameters for configuring BaseLLM

    interface BaseLLMInput {
        apiKey?: string;
        backend?: string;
        baseUrl: string;
        cache?: boolean | BaseCache<Generation[]>;
        callbackManager?: CallbackManager;
        callbacks?: Callbacks;
        concurrency?: number;
        maxConcurrency?: number;
        maxOutputTokens?: number;
        maxRetries?: number;
        metadata?: Record<string, unknown>;
        model: string;
        nBatch?: number;
        nPredict?: number;
        nThreads?: number;
        onFailedAttempt?: FailedAttemptHandler;
        repeatLastN?: number;
        repeatPenalty?: number;
        tags?: string[];
        temperature?: number;
        timeout?: number;
        topK?: number;
        topP?: number;
        verbose?: boolean;
    }

    Hierarchy

    • BaseLLMParams
      • BaseLLMInput
    Index

    Properties

    apiKey? backend? baseUrl cache? callbackManager? callbacks? concurrency? maxConcurrency? maxOutputTokens? maxRetries? metadata? model nBatch? nPredict? nThreads? onFailedAttempt? repeatLastN? repeatPenalty? tags? temperature? timeout? topK? topP? verbose?

    Properties

    apiKey?: string
    backend?: string
    baseUrl: string
    cache?: boolean | BaseCache<Generation[]>
    callbackManager?: CallbackManager

    Use callbacks instead

    callbacks?: Callbacks
    concurrency?: number

    Use maxConcurrency instead

    maxConcurrency?: number

    The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

    maxOutputTokens?: number
    maxRetries?: number

    The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

    metadata?: Record<string, unknown>
    model: string
    nBatch?: number
    nPredict?: number
    nThreads?: number
    onFailedAttempt?: FailedAttemptHandler

    Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

    repeatLastN?: number
    repeatPenalty?: number
    tags?: string[]
    temperature?: number
    timeout?: number
    topK?: number
    topP?: number
    verbose?: boolean

    Settings

    Member Visibility

    On This Page

    Properties