Interface AlephAlphaInput

Interface for the input parameters specific to the Aleph Alpha LLM.

Hierarchy

Implemented by

Properties

base_url completion_bias_exclusion_first_token_only completion_bias_inclusion_first_token_only control_log_additive maximum_tokens model raw_completion aleph_alpha_api_key? best_of? cache? callbackManager? callbacks? completion_bias_exclusion? completion_bias_inclusion? concurrency? contextual_control_threshold? disable_optimizations? echo? frequency_penalty? log_probs? logit_bias? maxConcurrency? maxRetries? metadata? minimum_tokens? n? onFailedAttempt? penalty_bias? penalty_exceptions? penalty_exceptions_include_stop_sequences? presence_penalty? repetition_penalties_include_completion? repetition_penalties_include_prompt? sequence_penalty? sequence_penalty_min_length? stop? tags? temperature? tokens? top_k? top_p? use_multiplicative_frequency_penalty? use_multiplicative_presence_penalty? use_multiplicative_sequence_penalty? verbose?

Properties

base_url

base_url: string

completion_bias_exclusion_first_token_only

completion_bias_exclusion_first_token_only: boolean

completion_bias_inclusion_first_token_only

completion_bias_inclusion_first_token_only: boolean

control_log_additive

control_log_additive: boolean

maximum_tokens

maximum_tokens: number

model

model: string

raw_completion

raw_completion: boolean

Optional aleph_alpha_api_key

aleph_alpha_api_key?: string

Optional best_of

best_of?: number

Optional cache

cache?: boolean | BaseCache<Generation[]>

Optional callbackManager

callbackManager?: CallbackManager

Deprecated

Use callbacks instead

Optional callbacks

callbacks?: Callbacks

Optional completion_bias_exclusion

completion_bias_exclusion?: string[]

Optional completion_bias_inclusion

completion_bias_inclusion?: string[]

Optional concurrency

concurrency?: number

Deprecated

Use maxConcurrency instead

Optional contextual_control_threshold

contextual_control_threshold?: number

Optional disable_optimizations

disable_optimizations?: boolean

Optional echo

echo?: boolean

Optional frequency_penalty

frequency_penalty?: number

Optional log_probs

log_probs?: number

Optional logit_bias

logit_bias?: object

Optional maxConcurrency

maxConcurrency?: number

The maximum number of concurrent calls that can be made. Defaults to Infinity, which means no limit.

Optional maxRetries

maxRetries?: number

The maximum number of retries that can be made for a single call, with an exponential backoff between each attempt. Defaults to 6.

Optional metadata

metadata?: Record<string, unknown>

Optional minimum_tokens

minimum_tokens?: number

Optional n

n?: number

Optional onFailedAttempt

onFailedAttempt?: FailedAttemptHandler

Custom handler to handle failed attempts. Takes the originally thrown error object as input, and should itself throw an error if the input error is not retryable.

Optional penalty_bias

penalty_bias?: string

Optional penalty_exceptions

penalty_exceptions?: string[]

Optional penalty_exceptions_include_stop_sequences

penalty_exceptions_include_stop_sequences?: boolean

Optional presence_penalty

presence_penalty?: number

Optional repetition_penalties_include_completion

repetition_penalties_include_completion?: boolean

Optional repetition_penalties_include_prompt

repetition_penalties_include_prompt?: boolean

Optional sequence_penalty

sequence_penalty?: number

Optional sequence_penalty_min_length

sequence_penalty_min_length?: number

Optional stop

stop?: string[]

Optional tags

tags?: string[]

Optional temperature

temperature?: number

Optional tokens

tokens?: boolean

Optional top_k

top_k?: number

Optional top_p

top_p?: number

Optional use_multiplicative_frequency_penalty

use_multiplicative_frequency_penalty?: boolean

Optional use_multiplicative_presence_penalty

use_multiplicative_presence_penalty?: boolean

Optional use_multiplicative_sequence_penalty

use_multiplicative_sequence_penalty?: boolean

Optional verbose

verbose?: boolean

Settings

Member Visibility

Theme

On This Page

Generated using TypeDoc