EmbeddingModel

Since

0.3.0-beta01

Inheritors

Properties

Link copied to clipboard

How many values this model accepts in a single call, if limited. embedMany consults this to auto-split large requests into batches when the caller doesn't pass an explicit maxEmbeddingsPerCall. Null = no limit.

Link copied to clipboard
abstract val modelId: String
Link copied to clipboard
open val provider: String
Link copied to clipboard

Whether the model permits its embedding batches to run concurrently. When true, embedMany fans batches out (bounded by maxParallelCalls) instead of running them serially.

Functions

Link copied to clipboard
abstract suspend fun embed(params: EmbeddingModelCallParams): EmbeddingModelResult