mini\Inference\InferenceServiceInterface::batchEvaluate()
Method
public
abstract
Signature
public abstract function batchEvaluate(array $prompts, mini\Validator\Validator|JsonSerializable|array $schema): arrayParameters
| Name | Type | Default | Description |
|---|---|---|---|
$prompts |
array |
required | Documentation missing |
$schema |
mini\Validator\Validator|JsonSerializable|array |
required | Documentation missing |
Returns
array
Documentation
Evaluate multiple prompts with the same schema
Allows implementations to optimize batch processing where supported. Implementations without native batching should loop over evaluate().