voxolith

GenerateOptions

How to run one request, for GeneratorPool.generate. Every field is optional.

Defined in: engine/src/worker/pool.ts:75

Extended by

Properties

PropertyTypeDescriptionDefined in
cache?booleanfalse: neither read nor write the worker's model cache for this request (default true).engine/src/worker/pool.ts:92
priority?numberQueue priority (default 0): a free worker takes the highest-priority queued request, in the order they were queued within one priority. Running requests are never pre-empted. Change it later with GeneratorPool.reprioritise.engine/src/worker/pool.ts:81
signal?AbortSignalCancel the request. A queued one leaves the queue; a running one rejects at once and its result is discarded when it lands, but the worker still finishes it, because a generator runs synchronously and cannot be interrupted (see respawnOnAbort for the alternative). Either way the promise rejects with signal.reason: a DOMException named "AbortError" unless abort() was given a reason of its own, as with fetch. An already-aborted signal rejects without queueing anything.engine/src/worker/pool.ts:90

On this page