GenerateOptions
How to run one request, for GeneratorPool.generate. Every field is optional.
Defined in: engine/src/worker/pool.ts:75
Extended by
Properties
| Property | Type | Description | Defined in |
|---|---|---|---|
cache? | boolean | false: neither read nor write the worker's model cache for this request (default true). | engine/src/worker/pool.ts:92 |
priority? | number | Queue priority (default 0): a free worker takes the highest-priority queued request, in the order they were queued within one priority. Running requests are never pre-empted. Change it later with GeneratorPool.reprioritise. | engine/src/worker/pool.ts:81 |
signal? | AbortSignal | Cancel the request. A queued one leaves the queue; a running one rejects at once and its result is discarded when it lands, but the worker still finishes it, because a generator runs synchronously and cannot be interrupted (see respawnOnAbort for the alternative). Either way the promise rejects with signal.reason: a DOMException named "AbortError" unless abort() was given a reason of its own, as with fetch. An already-aborted signal rejects without queueing anything. | engine/src/worker/pool.ts:90 |