Docs

Running a model

Auray Serverlessllm

Llama 3.1 8B Prompt Enhancer

Instruction-tuned language model optimized for prompt enhancement and rewriting

POSTauray-serverless/model/llama-3-1-8b-prompt-enhancer
openapi.jsonllms.txt

One of Auray's catalogue models: the same key, the same credits, the same job lifecycle as every other address.

Its request shape is published below. Whether it runs right now is GET /v1/catalogue's word, with no key needed: its addresses say connected for an address that runs, and a submit to any other is refused before anything is charged — described answers 501 model_not_connected, paused 503 model_disabled.

Category llm · Scope text:write (or external:write on an older key) · Price Credits per call: 0.1584. Quoted when you submit, at the most the request can cost; the charge settles to what the job cost and never above the quote. The submit's answer carries the quote as credits_quoted, and credits_charged says what has been taken.

#Input

FieldTypeRequiredDefaultDescription
promptstringyes—Text prompt to enhance. Documented range: 1 to 300 characters.
promptMaxLengthintegerno—Maximum length of the enhanced prompt. Documented range: 12 to 400.
promptVersionsintegerno1Number of enhanced prompt variations to generate. Documented range: 1 to 5.
idempotency_keystringno—Your own name for this request. Send the same one twice and the second call is answered with the first request rather than charged again. Idempotency-Key: as a header is accepted as an alias — that is the spelling a retrying proxy replays, and the one to use when running a model on auray.run, where a request that outlives its connection is answered 504 and recovered by replay. Omit it and the platform mints one. 1 to 64 characters.

#Example

curl -X POST https://queue.auray.run/auray-serverless/model/llama-3-1-8b-prompt-enhancer \
  -H "Authorization: Bearer $AURAY_API_KEY" \
  -H "content-type: application/json" \
  -d '{
  "prompt": "a brass orrery on a walnut desk, morning light from a window to the left"
}'

The same body on https://auray.run runs synchronously and answers the result — unless it usually takes longer than a run may hold its connection, which is refused 400 model_not_synchronous before anything is charged. Options — ?webhook=, ?wait=, priority and timeout headers — are on Submit a request.

#Machine contracts

  • openapi.json — this page as an OpenAPI 3.1 document, public.
  • llms.txt — the same, written for an agent.

Start typing to search every page of the documentation.

Up arrow Down arrow to moveEnter to openEscape to close