# Synth Developer Docs

> Run agents on your work, measure their results, train on scored tasks, and test whether the improvement holds up.

- [Make your agent better at your work](https://synthlabs.mintlify.app/index.md): Turn work that matters into repeatable tasks, compare agents fairly, and use the evidence to decide what to improve.
- [Run your first task](https://synthlabs.mintlify.app/getting-started/quickstart.md): Start with a complete example, or run a task and agent you already have.
- [How Synth fits together](https://synthlabs.mintlify.app/concepts/product-model.md): Understand the agent, the work, the assessment and the evidence before designing an experiment.
- [Build a reviewer you can evaluate](https://synthlabs.mintlify.app/tutorials/index.md): Run useful work, challenge its assessment, make one change, and decide whether training helped.
- [1. Get a useful review](https://synthlabs.mintlify.app/tutorials/first-review.md): Follow an authorization regression from source to a real agent finding.
- [2. Challenge the score](https://synthlabs.mintlify.app/tutorials/assessment.md): Separate executable correctness, judgment and untrusted candidate text.
- [3. Bring your own failure](https://synthlabs.mintlify.app/tutorials/adapt.md): Package enough context to investigate a real mistake and assess the result.
- [4. Compare one deliberate change](https://synthlabs.mintlify.app/tutorials/compare.md): Freeze tasks and scoring, then inspect what changed in the actual reviews.
- [5. Train and test transfer](https://synthlabs.mintlify.app/tutorials/train.md): Prove that weights changed, then test whether the resulting agent is worth using.
- [6. Use or reject the result](https://synthlabs.mintlify.app/tutorials/use.md): Take the selected reviewer back to new work, with an explicit rollback.
- [Operate and recover safely](https://synthlabs.mintlify.app/tutorials/operate.md): Keep run identity through interruptions and know what cleanup actually removes.
- [Tasks](https://synthlabs.mintlify.app/concepts/tasks-and-versions.md): Create, version, share, run, and inspect the work your agents need to master.
- [Define your agent](https://synthlabs.mintlify.app/concepts/profiles-and-candidates.md): Make the model and execution recipe explicit, validate it locally, and keep the version used by each experiment.
- [Build a test suite](https://synthlabs.mintlify.app/concepts/datasets-and-suites.md): Keep the work fixed while you compare agents, and reserve independent tasks for the final exam.
- [Define what good means](https://synthlabs.mintlify.app/guides/judging.md): Choose a verifier or judge, give it the right evidence, and qualify the assessment before optimizing against it.
- [Run an agent](https://synthlabs.mintlify.app/guides/managed-execution.md): Launch a task or dataset with an explicit agent and scoring method, then inspect the result.
- [Evaluate and compare agents](https://synthlabs.mintlify.app/guides/evaluate-and-compare.md): Measure a baseline and a deliberate change on the same tasks with the same assessment.
- [Review runs and results](https://synthlabs.mintlify.app/concepts/runs-and-evidence.md): Separate execution state, task quality and evidence before comparing agents.
- [Improve your agent](https://synthlabs.mintlify.app/concepts/improvement-lifecycle.md): Turn a recurring failure into a controlled experiment, then check whether the improvement holds on different work.
- [Train and test a checkpoint](https://synthlabs.mintlify.app/guides/managed-training.md): Run a bounded training plan, verify the saved model, and compare it with the baseline on held-out tasks.
- [Install the Synth CLI](https://synthlabs.mintlify.app/getting-started/install.md): Install the release used by these guides, including its bundled helpers.
- [Authentication](https://synthlabs.mintlify.app/getting-started/authentication.md): Sign in once and use the same user identity across Synth workflows.
- [CLI reference](https://synthlabs.mintlify.app/reference/cli.md): Release-linked command and flag reference for the Synth CLI.
- [Connections and environments](https://synthlabs.mintlify.app/reference/environments.md): Know which Synth service your commands target, without confusing it with the environment where an agent works.
- [Customer HTTP API](https://synthlabs.mintlify.app/reference/api.md): Use the same customer resources as the Synth CLI without adopting an SDK.
- [List personal access tokens](https://synthlabs.mintlify.app/api-reference/identity/list-personal-access-tokens.md): List token metadata without revealing token values. This administration operation requires an interactive user JWT; a personal access token cannot administer tokens.
- [Create a personal access token](https://synthlabs.mintlify.app/api-reference/identity/create-a-personal-access-token.md): Create a customer token with an interactive user JWT. The token value is returned once; preserve it before leaving the response.
- [Revoke a personal access token](https://synthlabs.mintlify.app/api-reference/identity/revoke-a-personal-access-token.md): Revoke one token owned by the authenticated user. This administration operation requires an interactive user JWT.
- [Create a task](https://synthlabs.mintlify.app/api-reference/registry/create-a-task.md): Create a private-by-default task and its first immutable Harbor-compatible version.
- [Create a dataset](https://synthlabs.mintlify.app/api-reference/registry/create-a-dataset.md): Create a private-by-default dataset whose immutable version pins exact task versions.
- [List tasks and datasets](https://synthlabs.mintlify.app/api-reference/registry/list-tasks-and-datasets.md): List Registry resources owned by the authenticated customer by default. Set scope=accessible to include all Registry resources visible to that customer.
- [Resolve a package reference](https://synthlabs.mintlify.app/api-reference/registry/resolve-a-package-reference.md): Resolve a logical, revision, digest, or immutable reference to one exact package version.
- [Get a task or dataset](https://synthlabs.mintlify.app/api-reference/registry/get-a-task-or-dataset.md): Inspect one visible logical package and its immutable version history.
- [Update package metadata](https://synthlabs.mintlify.app/api-reference/registry/update-package-metadata.md): Update allowed mutable metadata or visibility without rewriting immutable version history.
- [Launch a task matrix](https://synthlabs.mintlify.app/api-reference/registry/launch-a-task-matrix.md): Launch a bounded matrix of supported agent and model configurations against one exact immutable task version.
- [List version executions](https://synthlabs.mintlify.app/api-reference/registry/list-version-executions.md): List current and historical executions associated with one exact package version.
- [Get an execution](https://synthlabs.mintlify.app/api-reference/registry/get-an-execution.md): Inspect lifecycle state, configuration, trials, score, and failure for one execution.
- [List execution events](https://synthlabs.mintlify.app/api-reference/registry/list-execution-events.md): Read ordered customer lifecycle events for one execution.
- [List execution artifacts](https://synthlabs.mintlify.app/api-reference/registry/list-execution-artifacts.md): Inspect finalized customer artifact identities and download links for one execution.
- [Validate a managed job](https://synthlabs.mintlify.app/api-reference/managed-execution/validate-a-managed-job.md): Validate and translate a Harbor-compatible job without starting execution.
- [Create a managed job](https://synthlabs.mintlify.app/api-reference/managed-execution/create-a-managed-job.md): Launch an admitted Harbor-compatible job and return its durable handle.
- [Get a managed job](https://synthlabs.mintlify.app/api-reference/managed-execution/get-a-managed-job.md): Inspect aggregate lifecycle state for a managed job.
- [List managed job trials](https://synthlabs.mintlify.app/api-reference/managed-execution/list-managed-job-trials.md): Inspect the immutable child trials admitted for a managed job.
- [List managed job events](https://synthlabs.mintlify.app/api-reference/managed-execution/list-managed-job-events.md): Read insertion-safe lifecycle and execution events across the job's child trials.
- [Download a managed job bundle](https://synthlabs.mintlify.app/api-reference/managed-execution/download-a-managed-job-bundle.md): Download the finalized Harbor-compatible result bundle.
- [Cancel a managed job](https://synthlabs.mintlify.app/api-reference/managed-execution/cancel-a-managed-job.md): Request cancellation for active child trials without rewriting completed results.
- [Get current quota](https://synthlabs.mintlify.app/api-reference/usage/get-current-quota.md): Read current rolling compute use and remaining headroom.
- [Use Claude Code with Synth](https://synthlabs.mintlify.app/integrations/claude-code.md): Keep a familiar coding harness while selecting a model through Synth.
- [Inspect agent conversations](https://synthlabs.mintlify.app/guides/interactive-sessions.md): Use recorded interactions to understand an agent's behavior and preserve evidence deliberately.
- [Use a prepared workspace](https://synthlabs.mintlify.app/guides/workspaces.md): Inspect setup and run commands in an environment your organization has already configured.
- [Use Harbor tasks with Synth](https://synthlabs.mintlify.app/integrations/harbor.md): Keep the task format, local testing and managed execution boundaries clear.
- [Automate a workflow](https://synthlabs.mintlify.app/integrations/automation.md): Use customer credentials, immutable inputs, JSON and safe submission semantics in scripts.
- [Identity and scope](https://synthlabs.mintlify.app/concepts/identity-and-scope.md): Understand how users, organizations, credentials, and resource ownership fit together.
- [Lifecycle and recovery](https://synthlabs.mintlify.app/operations/lifecycle-and-recovery.md): Recover remote work without duplicating submissions or losing saved progress.
- [Errors and retry safety](https://synthlabs.mintlify.app/operations/errors.md): Interpret customer API failures and recover without duplicating work.
- [Work amounts, resources and limits](https://synthlabs.mintlify.app/operations/limits.md): Distinguish requested work, task resources, run overrides and service capacity.
- [Troubleshooting](https://synthlabs.mintlify.app/operations/troubleshooting.md): Separate connection, input, execution and evidence failures before retrying.

## OpenAPI Specs

- [openapi](/api-reference/openapi.json)

## Optional

- [Dashboard](https://app.synthlabs.ai)
- [CLI releases](https://github.com/SynthLabsAI/synth-releases/releases)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.