# Scorecard Docs

## Docs

- [Overview](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/overview.md): The simulation platform for building frontier AI agents
- [What Is Scorecard?](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/what-is-scorecard.md): The simulation platform for building frontier AI agents. Run thousands of realistic scenarios in minutes and ship new capabilities with confidence.
- [Frequently Asked Questions](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/faq.md): Common questions about Scorecard's AI evaluation platform
- [UI Quickstart](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/ui-quickstart.md): Send your first trace to Scorecard and explore it in the UI.
- [SDK Quickstart](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/sdk-quickstart.md): Evaluate a simple LLM agent with Scorecard in minutes.
- [Tracing Quickstart](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/tracing-quickstart.md): Trace your LLM applications by pointing your client to Scorecard.
- [Claude Agent SDK Tracing](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/claude-agent-sdk-tracing.md): Trace your Claude Agent SDK applications with Scorecard.
- [LangChain Tracing](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/langchain-quickstart.md): Trace your LangChain applications with Scorecard using OpenLLMetry.
- [Metrics Quickstart](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/metrics-quickstart.md): Create metrics, group them, run evaluations, and read scores.
- [MCP Server Quickstart](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/mcp-quickstart.md): Build testsets and metrics conversationally with Claude Desktop and the Scorecard MCP server
- [RAG Quickstart](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/intro/rag-quickstart.md): Evaluate a Retrieval Augmented Generation (RAG) agent with Scorecard in minutes.
- [Playground](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/playground.md): Test agents against testcases and score results with metrics — all in one visual workspace.
- [Metrics](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/metrics.md)
- [Tracing](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/tracing.md): Instrument and inspect every LLM request in minutes.
- [Runs & Results](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/runs.md): Execute evaluations and analyze AI agent performance.
- [Records](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/records.md): View, filter, and analyze all evaluation records across your project.
- [Testsets](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/testsets.md): Use Testsets to create curated datasets for evaluating your AI agents
- [Prompts](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/prompts.md): Create, version, test, and deploy prompts with integrated evaluation workflows.
- [SDK + Tracing](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/sdk-tracing.md): Combine structured evaluation data with detailed trace observability in a single record.
- [MCP Server Integration](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/mcp.md): Use AI assistants as your evaluation companion with Scorecard's Model Context Protocol server
- [Synthetic Data Generation](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/synthetic-data-generation.md): Generate high-quality synthetic test data for comprehensive AI evaluation
- [Multi-turn simulation](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/multi-turn-simulation.md): Test conversational AI agents with realistic multi-turn simulations and automated user personas.
- [A/B Comparison](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/a-b-comparison.md): Compare different AI agent runs side-by-side to make data-driven decisions about model improvements, prompt optimizations, and configuration changes.
- [Custom Endpoints](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/endpoints.md): Test and evaluate agent APIs and any HTTP endpoint with Scorecard
- [Vercel AI SDK Quick Start](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/ai-sdk-wrapper.md): Automatically trace and monitor your Vercel AI SDK applications with zero manual instrumentation
- [GitHub Actions Integration](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/github-actions.md)
- [AI Guardrails](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/ai-guardrails.md): In order to develop controllable and safe LLM applications, you can integrate Scorecard with the open-source toolkits [NeMo Guardrails](https://github.com/NVIDIA/NeMo-Guardrails) and [Guardrails AI](https://github.com/guardrails-ai/guardrails).
- [Custom LLM Providers](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/custom-provider.md): Scorecard supports multiple AI providers through our AI proxy infrastructure, allowing you to easily configure and switch between different LLM services.
- [Organizations & Projects](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/projects.md): Manage your team's evaluation work with Organizations and Projects
- [Enterprise Authentication](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/enterprise-authentication.md): Secure enterprise-grade authentication with SAML SSO and advanced security features
- [Security & Privacy](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/features/security-and-privacy.md): Preserving the privacy of our clients and ensuring secure processes is of top priority at Scorecard.
- [API Reference](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/overview.md): Browse the API documentation and integrate with Scorecard's API endpoints.
- [Create Project](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-project.md): Create a new Project.
- [List Projects](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-projects.md): Retrieve a paginated list of all Projects. Projects are ordered by creation date, with oldest Projects first.
- [Create Testset](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-testset.md): Create a new Testset for a Project. The Testset will be created in the Project specified in the path.
- [List Testsets in Project](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-testsets-in-project.md): Retrieve a paginated list of Testsets belonging to a Project.
- [Get Testset](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-testset.md)
- [Update Testset](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/update-testset.md): Update a Testset. Only the fields provided in the request body will be updated. If a field is provided, the new content will replace the existing content. If a field is not provided, the existing content will remain unchanged.
- [Delete Testset](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-testset.md)
- [Create multiple Testcases](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-multiple-testcases.md): Create multiple Testcases in the specified Testset.
- [List Testcases in Testset](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-testcases-in-testset.md): Retrieve a paginated list of Testcases belonging to a Testset.
- [Get Testcase](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-testcase.md): Retrieve a specific Testcase by ID.
- [Update Testcase](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/update-testcase.md): Replace the data of an existing Testcase while keeping its ID.
- [Delete multiple Testcases](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-multiple-testcases.md): Delete multiple Testcases by their IDs.
- [Create Metric](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-metric.md): Create a new Metric for evaluating system outputs. The structure of a metric depends on the evalType and outputType of the metric.
- [List Metrics](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-metrics.md): List Metrics configured for the specified Project. Metrics are returned in reverse chronological order.
- [Get Metric](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-metric.md): Retrieve a specific Metric by ID.
- [Update Metric](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/update-metric.md): Update an existing Metric. You must specify the evalType and outputType of the metric. The structure of a metric depends on the evalType and outputType of the metric.
- [Delete Metric](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-metric.md): Delete a specific Metric by ID. The metric will be removed from metric groups and monitors.
- [Create Run](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-run.md): Create a new Run.
- [List Runs](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-runs.md): Retrieve a paginated list of all Runs for a Project. Runs are ordered by creation date, most recent first.
- [Get Run](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-run.md): Retrieve a specific Run by ID.
- [Create Record](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-record.md): Create a new Record in a Run.
- [List Records and Scores](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-records.md): Retrieve a paginated list of Records for a Run, including all scores for each record.
- [Delete Record](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-record.md): Delete a specific Record by ID.
- [List Annotations](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-annotations.md): List all annotations (ratings and comments) for a specific Record.
- [Create Record Tag](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-record-tag.md): Apply a tag to a Record. Idempotent: re-applying an existing tag returns the existing tag.
- [List Record Tags](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-record-tags.md): List all tags applied to a specific Record.
- [Delete Record Tag](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-record-tag.md): Remove a tag from a Record by its text.
- [Assign Record User](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/assign-record-user.md): Assign an organization member to a Record. Idempotent: re-assigning an existing member returns the existing assignment.
- [List Record Assignees](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-record-assignees.md): List the organization members assigned to a Record.
- [Unassign Record User](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/unassign-record-user.md): Remove an assignee from a Record.
- [Upsert Score](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/upsert-score.md): Create or update a Score for a given Record and MetricConfig. If a Score with the specified Record ID and MetricConfig ID already exists, it will be updated. Otherwise, a new Score will be created. The score provided should conform to the schema defined by the MetricConfig; otherwise, validation err…
- [Create (upsert) system](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/create-upsert-system.md): Create a new system. If one with the same name in the project exists, it updates it instead.
- [List systems](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-systems.md): Retrieve a paginated list of all systems. Systems are ordered by creation date.
- [Get system](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-system.md): Retrieve a specific system by ID.
- [Update system](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/update-system.md): Update an existing system. Only the fields provided in the request body will be updated. If a field is provided, the new content will replace the existing content. If a field is not provided, the existing content will remain unchanged.
- [Delete system](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-system.md): Delete a system definition by ID. This will not delete associated system versions.
- [Upsert system version](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/upsert-system-version.md): Create a new system version if it does not already exist. Does **not** set the created version to be the system's production version.
- [Get system version](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-system-version.md): Retrieve a specific system version by ID.
- [Initiate Attachment Upload](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/initiate-attachment-upload.md): Initiates (or deduplicates) an upload of a file attached to a session. If the exact content is already stored for this (session ID, file path), the response has `alreadyExists: true` and no upload is needed. Otherwise, PUT the file bytes to the returned `uploadUrl`, then call the commit endpoint. Re…
- [Commit Attachment Upload](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/commit-attachment-upload.md): Finalizes an upload after the file bytes have been PUT to the signed upload URL. Verifies the object landed in storage before the attachment starts describing the new content. Committing an already-committed attachment is a no-op.
- [Get Attachment](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/get-attachment.md): Retrieves an attachment's metadata and a short-lived signed download URL for its content.
- [Delete Attachment](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/delete-attachment.md): Deletes an attachment: both the stored file and its metadata.
- [List Session Attachments](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/api-reference/list-session-attachments.md): Lists the uploaded attachments for a session. Only committed attachments are returned.
- [Product Updates](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/changelog.md): New updates and improvements

## OpenAPI Specs

- [openapi](https://scorecard-d65b5e8a-docs-attachment-api-reference.mintlify.site/openapi.yaml)

## Optional

- [About Us](https://www.scorecard.io/about-us)
- [Blog](https://www.scorecard.io/blog)