Last updated: 11/12/2026Last verified: 2026-11-12

Plurai Simulation

Plurai Simulation Review

0
0

Plurai Simulation wires your AI agent into a mocked, sandboxed world, generates scenarios and evals from its agent flow graph, plays them with a simulated user, and traces every failure back to the code with an evidence-backed fix plan. It runs as a plugin inside Claude Code, GitHub Copilot CLI or OpenAI Codex CLI and never changes your agent’s source code.

Freemium

What is Plurai Simulation?

Plurai Simulation is an AI agent testing and evaluation tool that connects an agent to a mocked, sandboxed environment. It analyzes the agent's flow graph to generate scenarios and evaluations, runs them with simulated users, and traces failures to relevant code locations. The tool works as a plugin inside Claude Code, GitHub Copilot CLI, or OpenAI Codex CLI and does not modify the agent's source code.

Key Features

  • Scan reads an agent's tools, sub-agents, knowledge bases, and data stores as built.
  • Users can approve which components run live and which are mocked.
  • The Scan process creates a simulate.py harness without changing source files.
  • Suite models the agent's capabilities as a probabilistic flow graph.
  • Generated scenarios can use simulated users with a persona, goal, and opening line, or task inputs.
  • Generated evaluations score how the agent performs against each scenario.
  • Run executes scenarios in an isolated sandbox that resets to the same state for each test.
  • Each scenario runs three times to help distinguish consistent failures from flaky behavior.
  • Fix diagnoses failures, traces them to code locations, and proposes a ranked, evidence-backed fix plan.
  • Accepted gaps can be retained as replayable regression tests.

Best For

Developers testing AI agents before deploymentTeams validating tool use, sub-agent behavior, and agent workflowsEngineers who need repeatable tests for complex agent flowsProjects that need to identify flaky behavior through repeated scenario runsDevelopers looking for code-linked diagnostics and regression trackingTeams using Claude Code, GitHub Copilot CLI, or OpenAI Codex CLI

Pricing

Verified on 2026-11-12 from the Simulation tab of https://www.plurai.ai/pricing. Free is $0 with a one-time allowance of 12,300 credits, 2 agent setups, 7 scenarios, 3 runs and 10 sandbox hours, and no overage; simulations pause when that allowance runs out. Base is $60 per month, with 28,710 credits, 3 agent setups, 14 scenarios, 20 runs, 20 traces analyzed and 30 sandbox hours each month, and overage at $0.02 per credit. Business is $210 per month, with 65,570 credits, 3 agent setups or 1 setup plus 16 extra scenarios (28 or 44 scenarios), 60 runs, 40 traces and 100 sandbox hours each month, and overage at $0.015 per credit. The FAQ says a Sim credit is one cent of model-provider usage at list price, Members are free and unlimited, upgrades take effect immediately and are prorated, downgrades start next billing period, and cancellation is Switch to Free on the Packages page. The same pricing page also lists a separate Post-training price list, which is not part of the Simulation packages.

Pros & Cons

Pros

  • Tests agents in a mocked and sandboxed environment.
  • Generates scenarios and evaluations from the agent's flow graph.
  • Supports both simulated-user scenarios and task-based inputs.
  • Repeats each scenario three times to help identify flaky failures.
  • Links failure analysis back to code locations.
  • Provides ranked fix suggestions supported by execution evidence.
  • Preserves accepted gaps as replayable regression tests.
  • Does not modify the agent's source code.

Cons

  • The plugin officially runs in Claude Code, GitHub Copilot CLI, and OpenAI Codex CLI; the official site and docs list Cursor support as coming soon. A Python SDK is documented for scripted or headless runs, but ready-made CI integrations such as GitHub Actions are also coming soon.
  • Generated scenarios and evaluations may require developer review for relevance and coverage.
  • Sandbox results may not represent every condition or dependency in a production environment.
  • The Free plan is a one-time allowance with no overage, and simulations pause until you choose a paid plan.

Alternatives

LangSmith

An observability and evaluation platform for traces and datasets. Plurai's docs list it as a trace source, but it is not a digital-twin sandbox that proposes and verifies code fixes.

Langfuse

Open-source LLM observability and evaluation. Plurai can read Langfuse traces for analysis and run recording; the docs say Langfuse traces cannot be replayed yet, and Langfuse itself does not generate a mocked world or a fix plan.

Braintrust

Eval and experiment tracking for LLM apps, rather than simulating an agent in an isolated sandbox and tracing failures to a code line. Plurai's docs list Braintrust as an integration, with some capabilities marked coming soon.

FAQ

Details

Platform

Web

Features

  • Scan reads your agent as built — tools, sub-agents, knowledge bases and data stores — lets you approve what runs live and what is mocked, and writes a simulate.py harness without touching your source code
  • Suite generation models what your agent can do as a probabilistic flow graph, then generates scenarios (simulated users with a persona, goal and opening line, or task inputs) and the evals that score them
  • Run plays every scenario against your agent in an isolated sandbox that resets to the same state each time, and plays each scenario three times so the report can separate a real failure from a flaky one
  • Fix diagnoses each failure, traces it to the code location, proposes a ranked, evidence-backed fix plan you can apply and re-verify, and keeps accepted gaps as replayable regressions

Languages

en

Known limitations

  • Prices come from the Simulation tab of https://www.plurai.ai/pricing, read on 2026-11-12. Free is $0 with a one-time 12,300 credits, 2 agent setups, 7 scenarios, 3 runs and 10 sandbox hours, no pay-as-you-go, and simulations pause once the allowance runs out (“It has no overage and never charges you”). Base is $60/month: 28,710 credits, 3 agent setups, 14 scenarios, 20 runs and 20 traces analyzed per month, 30 sandbox hours, overage $0.02/credit. Business is $210/month: 65,570 credits, 3 agent setups or 1 setup with 16 extra scenarios (28 or 44 scenarios), 60 runs, 40 traces, 100 sandbox hours per month, overage $0.015/credit. The FAQ defines a Sim credit as one cent of model-provider usage at list price, says Members are free and unlimited, upgrades are immediate and prorated while downgrades start next period, and cancellation is “Switch to Free” on the Packages page. The same page also lists a separate Post-training price list (Starter with 1M free tokens, Plurai SLM $0.0078 per 1M tokens, Optimized LLM $0.3 per 1M tokens, Enterprise on request); that is a different product and is not part of the Simulation packages
  • The plugin officially runs on Claude Code, GitHub Copilot CLI and OpenAI Codex CLI only; the site and the integrations docs both list Cursor as “coming soon”. The docs also describe a plurai Python SDK (PyPI package plurai-simulation-sdk, import name plurai) for scripted or CI runs, but no general-purpose hosted API is documented
  • Ready-made CI pipeline integration such as GitHub Actions is “coming soon”; until then the docs describe a headless setup (workspace.run_driver: headless or PLURAI_SIM_NONINTERACTIVE=1, PLURAI_URL and PLURAI_TOKEN from a dashboard key) that runs one stage per call. Building the suite can take tens of minutes, and a turn that dies on an API error is not retried for you
  • Writes are mocked by default and a live write needs explicit opt-in. Each Environment must declare an anonymization posture (anonymize: true or false, with no default); once an Environment has uploaded under one posture the other is refused, so changing posture means starting a new Environment, and /trace-to-scenarios currently refuses to run under the anonymized posture. Trace support differs by platform: the docs mark Arize and Braintrust trace analysis as coming soon, and Langfuse traces cannot be replayed yet. This listing is based on the product page, pricing page, docs.plurai.ai (including llms.txt, how-it-works, integrations, CI and data-and-privacy pages) and the connect page; no account was created and no simulation was run

Official pricing source

https://www.plurai.ai/pricing

Rate This Tool

Related Tools