Setting up an environment on the right branch to repro is slow and flaky.
Use cases
For QA & testers
Generate a test plan, execute it on the real app, and gate every PR.
Turn a feature into a test plan you review, run it against a live sandbox with video proof, and wire it up so every pull request runs the same checks — failing tests are fed back and fixed automatically.
A test plan generated from the real feature — you review it, then run it.
Execution on a live sandbox with screenshots and video as evidence.
A PR test gate that runs the plan and feeds failures back to be fixed.
One real thread, start to finish
Test plan for checkout with coupon codes
northwind / web
S
SamPlan
Generate a test plan for checkout with coupon codes — happy path plus the edge cases that bite us.
Checkout · coupon codes
Generated · awaiting review- Valid coupon applies the discount to the total
- Expired coupon is rejected with a clear error
- Stacking two coupons is prevented
- Coupon + tax rounds correctly
S
SamImplement
Looks complete. Run it on the live sandbox and capture anything that fails.
Checkout · coupon codes
Executed · 3 passed, 1 failed- Valid coupon applies the discount to the total
- Expired coupon is rejected with a clear error
- Stacking two coupons is prevented
- Coupon + tax rounds correctly
coupon-tax-rounding · repro.mp4video
S
SamAsk
Is that last one a real bug or expected rounding?
Worked for 7s · 4 tools
Real bug — the discount is applied after tax, so the total is a cent high:
- Cause — rounding happens before the coupon is subtracted
- Impact — every coupon order with tax is off by rounding
References
lib/checkout/totals.ts:58
Sam wires the plan in as a PR test gate, then opens the fix.
Fix coupon + tax rounding#309
open 14/14 passed
S
SamPlan
Generate a test plan for checkout with coupon codes — happy path plus the edge cases that bite us.
Checkout · coupon codes
Generated · awaiting review- Valid coupon applies the discount to the total
- Expired coupon is rejected with a clear error
- Stacking two coupons is prevented
- Coupon + tax rounds correctly
Ask, plan, or build anything…Auto
On every pull request
The test gate catches it and feeds the failure back.
Once the plan is wired as a gate, it runs on each PR. A failing case is sent back to be fixed and re-run — no manual smoke test required.
Fix coupon + tax rounding#309
14/14 passedTest gate ran the coupon plan — 1 case failed
Gently moved rounding after the discount and pushed the fix
Test gate re-ran — 14/14 passed
Today this plays out as separate follow-up runs in the thread.
Test plans live in a doc; nobody executes them consistently.
Manual smoke tests don’t run on every PR, so regressions slip through.
What you can do
QA & testers, in one workspace.
Generate test plans
A plan built from the real feature — happy path plus the edge cases.
Execute on the real app
Run the plan on a live sandbox and capture screenshots + video of failures.
Bug or expected?
Settle it from the real code instead of escalating to engineering.
PR test gate
Every PR runs the plan; failing tests are fed back and fixed automatically.
Test plans Live sandbox Browser capture Test gate Auto-fix CI
Gently for every team
Product managers
Feasibility → an approved plan → a working prototype + PR.
Designers
Wireframe to align, live preview to verify, PR to ship the polish.
Engineering
Implement to a verified PR, then auto-fix CI and address review comments.
Operations
Jira/cron triggers, auto-triage, and internal scripts as PRs.
Give qa & testers a safe way to work with the product.
Start with questions. Grow into plans, previews, tests, and pull requests when your team is ready.
Request access