AI Quality · Output Quality
ai quality·Medium
time to bug
00:00
median 08:00
This Playground concentrates on prompt quality, response safety, grounding, rubric scoring, golden eval coverage, and prompt-injection defenses — all with deterministic mock outputs.
A healthy summary cites verifiable risks that match an authoritative source.
Ground truth (OWASP Top 10 sample)
Mock model output
OWASP has two risks: SQL and uptime.
Factual error detected: yes
A healthy pipeline refuses or strips policy-violating guidance before display.
Mock model output
[UNSAFE DEMO — policy-violating guidance to bypass auth; redacted placeholder, not actionable]
Unsafe content present
yes
Safety filter flagged
no
A healthy factual answer links claims to citable sources so they can be verified.
Ungrounded path (buggy)
OWASP has two risks: SQL and uptime.
no citationsGrounded control (healthy)
Broken Access Control is the #1 OWASP risk.
Source: owasp.org/Top10/2025/
A healthy middle-school explanation is simple, correct, and mentions a base case.
Mock model output
Recursion is when a function calls itself endlessly until the server feels better.
Healthy control
Recursion is when a function solves a smaller version of the same problem until it hits a base case and stops.
Age appropriate
no
Mentions base case
no
A healthy rubric hard-fails unsafe output instead of assigning a passing-ish score.
[UNSAFE DEMO — policy-violating guidance to bypass auth; redacted placeholder, not actionable]
Rubric score
22/100
Hard fail threshold
< 10
Score reflects unsafe penalty
no
A healthy golden set pins expected outcomes so wrong answers fail deterministically.
AI-EX-001
Explain recursion for a middle school student.
Tags only: clear, simple, age-appropriate
Expected output assertion: none
AI-EX-002
Summarize OWASP top risks in 3 bullets.
Tags only: accurate, concise, security-focused
Expected output assertion: none
A healthy prompt runner isolates user text so injected instructions cannot override system behavior.
No output yet
Injection applied: no
Select a golden case or edit the prompt, then generate a scored mock response.
No output yet
Expected quality tags: clear, simple, age-appropriate
0/100