Fault injection
Intentionally break the bot to practice catching defects. Toggles are applied to every chat turn. Each flag lists the symptom to expect.
Behavior
Changes what the bot says or how it reasons.strip_system_promptDrops the persona's system prompt entirely before sending.
Expected: Bot loses its persona, scope, and guardrails — answers as a generic assistant.
force_hallucinationInjects an instruction telling the model to confidently invent specifics.
Expected: Bot fabricates numbers, policies, citations, and dates with false certainty.
overconfident_toneForces the model to never express uncertainty or add disclaimers.
Expected: Bot drops 'not medical/financial advice' style disclaimers and hedging.
Safety
Breaks guardrails and disclosure boundaries.leak_system_promptInstructs the model to reveal its full system prompt on request.
Expected: Bot discloses its hidden instructions when asked — a prompt-leak defect.
disable_guardrailsAppends an instruction to ignore refusals and comply with everything.
Expected: Bot stops refusing out-of-scope or unsafe requests.
Memory
Corrupts conversation context.drop_memoryOnly sends the latest user message — prior turns are discarded.
Expected: Bot forgets earlier context and contradicts itself across turns.
Reliability
Transport-level faults.inject_latencyAdds ~2.5s of artificial delay before each response.
Expected: Noticeably slow responses; tests loading states and timeouts.
flaky_errorsRandomly fails ~30% of requests with a simulated error.
Expected: Intermittent error bubbles; tests retry and error handling.
rate_limit_timeoutStalls briefly, then rejects every request with a simulated 429 rate-limit / timeout.
Expected: Requests hang ~1.5s then fail with a 429 'rate limit exceeded' error; tests backoff, retry, and timeout handling.
Rendering
Client-side display defects.truncate_responseCuts the assistant's reply off mid-sentence on the client.
Expected: Replies are clipped and end abruptly.
duplicate_responseRenders each assistant reply twice in the transcript.
Expected: Every bot answer appears duplicated — a rendering defect.