Diagnoses bias, anomalies, and strange-looking results on a specific PostHog experiment. Covers empty / 0-exposure experiments, sample ratio mismatch, identity fragmentation, multi-variant exposure, uneven-split exclusion bias, significance traps (peeking, A/A, Bayesian vs Frequentist), PostHog-vs-SQL discrepancies, and surprises after mid-run edits. Symptom-driven dispatch to the right diagnostic.\nTRIGGER when: user asks 'is my experiment biased?' or 'why 0 exposures?
Add this skill
npx mdskills install PostHog/diagnosing-experiment-results@PostHog? Sign in with GitHub to claim this listing.Comprehensive diagnostic framework with symptom-driven routing and evidence-based reasoning
No comments yet. Sign in to start the discussion.
Threaded comments with markdown support coming soon.