A/B testing is pervasive for business decision making. This practice is based on the scientific principles of experimentation.
This week we will explore prescriptive analytics, or how to statistically decide if Condition A is truly different from Condition B, and which one is better.
Class Data Demos on Google Sheets: W5ANOVA
Complete assigned readings before next class meeting, which are yellow-highlighted
W5-1.1: Correlation vs. Causation: PPT
W5-1.2: ANOVA: PPT
- NFF Chapter 10: Comparing two means (pdf))
- Example Study: A Survey of Causal Inference Applications at Netflix
- Example Study: Supercharging A/B Testing at Uber
- Example Study: Dan Ariely: How to change your behavior for the better - TED
- DA Worksheet #11: ANOVA (Solution; Python Solution)
- Khan Academy module on ANOVA
- [MINI] ANOVA by Data Skeptic Podcast
- ANOVA lecture by Dr. Andy Field
- Chapter 6 ANOVA from Introductory Business Statistics
- JASP Tutorial on ANOVA
W5-2: Bill Benter's guest lecture
- NFF Chapter 9: Categorical data analysis (pdf)
- Example Study: Sweeney L. Discrimination in online ad delivery: Google ads, black names and white names, racial discrimination, and click advertising. Queue. 2013 Mar 1;11(3):10-29.
- Khan Academy module on Testing two means (T Test)
- Reading: Chapter 5 T Test from Introductory Business Statistics
- JASP Tutorial on Independent Samples T-Test
- Video: A Statistically Significant Love Song
W5-3 T-Test: PPT
- NFF Chapter 11: Correlation and linear regression (pdf) - focus on the model evaluation section, starting with section 11.9
- Example Study: In a Job Interview, How Much does Timing Matter? (No Stupid Question Podcast)
- Practice for the Exam using the Toyota Corolla dataset and Practice Exam (Solution)
- DA Worksheet #12: T-Test (Solution)
- DA Worksheet #13: Chi-Square (Solution)
- Khan Academy module on Chi-Square
- [MINI] Chi-Squared Test by Data Skeptic Podcast
- Fischer's Exact Test (Lady Testing Tea)
- JASP Tutorial on Chi Square
- Reading: How to Conduct a Multinomial Test & a Chi-Square Test in JASP
- Chapter 11: The Chi-Square Distribution
*Access Harvard Business Review through the William & Mary Library proxy