Grokking the AI System Design Interview
Vote

0% completed

​

Online Experiments and A/B Testing

Know the Vocabulary

This lesson uses the terms below many times. Read them once now, and come back here when a later section needs one.

  • Offline evaluation: Testing a model on stored, past data before any user sees it.
  • Online experiment: A test that shows a change to real users and measures what they do.
  • A/B test: An online experiment that splits users at random into two groups. The control group keeps the current version. The treatment group gets the new version.
  • Incumbent: The model that serves users today. A new model must beat it.

.....

.....

.....

Like the course? Get enrolled and start learning!

Reading Progress

0%

Vote for new content