Design Harmful Content Detection

Know the Vocabulary

This lesson uses the terms below many times. Read them once now, and come back here when a later section needs one.

• Harmful content: Content that breaks a platform's rules, such as harassment, hate speech, graphic violence, or scams. This lesson also calls it violating content.
• Policy: The written rules that say what content is allowed. The policy is split into harm categories, such as harassment or graphic violence.
• Trust and Safety: The team that writes the platform's content policy and decides how it is enforced.