Market Resource: Prohibiting Legitimately Harmful Use or Activity Without Limiting Speech Based on Personal Characteristics or Identifiers

Overview:

Companies must understand how their product/service access and use policies impact the freedom of individuals and groups to publicly voice diverse viewpoints, operate businesses and nonprofits consistent with a wide array of beliefs, and participate equally in the marketplace. While it’s common for companies to require customers/users to comply with certain standards as a condition of using their products and services (e.g., prohibiting certain illegal or unethical practices such as using a product/service to commit fraud or violate intellectual property rights) businesses must guard against including terms that could be used to unduly restrict stakeholders’ speech or expressive activity.

Relevant Policies or Practices:

Any policy or requirement that conditions access/use of a product or service on adherence to certain standards of conduct or speech. Depending on the company and industry, this might include:

  • non-discrimination, harassment, or bullying policies,
  • terms of use/service,
  • content moderation policies/guidelines,
  • e-commerce marketplace seller guidelines/standards,
  • algorithmic system use policies,
  • ad content policies, and
  • ad targeting policies,
  • risk avoidance/risk mitigation/identifying and managing social risks or impacts/social risk policies,
  • code of ethics,
  • human rights policy.

Risk Factor(s):

  1. Policies that limit protection against legitimately harmful behavior to individuals with certain personal characteristics or identifiers – instead of protecting everyone from the behavior.
  2. Policies that could be used to condition/restrict use of a product or service based on a subjective judgment about whether certain views are offensive to a member of a protected group.

Steps to Identify and Mitigate Risk:

Apply policies that prohibit legitimately harmful behavior such as “bullying” and “harassment” equally to everyone, irrespective of personal characteristics or identifiers. Policies that bar harmful conduct based on certain personal characteristics serve a laudable and important purpose. However, experience has shown that these policies can at times pose two problems: (1) by limiting their scope to certain personal characteristics, they fail to protect everyone from the harmful conduct they ban, and (2) they are sometimes relied on to justify suppressing a particular point of view or punishing the exercise of religion.

The below table provides guidance to help companies apply their policies equally and reduce the risk that policies will be used/applied in ways that restrict expression.

Good TOS/Content Policy   Bad TOS/Content Policy
  • Defines harmful conduct without reference to a list of protected characteristics or identifiers (E.g., race, sex, religion, sexual orientation, and gender identity).
  • Protects all customers/sellers/creators /users from the targeted harmful conduct.
  • Avoids unclear and imprecise terms that risk treating mere expressions of political, religious, or social views on matters of public concern as  harassing,” “hateful,” “threatening,” “violent,” “discriminatory,” or the equivalent. 
  • Defines harmful conduct based on a list of protected characteristics or identifiers (E.g., race, sex, religion, sexual orientation, and gender identity).
  • Provides no protection from the targeted harmful conduct to customers/sellers/creators/users whose personal characteristics are not listed in the policy.
  • Includes unclear and imprecise terms that could treat mere expressions of political, religious, or social views on matters of public concern as  harassing,” “hateful,” “threatening,” “violent,” “discriminatory,” or the equivalent. 

 

TOS/Content Policy Examples (next page) 

Key:

Text with strikethrough and highlighted in red = Defines prohibited conduct or expression based on personal characteristics.

Text with strikethrough and highlighted in yellow = Original verbiage that is unclear and/or imprecise.

Text highlighted in green = Verbiage added or changed to improve or clarify original text.

Text NOT highlighted and without strikethrough = Acceptable verbiage.

= Policy contains unacceptable verbiage.

 

We prohibit content that wishes, hopes, promotes, incites, or expresses a desire for death, serious bodily
harm, or serious disease against an entire protected category and/or individuals who may be members of
that category against anyone.


https://help.twitter.com/en/rules-and-policies/hateful-conduct-policy

Hate speech [S]peech that encourages violence is not allowed on YouTube. We remove content
promoting violence or hatred against anyone. individuals or groups based on any of the following
attributes

  • Age
  • Caste
  • Disability
  • Ethnicity
  • Gender Identity and Expression
  • Nationality
  • Race
  • Immigration Status
  • Religion
  • Sex/Gender
  • Sexual Orientation
  • Victims of a major violent event and their kin
  • Veteran Status

https://support.google.com/youtube/answer/2801939?hl=en  

Etsy does not allow hate speech. Hate speech occurs when Etsy bans violent, offensive, derogatory or demeaning language is incitement or encouragement of violence directed at a person or group based on their one or more protected group attributes.

https://www.etsy.com/legal/policy/anti-discrimination-and-hate-speech/123551108902 

You may not promote violence against, threaten, or harass an individual or group of people. other people on the basis of race, ethnicity, national origin, caste, sexual orientation, gender, gender identity, religious affiliation, age, disability, or serious disease.

https://explore.zoom.us/en/community-standards/ 

(Editor’s note: The terms “threaten” and “harass” should either be stricken or defined in such a manner that they cannot be applied to mere expressions of political, religious, or social views on matters of public concern).

 

Avoid terms frequently used in conjunction with harmful conduct policies that risk unduly restricting expression. Policies that pose these concerns often frame their restrictions using one or more of the below terms.

Bigotry Harass/Harassment/Harassing
Bully/Bullying Hate group
Degrading Hate speech
Dehumanizing Hateful/Hateful conduct
Demeaning Harm
Denigrating Intolerance/Intolerant
Derogatory Misgendering
Directly attack Threaten
Discriminating/Discriminatory Violence 
Deadnaming  



Disclaimer: The information contained in this document is general in nature and is not intended to provide, or be a substitute for, legal analysis, legal advice, or consultation with appropriate legal counsel. You should not act or rely on information contained in this document without seeking appropriate professional advice. By printing and distributing this document, Alliance Defending Freedom, Inc. is not providing legal advice, and the use of this document is not intended to constitute advertising or solicitation and does not create an attorney-client relationship between you and Alliance Defending Freedom or between you and any Alliance Defending Freedom employee. For additional questions, call Alliance Defending Freedom at (800) 835-5233.