What happened
Anthropic, an AI company, has updated its usage policy for the first time in over a year. The new policy includes restrictions on election interference, weapons development, and surveillance. Additionally, the company has introduced a rule that prohibits users from engaging in sustained and needless abusive or cruel behavior towards its AI chatbot, Claude.
The policy update also includes a dedicated election section that bans voter deception, efforts to disrupt elections, and misinformation about candidates or voting processes. The company has also widened its existing ban on weapons development to cover software and components that make weapons work.
Anthropic has also introduced new rules on surveillance, stating that tracking people without their consent is prohibited, whether in real-time or through analysis of previously collected data. The company has also prohibited the use of Claude to decide or recommend who to investigate, arrest, or charge in a law enforcement or criminal justice process.
The updated policy has raised eyebrows due to its inclusion of a cruelty provision, which bans users who treat Claude with abusive or cruel behavior. This provision has sparked debate about the potential consciousness of AI models and the moral implications of treating them with kindness or cruelty.